Data Engineer

Post Date

Sep 19, 2023



ZIP/Postal Code

Sep 18, 2024 Insight Global

Job Type



Data Warehousing

Req #


Pay Rate

$60 - $90 (hourly estimate)

Job Description

Insight Global is looking for a Data Engineer to support one of our largest clients in the retail industry. They will be responsible for designing and modeling data engineering pipelines that support enterprise reporting an analytic needs. They will engineer efficient, adaptable, scaleable data pipelines for moving data from different sources into their Cloud Lakehouse. They will understand and analyze business requirements and translate into well0architected solutions that demonstrate the modern BI & Analytics platform. In addition, they will be a part of data modernization projects providing direction on matters of overall design and technical direction, acts as the primary driver toward establishing guidelines and approaches. Other responsibilities include driving timely and proactive issue identification, escalation, and resolutions, and collaborating effectively within Data Tech teams, BI teams to design and build optimized data flows from source to Data visualization.

Required Skills & Experience

* 8 + years in-depth, data engineering experience and execution of data pipelines, data ops, scripting and SQL queries

* 5+ years proven data modeling skills - must have demonstrable experience designing models for data warehousing and modern analytics use-cases (e.g., from operational data store to semantic models)

* Expert in Python for data analytics, visualization, machine learning, and models

* 2-3 years' experience in modern data architecture that support advanced analytics including Snowflake, Azure, etc. Experience with Snowflake and other Cloud Data Warehousing / Data Lake preferred

* Expert in engineering data pipelines using various data technologies -- ETL/ELT, big data technologies (Hive, Spark) on large-scale data sets demonstrated through years of experience

* Hands on data warehouse design, development, and data modeling best practices for modern data architectures

* Highly skilled in data orchestration with experience in tools like Ctrl-M, Apache Airflow. Hands on DevOps/Data Ops experience required

Nice to Have Skills & Experience

* Knowledge/working experience in reporting tools such as MicroStrategy, Power BI would be a plus

* Experience with Streamsets, dbt preferred

* Retail Domain experience

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.