Join an enterprise company's Real Growth and Development organization to revolutionize grocery retail! As a Data Engineer, you'll accelerate store launches by building automated solutions that transform store format ideation into reality. You'll develop centralized data lake integrations, create robust pipelines for geospatial visualizations, and provide critical insights supporting multi-million dollar business decisions.
Responsibilities
- Develop and maintain automated ETL pipelines (with monitoring) using scripting languages such as Python, Spark, SQL and AWS services such as S3, Glue, Lambda etc.
- Develop and maintain data quality, security and permissions for enterprise scale data lake implementations.
- Develop datasets for business analytics and ML models using data modeling techniques.
- Develop and optimize data lake tables using best practices for DDL, physical and logical tables, data partitioning, compression, and parallelization.
- Develop and maintain data lake metadata, data catalogs, and user documentation for internal business customers.
- Work with internal business customers, product managers, scientists and software developers to gather and document requirements for data publishing and data consumption via data lake.
- Actively participates in the code review process, design discussions, team planning and operational excellence.
We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to
Human Resources Request Form. The EEOC "Know Your Rights" Poster is available
here.
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:
https://insightglobal.com/workforce-privacy-policy/ .
Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence.
Experience working on a software development team
Experience leveraging geospatial tools and geospatial data
Experience building dashboards in Quicksight, Tableau or PowerBI
Understanding of storage formats such as Parquet/Avro and open table formats such as Iceberg/Hudi/Delta Lake
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.