Job Description
We are seeking an experienced Data Engineer to join our Global Digital Commerce team and help build scalable, cloud-based data products that power international growth. This role is responsible for the end-to-end development of data pipelines, including data modeling, testing, monitoring, and production support. Working closely with product, architecture, and engineering teams, you will deliver high-quality data solutions, drive best practices, and improve data quality across a complex global ecosystem. This is an opportunity to shape the future of digital commerce within a fast-paced, innovative, and entrepreneurial environment.
Team & Key Projects
The next great shift in consumer behavior driven by technological disruption is underway, and it’s happening in the food & beverage industry. As other sectors have shifted to Digital Commerce-first business models in recent years, food & beverage has continued to rely predominantly on traditional brick & mortar models, but this is changing rapidly. New technologies are transforming every aspect of reaching consumers, from the rise of digital marketing and online grocery platforms to the creation of supply chain tools that enable speedy at-home delivery. Although we are a large multinational company, our Global Digital Commerce Team prides itself on having the entrepreneurial, action-oriented culture of an exciting startup business. Our group includes startup founders, Silicon Valley veterans, food & beverage experts, and seasoned executives from digital transformation leaders such as Amazon and Walmart. Our goal is to build the technological products and capabilities that will reinvent our industry and make us the #1 food & beverage business in Digital Commerce for decades to come
Accountabilities:
• Own data pipeline development end-to-end, spanning data modeling, testing, scalability, operability and ongoing metrics.
• Contribute to best practices for engineering, and coding as part of a world class engineering team
• Work with the product team leveraging our core technology platforms
• Collaborate in architecture discussions and architectural decision making that is part of continually improving and expanding these platforms.
• Focus on delivering high quality data pipelines and tools through careful analysis of system capabilities and feature requests, peer reviews, test automation, and collaboration with QA engineers
• Introduce new tools / practices to improve data and code quality; this includes researching / sourcing 3rd party tools and libraries, as well as developing tools in-house to improve workflow and quality for all data engineers
• Support data pipelines developed by your team through good exception handling, monitoring, and when needed by debugging production issues
• Extremely comfortable working with data, including managing large number of data sources, analysing data quality, and pro-actively working with client’s data/ IT teams to resolve issues
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
• 5+ years of experience in designing and building systems for collecting, storing, and analysing data at scale
• Python, PySpark, SQL,Airflow , DBT, Big Data – Hadoop (Hive/Impala), AWS, Azure, Snowflake
• Strong interpersonal skills to effectively interact with client/onshore personnel to understand specific Enterprise Information Management requirement and develop solutions based on those requirement
• Very strong analytical skills with the demonstrated ability to research and make decisions based on the day-to-day and complex customer problems required
• Hands on experience of handling large data sets and use of python/PySpark/SQL/Hive/Impala for data analysis
• Strong record of achievement, solid analytical ability, and an entrepreneurial hands-on approach to work.
• Deep understanding of database design and engineering
Nice to Have Skills & Experience
• Experience in Retail, E-commerce or Financial Services domain
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.