Job Description
This data engineer will play a pivotal role in constructing the data processing pipelines that drive our proprietary brands and our key partnerships. As a member of this team, you will contribute to the development of a Homogenized Multi-Tenant Data Warehouse. Your primary responsibility will involve hands-on tasks to transform existing data from diverse enterprise systems into a unified data platform housing robust datasets ready for analytics and reporting. This entails mastering upstream processes, pipelines, and source systems. Moreover, you will collaborate with various functional units to ensure the successful deployment, operation, and maintenance of solutions.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
4-6 years of data engineering experience, SQL Expert!!
• 2+ years of experience with AWS
• 2+ years of experience working on Spark/SparkSQL using Scala/Python to build and maintain complex ETL pipelines
• 2+ years of experience with Databricks
• Experience with GitHub and CI/CD processes
• Strong communication and business acumen
• Experience providing operational support for the production data pipelines and data triaging
Nice to Have Skills & Experience
• High Touch
• Fivetran
• Digital Marketing background
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.