Job Description
• Lead a team of 2-5 Data Engineers with varied experience level to design and build data pipelines from various data sources to a target data warehouse using real-time and batch data load strategies utilizing cutting edge cloud technologies.
• Serve as a people leader by directly mentoring and coaching engineers, supporting formal performance review cycles, and providing regular, actionable feedback to drive individual growth and team success.
• Work with a cross functional team of business stakeholders, engineering leaders, data analysts and data scientists to formulate both business and technical requirements.
• Partner with business and data leaders to understand broader business strategies and define a roadmap outlining how the team will support and enable key initiatives
• Establish and enforce standards for documenting data platform designs, including logical and physical data models, metadata, ETL specifications, and end-to-end integration workflows.
• Design processes for ensuring data quality and integrity while providing timely responses to ad hoc requests.
• Lead and execute proof-of-concepts where appropriate to assess, validate, and improve technical processes and approaches
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
• 3+ years of experience managing a mid-size team, at least 2 data engineers
• 3+ years of experience in the big data space
• Experience in translating business requirements into technical data solutions on a large scale
• Experience working on Spark (SparkSQL / Data Frames / Dataset API) using Scala/Python to build and maintain complex ETL pipelines.
• Experience with Databricks
• 2+ years of experience working on AWS
• Excellent communication skills, with the ability to clearly articulate complex technical concepts to non-technical stakeholders
• Experience with GitHub and CI/CD processes
• Experience driving operational excellence for large-scale data platforms, including reliability, scalability, performance and cost optimization
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.