Job Description
The Automation QA Data Engineer is responsible for building and maintaining the team's automated data validation assets in Python and Databricks. The first major deliverable is to pick up the paused in-flight automation work (originally started by an internal developer) for daily tabular cube health monitoring, finalize it, and extend it into a reusable framework. This role focuses on converting manual SQL-based validations into automated Python routines that compare data warehouse sources against tabular cube outputs and alert developers automatically on mismatches.
Key Responsibilities
• Take over and complete the in-flight Python/Databricks automation for daily tabular cube health monitoring; productionize it for ongoing use.
• Design, develop, and maintain automated Python scripts that iterate through columns and tables, run comparisons, and surface results.
• Implement automated DAX-based validations against tabular cubes and compare results against the Azure Data Warehouse source (column completeness, sum totals, null percentages, key-field checks).
• Build automated email alerting so developers are notified immediately when mismatches are detected.
• Convert manual, stakeholder-supplied test cases into repeatable automated tests with clear assertions and reporting.
• Develop reusable QA accelerators (Python libraries, utilities, templates) that the broader team can adopt.
• Support automated test execution across DP 1.0 (Databricks + Synapse), DP 2.0, and Snowflake where applicable.
• Triage automated test failures, perform initial analysis, and route to development teams as needed.
• Continuously improve test coverage, execution speed, and reliability of the automation suite.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
• 3–6 years of QA automation or data engineering experience, with a strong focus on data/backend automation (not UI-only).
• Strong Python development skills, including iteration patterns, comparison logic, modular code design, and email/notification integrations.
• Hands-on experience with Databricks as an execution platform for Python and SQL workloads.
• Solid SQL skills with the ability to author validation queries against data warehouse sources.
• Working understanding of data quality concepts: completeness, null analysis, reconciliation, and key-field validation.
• Experience picking up partially completed automation work and finishing it to production quality.
• Experience working in Jira-driven workflows.
• Strong problem-solving skills and ability to work independently against a defined automation roadmap.
Nice to Have Skills & Experience
• Azure Synapse / Azure Data Warehouse experience.
• DAX query authoring against tabular cubes (SSAS Tabular / Azure Analysis Services / Power BI).
• Snowflake experience.
• Exposure to AI workflows or AI-assisted automation (e.g., LLM-assisted test generation, automated RCA summaries).
• Familiarity with Git-based source control and code review practices.
• Experience with Azure DevOps pipelines or similar CI/CD tooling for scheduling and integrating automated tests.
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.