Job Description
*this role requires candidates to be located only in LA (preferred), SF/Bay Area, SEA, or NYC*
A streaming client is in need of hiring a unique candidate who is a Data Quality Engineer who not only understands data and has the technical background, but also someone who has a 'quality engineering and testing mindset' and is passionate about testing. This role focuses on
contributing to strategic data quality initiatives through day-to-day testing, automation, and
collaboration. You will be responsible for building strong SQL test cases to test data and use Python as well for testing. This is a technical role where you will be responsible for helping build the automation process for data validation and testing, while working through a backlog of work. You will be responsible for validating all streaming-related data from this client's multiple streaming platforms. You will use automation while doing ETL validations (i.e. the ETL is already built by a different team), so you will be responsible for validating the ETL and adhere to standards. You must also know write queries as well as test your own scripts/queries. You will also be required to attend team/scrum meetings and sprint stand ups and planning sessions. In addition, this team is really looking for a candidate who is passionate about learning, is collaborative, and has excellent communication.
Additional:
• Validate ETL logic, business logic, and data quality in Snowflake, Databricks, and other
data platforms before code changes are released to production.
• Partner with data engineers to identify potential failure points and proactively help catch
issues early.
• Ensure the quality of every release using rigorous, data-driven testing practices.
• Develop automated and reusable tests to improve coverage, development velocity, and
reduce regression risk.
• Translate business and technical requirements into test scenarios to validate KPIs,
metrics, and business rules.
• Contribute to and enhance the existing test automation framework, with a focus on
scalability and maintainability.
• Collaborate closely with Data Analysts, Product Managers, and Engineering teams to
ensure accuracy, completeness, and usability of the data.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
*this role requires candidates to be located only in LA (preferred), SF/Bay Area, SEA, or NYC*
-5-7 years of experience as a Sr. Data Quality Engineer
-Strong experience validating data pipelines, ETL processes, and data warehouses in production environments
-Expert-level SQL skills and hands-on experience working with large datasets (terabytes
or more), capable of identifying data anomalies through efficient queries
-Proficiency with Snowflake, Hive, Databricks, and other modern data platforms / big data processing
-Solid Python skills and experience with test automation for data pipelines
-Familiarity with tools like Airflow and Spark and understanding of CI/CD principles
-Strong collaboration and communication skills
-Ability to work effectively across cross-functional teams
-Passion for testing and data quality
-Must be able to automate the data validation process
-Understanding of business logic validations
-Experience working in a Scrum environment
-Takes initiative, can hit the ground running, works well with others and stakeholders
-Bachelor's Degree
Nice to Have Skills & Experience
• Experience with BDD frameworks (e.g., Behave)
• Experience working in AWS or other cloud environments
• Familiarity with open-source data quality tools like Deequ, Great Expectations, or similar custom framework
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.