Job Description
We are seeking a Senior Software Engineer, SQA – AI/ML Products to ensure the quality, safety, and reliability of AI-driven capabilities across our digital products. This role focuses on validating LLM-powered applications such as chatbots, copilots, RAG-based search, recommendations, and agentic workflows, partnering closely with Product, Engineering, Data Science, and MLOps teams to define expected behaviors, edge cases, and quality standards.
The Senior SQA Engineer will design and execute automated and AI-specific testing strategies across UI, APIs, and model-level interactions, integrating quality checks into CI/CD pipelines. Responsibilities include evaluating AI outputs for accuracy, grounding, hallucinations, bias, and safety; validating end-to-end RAG pipelines; monitoring production systems for drift, regressions, and performance issues; and supporting root-cause analysis and defect resolution. This role combines strong software quality engineering fundamentals with emerging GenAI evaluation techniques to ensure AI systems behave predictably and responsibly in production.
We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
-6+ years of experience in Software Quality Assurance or Test Automation, including experience testing AI/ML-based products.
-Strong proficiency in Python or JavaScript.
-Experience with cloud services preferably Azure.
-Experience testing RESTful APIs using tools such as Postman or Swagger.
-Hands-on experience with automation frameworks including Selenium, Cypress, Playwright, or PyTest.
-Working knowledge of LLM evaluation frameworks (e.g., LangSmith, RAGAS) and vector database APIs.
-Solid foundation in QA best practices: test planning, regression testing, CI/CD integration, and defect lifecycle management.
Nice to Have Skills & Experience
-Experience testing RAG-based systems or agentic AI workflows at scale.
-Familiarity with model and data drift monitoring tools (e.g., Azure Monitor, Vertex AI monitoring, Fiddler).
-Exposure to ethical AI, bias testing, or responsible AI evaluation methodologies.• Experience working in regulated industries such as healthcare, life sciences, or financial
services.
-Understanding of MLOps or LLMOps concepts.
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.