Job Description
Insight Global is seeking a strategic and technically adept Senior Product Manager to lead the development of AI context infrastructure for a large software-development company. This role is pivotal in shaping how our intelligent systems retrieve, process, and deliver high-value contextual data across multiple platforms. You’ll be at the forefront of defining architectural standards and driving innovation in a rapidly evolving space.
Key Responsibilities:
• Lead the development of scalable systems that retrieve and transform semantic data for AI-driven applications. Optimize for speed, accuracy, and cost-efficiency using hybrid search, caching, and compression techniques.
• Manage an engineering team of approximately 5 data science/engineering professionals. Drive collaboration and accountability.
• Develop internal tools and APIs that serve multiple product teams. Ensure seamless integration and promote best practices across engineering groups.
• Implement evaluation frameworks to monitor retrieval precision, relevance, and system performance. Collaborate with ML teams to refine models and algorithms.
• Continuously assess emerging technologies in context engineering, such as GraphRAG, multimodal retrieval, and advanced compression. Determine their practical application within our ecosystem.
Act as a bridge between ML engineers, platform developers, and product teams. Drive alignment on priorities and ensure timely delivery of strategic initiatives.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
• 4–6 years of product management experience, with at least 2 years focused on AI/ML infrastructure.
• Hands-on experience with retrieval-augmented generation (RAG), semantic search, or vector databases.
• Familiarity with graph databases (Neo4j), embedding models, and context compression techniques.
• Proven success in building platform products for internal stakeholders.
• Strong technical foundation with proficiency in Python and SQL.
Ability to translate complex technical concepts into business value and influence cross-functional teams.
What ZI looks for:
• You understand the intricacies of AI retrieval systems and can contribute meaningfully to architectural decisions.
• You build with scale in mind, optimizing for reuse and long-term value.
• You stay current with research and adapt quickly to new insights.
You can articulate technical trade-offs and business impact to diverse audiences.
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.