Sr. Software Engineer - Product Owner for AI Projects

Insight Global is seeking a Sr. Software Engineer - Product Owner for AI Projects to join the team of one of our software company clients. As part of the cloud operations organization, this position makes significant contributions toward the delivery of DevOps solutions that support best-in-class cloud based applications. As a CD developer, you will be responsible for designing, developing, and maintaining our internal developer portal using Backstage, an open platform for building developer portals. The ideal candidate will have strong experience in software development, infrastructure automation, and CI/CD pipelines.

In this role, the successful person will create and maintain Internal Developer Portal that helps developers build, test, and deploy applications more efficiently. Streamline the software development process by automating routine tasks and providing a unified interface for developers to work across different platforms. Meet security compliance and best practice standards and are well documented. Participate in, and sometimes lead, proof of concept and first-of-a-kind activities to validate product concepts.

This role is responsible for designing, developing, and implementing complex software solutions that deliver high-quality results and exceed customer expectations. The individual serves as a technical lead on major projects, driving architecture decisions, influencing product direction, and ensuring successful delivery across platforms. They provide advanced technical expertise, solve complex problems, and introduce innovative technologies that improve products and team capabilities. The position requires strong collaboration and communication skills, including working closely with customers, cross-functional teams, and mentoring junior engineers. Operating with a high degree of autonomy, this person leverages extensive industry knowledge and independent judgment to lead highly complex initiatives from concept through execution.

Key Responsibilities:
- Design and maintain infrastructure supporting AI/ML workloads and AI-driven development initiatives.
- Integrate and manage Large Language Model (LLM) APIs such as OpenAI, Azure OpenAI, AWS Bedrock, or similar platforms.
- Support prompt engineering practices and enable internal teams to effectively leverage LLM capabilities.
- Deploy, monitor, and optimize AI/ML models in production environments following MLOps best practices.
- Implement monitoring, observability, and governance mechanisms for AI model performance and reliability.
- Support and integrate AI agent frameworks such as LangChain, LangGraph, and AutoGen.
- Design and implement Retrieval-Augmented Generation (RAG) architectures and AI orchestration platforms.
- Work with vector databases and semantic search technologies to enable advanced AI-powered search capabilities.
- Enable the use of AI-powered development tools (e.g., GitHub Copilot or similar) within secure enterprise environments.
- Evaluate and implement responsible AI practices, including bias detection, transparency, explainability, and governance frameworks.
- Ensure AI/ML workloads adhere to security best practices, including secure API integrations, access controls, data privacy, and model protection strategies.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

- Bachelor’s degree in Computer Science, Engineering, or related field
- Proven experience as a Software / DevOps / Platform Engineer delivering enterprise-grade cloud or SaaS solutions across the full SDLC
- Strong programming skills in Java, Python, and/or Go
- Hands-on experience with AWS and/or Azure, Kubernetes, Docker, and container orchestration
- Strong knowledge of microservices architecture, API development (REST/GraphQL), asynchronous processing, and cloud-native design
- Experience with CI/CD pipelines, Git (GitLab/GitHub), and Infrastructure as Code (e.g., Terraform, Ansible, ArgoCD, Jenkins)
- Experience securing CI/CD and cloud environments (secrets management, container scanning, runtime security, compliance)
- Familiarity with cloud monitoring and observability tools (e.g., Prometheus, Grafana, Datadog, CloudWatch)
- Experience working with internal developer portals (e.g., Backstage), service catalogs, and developer enablement platforms is a strong plus
- Strong understanding of cloud security, web application security, and information security best practices
- Experience with AI/ML frameworks and deploying AI models in production environments (MLOps practices)
- Experience working with LLM APIs (e.g., OpenAI, Azure OpenAI, AWS Bedrock) and prompt engineering
- Knowledge of RAG architectures, AI orchestration platforms, and AI agent frameworks (e.g., LangChain, LangGraph, AutoGen)
- Understanding of vector databases and semantic search technologies
- Ability to implement responsible AI practices, including bias detection, governance, and AI workload security
- Experience leveraging AI-powered development tools (e.g., GitHub Copilot)
- Experience working in Agile/Scrum environments
- Strong problem-solving, communication, and stakeholder management skills
- Ability to manage projects, define scope, track milestones, and communicate technical concepts to both technical and business audiences

Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.