Senior Software Engineer, AI Systems (Sunnyvale, CA)

Post Date

Apr 02, 2026

Location

Sunnyvale,
California

ZIP/Postal Code

94086
US
Jun 07, 2026 Insight Global

Job Type

Contract-to-perm

Category

Programmer / Developer

Req #

BEN-0e968874-67a7-4a62-99a1-e9697de38c7a

Pay Rate

$45 - $56 (hourly estimate)

Job Description

1. AI-Driven Software Development
○ Build and deploy production-ready AI-powered services using LLMs and Generative AI.
○ Develop and enhance components for RAG pipelines, agentic workflows, and knowledge-grounded reasoning systems.
○ Write high-quality, testable, and maintainable code with strong focus on observability, reliability, and performance.
2. System Design & Scalable Engineering
○ Design and implement scalable, cloud-native services and distributed systems for AI-powered applications.
○ Own key service-level components across APIs, microservices, data pipelines, and vector-backed retrieval systems.
○ Work with senior engineers and architects to improve system performance, latency, scalability, and fault tolerance.
3. Integration & Delivery
○ Partner with product, platform, and data teams to integrate AI capabilities into business applications.
○ Build robust APIs, backend services, and middleware to support adoption of AI solutions across use cases.
○ Deliver features with a balance of speed, maintainability, security, and operational excellence.
4. Collaboration & Engineering Excellence
○ Contribute to technical design discussions and help drive implementation for complex feature areas.
○ Participate actively in code reviews, design reviews, and operational improvements to raise engineering quality.
Mentor junior engineers and share best practices for building AI-enabled distributed systems.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Required Skills & Experience

○ 5+ years of experience in software engineering, with strong experience in backend systems, distributed systems, or cloud platforms.
○ Hands-on experience working with Generative AI and LLM-based applications in applied or production settings.
○ Strong coding skills in Python (preferred) and experience building production-grade backend systems.
○ Experience building scalable microservices, APIs, and event-driven systems.
○ Familiarity with vector databases, RAG pipelines, and LLM integration patterns.
○ Exposure to AI/ML frameworks such as PyTorch, TensorFlow, or Hugging Face is a plus; focus is on application and system integration rather than model training.
○ Good understanding of system design fundamentals and non-functional requirements such as performance, resiliency, and reliability.
Track record of delivering production-quality software with strong ownership and cross-functional collaboration.

Nice to Have Skills & Experience

○ Experience with cloud platforms such as Azure, GCP, or AWS.
○ Experience with observability, monitoring, and production operations for AI-powered systems.
Familiarity with security, compliance, and responsible AI considerations in enterprise environments.

Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.