Job Description
A large healthcare client of Insight Global is reimagining pediatric healthcare through AI. You’ll architect, build, and maintain our Generative AI platform, powering intelligent assistants, automating workflows, and enabling ML-driven decision support. This hands-on role is ideal for engineers passionate about ML infrastructure, backend systems, and real-world impact.
Key Responsibilities
• Architect and build scalable infrastructure for GenAI applications.
• Develop robust backend systems for conversational AI, vector databases, and LLM orchestration.
• Create APIs, services, and frameworks for rapid AI feature deployment.
• Collaborate with ML researchers and cross-functional teams to identify development priorities.
• Ensure platform reliability, security, and compliance (HIPAA, PHI).
• Implement observability, testing, and governance for LLM-based applications.
• Maintain infrastructure as code (IaC) and CI/CD pipelines.
• Integrate open-source and third-party tools (LangChain, Weaviate, Pinecone, Azure OpenAI, Vertex AI).
Eligible States for Remote Work:
AZ, FL, CA, GA, KS, ID, MO, NV, NC, TN, TX, WY
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
• 5+ years of industry experience in software engineering
• Strong software engineering skills
• Experience building large-scale distributed systems
• Experience developing ML and GenAI applications
• Proficiency in Python and backend frameworks (e.g., FastAPI, Flask)
• Experience with cloud platforms (preferably AWS) and tools like Docker and Kubernetes
• Strong knowledge of API development, microservices, and serverless architectures
• Experience with LLMs, retrieval-augmented generation, and vector database solutions
• Effective communication skills and ability to articulate complex technical ideas to cross-disciplinary internal and external stakeholders
• Familiarity with tools such as LangChain, LlamaIndex, Pinecone, Weaviate, or FAISS
• Experience deploying or managing OpenAI/Vertex AI integrations
• Knowledge of healthcare data standards and privacy regulations (e.g., FHIR, HIPAA)
• Experience with Databricks, Spark, or similar distributed data platforms
• Experience with CI/CD implementations using git and a common CI/CD stack (e.g., Azure DevOps, CloudBuild, Jenkins, CircleCI, GitLab)
• Bachelor’s degree in Computer Science or related discipline
Nice to Have Skills & Experience
• Experience with application performance tuning and optimization
• Experience with MLOps or deploying machine learning models in production
• Experience with JavaScript (React, Node.js)
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.