Job Description
Insight Global is seeking an AI Engineer for a top internal technology organization focused on applied AI and automation. This candidate will play a hands-on builder role, rapidly prototyping and productionizing AI-powered applications that integrate directly into internal platforms. The role centers on prompt and agent design, evaluation, and quality—turning early AI concepts into reliable, user-facing features. Working closely with AI leadership, platform engineers, and data teams, this engineer will help scale a growing AI product ecosystem while shaping how AI is safely and effectively deployed across the organization
Day-to-Day:
- Build AI-powered features and PoCs in Python using LLMs, RAG pipelines, and agentic workflows
- Design, iterate, and version production prompts and system instructions
- Develop and maintain evaluation harnesses to measure accuracy, grounding, and task success
- Take AI PoCs to production by adding tests, logging, guardrails, and error handling
- Partner with platform and data engineers on integrations, APIs, and deployment
- Improve reusable AI building blocks (prompt templates, RAG scaffolding, eval utilities)
- Monitor AI feature quality, debug regressions, and triage evaluation drops
- Document prompts, evaluations, and AI feature behavior for auditability and knowledge sharing
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
- 3–5 years of professional software engineering experience with a recent focus on applied AI / LLM-based systems
- Strong Python skills, including FastAPI, async patterns, and Pydantic v2
- Hands-on experience shipping LLM-powered features (RAG, agents, tool/function calling, structured outputs)
- Experience with prompt engineering and building evaluation harnesses (offline and online)
- Experience working with at least one major model provider (OpenAI, Anthropic, Azure OpenAI, or similar)
- Ability to read/write SQL and work with relational databases (Postgres or similar)
- Familiarity with Azure services for deployment, storage, or model hosting
- Strong written and verbal communication skills
- Bias toward shipping quickly and iterating with real users
Nice to Have Skills & Experience
- Experience with agentic frameworks or orchestration tools (LangGraph, Semantic Kernel, Autogen, Power Automate)
- Experience integrating AI solutions within the Microsoft ecosystem (M365, SharePoint, Power Platform)
- Experience with vector databases, embeddings, and retrieval optimization
- Exposure to MLOps and observability tools (MLflow, Weights & Biases, eval dashboards)
- Open-source contributions or public technical writing in applied AI
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.