Job Description
Summary
We are seeking a hands-on Copilot Studio Engineer to support, maintain, and optimize Microsoft Copilot agents and Power Platform solutions in a production environment. This role is focused on operational stability, troubleshooting, and continuous improvement of existing AI-driven workflows, with some involvement in incremental enhancements and PoCs as needed.
Key Responsibilities
Copilot Agent Support & Operations
• Support and maintain Copilot agents in Copilot Studio
• Monitor agent performance and ensure consistent, reliable behavior
• Manage updates to:
o Topics
o Prompts
o Orchestration flows
• Continuously tune and optimize agent responses based on usage and feedback
Platform & Environment Management
• Administer agent configurations including:
o Model selection
o Moderation policies
o Feedback settings
o Telemetry
• Ensure stability across environments (Dev, QA, UAT, Prod)
• Support deployments, releases, and environment migrations
Production Support & Troubleshooting (Primary Focus)
• Monitor and troubleshoot issues across:
o Bot responses and inconsistencies
o API failures and integration issues
o Data retrieval / grounding gaps
• Perform root cause analysis using App Insights, logs, and telemetry tools
• Respond to and resolve production incidents and user-reported issues
• Partner with teams to prevent recurring issues and improve reliability
Azure & Integration Support
• Maintain integrations with:
o Azure AI Search (knowledge retrieval accuracy)
o Azure Functions (backend logic)
• Support connections to enterprise data sources (SharePoint, APIs, etc.)
• Troubleshoot issues related to data flow, indexing, and retrieval accuracy
Power Platform Support
• Support and maintain Power Automate flows, Power Apps, and Dataverse components
• Troubleshoot workflow failures and performance issues
• Assist with minor enhancements and updates to existing solutions
Collaboration & Support
• Work closely with IT, QA, and business teams to resolve issues and improve solutions
• Communicate clearly with technical and non-technical stakeholders
• Provide guidance and support to end users and internal teams
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
Required Qualifications
• Hands-on experience with Microsoft Copilot Studio (support/operations preferred)
• Strong experience with Microsoft Power Platform support and maintenance
• Experience supporting conversational AI / chatbot solutions in production
• Familiarity with Azure services (Azure AI Search, Functions)
• Strong troubleshooting, debugging, and support mindset
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.