Job Description
This Automation Engineer role sits within a Data and AI Operations team focused on building software and automation solutions that improve the reliability, efficiency, and scalability of data and AI platforms.
The role bridges software engineering, data engineering, and AI operations, with a strong emphasis on Python development, workflow automation, operational tooling, platform engineering, and enabling self-service experiences for users.
This is not a traditional ETL-focused Data Engineer role. The ideal candidate is a strong Python engineer who has worked in data engineering environments and enjoys building software that automates operational processes, improves developer productivity, and enables users to interact with data and platform systems more efficiently.
Day to Day
Build Python-based tools and services that automate operational workflows.
Develop software that improves the efficiency of data and AI platform operations.
Create self-service solutions that allow users to ask questions and automatically retrieve answers from data and operational systems.
Design and implement automation frameworks that reduce manual effort across data and AI workflows.
Develop integrations with Databricks, Spark, Airflow, cloud platforms, and internal systems.
Build monitoring, diagnostics, and operational support tooling.
Automate issue detection, root cause identification, and remediation workflows.
Collaborate with Data Engineers, AI Engineers, and Platform teams to improve operational efficiency and platform reliability.
Design scalable systems and participate in architecture discussions around data and AI platforms.
Develop internal tools, APIs, and services that support AI Operations and platform automation initiatives.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
Strong Python software development experience.
Experience building automation tools, services, frameworks, or internal platforms.
Experience working in a Data Engineering, Data Platform, AI Platform, or ML Platform environment.
Experience with Databricks, Spark, or PySpark.
Experience designing and developing scalable software solutions.
Experience integrating with APIs, cloud platforms, or distributed systems.
Experience with workflow orchestration platforms such as Airflow.
Strong problem-solving and debugging skills.
Experience building production-quality code with testing, logging, and monitoring.
Bachelor's degree in Computer Science, Engineering, or related field, or equivalent practical experience.
Nice to Have Skills & Experience
• Experience with AI Operations (AIOps), MLOps, or platform engineering.
Experience with LLMs, Generative AI, RAG, semantic search, vector databases, or chatbot development.
Experience building systems that allow users to query data using natural language.
Databricks platform experience, including Unity Catalog, Delta Lake, or Delta Live Tables.
Experience with cloud platforms such as AWS, Azure, or GCP.
Experience with monitoring and observability tools such as Datadog, Grafana, Prometheus, CloudWatch, or Splunk.
Experience with Kubernetes, Terraform, CI/CD, or Infrastructure as Code.
Experience building operational dashboards, diagnostics platforms, or self-service tooling.
Experience automating incident detection, remediation, or operational workflows.
Experience with feature stores, model serving, or machine learning platform engineering.
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.