Data Engineer - Machine Learning

Insight Global is looking for a Data Engineer to join one of our largest life insurance clients' Enterprise Data & Analytics engineering team. The ideal candidate will work closely with the Data Science team to enable cutting-edge AI and machine learning solutions that will contribute to enhancing customer well-being, fostering growth, maintaining competitive advantage, and customer satisfaction. The role requires a passion for data engineering, machine learning, and data-driven decision-making, and the ability to transform innovative ideas into tangible solutions that directly impact the business and customers. The Data Engineer will work in an innovative, fast-paced environment, collaborating with bright minds while enjoying a balance between strategic and hands-on work. The role offers opportunities for continuous learning and skillset expansion, mastering new tools and technologies that advance the companys goals. If you are a committed team player who thrives on creating value through innovative solutions and is eager to make a significant impact, this role could be a great fit for you.
Collaborate with data scientists and analysts to understand data requirements and translate them into scalable, high-performing data pipeline solutions.
Support data discovery and preparation for model development, perform detailed analysis of raw data sources by applying business context, and collaborate with cross-functional teams to transform raw data into curated and certified data assets to be used for machine learning and business intelligence use cases.
Extract text data from various sources like documents, logs, text notes stored in databases, and web pages using web scraping methods to support the development of natural language processing and language learning models.
Monitor and troubleshoot data pipeline performance, identifying and resolving bottlenecks and issues.
Collaborate with data science and data engineering teams to build scalable and reproducible machine learning pipelines for training and inference.
Implement machine learning models into operations and processes via batch, streaming, and API methods.
Develop, test, and maintain robust tools, frameworks, and libraries that standardize and streamline the data and machine learning lifecycle.
Contribute to developing and maintaining end-to-end MLOps lifecycle to automate machine learning solutions development and delivery.
Implement a robust monitoring framework for model performance.
Collaborate with cross-functional teams of Data Science, Data Engineering, business units, and various IT teams.
Create and maintain effective documentation for projects and practices, ensuring transparency and effective team communication.
Stay up-to-date with the latest trends in modern data engineering, machine learning, and AI, ensuring that our company remains at the cutting edge of industry advancements.

Bachelors or Masters degree in computer science, Data Science, Engineering, or a related field
3-5+ Years of Data engineering experience
Experience in working with Python, PySPark, and SQL
Cloud experience with AWS preferred, will also accept experience with Azure
Experience in developing and maintaining robust data pipelines for both structured and unstructured data to be used by Data Scientists to build ML Models.
Experience working with Cloud Data Warehousing (Databricks preferred, or equivalent) platforms and experience in working with distributed frameworks like Spark.
Hands on experience in using Databricks platform for MLOps using MLFlow, Model Registry, and Databricks Workflow.
Proficiency in API development and object-oriented programming
Proficient in understanding and incorporating software engineering principles in the design and development process.
Hands-on experience with CI/CD tools (e.g., Jenkins or equivalent)
Excellent communication skills and ability to work and collaborate with cross-functional teams across technology and business.

Insurance Industry background
Prior experience working as a software engineer before transitioning into data engineering.

Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.