Job Description
An employer is seeking a Data Engineer to join a large healthcare company. Responsibilities include:
Design and implement large-scale data integration workflows, including bulk data loads and real-time streaming pipelines for healthcare systems.
Develop and maintain ETL processes to migrate data across diverse platforms, ensuring accuracy, consistency, and compliance with healthcare standards.
Work with technologies such as Java, Python, and SQL to build and optimize data ingestion and transformation logic.
Validate and reconcile data during migration, performing quality checks and troubleshooting discrepancies.
Optimize data pipelines for performance and scalability, meeting non-functional requirements like reliability and throughput.
Automate deployment of data integration components using CI/CD practices for seamless production rollouts.
Monitor data flows and system KPIs, proactively identifying and resolving issues in production environments.
Collaborate with cross-functional teams to troubleshoot complex data integration challenges and perform root cause analysis.
Ensure adherence to security and compliance standards, safeguarding sensitive healthcare data throughout integration processes.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
4+ years of professional experience with data engineering, developing data pipelines using dataflow and integrating with scheduler components
Experience developing and debugging in Java or Python
Experience building and deploying services using Gradle, Maven, Jenkins, GitHubActions etc. as part of CI/CD process
Knowledge of ETL products and working on Structured and Unstructured data
Experience in Bulk Loads and any Streaming load integration ( Data Integration)
Experience on Any Replication Technologies ( Ex- Goldengate, Shareplex, Streamsets, Striim, etc)
Nice to Have Skills & Experience
Cloud experience, GCP preferred
Experience with any Relational Database (Spanner, Oracle, PostgreSQL etc.)
Experience with Datawarehouse Databases - BigQuery
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.