Our Healthcare Insurance Client is looking to hire a Sr. Data Engineer. This will be a 1 year work from home remote contract. We are looking for someone who has experience in a Data Engineering role, with a proven track record of successfully delivering customized complex, large-scale, multi-team data projects using Python and SQL.
As a Senior Data Engineer, youll be an integral part of our team, helping to design, build, and maintain the infrastructure and systems that support the effective collection, storage, and processing of large volumes of data. In this exciting role, youll have the opportunity to develop robust data pipelines that effortlessly ingest, transform, and load (ETL/ELT) data from a variety of sources into our digital platforms. Your dedication to ensuring data quality, integrity, and security throughout the data lifecycle will be key, as will your efforts to optimize our data storage solutions for top-notch performance and scalability.
Key Responsibilities:
Help design and implement scalable data pipelines and architectures that support low-latency and high-performance data processing.
Support and enhance existing data processing platforms deployed in AWS, ensuring optimal performance and scalability.
Collaborate closely with software engineers, product managers, and business analysts to understand data requirements and deliver effective solutions.
Contribute to the development of best practices and standards for data engineering and machine learning, promoting efficiency and quality across projects.
Implement backup, disaster recovery, and failover procedures for mission-critical data systems using AWS services like Amazon RDS.
Help manage and scale Elasticsearch clusters for efficient indexing and retrieval of large datasets for micro-services.
Ingest data from various sources, such a flat files, streaming systems, and RESTful APIs.
Ensure compliance with data privacy regulations, such as HIPAA, to protect sensitive information.
We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to
Human Resources Request Form. The EEOC "Know Your Rights" Poster is available
here.
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:
https://insightglobal.com/workforce-privacy-policy/ .
7+ years of experience in a Data Engineering role, with a proven track record of successfully delivering customized complex, large-scale, multi-team data projects using Python and SQL.
5+ years Proficiency in working with diverse data infrastructures, including relational databases (e.g., SQL), and column stores (e.g., Redshift).
5+ years of proficiency in Python with a focus on scaling custom data pipelines.
5+ years of proven ability to document processes, architecture designs, deployment pipelines, development methods, and troubleshooting techniques.
3+ years of experience using Airflow to orchestrate and schedule ETLs.
Familiarity with OpenSearch, RDS Postgres, and Redshift
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.