Responsibilities:
Design, develop, and maintain scalable data ingestion pipelines on Google Cloud Platform (GCP).
Implement data integration solutions to collect, process, and store large volumes of data from various sources.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure data quality and integrity.
Optimize and troubleshoot data ingestion processes to ensure high performance and reliability.
Monitor and manage data workflows, ensuring timely and accurate data delivery.
Develop and maintain documentation for data ingestion processes and workflows.
Stay up-to-date with the latest GCP services and best practices in data engineering.
We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to
Human Resources Request Form. The EEOC "Know Your Rights" Poster is available
here.
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:
https://insightglobal.com/workforce-privacy-policy/ .
Proven experience as a Data Engineer with a focus on data ingestion
Strong proficiency in Google Cloud Platform (GCP) services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage
Experience with ETL tools and frameworks
Proficiency in programming languages such as Python, Java, or Scala
Familiarity with data modeling, data warehousing, and data integration concepts
Experience with real-time data processing and streaming technologies
Knowledge of data governance and security best practices
Certification in Google Cloud Professional Data Engineer or similar
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.