Job Description
An employer is seeking a GCP Data Engineer to join a large automotive company sitting fully remote. This person will be helping with their data ingestion work across the enterprise. Responsibilities include:
* Design, Develop and Deploy ETL/ELT pipelines for data ingestion, data integration, data aggregation and data distribution
* Monitor, support, and trouble shoot any issues related to the pipelines and data discrepancy the pipelines caused or related.
* Collect, load, and maintain data inventory of source, target, and data warehouse schemas
* Adhere and enforce client data operation's SDLC processes, standards, and best practices throughout the entire project lifecycle.
* Familiar with and take agile approach in the project delivery: Working with PM, plan project milestones, deliverables in each scrum and ETA etc. Ability to prioritize between multiple deliverables to ensure meeting timelines according to project plan.
* Create, update, and maintain complete document for your work and works that you have involved but not up to date yet. Create runbooks for applications that need to support team to monitor and support
Required Skills & Experience
* Bachelor's Degree in Computer Science or Engineering
* Strong knowledge of SQL, including 3-5 years' experience writing queries and leveraging advanced SQL features and Big Data features to enhance your code performance.
* 2+ years' experience of working in big data querying platforms, Google BigQuery preferred or comparable (AWS, Azure, Redshift, Hive QL, etc.)
* 2+ years' experience in developing & deploying ETL/ELT solutions, experience with Apache Airflow a plus.
* 2+ years' experience in developing applications with Python, specifically packages & libraries related to data processing (Pandas, PySpark, etc.)
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.