Job Description
Responsibilities:
Maintaining operations for big data ETL/ ELT pipelines using Google Cloud Composer, Python, SQL and DBT on GCP.
Maintaining operations for data ingestion processes landing data into Google Storage, Big Query and Big Table.
Troubleshoot data pipeline errors and follow incident management and escalation procedures.
Maintain and enhance, and follow runbooks, SOPs, and handoff documentation for operational processes.
Manage operational tasks such as platform maintenance, upgrades, and KTLO (keep‑the‑lights‑on) work.
Execute incident response and escalation, including after‑hours/on‑call support when required.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
1 to 3 years of experience in data operations
Bachelor's Degree or Equivalent
Demonstrated experience with GCP
Demonstrated experience of incident management and escalation
Demonstrated experience of running operations for end to end data pipelines
Demonstrated experience of following run books and triaging data pipeline errors
Demonstrated experience in supporting data pipelines and data warehouses
Demonstrated strong troubleshooting and problem-solving skills
Demonstrated expert level experience of SQL
Demonstrated experience with Airflow and Google Composer
Demonstrated expert with Big Query, Google Storage, Data Flow, Big Table
Demonstrated understanding of Datawarehouse best practices including Relational and Dimensional Modeling
Demonstrated experience of DBT, Python and Java
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.