Job Description
Delivery and Execution • Build, and deploy automated batch data pipelines using Apache Airflow and Python based on provided design
• Write clean, scalable scripts to extract, transform, and load (ETL/ELT) datasets between SFTP, GCP, and Snowflake
• Implement SQL queries for high-volume data processing in Snowflake and PostgreSQL
• Build and maintain API integration layers (REST/GraphQL)
• Collaborate on the design of backend microservices (utilizing Spring Boot where applicable) to support data accessibility
Support and Enablement • Monitor pipeline health, troubleshoot job failures, and ensure data integrity and SLA delivery
• Document system configurations, data contracts, technical design specifications, and test plans
Pay Rate: Up to $7.00 an hour depending on skills and experience
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
Required Experience • 1-2 years in Backend Development roles building robust ETL/ELT pipelines
• Exposure on orchestrating data workflows using Apache Airflow
• Experience developing production-grade automation and transformation scripts using Python
• Hands-on experience integrating to cloud data platforms (GCP, Snowflake) and legacy relational databases
Essential skills
• Programming proficiency in Python (specifically for automation, data manipulation, and ETL)
• Exposure in Apache Airflow (DAG development, Custom Operators, Hooks, and XComs)
• Good SQL proficiency across multiple engines (PostgreSQL, MS-SQL, and Snowflake)
• Hands-on experience with Google Cloud Platform (GCP) services (e.g., Cloud Storage, Cloud Run)
• Experience consuming and integrating data via RESTful and GraphQL APIs
• Has knowledge in secure data exchanges using file transfer protocols (SFTP)
• Experience with CI/CD pipelines, version control (Bitbucket), and containerization (Docker)
Nice to Have Skills & Experience
Desired skills • Experience with Java and the Spring Boot framework for backend API development
• Exposure to SAP Integrations using Java.
• Exposure to Kubernetes orchestration (GKE) and cloud-native deployments
• Familiarity with event-driven architectures (Kafka or Pub/Sub)
• Knowledge of data governance and security controls around automated data pipelines
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.