Job Description
An employer is seeking a Senior Data Engineer to support the Data Strategy & Operations function. This role will focus on building and managing scalable data integration patterns into Data 360, onboarding third-party data providers, and ensuring reliable ingestion, transformation, and distribution of data across the organization.
The ideal candidate will combine strong technical expertise in modern data engineering stacks with hands-on experience building and maintaining production-grade pipelines in a fast-paced environment.
He or she will be responsible for:
Design and deliver new data integrations from third-party data providers into Data 360
Manage and enhance existing ingestion pipelines to support new datasets and evolving business needs
Develop and maintain data egress patterns to distribute data outputs to multiple downstream systems and platforms
Monitor, maintain, and troubleshoot batch and real-time data pipelines to ensure reliability and performance
Track and report key ingestion KPIs including data volume, number of streams, pipeline health, and throughput metrics
Collaborate closely with Product, Data Science, and Analytics teams to support data-driven initiatives
Ensure data quality, integrity, and availability across all pipelines and integrations
This role is fully remote with the preference being located in Hyderbad.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
5+ years of experience in data engineering and ETL development
Strong experience with Informatica (preferred) or similar ETL tools
Hands-on experience with Airflow for orchestration and MuleSoft for integrations
Advanced SQL skills with Snowflake and other relational databases
Proven experience building batch and real-time data pipelines
Strong experience writing Python modules for custom ETL workflows
Experience with dbt for data transformation and modeling
Solid understanding of data modeling, data warehousing, and big data processing frameworks
Experience with data quality, monitoring, and pipeline orchestration frameworks
Familiarity with AWS and/or GCP environments
Experience working with distributed and event-driven architectures
Nice to Have Skills & Experience
Experience working with Salesforce platforms and data models
Exposure to Salesforce Flows and Apex
Experience integrating with third-party data vendors and APIs
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.