Job Search Results for data engineer

An Oil & Gas customer of Insight Global is looking for a Master Data Engineer to join their team full-time to sit in The Woodlands, TX, on a hybrid schedule 3 days a week and as needed with travel up... More to 5% within the Texas area. The IT division's primary goal over the next few years is focused on their Data Transformation efforts that will support all of the company's domains for midstream assets. This person will be designing, developing, and deploying innovative data and analytical solutions to enhance current operations and shape the future of the organization. The salary range for this role is dependent on level of experience with a flexible range of $120,000-$200,000 annually.Responsibilities:Collaborate with data stewards to design, develop and prioritize capabilities to accurately capture high quality data.Maintain and improve existing master data management systems while evaluating and implementing future improvements and solutions.Review integration complexities of current and future systems and understand the effects of combining data from different systems.Design, build, and manage data pipelines to ingest, transform, and distribute master data between enterprise systems and Azure destinations.Write complex system queries into operational systems to extract datasets that meet master data source ingestion requirements.Employ programming languages like Java and Python in relation to enhancing master data applications.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

We are seeking a Senior Data Engineer with strong experience in data extraction, transformation, and analytics to support enterprise reporting and system modernization initiatives. This role will... More play a critical part in sunsetting legacy systems, extracting and consolidating data, and enabling high-quality reporting through Power BI and Tableau.You will work closely with analytics, engineering, and business stakeholders while building and maintaining cloud-native data solutions on Azure.Key Responsibilities:?Design, build, and maintain scalable data pipelines using Python and cloud-native services?Extract, transform, and load (ETL/ELT) data from legacy and sunsetting systems into modern analytics platforms?Develop and optimize AWS Lambda?style serverless workloads (or equivalent patterns) using Python?Model, store, and query structured data in PostgreSQL?Support and enable business reporting and analytics, partnering with BI teams using Power BI and Tableau?Ensure data accuracy, consistency, and availability for reporting and downstream analytics?Collaborate with stakeholders to understand reporting requirements and translate them into technical solutions?Implement and maintain DevOps best practices, including CI/CD pipelines, infrastructure automation, and monitoring?Manage source control and collaboration using Git?Work closely with Azure services to build reliable, secure, and scalable data platforms?Monitor and troubleshoot data pipelines, ensuring performance, reliability, and cost efficiencyWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We?re looking for an early-career Data Engineer to support the development and maintenance of data pipelines that drive reporting and analytics. This role will work closely with both technical teams... More and business stakeholders to ensure data is accurate, accessible, and reliable.You?ll be working primarily in SQL Server and Azure, helping with data integration, ETL processes, and data modeling efforts. This is a hands-on role with strong growth potential for someone looking to build their skills in cloud data engineering.Build and maintain data pipelines in SQL Server and AzureDevelop and optimize ETL/ELT processesSupport data modeling and warehouse design (star schema)Write and optimize SQL queries and stored proceduresWork with APIs to ingest and process dataPartner cross-functionally to deliver clean, usable datasetsMonitor pipelines and troubleshoot data quality/performance issuesWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are seeking an experienced Senior Data Engineer with deep expertise in health plan / managed care environments to design, develop, and maintain enterprise-grade data solutions. This role will... More support critical healthcare operations and analytics by working with QNXT replicated databases, Oracle platforms, and complex SQL-based data transformations in a Unix/Linux environment.The ideal candidate has hands-on experience supporting payer systems, understands healthcare data models (claims, eligibility, providers, members), and can work independently in a highly regulated environment.Key ResponsibilitiesDesign, develop, and optimize scalable data pipelines and data models supporting healthcare and managed care use casesWork extensively with Oracle databases, including performance tuning, query optimization, and data integrity managementDevelop and maintain complex SQL, PL/SQL, and T-SQL scripts, procedures, functions, and packagesSupport and manage data extracted from QNXT replicated databases, ensuring accuracy, timeliness, and reliabilityCollaborate with business, analytics, and reporting teams to translate health plan requirements into technical solutionsPerform root-cause analysis and resolve data quality, performance, and integration issuesOperate within Unix/Linux environments, including scripting, scheduling, and job monitoringEnsure compliance with healthcare data governance, security, and regulatory standards (HIPAA, PHI handling)Provide technical guidance and mentorship to junior engineers as neededWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

The Senior Data Engineer will be responsible for designing, governing, and evolving a centralized data platform in Snowflake by ingesting large volumes of both structured and unstructured data from... More multiple internal source systems. On a day-to-day basis, this role works closely with other data engineers, providing hands-on technical guidance, architectural direction, and best-practice recommendations to ensure data is modeled, streamed, and organized correctly within Snowflake. The engineer leverages Azure Data Factory to orchestrate batch and streaming pipelines, establishes a more structured and scalable approach to data ingestion, and ensures performance, reliability, and cost efficiency across Snowflake workloads. They partner with analytics and reporting stakeholders to support highly customized Power BI reports and semantic models, while also advising on modern Snowflake capabilities, such as AI/Cortex features where appropriate. This role serves as the on-site subject matter expert, spending significant time reviewing designs, explaining recommended approaches, documenting standards, and translating business requirements into scalable data models to support enterprise analytics and decision-making.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for an AWS Data Engineer to join one of our financial clients and help with an ongoing project. This resource will be responsible to helping unify store data in order to... More unify legacy systems across various lines of businesses. This resource should have an ETL background with a strong focus on data engineering, specifically with AWS. Candidates will be responsible for working independently creating code, testing AWS pipelines, running through and managing requirements, data analysis and helping to enhance existing models.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

An employer is seeking a Senior Data Engineer to support the Data Strategy & Operations function. This role will focus on building and managing scalable data integration patterns into Data 360,... More onboarding third-party data providers, and ensuring reliable ingestion, transformation, and distribution of data across the organization.The ideal candidate will combine strong technical expertise in modern data engineering stacks with hands-on experience building and maintaining production-grade pipelines in a fast-paced environment.He or she will be responsible for:Design and deliver new data integrations from third-party data providers into Data 360Manage and enhance existing ingestion pipelines to support new datasets and evolving business needsDevelop and maintain data egress patterns to distribute data outputs to multiple downstream systems and platformsMonitor, maintain, and troubleshoot batch and real-time data pipelines to ensure reliability and performanceTrack and report key ingestion KPIs including data volume, number of streams, pipeline health, and throughput metricsCollaborate closely with Product, Data Science, and Analytics teams to support data-driven initiativesEnsure data quality, integrity, and availability across all pipelines and integrationsThis role is fully remote with the preference being located with PST or CST time zone preference.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

The Databricks Engineer is responsible for designing and delivering scalable data solutions that support enterprise analytics and business operations. This role focuses on backend data engineering,... More provides technical leadership, and partners closely with stakeholders to support data platform modernization. In this role, you?ll work hands-on building and optimizing data pipelines in Azure and Databricks, collaborate with business and technical partners to design modern data solutions, review code and architecture, support platform modernization initiatives, and act as a technical resource for the broader data engineering team.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

?Design and implement scalable, secure, and high-performance data engineering frameworks?Build and maintain ETL/ELT pipelines to support data ingestion, transformation, and integration?Leverage... More Snowflake features (Snowpipe, Streams & Tasks, Native Apps) and DBT for building scalable, enterprise-grade data solutions across ingestion, transformation, and orchestration?Optimize Synapse SQL Dedicated Pools to enhance BI performance?Build data pipelines that seamlessly connect to reporting platforms such as Tableau and Power BI, enabling interactive and timely business insights?Ensure data accuracy and integrity through validation checks, lineage tracking, and quality monitoring?Tune workflows for performance and cost-efficiency at scalePay Rate: $10.00-$14.00 an hour depending on skills and experienceWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

PGIM Real Estate is seeking an Azure Data Engineer to play a key role in modernizing the firm?s data platform and advancing its data and analytics capabilities. This is a transformational role... More directly aligned with PGIM Real Estate?s commitment to leveraging data, analytics, and technology to proactively address business challenges and unlock new opportunities.The Data Engineer will be responsible for supporting and enhancing existing ETL processes for the on- prem data lake (PostgreSQL) while leading the evolution and migration of these processes to Microsoft Fabric. This role will focus heavily on developing and maintaining SQL-based transformation logic to ensure high quality, trusted, and analytics ready data.Working closely with the Data Management team, the Data Engineer will help identify, remediate, and prevent data quality issues by encoding validation rules and controls directly into data pipelines. The role will also contribute to the evaluation and implementation of tools and frameworks supporting data governance, architecture, and data quality as the platform continues to evolve.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less