Job Search Results for data engineer

We are seeking a highly capable Data Engineer with strong foundations in Business Intelligence, Data Warehousing, and Analytics Engineering. The ideal candidate brings deep expertise in building and... More scaling data platforms with a focus on modeling, transformation, and data quality, rather than general-purpose application development. This role is best suited for someone who thrives on ownership, is detail-oriented, and approaches data systems with both discipline and curiosity.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

An employer is looking for a Sr. Data Engineer in the Seattle, WA area. This entertainment company is looking for a Sr. Data Engineer to join their consumer business division. They are dealing with... More large amounts of television and digital data around their customers. This person will be responsible for their Data Warehouse as they evolve into a more cloud based environment. Someone with AWS and Snowflake experience would be a standout candidate. However, if you have an expertise in Python for developing ETL pipelines, data warehousing, and some cloud experience, this could be a fit for you. This group is looking for a team player who's interested in learning new technologies in an evolving organization. If this sounds like you, please apply today!We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Day to Day:We are seeking a qualified candidate for the role of QA Engineer, who will be responsible for developing and executing automated test scripts in a big data environment. The Senior Data... More Quality Engineer will support the development of secure, scalable data integration and analytics solutions within the People Enablement Technology team. This role focuses on validating data pipelines built using Databricks, Azure Data Factory, Snowflake, and related technologies. The ideal candidate will have a strong background in ETL testing, data validation, and automation, with a deep understanding of data governance, encryption, and automation practices.You will collaborate closely with data engineers, architects, analysts, and business stakeholders to ensure that data solutions meet business requirements and maintain high standards of quality and compliance. This role focuses on validating data pipelines built using Databricks, Azure Data Factory, Snowflake, and related technologies. The ideal candidate will have a strong background in ETL testing, data validation, and automation, with a deep understanding of data governance, encryption, and DevSecOps practices.You will collaborate closely with data engineers, architects, analysts, and business stakeholders to ensure that data solutions meet business requirements and maintain high standards of quality and compliance.Principal Duties and Responsibilities:Design and implement test strategies for complex data pipelines and workflows using Databricks, Azure Data Factory, and SnowflakeDevelop and maintain automated test suites for data validation, transformation logic, and data quality checks using Python, SQL, and PySparkCollaborate with cross-functional teams to define test cases, acceptance criteria, and quality benchmarksPerform root cause analysis and support troubleshooting of data issues in production and non-production environmentsMaintain detailed test documentation, prepare test data sets, and contribute to knowledge sharing across the QA and engineering teamsWe are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Insight Global is looking for Senior Data Engineer/Data Lead for one of their clients in Cincinnati, OH. You will be supporting the data management and AI/data governance teams for the banks... More Enterprise Data Office. You will lead data strategy and hands-on data engineering to enforce capabilities of modern technology stacks, in support of data management, governance, lineage, and quality for regulatory reporting, risk metrics, and more. The overall goal, is to design and build platforms and solutions to help the bank manage, secure, and generate value from its data by transitioning manual work/processes to a modern technology stack.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

We are seeking a highly skilled Sr. Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in data warehouse concepts, streaming data processing, Azure cloud... More services, Snowflake, and SQL. This role will be responsible for designing, building, and optimizing data pipelines, ensuring efficient data management and accessibility to support business intelligence and analytics.Key Responsibilities - Design, develop, and maintain data pipelines and ETL processes for structured and unstructured data. - Implement and optimize data warehouse solutions using Snowflake and Azure technologies. - Work with real-time data streaming technologies such as Apache Kafka, Azure Event Hubs, or similar. - Develop and optimize SQL queries for data transformation, aggregation, and analysis. - Ensure data integrity, security, and governance by implementing best practices. - Collaborate with cross-functional teams to understand data needs and deliver efficient solutions. - Monitor, troubleshoot, and improve performance of existing data pipelines and systems. - Stay up to date with industry trends and emerging technologies in data engineering.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

An Oil & Gas customer of Insight Global is looking for a Data Engineering Advisor to join their team full-time to sit in The Woodlands, TX, on a hybrid schedule 3 days a week and as needed with... More travel up to 5% within the Texas area. The IT division's primary goal over the next few years is focused on their Data Transformation efforts that will support all of the company's domains for midstream assets. This person will be designing, developing, and deploying innovative data and analytical solutions to enhance current operations and shape the future of the organization. The salary range for this role is dependent on level of experience with a flexible range of $120,000-$200,000 annually. Responsibilities:Design and create data architecture and strategies to facilitate efficient storage and retrieval of structured and unstructured data.Design, build, and manage data pipelines to ingest, transform, and distribute data between on-premises and Azure-based destinations.Implement measures to ensure the quality and integrity of data, including data cleaning, validation, and error handling within data pipelines.Utilize technologies from Qlik, OpenText, SAP Datasphere, and Azure cloud services, including Copilot, Dataverse, Fabric, Data Factory, Logic Apps, Power Automate, Azure Synapse Analytics, Fabric to enable custom applications and BI efforts.Employ programming languages like Java or Python for automation and API integration tasks.Work closely with data scientists and developers to provide data necessary for custom applications, visualizations, and analytic models.Assess, recommend, and integrate new data management technologies, data modeling, relational data structures, and change data capture.Identify bottlenecks, optimize queries, and fine-tune database or data processing configurations.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Participate in architecture development and solution design sessionsDrive data quality processes like data profiling, data cleansing etc.Guide other data engineers in the teamLead requirements... More sessions and data analysisConvert business requirements for information to technical specifications for data ingestion solutionsEngage with business stakeholders and source system SMEs to understand current data processes and develop data processing logic.Define, design & implement different data ingestion patterns based on business needs & requirementsLead the data modeling workstream; develop data models that are fit for business requirements using ErwinParticipate in data governance initiativesEnsure data integrity & quality is maintained throughout the solution; develop data quality solutions as part of the data flowDocument data flows and other design specificationsEvaluate best-fit data ingestion, integration & replication tools for cloud-based data analytics use casesImplement real-time data transfers to ensure data is made available to business at the right time & the right placeMaintain & support the data ingestion tools & solutionsWe are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Insight Global is seeking skilled AWS Data Engineers to join our banking client to support a large scale SaaS to AWS transformation project. Candidates will be involved in an initiative to build a... More new cloud platform tool in AWS for Wealth Data Solutions and moving data from Hadoop to AWS. The ideal candidates will have a strong background in data engineering, AWS webservices, and a strong understanding of data warehousing and batch processing. These individuals should be confident to work in an agile environment (Scrum, Kanban) and to collaborate with other functional roles in delivery including testing, analysis, architecture, and business stakeholders. Main themes for these individuals to consider are data storage, data movement, meta data & governance, infrastructure, and security/IAM. This role will hybrid in Toronto, ON on a 6 month contract with potential for extensions and conversion to full time. \Responsibilities:- Perform data/file transformation using AWS services. - Utilize AWS Glue for batch processing (Spark or Python).- Implement data warehousing solutions using Amazon S3, Redshift (analytics and BI), Aurora/RDS (operational data stores).- Ensure metadata and governance using AWS Glue Catalog, Lake Formation, and Macie.- Create operational dashboards using AWS QuickSight and Power BI.- Deploy and manage ML models in AWS SageMaker.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Our client is looking for a Senior Data Engineer to join their team in India. Responsibilities are shown below:Collaborate with business stakeholders and other technical team members to acquire and... More migrate data sources that are most relevant to business needs and goals.Demonstrate deep technical and domain knowledge of relational and non-relation databases, Data Warehouses, Data lakes among other structured and unstructured storage options.Determine solutions that are best suited to develop a pipeline for a particular data source.Develop data flow pipelines to extract, transform, and load data from various data sources in various forms, including custom ETL pipelines that enable model and product development.Efficient in ETL/ELT development using Azure cloud services and Snowflake, Testing and operation/support process (RCA of production issues, Code/Data Fix Strategy, Monitoring and maintenance).Work with modern data platforms including Snowflake to develop, test, and operationalize data pipelines for scalable analytics delivery.Provide clear documentation for delivered solutions and processes, integrating documentation with the appropriate corporate stakeholders.Identify and implement internal process improvements for data management (automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability).Stay current with and adopt new tools and applications to ensure high quality and efficient solutions.Build cross-platform data strategy to aggregate multiple sources and process development datasets.Proactive in stakeholder communication, mentor/guide junior resources by doing regular KT/reverse KT and help them in identifying production bugs/issues if needed and provide resolution recommendation.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Responsible for designing, implementing, and optimizing data pipelines both upstream and downstream of CRM Dynamics, leveraging Databricks, ADLS Gen 2, and Azure cloud platforms like Synapse and... More ADF.Data Strategy: Develop and maintain robust data pipelines to support CRM Dynamics and other business applications. Collaborate with relevant stakeholders to prioritize and deliver technical solutions that align with business goals. Implement and manage data integration processes using Databricks, ADLS Gen 2, Azure Synapse, and Azure Data Factory (ADF). Ensure data quality, consistency, and reliability across all data pipelines.Data Pipeline Management: Design and implement scalable data pipelines for data ingestion, transformation, and storage. Optimize data workflows to improve performance and reduce latency. Monitor and troubleshoot data pipeline issues to ensure seamless data flow. Maintain comprehensive documentation of data pipelines, data flows, and data integration processesWe are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less