Job Search Results for data engineer

Job Description: Lead complex technology initiatives including those that are companywide with broad impact. Act as a key participant in developing standards and companywide best practices for... More engineering complex and large scale technology solutions for technology engineering disciplines. Design, code, test, debug, and document for projects and programs. Review and analyze complex, large-scale technology solutions for tactical and strategic business objectives, enterprise technological environment, and technical challenges that require in-depth evaluation of multiple factors, including intangibles or unprecedented technical factors. Make decisions in developing standard and companywide best practices for engineering and technology solutions requiring understanding of industry best practices and new technologies, influencing and leading technology team to meet deliverables and drive new initiatives. Collaborate and consult with key technical experts, senior technology team, and external industry groups to resolve complex technical issues and achieve goals. Lead projects, teams, or serve as a peer mentor. We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

A large banking client is looking for a junior Data Engineer to join their team to help with data modeling. The work is being done in Alteryx and this role will work with data from multiple sources... More and align field definitions. This role will work with Alteryx for data preparation and workflow automation. This role is about getting quality models built quickly and efficiently.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are seeking a Mid-Level Data Engineer to design, build, and maintain data pipelines and infrastructure that power analytics, reporting, and data-driven decision-making. You?ll collaborate with... More product, data analysts, and software engineers to ensure our data ecosystem is reliable, scalable, and efficient.?Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and deliver data from customer applications, third-party sources, public websites, APIs, and internal systems.?Leverage AI/ML models and web scraping frameworks to extract, clean, and normalize structured and unstructured data for integration into core pipelines and monetized datasets.?Develop intelligent data enrichment workflows using AI/ML techniques (e.g., entity resolution, anomaly detection, and NLP-based parsing).?Implement and optimize data models and architectures to support analytics, reporting, and monetization strategies.?Write and optimize SQL queries and other data transformations for performance at scale.?Ensure data quality, reliability, and consistency by applying validation frameworks, automated testing, and observability tools.?Monitor pipelines and AI models for accuracy, data drift, performance, and data freshness?proactively addressing issues and driving continuous improvements.?Collaborate cross-functionally with analysts, engineers, and data scientists to deliver high-quality, reliable data products.?Implement monitoring and observability for pipeline health, usage metrics, and operational reliability.?Document technical specifications, workflows, and integrations to support maintainability and knowledge sharing.?Participate in peer code reviews, contributing constructive feedback and adhering to best practices.?Ensure compliance with data security, privacy, and governance requirements (e.g., NIST, StateRAMP, FedRAMP, GDPR) in all data pipelines and monetized data products.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

The Data Engineer will be an integral part of the product development cycle, responsible for creating features and developing tables and hydration procedures in a Databricks environment. This role... More requires a deep understanding of SQL, as it is the core language for interacting with data. They will be taking features to translate them into technical development by creating SQL tables, stored procedures, orchestration of these products. The engineer will also work with Python and PySpark to build and manage data transformations. Additionally, they will learn about the domain context to effectively build data transformations.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Data Engineer to join one of their top financial clients in New York City, coming onsite 4x per week in Midtown East. As the data ecosystem changes within the Global... More Transaction Banking (GTB) group, we are seeking a data savvy individual who can focus on data modeling and analysis efforts to support the business needs. As different warehousing and big data techniques are being implemented, we're seeking someone who can contribute to setting up an environment with curated data, and work with the business to provide insights, visualization, and analysis as needed. We are seeking someone who has technical skills in SQL as well as different ETL & visualization tools that can contribute as needed per business request. This resource will also mentor other junior colleagues. Duties include the below:? Expert knowledge of data engineering frameworks, technologies, tools, processes, patterns, and procedures, including how they impact and integrate with other technology areas such as Architecture or Infrastructure? Performs highly complex technical tasks independently? Designs and develops to meet business and technical requirements; analyzes, adapts, integrates, codes, tests, debugs, and executes? Uses and evolves established patterns to solve complex problems; leads the development of new patterns where necessary? Recognized as primary subject matter expert in multiple areas directly and indirectly related to key accountabilities? Consults with peers and partners across multiple teams on all aspects of research, analysis, design, and supportWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are seeking a Data Engineer / Data Ops Specialist to join our growing data team. This role will focus on building scalable data models using DBT, automating data pipelines based on Pydantic data... More contracts, and integrating CI/CD workflows using GitHub Actions. The ideal candidate will have a strong background in Python, data modeling, and DevOps practices, and will also provide support to data engineering users across the organization.Responsibilities:Data Modeling & Transformation-Design and implement robust DBT models based on Pydantic data contracts.-Ensure data quality, consistency, and documentation across models and pipelines.Automation & CI/CD-Develop and maintain automated workflows using GitHub Actions for data pipeline deployment and validation.-Integrate data contracts into the Python codebase to drive dynamic DBT model generation.Data Engineering Support-Provide technical support and guidance to data engineers on tooling, best practices, and troubleshooting.-Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions.Process Optimization-Identify opportunities to streamline data operations and improve pipeline efficiency.-Contribute to the development of internal tools and frameworks for data contract management.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are seeking a highly skilled and experienced Data Engineer to join our growing team. The successful candidate will be responsible for designing, developing, and maintaining our AWS-based data... More lake, ensuring data quality, accessibility, and security. This role requires a strong understanding of AWS data services, data warehousing concepts, and best practices for building scalable and efficient data pipelines. Responsibilities: Design, implement, and maintain scalable and robust data pipelines for our AWS data lake using services such as AWS Glue, AWS Lambda, Amazon S3, Amazon S3 Vectors, Amazon BedRock, Amazon DataBrew, Amazon Athena, and Amazon QuickSite. Develop and optimize ETL processes to ingest, transform, and load data from various sources into the data lake. Ensure data quality, integrity, and security within the data lake environment. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs. Design conceptual, logical, and physical representations of the data to support efficient storage, access, and analysis, ensuring it meets business requirements . Develop, monitor and troubleshoot data pipelines and data lake infrastructure to ensure optimal performance and reliability. Implement and maintain data governance policies and procedures. Stay up-to-date with the latest AWS data services and technologies to recommend and implement improvements. Document data lake architecture, data flows, and operational procedures.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

An employer in the Irvine area is seeking a Data Engineer. This is a hybrid position, with expectation to come into the office quarterly in addition to occasional meetings on site. Must sit in... More Southern California. The Data Engineer will be responsible for designing, implementing, and maintaining database architectures that support business applications and processes, assisting with the organization's goal to move from on prem to Microsoft Fabric (currently in a hybrid environment). This individual will focus on data ingestion, ETL processes, database security, and performance optimization within the Enterprise Data Warehouse. The Data Engineer will work with several stakeholders and business lines, including the infrastructure and data integration teams to help navigate the cloud infrastructure. Individual will be responsible for relaying requirements to reporting team and will help bridge the gap between development and production.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are looking for a Data Engineer to work for a leader in the utility industry. This work is going to be supporting a an organization focused within regulatory, governance and operations. We are... More responsible for building reports for all levels of leadership and individual contributors to help support their daily operating and weekly operating review requests. Data exists and build out the dashboards. Metrics have already been created and the client has the data models built, we need the methodology to be supported on how to slice and dice it, take that to PBI and allow the dashboard to interact with the business. The goal in building comprehensive reports and dashboards is to automate process for leadership to understand where projects sit. Much of the data is going to represent performance measurements and KPI?s that go around it. Unit progression, feet mileage and how much we are hardening and in between steps, how many miles in estimating, how many have gone back and what do our dependencies look like. Do we have any permitting issues and what are those issues and layers of granularity and annual perspective that all feed out to the end resort of the KPI?s with units. Data will be driven by date and permitting outdate and start dates. Main unit of measure and miles associated and see the projects and through puts. We need this individual to be attentive to details, willingness to hit ground running and be a go-getter.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Data Pipeline DevelopmentDesign and implement complex, scalable ETL pipelines using Azure Fabric, Data Factory, and Synapse.Build and maintain transformation pipelines and data flows in Azure... More Fabric.Source data from diverse systems including APIs, legacy systems, and mainframes (nice to have).Automate data ingestion, transformation, and validation processes using PySpark and Python.Maintain source control hygiene and CI/CD pipelines (e.g., Azure DevOps, Jenkins).Database Design & OptimizationDesign and maintain relational and NoSQL databases (SQL Server, Oracle, etc.).Ensure referential integrity, indexing, and query optimization for performance.Data Infrastructure ManagementManage data warehouses, data lakes, and other storage solutions on Azure.Monitor system performance, ensure data security, and maintain compliance.Data Modeling & GovernanceDevelop and maintain logical and physical data models.Implement data governance policies and ensure data quality standards.Collaboration & Agile DevelopmentWork closely with business and technical teams to gather requirements and deliver solutions.Participate in agile ceremonies, sprint planning, and code reviews.Provide technical guidance and mentorship to team members.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less