Job Search Results for data engineer

Our client in the Utility industry is seeking a junior?mid level Data Engineer to support data integration, analysis, and heavy automation initiatives. This role focuses on pulling data from multiple... More systems, performing analysis, and building complex automation platforms?with a strong emphasis on Power Apps?based user interfaces for internal customers.Key Responsibilities:- Build and maintain automation solutions to eliminate manual, repetitive processes- Extract data from source systems using tools such as SSIS, R, or similar ETL/integration tools- Transform, validate, and load data into relational databases- Perform data analysis after ingestion to support business operations and decision-making- Develop Power Apps as the primary user-facing interface for internal platforms- Build and support complex internal platforms that integrate multiple data sources- Collaborate with IT and business teams to ensure reliable data flow and automation outcomesPay is dependent on experience level and match to qualifications: $35-42/hrWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Our client is looking for a Data Engineer to join their team in Boca Raton, FL. In this role, you will be supporting AI use cases and be responsible for building efficient data pipelines for the real... More time use across the engineering and product teams. This will require candidates that are very strong in SQL coding, writing stored procedures and strong cloud exposure. This is a hands on role that requires you to be in office in Boca four days a week (Monday through Thursday).We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

-Design and develop scalable, reusable data ingestion frameworks using Azure Databricks and PySpark-Build metadata-driven pipelines that decouple configuration from execution-Implement and maintain... More Bronze, Silver, and Gold data layers following Medallion architecture-Integrate data pipelines with data catalog and governance tools (e.g., DataHub, Purview)-Implement schema enforcement, data contracts, and data quality checks within pipelinesWork with ingestion tools (e.g., Fivetran) and file-based ingestion patterns-Enable automation for dataset onboarding using configuration-driven approaches-Collaborate with architecture, governance, and business teams to ensure scalable and governed data access-Contribute to evolving toward event-driven and near real-time ingestion patterns-Support CI/CD and DevOps practices for data platform components-Pay Rate between 50-65/hrWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

A prestigious University in San Diego is looking to hire an experienced SQL Developer to help with a project supporting the go-live of a new SIS (Student information system). There are currently 250... More downstream applications that depend on the existing student information system, so these apps need to connect to a new data warehouse once the new system goes live. To support this effort, the SQL developer will extract data from the existing data warehouse in SAP Hana (point A) into the DB2 data warehouse (point B). This will require advanced query skills and ability to write SQL tables in DB2 syntax, to create a sub-set of the existing data warehouse for the downstream applications to connect to. In this role, you will work closely with the SAP Hana Dba, DB2 DBA, and various developers that support the applications. This position requires advanced development skills in all areas of MS SQL.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a dynamic Data Engineer (ML) to join the Data Platform team at a large retail client. This team oversees the technical foundation of the organization?s enterprise data... More platform, enabling teams to build scalable data products and integrate ML/AI into their workflows.As a Data Engineer with a focus on ML Ops and platform, you will be responsible for the development, support, configuration, and automation of the data tools, infrastructure, and workflows that support the ML Ops strategy. You will work closely with data engineers, analysts, and architects to establish and scale enterprise ML platform capabilities.ResponsibilitiesPlatform Ownership ? Databricks & ML EcosystemOwn and support the Databricks platform, with a focus on administration, optimization, and operational supportPartner with engineering teams to support workloads, troubleshoot platform issues, and improve usage patternsSupport a Unity Catalog migration, helping drive governance and standardization across the platformMonitor and support ML platform operations and workflows to ensure consistency and reliabilityML Ops Development & StandardizationProvide technical leadership in the design, expansion, and optimization of ML Ops capabilitiesDesign enterprise standards for infrastructure, process automation, and observability across the ML lifecycleBuild and mature ML pipelines using MLflow, focusing on improving current-state processes and consolidationSimplify and unify ML workflows across the enterprise into a scalable, standardized frameworkSupport the full ML lifecycle: model development, training, deployment, and productionizationCloud, Infrastructure & OperationsLead Azure cloud infrastructure administration and automation, leveraging Infrastructure as Code (IaC)Provision and automate network configurations, access controls, services, and applicationsEnsure cloud environments meet expectations for reliability, availability, performance, and securityDefine and implement monitoring, alerting, and observability frameworksOversee and participate in production deployments and CI/CD improvementsOperations & Cross-Functional CollaborationCoordinate recovery from incidents using well-defined operational procedures and communication frameworksManage outages, escalations, and production incidents across ML and platform systemsInterface with global vendors and internal stakeholdersActively recommend and implement improvements to the continuous delivery toolsetProvide guidance and mentorship to junior engineersWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are seeking a Machine Learning Engineer?leaning Data Scientist to join the Wildfire Consequence Modeling team. This role is ideal for someone who can work effectively with academically oriented... More researchers while bringing a solution architecture and software engineering mindset to model design, implementation, and production grade systems.The team is composed primarily of individuals with academic backgrounds. This role will help balance the group by emphasizing practical problem solving, system design, and scalable machine learning solutions, while still engaging deeply in data science and model development.________________________________________Key Responsibilities?Design, develop, and deploy machine learning systems supporting wildfire consequence modeling?Collaborate closely with academic researchers and data scientists to translate research concepts into production ready models?Lead or contribute to solution architecture for data and ML workflows, balancing performance, scalability, and maintainability?Design and implement end to end ML pipelines, including data ingestion, feature engineering, model training, and inference?Apply strong software engineering principles to machine learning model development?Support and guide architectural decisions related to cloud infrastructure, tooling, and integrations?Work hands on with geospatial data and analytics relevant to wildfire modeling?Partner with the broader data science team to improve model robustness, scalability, and operational readinessWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

? Design, build, and maintain data pipelines moving data from multiple source systems into centralized data warehouses? Perform day-to-day ETL operations using SSIS and SQL Server? Collaborate with... More offshore team members, providing guidance and ensuring accountability? Participate in CI/CD processes for deployment and automation? Support ongoing data warehousing initiatives and operational enhancements? Work on prioritized pipeline tasks with defined deliverables? Contribute to data platform modernization efforts and future cloud migrationWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

One of our clients within the Financial Services space is looking for a full-time Data Engineer to support their organization. This position is part of the Enterprise Data & Analytics Capability... More team under Global Technology Organization. In this role, you will lead the design, development, and optimization of large-scale data solutions on the Databricks platform. Day to day responsibilities include the following:?Design, build, and maintain scalable data pipelines on Databricks (using Spark, Delta Lake, etc.)?Write clean, efficient and maintainable PySpark or SQL code for data transformation?Design robust data models for analytics and reporting?Ensure data quality, consistency, and governance?Handle batch and streaming data workflows?Provide architectural guidance and support in platform usage?Drive best practices in data engineering across the team?Monitor and optimize performance of Spark jobs and cluster usage?Ensure compliance with security and data privacy standardsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Data Engineer to join a large payor/provider. This person will be responsible to:? Design, develop, and implement end-to-end data solutions using Azure Databricks.?... More Convert current SQL to Python code in Databricks.? Modify and maintain data pipelines.? Write, test, and optimize PySpark and SQL scripts to transform and load high volumes of structured data.? Update or maintain existing data pipelines in a production setting.? Ensure data quality and integrity by implementing data validation and cleansing processes. ? Demonstrate strong verbal communication and critical thinking skills, working well within a team environment and not being afraid to speak up.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

In this role, the Data Engineer supports and builds end-to-end data pipelines across both on-premise environments (roughly 65% of the time) and the Azure cloud (about 35%), working as part of a... More small, collaborative team that includes two other Data Engineers and a Data Scientist. On a daily basis, they are designing, developing, and maintaining ETL workflows using SSIS?extracting data from various sources, performing data cleansing and validation, and integrating it into downstream systems to ensure accuracy and reliability. They also serve as an administrator within SSAS, building and maintaining data models, supporting analytical structures, and ensuring data is optimized and accessible for reporting and business intelligence. In close collaboration with the other engineers, they help troubleshoot pipeline issues, optimize performance, and share best practices across the data ecosystem, while partnering with the Data Scientist to ensure datasets are properly structured and readily available for advanced analytics and modeling. Additionally, they leverage Databricks to process and manage large-scale datasets, supporting more complex data transformations and analytics use cases. The role involves hands-on coding in Python and SQL to automate workflows, enhance pipeline efficiency, and manage operational tasks. While the majority of the work focuses on core data engineering responsibilities, there is also exposure to emerging tools like Microsoft Fabric and occasional work within Linux environments, contributing to a modern, evolving data platform.$110,000 to $126,000 - Exact compensation may vary based on several factors, including skills, experience, and education.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less