Job Search Results for data engineer

An employer in the Irvine area is seeking a Data Engineer. This is a hybrid position, with expectation to come into the office quarterly in addition to occasional meetings on site. Must sit in... More Southern California. The Data Engineer will be responsible for designing, implementing, and maintaining database architectures that support business applications and processes, assisting with the organization's goal to move from on prem to Microsoft Fabric (currently in a hybrid environment). This individual will focus on data ingestion, ETL processes, database security, and performance optimization within the Enterprise Data Warehouse. The Data Engineer will work with several stakeholders and business lines, including the infrastructure and data integration teams to help navigate the cloud infrastructure. Individual will be responsible for relaying requirements to reporting team and will help bridge the gap between development and production.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

A healthcare payor is actively hiring for Data Engineers with strong Databricks expertise to help drive their data ingestion projects. This role will play a critical part in growing their Enterprise... More Data Office so the enterprise can leverage data to directly impact patient outcomes, operational efficiency, and data-driven decision-making. Key Responsibilities include: ? Design, develop and implement end-to-end data solutions using Azure Databricks.? Convert legacy SQL workflows into modern Python-based pipelines.? Maintain and optimize high-volume data pipelines in production.? Write, test, and tune PySpark and SQL scripts for performance and scalability.PLEASE NOTE: We are looking for someone who values in person collaboration and is willing to come onsite weekly in Newtown Square, PA 19073.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for a data engineer contractor for one of their top financial clients. The following would be their roles and responsibilities:- Bachelor's degree in Computer... More Science/Information Systems or equivalent combination of education and experience.- Must be able to communicate ideas both verbally and in writing to management, business and IT sponsors, and technical resources in language that is appropriate for each group.- Four+ years of relevant IT experience in data engineering or related disciplines.- Significant experience with at least one major relational database management system (RDBMS).- Experience working with and supporting Unix/Linux and Windows systems.- Proficiency in relational database modeling concepts and techniques.- Solid conceptual understanding of distributed computing principles and scalable data architectures.- Working knowledge of application and data security concepts, best practices, and common vulnerabilities.- Experience in one or more of the following disciplines preferred: scalable data platforms and modern data architectures technologies and distributions, metadata management products, commercial ETL tools, data reporting and visualization tools, messaging systems, data warehousing, major version control systems, continuous integration/delivery tools, infrastructure automation and virtualization tools, major cloud platforms (AWS, Azure, GCP), or rest API design and development.- Previous experience working with offshore teams desired.- Financial industry experience, especially Regulatory Reporting, is a plus.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

As a critical member of the Assurance service team, the Data Engineer will acquire and analyze utility-scale electric power plant process data to develop and deploy machine learning-based forecasting... More and anomaly detection systems.Core Competencies ?Self-starting problem-solver, innovative, enterprising, data-driven ?Independent, resourceful, adaptable, and unafraid to fail and try again?Action-oriented individual who thrives with minimal supervision?Focused on value (why the client needs our product, value-add prospects, dollar focused, thinking outside the box) ?Willing to learn industry concepts/terminology and understand customer needs Responsibilities: ?Build, operate, and maintain production deployments of machine learning offerings via established Azure resources ?Problem-solve and modify deployments per specifications ?Remain responsible for deployments and servicing of customer requests?Clearly and concisely document deployments for each new customer ?Work with domain experts to discover and communicate value-add optimization prospects Compensation: $120-130k.Exact compensation may vary based on several factors, including skills, experience, and education.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

One of our large financial customers is seeking (3) Data Engineers. The Data Engineer will support our client's operational data platform by enhancing and maintaining data pipelines that power... More operational reporting and analytics. This includes modifying existing Java/Spring Batch pipelines, creating new ones as needed, optimizing data flows, and deploying to AWS environments. The role is hands-on with development, testing, and debugging, while working cross-functionally in an Agile, Kanban-style team.This is a contract, with the possibility of converting to a full time employee. This is a hybrid role, being on site every other week in Rhode Island or Texas. Compensation is based off many factors including experience, education, and more and this position offers a range of $55 - $75/hr.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Responsibilities: ?Develop and operationalize data pipelines to support Data Science and analytical models. ?Install, patch, upgrade, and administer software systems for data pipelines (ETL, data... More quality, distributed processing, streaming platforms). ?Ensure compliance with security, documentation, governance, and standards. ?Perform DevOps tasks and orchestrate data marts and analytical processes. ?Monitor, secure, and track data usage and analytic product performance. ?Collaborate with internal teams to deliver accurate, accessible API services. ?Mentor junior Data Engineers on best practices and technology usage. ?Research and evaluate emerging technologies for organizational fit.Day to Day:One of Insight Global clients is looking for a Data Engineer to come join their team. This individual will be responsible for attending daily stand-up meetings to discuss projects, roadblocks, and priorities. They will check in on the status of overnight data pipeline runs and address any issues to ensure data integrity. The engineer will integrate new data sources into the data warehouse, collaborating with analysts and stakeholders to meet data requirements. They will also be responsible for performing data cleaning and transformation using tools like SQL and Python. Other responsibilities will include meeting with data scientists to support upcoming projects. They will also design and implement data models, optimize database performance, and build scalable data pipelines using cloud platforms. While document data processes and infrastructure changes. Additionally, they will respond to ad-hoc data requests, provide insights for decision-making, and tune data system performance.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We?re seeking a highly skilled Data Engineer to design, build, and maintain production-grade data pipelines that process and transform terabytes of data. This role involves close collaboration with... More data scientists and software engineers to ensure data infrastructure is scalable, reliable, and cost-effective.Pipeline Development & Deployment - Architect, develop, and deploy batch and streaming pipelines using Airflow and containerized workflows for cybersecurity use cases.Containerize data-processing jobs with Docker, orchestrate with Kubernetes, and manage releases using Helm charts.Distributed Computing - Build high-throughput data transformations using Dask or Apache Spark.Maintain training data clusters across hybrid environments (on-prem and cloud).Optimize training jobs for performance, resiliency, and cost efficiency.Monitoring & Reliability - Implement observability solutions (logging, metrics, alerting) to maintain pipeline health and SLA adherence.Troubleshoot, debug, and resolve data-processing failures in production environments.Collaboration & Best Practices - Work with cross-functional teams to define data contracts, schemas, and quality checks.Enforce software engineering best practices: CI/CD, code reviews, automated testing, and documentation.Data Modeling & Storage - Design and maintain data models and schemas for AI/ML continuous training use cases.Load and manage data in cloud storage and data lakes, ensuring performance and accessibility.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

?Responsible for developing, expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. ?Support software... More developers, database architects, data analysts and data scientists on data initiatives and ensure optimal data delivery architecture is consistent throughout ongoing projects. ?Creates new pipeline and maintains existing pipeline, updates Extract, Transform, Load (ETL) process, creates new ETL feature , builds PoCs with Redshift Spectrum, Databricks, AWS EMR, SageMaker, etc.; ?Implements, with support of project data specialists, large dataset engineering: data augmentation, data quality analysis, data analytics (anomalies and trends), data profiling, data algorithms, and (measure/develop) data maturity models and develop data strategy recommendations. ?Operate large-scale data processing pipelines and resolve business and technical issues pertaining to the processing and data quality. ?Assemble large, complex sets of data that meet non-functional and functional business requirements ?Identify, design, and implement internal process improvements including re-designing data infrastructure for greater scalability, optimizing data delivery, and automating manual processes ? ?Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies ?Building analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition? ?Working with stakeholders including data, design, product and government stakeholders and assisting them with data-related technical issues ?Write unit and integration tests for all data processing code. ?Work with DevOps engineers on CI, CD, and IaC. ?Read specs and translate them into code and design documents. ?Perform code reviews and develop processes for improving code quality. ?Perform other duties as assigned.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

A large media company is looking for a Sr. Data Engineer with analytics delivery experience to join their team. The day-to-day responsibilities will include:- 75% senior data engineering- 25%... More analytics delivery management (lead status calls, track status across 40 yearly initiatives, collaborating with Sr. Business Analyst)The ideal candidate will have a heavy coding/technical background with experience in project management and working cross-functionally. This is a hybrid 3x a week onsite in the Santa Monica location!We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

As a Data Center Building Engineer, you will be responsible for maintaining and operating all building systems to ensure continuous uptime, including fire and life safety, HVAC, plumbing, electrical... More infrastructure, emergency backup systems, and hot water equipment. Your duties include monitoring and adjusting mechanical and electrical systems such as chillers, boilers, pumps, generators, and switchgear, while recording equipment readings and making necessary corrections. You?ll troubleshoot issues, manage work orders through CMMS software, coordinate with vendors, respond to customer tickets, and follow emergency escalation procedures. A strong understanding of the site layout is essential for managing incidents that could impact critical systems, and you?ll be expected to handle hazardous materials safely while keeping your workspace clean. Additional responsibilities may be assigned as needed to support facility operationsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less