Job Search Results for data engineer

An employer in the Irvine area is seeking a Data Engineer. This is a hybrid position, with expectation to come into the office quarterly in addition to occasional meetings on site. Must sit in... More Southern California. The Data Engineer will be responsible for designing, implementing, and maintaining database architectures that support business applications and processes, assisting with the organization's goal to move from on prem to Microsoft Fabric (currently in a hybrid environment). This individual will focus on data ingestion, ETL processes, database security, and performance optimization within the Enterprise Data Warehouse. The Data Engineer will work with several stakeholders and business lines, including the infrastructure and data integration teams to help navigate the cloud infrastructure. Individual will be responsible for relaying requirements to reporting team and will help bridge the gap between development and production.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Responsibilities: *Write and review portions of detailed specifications for the development of system components of moderate complexity. *Complete moderate to complex bug fixes. *Work... More closely with other development team members, Quality Analysts and Business to understand product requirements and translate them into software designs. *Operate in various development environments (Agile, Waterfall, etc.) while collaborating with key stakeholders. *Resolve technical issues as necessary. *Keep abreast of new technology developments. *Make major code design and changes to new & existing products and be a primary point of contact for products they develop or own.Day-to-Day:This position performs complex research, design, and software development assignments within a specific software functional area or product line. This is an exciting opportunity to learn cutting edge, and dynamic technology built to make "Big Data" management easier and simpler. This role will include extracting, loading, cleansing, translating, manipulating, analyzing, linking and indexing massive amounts of data utilizing cutting edge technology and techniques. This position will have the opportunity to work alongside talented colleagues with a variety of skills and business/industry content knowledge and will collaborate closely with internal business stakeholders and technical teams to deliver a product experience that aims to exceed customer expectations.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for a data engineer contractor for one of their top financial clients. The following would be their roles and responsibilities:- Bachelor's degree in Computer... More Science/Information Systems or equivalent combination of education and experience.- Must be able to communicate ideas both verbally and in writing to management, business and IT sponsors, and technical resources in language that is appropriate for each group.- Four+ years of relevant IT experience in data engineering or related disciplines.- Significant experience with at least one major relational database management system (RDBMS).- Experience working with and supporting Unix/Linux and Windows systems.- Proficiency in relational database modeling concepts and techniques.- Solid conceptual understanding of distributed computing principles and scalable data architectures.- Working knowledge of application and data security concepts, best practices, and common vulnerabilities.- Experience in one or more of the following disciplines preferred: scalable data platforms and modern data architectures technologies and distributions, metadata management products, commercial ETL tools, data reporting and visualization tools, messaging systems, data warehousing, major version control systems, continuous integration/delivery tools, infrastructure automation and virtualization tools, major cloud platforms (AWS, Azure, GCP), or rest API design and development.- Previous experience working with offshore teams desired.- Financial industry experience, especially Regulatory Reporting, is a plus.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

As a critical member of the Assurance service team, the Data Engineer will acquire and analyze utility-scale electric power plant process data to develop and deploy machine learning-based forecasting... More and anomaly detection systems.Core Competencies ?Self-starting problem-solver, innovative, enterprising, data-driven ?Independent, resourceful, adaptable, and unafraid to fail and try again?Action-oriented individual who thrives with minimal supervision?Focused on value (why the client needs our product, value-add prospects, dollar focused, thinking outside the box) ?Willing to learn industry concepts/terminology and understand customer needs Responsibilities: ?Build, operate, and maintain production deployments of machine learning offerings via established Azure resources ?Problem-solve and modify deployments per specifications ?Remain responsible for deployments and servicing of customer requests?Clearly and concisely document deployments for each new customer ?Work with domain experts to discover and communicate value-add optimization prospects Compensation: $120-130k.Exact compensation may vary based on several factors, including skills, experience, and education.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

One of our large financial customers is seeking (3) Data Engineers. The Data Engineer will support our client's operational data platform by enhancing and maintaining data pipelines that power... More operational reporting and analytics. This includes modifying existing Java/Spring Batch pipelines, creating new ones as needed, optimizing data flows, and deploying to AWS environments. The role is hands-on with development, testing, and debugging, while working cross-functionally in an Agile, Kanban-style team.This is a contract, with the possibility of converting to a full time employee. This is a hybrid role, being on site every other week in Rhode Island or Texas. Compensation is based off many factors including experience, education, and more and this position offers a range of $55 - $75/hr.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We?re seeking a highly skilled Data Engineer to design, build, and maintain production-grade data pipelines that process and transform terabytes of data. This role involves close collaboration with... More data scientists and software engineers to ensure data infrastructure is scalable, reliable, and cost-effective.Pipeline Development & Deployment - Architect, develop, and deploy batch and streaming pipelines using Airflow and containerized workflows for cybersecurity use cases.Containerize data-processing jobs with Docker, orchestrate with Kubernetes, and manage releases using Helm charts.Distributed Computing - Build high-throughput data transformations using Dask or Apache Spark.Maintain training data clusters across hybrid environments (on-prem and cloud).Optimize training jobs for performance, resiliency, and cost efficiency.Monitoring & Reliability - Implement observability solutions (logging, metrics, alerting) to maintain pipeline health and SLA adherence.Troubleshoot, debug, and resolve data-processing failures in production environments.Collaboration & Best Practices - Work with cross-functional teams to define data contracts, schemas, and quality checks.Enforce software engineering best practices: CI/CD, code reviews, automated testing, and documentation.Data Modeling & Storage - Design and maintain data models and schemas for AI/ML continuous training use cases.Load and manage data in cloud storage and data lakes, ensuring performance and accessibility.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

?Responsible for developing, expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. ?Support software... More developers, database architects, data analysts and data scientists on data initiatives and ensure optimal data delivery architecture is consistent throughout ongoing projects. ?Creates new pipeline and maintains existing pipeline, updates Extract, Transform, Load (ETL) process, creates new ETL feature , builds PoCs with Redshift Spectrum, Databricks, AWS EMR, SageMaker, etc.; ?Implements, with support of project data specialists, large dataset engineering: data augmentation, data quality analysis, data analytics (anomalies and trends), data profiling, data algorithms, and (measure/develop) data maturity models and develop data strategy recommendations. ?Operate large-scale data processing pipelines and resolve business and technical issues pertaining to the processing and data quality. ?Assemble large, complex sets of data that meet non-functional and functional business requirements ?Identify, design, and implement internal process improvements including re-designing data infrastructure for greater scalability, optimizing data delivery, and automating manual processes ? ?Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies ?Building analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition? ?Working with stakeholders including data, design, product and government stakeholders and assisting them with data-related technical issues ?Write unit and integration tests for all data processing code. ?Work with DevOps engineers on CI, CD, and IaC. ?Read specs and translate them into code and design documents. ?Perform code reviews and develop processes for improving code quality. ?Perform other duties as assigned.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

A large media company is looking for a Sr. Data Engineer with analytics delivery experience to join their team. The day-to-day responsibilities will include:- 75% senior data engineering- 25%... More analytics delivery management (lead status calls, track status across 40 yearly initiatives, collaborating with Sr. Business Analyst)The ideal candidate will have a heavy coding/technical background with experience in project management and working cross-functionally. This is a hybrid 3x a week onsite in the Santa Monica location!We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

As a Data Center Building Engineer, you will be responsible for maintaining and operating all building systems to ensure continuous uptime, including fire and life safety, HVAC, plumbing, electrical... More infrastructure, emergency backup systems, and hot water equipment. Your duties include monitoring and adjusting mechanical and electrical systems such as chillers, boilers, pumps, generators, and switchgear, while recording equipment readings and making necessary corrections. You?ll troubleshoot issues, manage work orders through CMMS software, coordinate with vendors, respond to customer tickets, and follow emergency escalation procedures. A strong understanding of the site layout is essential for managing incidents that could impact critical systems, and you?ll be expected to handle hazardous materials safely while keeping your workspace clean. Additional responsibilities may be assigned as needed to support facility operationsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

A client is seeking a Data Engineer to support their data pipeline with the below responsibilities:?Design and develop scalable data pipelines to collect, process, and store large volumes of... More data.?Collaborate with data scientists and analysts to drive scope & requirements as well as deliver strong technical design of data analytics solutions.?Ensure data quality and integrity through cleansing processes, validation, and automated testing.$130,000 to $140,000 - Exact compensation may vary based on several factors, including skills, experience, and education. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less