Job Search Results for data engineer

Insight Global is looking for a Data Visualization engineer in the Warren, Michigan area. The engineer will be a part of a team that will be working to build a unified dashboard for data analytics... More using real-time and post-hoc data analysis techniques for human factors and biometric sensing experiments. This tool will be a closed-loop system that will incorporate data derived from human interaction with the driving simulator and biometric sensors which can be analyzed in real-time or post-hoc. The designed application(s) needs to work in real-time and follow some best practices so that the application is easily transferrable to different platforms, such as other driving simulators, vehicles, and similar technology.Compensation:$45/hr to $50/hrExact compensation may vary based on several factors, including skills, experience, and education. Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are seeking a skilled Data Engineer to design, build, and optimize large-scale batch data pipelines in a cloud environment. This role focuses on reliability, performance, and data quality,... More supporting analytics and downstream consumers through well-engineered big-data solutions. The ideal candidate has strong experience with Apache Spark, cloud data platforms (GCP preferred), and writing performant SQL at scale.Key ResponsibilitiesDesign, develop, and maintain batch data pipelines using Apache Spark, Hadoop, Hive, or similar frameworks in a cloud environment.Build highly optimized, fault-tolerant, and SLA-driven data pipelines that operate reliably at scale.Leverage Google Cloud Platform (GCP) services such as BigQuery, GCS, Dataproc, and Pub/Sub to support data ingestion, processing, and storage.Write and optimize SQL queries (BigQuery SQL and/or Spark SQL) for data analysis, profiling, and performance tuning.Collaborate closely with analytics, data science, and downstream consumers to ensure data availability, correctness, and usability.Monitor and troubleshoot pipeline failures; implement alerting, retries, and data quality checks.Improve pipeline performance through partitioning, clustering, resource tuning, and query optimization.Follow software engineering best practices, including version control, testing, and documentation.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for an AWS Data Engineer to join one of our financial clients and help with an ongoing project. This resource will be responsible to helping unify store data in order to... More unify legacy systems across various lines of businesses. This resource should have an ETL background with a strong focus on data engineering, specifically with AWS. Candidates will be responsible for working independently creating code, testing AWS pipelines, running through and managing requirements, data analysis and helping to enhance existing models.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are seeking a highly skilled Software Engineer with expertise in Python, AWS, and coding best practices. The ideal candidate will have a strong background in software development, cloud computing.... More You will be responsible for developing and maintaining scalable software solutions that power our products and services.Key Responsibilities:?Design, develop, and maintain high-quality software solutions using Python.?Utilize AWS services to build, deploy, and manage applications in the cloud.?Has strong knowledge of cloud data engineering principles and manages Python based data pipelines.?Write clean, maintainable, and efficient code.?Collaborate with cross-functional teams to define, design, and ship new features.?Troubleshoot and resolve complex technical issues and bugs.?Perform code reviews and provide constructive feedback to peers.?Stay up-to-date with the latest industry trends and technologies to ensure our solutions remain current and competitive.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We?re looking for a Senior Data Engineer - Purview Enablement to support the setup and operationalization of Microsoft Purview for data governance use cases. This role will focus on hands-on... More configuration, integration, and scanning of enterprise systems so data can be catalogued, classified, tagged, and managed more effectively across the environment.The ideal candidate brings practical experience working with Microsoft Purview and related data platforms, along with the technical ability to connect Purview to source systems and support governance-related data workflows. Experience with Microsoft Fabric, Snowflake, and other relevant technologies is preferred, but the key focus is on hands-on implementation rather than broad governance consulting.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

As data operations engineer, you will collaborate with various infrastructure teams, platforms, product, engineering and scientists, to identify requirements that will derive the creation of sensible... More operations to build and manage data analytics foundations. The ideal candidate is a self-motivated teammate with good problem solving and communication skills with the ability to adapt and learn quickly, provide results with limited direction, and choose the best possible operational decisions.KEY RESPONSIBILITIES?Lead day-to-day operations to ensure organizational delivery of quality results.?Responsible for provisioning, enabling, scaling and maintaining our team?s data, analytics and ML infrastructures for batch and real time systems including pipelines, frameworks, tools and services in hybrid cloud.?Shepherd zero-downtime deployment process through continuous delivery practices, rapidly releasing features that provide critical and faster insights to business users.?Collaborate with the platform team by building the right tools for observability , monitoring, alerting and self-healing for the day to day management of analytics foundations.?Debug complex problems in distributed environment and ability to run the prod incidents efficiently to following up with Post incident reviews.?Developing self-service tools and automation to improve engineering efficiency and the quality of services.?Excellent verbal and written communication skills.?Self-starter with forward thinking capability with strong executional track record and be accountable for business priorities.?Hands-on experience with CI/CD pipelines and cloud environments like Gitlab, Spinnaker, Docker/Kubernetes observability using Splunk, Grafana/Data dog is a huge plus.?Proficient with one or more programming languages such as Python/Go/Rust/Java/Scala for automation and API integrations.?Experience in implementing security controls, governance processes, compliance validation, infrastructure cost analysis and optimization.?Knowledge of analytics and Applied ML stack like Apache Spark, Trino/Pinot, Iceberg, Atlas, Flink, Airflow/Luigi, Tableau, Snowflake, Databricks, MLFlow, Data Catalogs, Jupyter Notebooks, Vector database and Cassandra.?Solid understanding of IAAC (infrastructure as a code) techniques like terraform, orchestration and tooling.?Experience scaling operations in a fast-paced and dynamic environment. Experience working in agile or evolving product environments.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

One of Insight Global?s customers is looking to onboard a Data Center Administrator to their team. This role supports the internal data center team across multiple locations, including a primary data... More center in Los Angeles and an Irvine campus with small server rooms in each building. The Data Center Admin will focus heavily on physical data center operations, including racking and stacking equipment, cabling, rack distribution, and supporting rack rebuild projects. They will assist with network connectivity initiatives by running and connecting cables, verifying connections, and checking the status and quality of completed work across campus server rooms. In addition, the role will handle basic operational tasks following hardware repairs or replacements, leveraging strong Linux experience to log into servers and perform post-repair validation or system checks. The position is a 3-6 month contract and requires hybrid work and travel between the Irvine campus and LA data center as needed for specific projects, with no on-call responsibilities.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Senior Data Engineer (Full Stack Data Engineer) for a top media and entertainment client. This individual will join a highly visible data engineering team supporting... More critical analytics and AI initiatives used at the SVP and President level. The role is heavily hands-on, focused on building and scaling batch ETL pipelines using Databricks, Spark, SQL, and Python. The ideal candidate is technically deep, thrives in complex data environments, and enjoys mentoring junior engineers while working closely with data science teams to enable advanced analytics and machine learning use cases.Day-to-Day:Build and maintain batch ETL pipelines in DatabricksDevelop new data pipelines (net-new development, not just maintenance)Write complex, high-performance SQL queriesPerform data modeling to support analytics and data science use casesEnsure data quality, governance, and observabilityIntegrate and manage complex datasets from multiple sources (TV, digital, ad sales)Partner closely with Data Science and AI teamsMentor and support early-career and junior engineersCollaborate with stakeholders across multiple time zonesWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

An Insight Global client is looking to hire a Sr. Data Engineer to join their team of 16 in Arlington, VA. This is a very dynamic team that juggles multiple projects at one time. We are looking for... More someone to be an architect, developer and mentor to junior level team members. You can expect 75% of your day to be dedicated to coding while the remaining 25% will split between mentorship and meetings. This role will consist of primarily internal projects, with about 10% being client facing. We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

The AI Center of Excellence has built a portfolio of over 100 AI opportunities across a client of IG, with 10+ active projects delivering validated prototypes to business stakeholders. The CoE has... More proven its ability to rapidly prototype AI solutions ? multiple projects have achieved validated results within weeks. However, the consistent pattern across all active projects is the same: the path from prototype to production requires dedicated data engineering capabilities that the CoE does not currently have.Today, data preparation consumes approximately 45-55% of the AI Solution Architect's time ? time that should be spent on architecture, stakeholder engagement, and new opportunity development. Every prototype relies on manual data exports (Excel, CSV) rather than automated pipelines connected to enterprise systems. This bottleneck limits both the number of projects the CoE can support and the speed at which validated prototypes can reach production.The AI Data Engineer will be embedded within the CoE, focused on building the data pipelines and enterprise integrations needed to move AI solutions from prototype to production. This role is the critical enabler for the clients $10M incremental EBITDA target ? without production-grade data infrastructure, validated prototypes remain prototypes.Compensation:$45/hr to $55/hr Exact compensation may vary based on several factors, including skills, experience, and education.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less