Job Search Results for data engineer

Insight Global is looking for a Data Visualization engineer in the Warren, Michigan area. The engineer will be a part of a team that will be working to build a unified dashboard for data analytics... More using real-time and post-hoc data analysis techniques for human factors and biometric sensing experiments. This tool will be a closed-loop system that will incorporate data derived from human interaction with the driving simulator and biometric sensors which can be analyzed in real-time or post-hoc. The designed application(s) needs to work in real-time and follow some best practices so that the application is easily transferrable to different platforms, such as other driving simulators, vehicles, and similar technology.Compensation:$45/hr to $50/hrExact compensation may vary based on several factors, including skills, experience, and education. Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

A client is seeking a Senior Data Engineer to join their growing Data Engineering team! This person will will play a key role in shaping bothcustomer-facing and business-facing data products that... More align with their mission. Yourtechnical expertise and analytical acumen will contribute to designing and buildingextensive data sets that impact thousands of internal users and millions of members.Join a world-class data engineering team dedicated to advancing your skills and careerin data engineering and beyond.Essential Functions: -Collaborate with engineers, product managers, and data scientists tounderstand data needs and develop end-to-end data pipelines, solutions, andfoundational data sets-Design and own the data architecture for large-scale projects, making informeddecisions about design and operational trade-offs-Build, launch, and optimize sophisticated data pipelines, data models, andvisualizations that support diverse use cases across multiple products ordomains-Define and manage Service Level Agreements (SLAs) for all data sets withinareas of ownership-Implement data security models based on privacy requirements, ensurecompliance with safeguards, address data quality issues, and evolve datagovernance processes-Solve complex data integration challenges using optimal ETL/ELT patterns,frameworks, and query techniques for both structured and unstructured datasources-Maintain and enhance existing production processes by optimizing complexcode using advanced algorithmic concepts-Optimize pipelines, dashboards, frameworks, and systems to streamline dataartifact development-Mentor team members, providing and receiving actionable feedback to fosterskill growth and collaborationWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

?Design, build, and maintain highly scalable and reliable data pipelines to move and transform data across large-scale, distributed systems at exabyte scale.?Architect, implement, and deploy new data... More models and data processing workflows in production, ensuring data quality, integrity, and compliance with data privacy regulations.?Collaborate with cross-functional teams ? including software engineers, data scientists, and product managers ? to understand data requirements and deliver effective, high-impact solutions.?Develop and optimize data-driven systems and solutions to enhance operational scale, efficiency, and generate actionable business insights aligned with evolving product and business needs.?Work closely with engineering teams to plan and execute on half-yearly roadmaps that align with business priorities and available engineering capacity.?Perform data quality monitoring, root cause analysis, and proactive resolution of data pipeline issues to ensure high reliability and trust in data assets.?Develop comprehensive documentation for all data pipelines, models, and related processes, and cross-train team members on new and evolving data systems.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are looking for a Junior Data Engineer with 1?3 years of experience who is eager to learn and grow in cloudbased data engineering. The candidate should have basic exposure to GCP services, data... More workflows, or Airflow-based orchestration. A strong willingness to take responsibility, learn new tools, and adapt quickly is essential. Key Responsibilities ? Support in building and maintaining data pipelines and workflow processes. ? Work with data related GCP services such as Cloud Run, Cloud Functions, and Composer. ? Take responsibility for assigned tasks and ensure timely completion. ? Learn and adopt best practices for performance, reliability, and code quality.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking to hire a Sr. Data Engineer for a retail client based in Vancouver. This role is a hybrid position and requires 3 days onsite per week in Downtown Vancouver. You will be... More joining a team that works heavily with customer data?owning the customer data pipelines that gather data coming from multiple sources and consolidating that data for different use cases. Some use cases include segmentation, data and analytics, advanced analytics for ML models to generate product recommendations, etc.You will have a strong knowledge of the Azure infrastructure and can build Azure pipelines. You will make general recommendations to the client on how to improve the current infrastructure. This role is not tied to a certain body of work; rather, you will support multiple workstreams and work with the Product teams to prioritize. Other duties and responsibilities include:Data pipeline creation and maintenanceStack: GCP, Azure Cloud, Azure Databricks, SnowflakeIncludes engineering documentation, knowledge transfer to other engineers, future enhancements, and maintenanceCreate secure data views and publish them to the Enterprise Data Exchange via Snowflake for other teams to consumeData pipeline modernization and migration via Databricks Delta Live Tables (DLT) and Unity CatalogLeverage existing CI/CD processes for pipeline deploymentAdhere to PII encryption and masking standardsOrchestration tools: ADF, Airflow, FivetranLanguages: SQL, PythonData Modeling: Star and Snowflake schemasStreaming: Kafka, Event Hubs, Spark, Snowflake StreamingDevOps Support: Support improvements for current CI/CD processesProduction monitoring and failure supportWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Lead AI Data Engineer to sit hybrid at a Cybersecurity client in Frisco, Texas. You will join their eCommerce Operational Intelligence team, building enterprise-scale data... More pipelines and analytics foundations (SQL, Spark/PySpark, ETL/ELT) that produce reliable operational insights and measurable business impact.You will drive the transformation of eCommerce operational analytics and real-time monitoring by building scalable data pipelines, AI-powered insights, and intelligent dashboards. This role leads AI proof-of-concepts and contributes to production-grade solutions that improve platform reliability, accelerate root-cause identification, enhance engineering productivity, and strengthen operational intelligence across their eCommerce ecosystem.Day to Day: -Build and operate production ETL/ELT pipelines processing millions of eCommerce events daily and order trends. -Write and tune complex SQL for operational analytics, KPIs, and reporting. -Design analytics-ready schemas and data models for performance and scale. -Troubleshoot pipelines, microservices, and APIs; apply observability to isolate root causes. -Integrate data across eCommerce, MarTech, and operational systems into unified insights. -Build AI-driven anomaly detection/notification. (This role can pay $200,000 - 220,000 based on years of experience).We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are seeking a highly skilled Software Engineer with expertise in Python, AWS, and coding best practices. The ideal candidate will have a strong background in software development, cloud computing.... More You will be responsible for developing and maintaining scalable software solutions that power our products and services.Key Responsibilities:?Design, develop, and maintain high-quality software solutions using Python.?Utilize AWS services to build, deploy, and manage applications in the cloud.?Has strong knowledge of cloud data engineering principles and manages Python based data pipelines.?Write clean, maintainable, and efficient code.?Collaborate with cross-functional teams to define, design, and ship new features.?Troubleshoot and resolve complex technical issues and bugs.?Perform code reviews and provide constructive feedback to peers.?Stay up-to-date with the latest industry trends and technologies to ensure our solutions remain current and competitive.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Senior Data Engineer (Full Stack Data Engineer) for a top media and entertainment client. This individual will join a highly visible data engineering team supporting... More critical analytics and AI initiatives used at the SVP and President level. The role is heavily hands-on, focused on building and scaling batch ETL pipelines using Databricks, Spark, SQL, and Python. The ideal candidate is technically deep, thrives in complex data environments, and enjoys mentoring junior engineers while working closely with data science teams to enable advanced analytics and machine learning use cases.Day-to-Day:Build and maintain batch ETL pipelines in DatabricksDevelop new data pipelines (net-new development, not just maintenance)Write complex, high-performance SQL queriesPerform data modeling to support analytics and data science use casesEnsure data quality, governance, and observabilityIntegrate and manage complex datasets from multiple sources (TV, digital, ad sales)Partner closely with Data Science and AI teamsMentor and support early-career and junior engineersCollaborate with stakeholders across multiple time zonesWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Title: Lead Data EngineerLocation: Hybrid in SF (Tuesdays onsite)Openings: 1Work Schedule: (available until 12 am PT time to overlap with onshore team)Follow-Up Meeting: After each interview is... More scheduled.Contract Type: 12 months contract extensionsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Data/AI Engineer you should be curious to learn new and complex technologies, have a drive to contribute new ideas for future development, and be passionate about writing... More reliable, efficient, and maintainable code. You will be expected to build and improve software by working with a Product Owner, Scrum Master, and other Engineers by translating functional requirements into robust, scalable, and supportable solutions. You will participate in the full development lifecycle and actively troubleshoot issues in support of applications in production critical environments. ?Integrate AI capabilities, such as LLMs, into enterprise web applications using standard APIs.?Identify and prepare data for use in an LLM?Engineers prompts for a large language model to maximize use of knowledge repositories and improve accuracy and relevance of LLM outputs.?Assists in the Design, development, documentation, testing, and debugging applications software and systems that contain logical and mathematical solutions. ? Develop well-written code using provided coding standards ? Testing software using a Test Procedure or Requirements document and documenting/correcting any errors found.Compensation:$49/hr to $52/hr.Exact compensation may vary based on several factors, including skills, experience, and education.Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less