Job Search Results for big data

Data Labeling SME

We are seeking a data labeling SME. The Data Labeling Subject Matter Expert will be responsible for overseeing and ensuring the accuracy and quality of data labeling processes. This role requires a... More deep understanding of HIPPA, PII, and data annotation techniques, tools, and best practices. The targeted pay range is $50-65/hour.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Senior Data Engineer

Insight Global is looking to add a 2 Data Engineers to our client's team who are headquartered in the St. Louis area but can sit remotely. They will be responsible for moving applications from one... More environment to another in addition to ensuring every component has been upgraded and will also be responsible for modernizing the framework as well. They will need someone to come in and support development efforts across the enterprise and will interact with multiple different application owners & software vendors so communication is very important. They will be using Apache Spark, Apache Iceberg, and Apache Airflow for ETL pipelines. This person will transform and integrate EBCDIC Mainframe data into Hive and Impala tables using Precisely Connect for Big Data, optimize data transformation processes for performance, scalability, and reliability, and ensure data consistency, accuracy, and quality across the ETL pipelines. This person will function as the point of escalation for ETL loads, data quality issues, and production support issues, monitor ETL workflows and troubleshoot issues to ensure smooth production operations and implement proactive monitoring, alerting, and reporting solutions to improve pipeline reliability. This individual will be responsible for supporting and rebuilding legacy ETL jobs (currently not using ACID transactions) with modern solutions using Apache Spark and Apache Iceberg to support ACID transactions. They will be overseeing design, and implement workflows for automating data pipelines using Apache Airflow as well as establishing and enforcing best practices for ETL code development, version control, and deployment using Azure DevOps.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Azure Data Analyst - INTL India

A client is looking for a Data Analyst/Engineer to join their team in India. They will be supporting our platform, Mosaic which delivers a systemized capability for the complete planning &... More forecasting process by each customer, product, and business unit across the sector, as well as reporting analytics for actuals. They will use Databricks to gather, cleanse, transform and analyze large datasets in preparation for data scientists to build data models with. They will then use Synapse Analytics to integrates big data and data warehousing to query structured and unstructured data as well ata Teradata to handle enterprise-level data warehousing with SQL-based transformations. Involved in stakeholder management, guiding them with data driven insights.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Azure Data Engineer - INTL LATAM

A client is looking for a Data Engineer to join their team in Mexico. They will be supporting our platofrm, Mosaic which delivers a systemized capability for the complete planning & forecasting... More process by each customer, product, and business unit across the sector, as well as reporting analytics for actuals. They will use Databricks to gather, cleanse, transform and analyze large datasets in preparation for data scientists to build data models with. They will then use Synapse Analytics to integrates big data and data warehousing to query structured and unstructured data as well ata Teradata to handle enterprise-level data warehousing with SQL-based transformations. Involved in stakeholder management, guiding them with data driven insights.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

MDO Fuse Data Governance Lead

Insight Global is seeking a MDO Fuse Data Governance Lead to join a Big Four consulting company to support a SAP S4HANA implementation for a client in the energy sector. This is a 6 month contract to... More start, with high likeihood of extension to 18 months in total. The candidate will sit fully remote (Canada or US) with occasional travel (once per month or as needed) to the client site in Calgary, AB. You will support the project starting at design phase and work technically to configure workflows/integrations, but also work with the client to gather requirements and present what has been built.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

SR. Data Engineer

A client of Insight Global, a leading telecommunications provider serving millions of customers, is seeking a Senior Data Engineer to join its Network Analytics team. This role is pivotal in... More designing and maintaining the data infrastructure that powers enterprise-scale network operations. You will lead efforts to build scalable ETL pipelines using Spark, optimize data storage solutions, and ensure data quality and availability for advanced analytics. Leveraging AWS cloud technologies, you will implement robust monitoring and alerting systems, manage deployment pipelines for continuous integration, and collaborate across teams to align data solutions with business objectives. Beyond technical execution, you will provide strategic guidance on data engineering best practices, document standards, and communicate insights effectively to stakeholders with diverse technical backgrounds. This position offers the opportunity to drive innovation, enhance operational efficiency, and influence data-driven decision-making at scale.This role will pay between $60-70 per hour based on experience.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Data Engineer

A Fortune 100 automotive client is seeking a remote Data Engineer to design, build, and enable scalable AI and machine learning solutions within a data-driven platform supporting manufacturing and... More operational analytics use cases. This role is responsible for cloud platforms, and distributed data processing, while also possessing the communication skills to bridge the gap between diverse application teams. This role will play a key part in supporting centralized enterprise data hubs and foundational AI proof-of-concept initiatives within a manufacturing setting.? Design, build, and maintain scalable data pipelines for ingesting and processing data from enterprise systems, local databases, and operational platforms? Develop and optimize ETL / ELT workflows for large-scale data processing? Act as a technical bridge between various application teams to ensure seamless data integration and alignment on AI data requirements? Support both batch and real-time data systems across manufacturing environments? Integrate data from operational systems and Industrial IoT platforms into centralized enterprise data hubs? Ensure data quality, integrity, observability, and performance optimization? Collaborate with software engineers, AI engineers, and business stakeholders to define data requirements? Support data modelling and data architecture for analytics, reporting, and AI consumption? Enable data availability for business intelligence and downstream AI applications? Support proof-of-concept execution for foundational AI initiatives within a manufacturing environmentWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

LATAM Sr. Data Validation Engineer - REMOTE

Insight Global is seeking a Data Validation Engineer for an end client to join its QA Automation organization and serve as the team's subject matter expert for data quality and validation. This... More individual will be responsible for validating large-scale datasets, analytics platforms, and ETL pipelines that support Paramount's streaming and digital products. The ideal candidate will have strong Python and SQL skills, experience working with BigQuery and cloud-based data environments, and a proven background validating data accuracy, completeness, and consistency. This role will also leverage AI tools and large language models (LLMs) to enhance data validation processes, automate analysis, improve anomaly detection, and accelerate root cause investigation. The Data Validation Engineer will partner closely with QA Automation Engineers, Data Engineers, and business stakeholders to ensure trusted data is available for reporting, analytics, and downstream testing efforts.Responsibilities?Own end-to-end data validation efforts across large-scale data pipelines and analytics platforms?Validate data movement through ETL/ELT processes and identify discrepancies between source and target systems?Develop and maintain Python-based data validation, reconciliation, and quality-checking scripts?Write SQL queries to analyze data, investigate issues, and verify business logic?Perform source-to-target validation across BigQuery and cloud-based data platforms?Troubleshoot data quality issues and perform root cause analysis?Leverage AI/LLM technologies (Claude, ChatGPT, Copilot, etc.) to generate and optimize validation rules, SQL queries, reconciliation logic, and analysis summaries?Utilize AI-assisted techniques for anomaly detection, trend analysis, and identification of data inconsistencies?Partner with QA Automation Engineers to ensure reliable, trusted data is available for downstream testing efforts?Support validation of analytics generated across web, mobile, and connected TV (CTV) platforms?Collaborate within Agile teams using Jira and ConfluenceWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

INTL- MEXICO Data Engineer

Insight Global is seeking a Data Engineer in Mexico for one of our top manufacturing clients. This candidate can sit anywhere fully remote in Mexico. In this role you will be joining the Corporate... More Enterprise Data Engineering Team. As an engineer you will need to have professional experience in data integration, data transformation and developing data pipelines. You will be designing data models and data storage solutions in an Azure cloud environment, need to have proficiency in Python as a programming language along with Scala and some Java, be able to build processes to support data transformation, data structures, metadata, dependency, and workload management, experience with API based data management and acquisition and communicate technical and business acumen in both Spanish and English proficiently. Day to Day: * Design data models and data storage solutions in the cloud (Azure) * Program with languages commonly used in data engineering: Python (primary), Java, or Scala * Build processes supporting data transformation, data structures, metadata, dependency, and workload management * API based data acquisition and management * Conduct data storage and processing technologies including (Hadoop, Spark, Kafka, SQL databases) * Work with data scientists to facilitate technical design of complex data sourcing, transformation, and aggregation logic, ensuring business analytics requirements are met * Work with big data pipelines to develop streaming analytics * Utilize business intelligence data visualization tools and techniques to translate business analytics into solutions * Work with parallel processing / multithreading and compute optimization * Communicate in an articulate and poised manner technical / business information Collaborate with management to prioritize business and information needsWe are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Data Engineer - INTL - Europe

We are seeking an experienced Data Engineer to join our Global Digital Commerce team and help build scalable, cloud-based data products that power international growth. This role is responsible for... More the end-to-end development of data pipelines, including data modeling, testing, monitoring, and production support. Working closely with product, architecture, and engineering teams, you will deliver high-quality data solutions, drive best practices, and improve data quality across a complex global ecosystem. This is an opportunity to shape the future of digital commerce within a fast-paced, innovative, and entrepreneurial environment. Team & Key ProjectsThe next great shift in consumer behavior driven by technological disruption is underway, and it?s happening in the food & beverage industry. As other sectors have shifted to Digital Commerce-first business models in recent years, food & beverage has continued to rely predominantly on traditional brick & mortar models, but this is changing rapidly. New technologies are transforming every aspect of reaching consumers, from the rise of digital marketing and online grocery platforms to the creation of supply chain tools that enable speedy at-home delivery. Although we are a large multinational company, our Global Digital Commerce Team prides itself on having the entrepreneurial, action-oriented culture of an exciting startup business. Our group includes startup founders, Silicon Valley veterans, food & beverage experts, and seasoned executives from digital transformation leaders such as Amazon and Walmart. Our goal is to build the technological products and capabilities that will reinvent our industry and make us the #1 food & beverage business in Digital Commerce for decades to come Accountabilities:?Own data pipeline development end-to-end, spanning data modeling, testing, scalability, operability and ongoing metrics.?Contribute to best practices for engineering, and coding as part of a world class engineering team ?Work with the product team leveraging our core technology platforms?Collaborate in architecture discussions and architectural decision making that is part of continually improving and expanding these platforms.?Focus on delivering high quality data pipelines and tools through careful analysis of system capabilities and feature requests, peer reviews, test automation, and collaboration with QA engineers?Introduce new tools / practices to improve data and code quality; this includes researching / sourcing 3rd party tools and libraries, as well as developing tools in-house to improve workflow and quality for all data engineers?Support data pipelines developed by your team through good exception handling, monitoring, and when needed by debugging production issues?Extremely comfortable working with data, including managing large number of data sources, analysing data quality, and pro-actively working with client?s data/ IT teams to resolve issuesWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less