Job Search Results for big data

Senior Data Engineer

Insight Global is looking to add a 2 Data Engineers to our client's team who are headquartered in the St. Louis area but can sit remotely. They will be responsible for moving applications from one... More environment to another in addition to ensuring every component has been upgraded and will also be responsible for modernizing the framework as well. They will need someone to come in and support development efforts across the enterprise and will interact with multiple different application owners & software vendors so communication is very important. They will be using Apache Spark, Apache Iceberg, and Apache Airflow for ETL pipelines. This person will transform and integrate EBCDIC Mainframe data into Hive and Impala tables using Precisely Connect for Big Data, optimize data transformation processes for performance, scalability, and reliability, and ensure data consistency, accuracy, and quality across the ETL pipelines. This person will function as the point of escalation for ETL loads, data quality issues, and production support issues, monitor ETL workflows and troubleshoot issues to ensure smooth production operations and implement proactive monitoring, alerting, and reporting solutions to improve pipeline reliability. This individual will be responsible for supporting and rebuilding legacy ETL jobs (currently not using ACID transactions) with modern solutions using Apache Spark and Apache Iceberg to support ACID transactions. They will be overseeing design, and implement workflows for automating data pipelines using Apache Airflow as well as establishing and enforcing best practices for ETL code development, version control, and deployment using Azure DevOps.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Data Labeling SME

We are seeking a data labeling SME. The Data Labeling Subject Matter Expert will be responsible for overseeing and ensuring the accuracy and quality of data labeling processes. This role requires a... More deep understanding of HIPPA, PII, and data annotation techniques, tools, and best practices. The targeted pay range is $50-65/hour.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Sr Data Engineer - Palantir

Insight Global is looking for a Senior Palantir Data Engineer to work remotely for one of our client's based out of Kansas City. This person will be responsible for putting efforts towards a resource... More management tool. There is a lot of rework that needs to be done within this platform so ideally, this person has technical leadership that can spearhead this platform onto the right track. This position also includes having to design and build data pipelines that would then transform raw data to clean datasets. The position is focused on developing and maintaining ETL/ELT workflows that would ensure quality for users. A lot of the data is currently handled in data bricks. This position is very hands on when it comes to coding, querying, and troubleshooting. The platform that this person is dedicated to supported is hosted within an GCP environment. Since we are seeking a well experienced candidate, ideally this person will understand how to implement best practices that influence data governance and reliability. This candidate will join a team of 3 other Palantir experts that are currently supporting a spread of different projects.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Ontology Data Modeler

A Fortune 100 client's Aviation Analytics program is seeking an Ontology Data Modeler to join their team. This individual will design and implement ontologies to accurately represent manufacturing... More processes, part configurations, supply chain hierarchies, logistics, quality events, and compliance frameworks. They will collaborate with domain experts across engineering, quality, logistics, and IT to formalize vocabulary and relationships using standards such as OWL, RDF, and SHACL. Additionally, they will develop and maintain knowledge graphs integrating data from MES, ERP, PLM, QMS, and IoT sources, supporting digital twin, root cause analysis, predictive quality, and sustainability efforts. The individual will implement reasoning engines and validation rules to infer product dependencies, identify anomalies, and ensure data integrity. They will be responsible for driving the development of semantic metadata and tagging strategies for advanced search, lineage tracing, and knowledge reuse, aligning ontological structures with enterprise data strategies and digital engineering initiatives, including MBSE. The ability to articulate ideas clearly, effectively engage with stakeholders, and communicate the process and benefits of ontology creation is vital for this position.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

INTL- MEXICO Data Engineer

Insight Global is seeking a Data Engineer in Mexico for one of our top manufacturing clients. This candidate can sit anywhere fully remote in Mexico. In this role you will be joining the Corporate... More Enterprise Data Engineering Team. As an engineer you will need to have professional experience in data integration, data transformation and developing data pipelines. You will be designing data models and data storage solutions in an Azure cloud environment, need to have proficiency in Python as a programming language along with Scala and some Java, be able to build processes to support data transformation, data structures, metadata, dependency, and workload management, experience with API based data management and acquisition and communicate technical and business acumen in both Spanish and English proficiently. Day to Day: * Design data models and data storage solutions in the cloud (Azure) * Program with languages commonly used in data engineering: Python (primary), Java, or Scala * Build processes supporting data transformation, data structures, metadata, dependency, and workload management * API based data acquisition and management * Conduct data storage and processing technologies including (Hadoop, Spark, Kafka, SQL databases) * Work with data scientists to facilitate technical design of complex data sourcing, transformation, and aggregation logic, ensuring business analytics requirements are met * Work with big data pipelines to develop streaming analytics * Utilize business intelligence data visualization tools and techniques to translate business analytics into solutions * Work with parallel processing / multithreading and compute optimization * Communicate in an articulate and poised manner technical / business information Collaborate with management to prioritize business and information needsWe are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

GCP Data Engineer

Insight Global is seeking a Data Engineer to support customer reporting initiatives within a large healthcare technology organization. This individual will be responsible for pipeline development... More using Python, SQL and GCPWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Remote Sr. Utility Data Scientist

? Support business unit strategic planning while providing a strategic view on machine learning technologies.? Advice and counsel key stakeholders on machine learning findings and recommend courses... More of action that redirect resources to improve operational performance or assist with overall emerging business issues.? Provide key stakeholders with machine learning analyses that best positions the company going forward.? Educate key stakeholders on the organizations advance analytics capabilities through internal presentations, training workshops, and publications.$55/hr to $65/hr.Exact compensation may vary based on several factors, including skills, experience, and education.Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Remote Senior Solution Architect (Data, Cloud & AI Architecture

Senior Solution Architects (Data, Cloud & AI Architecture), These are India-based IC roles supporting multiple global programs. The initial engagement is 3 months, with the possibility of a 12-month... More renewal based on performance. If you?d like more information, I?m happy to share further context, see the role details and expectations below.Role Overview : Sr. Solution Architect with extensive experience in data architecture, , cloud services (Azure preferred), good databricks working experience and AI-driven solutions. This role focuses on designing scalable, secure, and high-performance data and AI solutions, collaborating with cross-functional teams, and ensuring best practices in data governance and security. Key Responsibilities:Design and implement scalable cloud-native solutions on Azure, ensuring security and performance.Architect end-to-end data solutions, Ownership , integrating data sources, processing systems, and AI/ML platforms.Build conceptual & logical architectures for data-driven programs.Provide guidance on data pipelines, ETL/ELT workflows, and data integration.Provide guidance on cost-effective solutions that are scalable and performantImplement data governance frameworks, ensuring data quality and compliance.Collaborate with stakeholders to understand requirements and deliver innovative solutions.Mentor team members and provide technical guidance where needed.They have to have the ability to solve for the following problems: Example1 : work on different streams. IE: there is a data SaaS model in europe but we are in databricks. How can I send this data to them? I would look at the data, size, confidentiality, cost, how they could accept it, how are pepsico standards and governance policies, etc.Example 2: I want to do a cloud migration. Where do I start? How do I do data discovery?We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

CPQ Developer - INTL - India

Insight Global is looking for an experienced Oracle CPQ Modeler (formerly known as Big Machines) to join the modeling team at one of our clients . The CPQ Developer will be a key member of our... More Strategic Enablement team, working closely with product configuration managers for New Product Introduction (NPI). This role involves utilizing Business Markup Language (BML) and Configure, Price, Quote (CPQ) tools to achieve team goals. Working with product configuration managers for NPI integration, work to create upgrades and enhancements. This role is fully remote and offers a dynamic and fast-paced work environment. The CPQ Developer will have the opportunity to make significant contributions to our product and configuration initiatives. PR: $10-$11We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Developer BI Analyst

Insight Global is seeking a Developer BI Analyst to design, develop, and optimize business intelligence solutions that drive healthcare intake analytics and reporting. This role focuses on building... More advanced data models, predictive analytics, and interactive dashboards to support critical decision-making across clinical, HR, finance, and operations domains.The successful candidate will have strong programming expertise in Python, advanced problem-solving skills, and experience with Power BI for visualization. This is an exciting opportunity to work on impactful BI initiatives, develop machine learning models, and deliver insights consumed by hundreds of business users. The ideal candidate will be mid-to-senior level, enthusiastic about learning, and eager to grow toward full-stack engineering responsibilities.Compensation: $110,000?$120,000 annually with full benefits, PTO, holiday PTO, and 401k match.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less