Job Search Results for big data

Senior Data Engineer

Insight Global is looking to add a 2 Data Engineers to our client's team who are headquartered in the St. Louis area but can sit remotely. They will be responsible for moving applications from one... More environment to another in addition to ensuring every component has been upgraded and will also be responsible for modernizing the framework as well. They will need someone to come in and support development efforts across the enterprise and will interact with multiple different application owners & software vendors so communication is very important. They will be using Apache Spark, Apache Iceberg, and Apache Airflow for ETL pipelines. This person will transform and integrate EBCDIC Mainframe data into Hive and Impala tables using Precisely Connect for Big Data, optimize data transformation processes for performance, scalability, and reliability, and ensure data consistency, accuracy, and quality across the ETL pipelines. This person will function as the point of escalation for ETL loads, data quality issues, and production support issues, monitor ETL workflows and troubleshoot issues to ensure smooth production operations and implement proactive monitoring, alerting, and reporting solutions to improve pipeline reliability. This individual will be responsible for supporting and rebuilding legacy ETL jobs (currently not using ACID transactions) with modern solutions using Apache Spark and Apache Iceberg to support ACID transactions. They will be overseeing design, and implement workflows for automating data pipelines using Apache Airflow as well as establishing and enforcing best practices for ETL code development, version control, and deployment using Azure DevOps.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Data Labeling SME

We are seeking a data labeling SME. The Data Labeling Subject Matter Expert will be responsible for overseeing and ensuring the accuracy and quality of data labeling processes. This role requires a... More deep understanding of HIPPA, PII, and data annotation techniques, tools, and best practices. The targeted pay range is $50-65/hour.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Ontology Data Modeler

A Fortune 100 client's Aviation Analytics program is seeking an Ontology Data Modeler to join their team. This individual will design and implement ontologies to accurately represent manufacturing... More processes, part configurations, supply chain hierarchies, logistics, quality events, and compliance frameworks. They will collaborate with domain experts across engineering, quality, logistics, and IT to formalize vocabulary and relationships using standards such as OWL, RDF, and SHACL. Additionally, they will develop and maintain knowledge graphs integrating data from MES, ERP, PLM, QMS, and IoT sources, supporting digital twin, root cause analysis, predictive quality, and sustainability efforts. The individual will implement reasoning engines and validation rules to infer product dependencies, identify anomalies, and ensure data integrity. They will be responsible for driving the development of semantic metadata and tagging strategies for advanced search, lineage tracing, and knowledge reuse, aligning ontological structures with enterprise data strategies and digital engineering initiatives, including MBSE. The ability to articulate ideas clearly, effectively engage with stakeholders, and communicate the process and benefits of ontology creation is vital for this position.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Data Engineer - Snowflake - INTL Colombia

A healthcare client of ours is looking for multiple Data Engineers to join their growing team. This team is currently working on a project to modernize on prem SQL warehouses to snowflake. The data... More warehouse is built, so you will be supporting the build out of data marts on top of their Snowflake enterprise warehouse. This includes lifting and shifting existing data marts, building net new data marts, and further integrations. Additionally, the data engineering team designs, tests, deploys and maintains data pipelines and establishes a strong data reporting environment. This company operates within an AWS environment which is supported by their DevOps team; however, any cloud integration experience could be helpful. This position is currently slated as a 6-month contract, with high likelihood to extend for an additional 6+ months. Furthermore, this org has a large pipeline of project work for the next three years, so continuous extensions are likely. Insight Global offers full benefits while on contract. If you're interested, apply today!We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

INTL - MX - GCP Data Engineer

Day to Day:In this role, you?ll leverage your expertise in GCP and data engineering to modernize legacy applications and build scalable cloud analytics platforms. You?ll collaborate with global... More engineering teams to define and implement enterprise data strategies, working closely with stakeholders to align solutions with business needs and regulatory requirements. Your responsibilities will include designing and delivering a unified data platform on GCP, guiding teams on data modeling and architecture, and advising on best practices for cloud security, DevOps, and data mesh. You?ll also support proof-of-concepts, product evaluations, and integration efforts, while enabling insights through AI/ML platforms and modern data solutions.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Data Engineer (INTL Remote)

A global law firm with nearly 1,400 lawyers and more than 3,000 employees across 19 offices in the United States, Europe, and Asia is looking to build out a data lake to encompass both internal and... More external data. The role is a long-term contract and remote. The firm is widely recognized for its expertise in corporate law, litigation, intellectual property, life sciences, technology, and venture capital, advising on transformative deals, IPOs, and complex regulatory matters. The firm has earned numerous workplace accolades, including being named to Fortune?s Best Companies to Work For and receiving honors such as Best Workplaces for Women, Best Workplaces for Flexibility, Best Workplaces for Giving Back, and Best Workplaces for Parents. The firm is looking to hire 2 Data Engineers to join their team building this greenfield data lake. Their primary responsibility will be to be hands-on development, focusing on data transformation and strategy initiatives using dbt-cloud (or dbt-core) for ETL workflows. They will collaborate with the Lead as well. Key ResponsibilitiesPipeline Development-Design, implement, and maintain ingestion pipelines for structured and semi-structured data.-Develop transformation workflows using dbt-cloud to ensure clean, modeled data for analytics.Data Product Delivery-Build domain-specific data products aligned with business requirements.-Ensure data quality, consistency, and adherence to governance standards.Collaboration-Execute tasks under guidance from the Lead Data Engineer.-Work with architects and other engineers to ensure interoperability across squads.Performance & Optimization-Monitor pipeline performance and optimize for scalability and cost efficiency.-Document processes and maintain version control for all data workflows.Compensation:$15/hr to $30/hr.Exact compensation may vary based on several factors, including location, skills, experience, and education.Employees in this role will enjoy a comprehensive benefits package starting on day one of employment, including options for medical, dental, and vision insurance. Eligibility to enroll in the 401(k) retirement plan begins after 90 days of employment. Additionally, employees in this role will have access to paid sick leave and other paid time off benefits as required under the applicable law of the worksite location.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Data Engineer

As a Data Engineer, your day begins by syncing with business stakeholders often on calls to understand their evolving data needs and operational challenges, particularly in the U.S. healthcare space.... More You?ll spend a significant portion of your time diving into large datasets, using SQL and ETL tools like SSIS and .NET to extract, transform, and load data from various sources. Your analytical mindset will help you uncover patterns and trends that inform strategic decisions, especially around provider contracts and operational performance. You?ll act as a hybrid engineer, not only coding but also interpreting data in a way that resonates with business leaders. You?ll regularly present your findings in a clear, visual format, helping teams understand whether current data setups align with business expectations. Collaboration is key?you?ll work closely a variety of teams, contributing to both individual and cross-functional projects. Your role also involves exploring new technologies, including Java, MongoDB, and MDF databases, as the team transitions away from a purely SQL-based environment. If you have an interest in AI and automation, you?ll have the opportunity to propose and implement ideas that enhance efficiency and combat repetitive tasks. Every day is a mix of technical problem-solving, strategic thinking, and business engagement.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

INTL- MEXICO Data Engineer

Insight Global is seeking a Data Engineer in Mexico for one of our top manufacturing clients. This candidate can sit anywhere fully remote in Mexico. In this role you will be joining the Corporate... More Enterprise Data Engineering Team. As an engineer you will need to have professional experience in data integration, data transformation and developing data pipelines. You will be designing data models and data storage solutions in an Azure cloud environment, need to have proficiency in Python as a programming language along with Scala and some Java, be able to build processes to support data transformation, data structures, metadata, dependency, and workload management, experience with API based data management and acquisition and communicate technical and business acumen in both Spanish and English proficiently. Day to Day: * Design data models and data storage solutions in the cloud (Azure) * Program with languages commonly used in data engineering: Python (primary), Java, or Scala * Build processes supporting data transformation, data structures, metadata, dependency, and workload management * API based data acquisition and management * Conduct data storage and processing technologies including (Hadoop, Spark, Kafka, SQL databases) * Work with data scientists to facilitate technical design of complex data sourcing, transformation, and aggregation logic, ensuring business analytics requirements are met * Work with big data pipelines to develop streaming analytics * Utilize business intelligence data visualization tools and techniques to translate business analytics into solutions * Work with parallel processing / multithreading and compute optimization * Communicate in an articulate and poised manner technical / business information Collaborate with management to prioritize business and information needsWe are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Lead Data Engineer (Hybrid Remote)

A global law firm with nearly 1,400 lawyers and more than 3,000 employees across 19 offices in the United States, Europe, and Asia is looking to build out a data lake to encompass both internal and... More external data. The role is a long-term contract with the right to hire, so the candidate must be commutable to one of their office locations: Boston MA, NYC, Palo Alto CA, Chicago IL, Denver CO, LA, Miami FL, Reston VA, San Diego CA, San Francisco CA, Santa Monica CA, Seattle WA, or Washington DC. The role will require 4-8 days onsite per month. The firm is widely recognized for its expertise in corporate law, litigation, intellectual property, life sciences, technology, and venture capital, advising on transformative deals, IPOs, and complex regulatory matters. The firm has earned numerous workplace accolades, including being named to Fortune?s Best Companies to Work For and receiving honors such as Best Workplaces for Women, Best Workplaces for Flexibility, Best Workplaces for Giving Back, and Best Workplaces for Parents. The firm is looking to hire a Lead Data Engineer to join their team building this greenfield data lake. The Lead's primary responsibility will be to serve as the technical anchor for the data engineering squad, leading design discussions, enforcing best practices, and mentoring team members. This role combines leadership with hands-on development, focusing on data transformation and strategy initiatives using dbt-cloud (or dbt-core) as the ELT tool. This lead will also be producing some outputs both leading and doing hands on. Primary focus is leading a squad and 2nd is product delivery.Key ResponsibilitiesLeadership & Oversight-Act as the technical lead for the squad, guiding design decisions and ensuring adherence to standards.-Mentor and coach data engineers, fostering a culture of quality and innovation.-Coordinate with architects and other leads across squads for consistency in design and implementation.Technical Delivery-Own design discussions and establish best practices for data engineering workflows.-Lead implementation of data transformation pipelines using dbt-cloud or dbt-core.-Contribute hands-on to building and optimizing data solutions.Cross-Squad Collaboration-Partner with the Data Foundation/Platform Squad to manage ingestion, Unity Catalog integration, and MDM components.-Ensure interoperability across squads delivering domain-specific data products.Governance & Standards-Define and enforce coding standards, performance benchmarks, and documentation practices.-Align solutions with enterprise security, compliance, and governance requirements.Compensation:$63/hr to $74/hr.Exact compensation may vary based on several factors, including location, skills, experience, and education.Employees in this role will enjoy a comprehensive benefits package starting on day one of employment, including options for medical, dental, and vision insurance. Eligibility to enroll in the 401(k) retirement plan begins after 90 days of employment. Additionally, employees in this role will have access to paid sick leave and other paid time off benefits as required under the applicable law of the worksite location.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Data Quality Engineer (Python) - INTL India

A streaming client is in need of hiring a unique candidate who is a Data Quality Engineer who not only understands data and has the technical background, but also someone who has a 'quality... More engineering and testing mindset', who is passionate about testing. This is a technical role where you are required write clean/strong Python code, but also have strong QA/testing skills (i.e. create test plans and test cases, and ensure extensive coverage). In addition, you may also be responsible for helping build the automation process for data validation for all streaming-related data for subscriber info (etc.), from this client's multiple streaming platforms. You will be required to attend team/scrum meetings and sprint stand ups and planning sessions. You will use automation while doing ETL validations (i.e. the ETL is already built by a different team), so you will be responsible for validating the ETL and adhere to standards. In addition, this team is really looking for a candidate who is passionate about learning, is collaborative, and has excellent communication. This is NOT a Python programming role, it is strictly a QA testing role within data engineering/quality.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less