Job Search Results for big data

Data Scientist

Day to Day:Insight Global is looking for a Senior Data Scientist who will spend each day developing and maintaining a consistent, scalable approach to institutional data analysis while building... More knowledge management tools that help leaders understand key insights across the student lifecycle. Their work will involve applying statistical models, such as regression, classification, and forecasting, to support strategic decision-making, as well as creating and maintaining dashboards, reports, forecasts, and databases that communicate findings clearly to both technical and non-technical audiences. They will regularly mine large datasets, performing data cleaning, validation, and error analysis to ensure accuracy, and analyze trends and patterns with institutional goals in mind. The role also requires developing deep expertise in academic, operational, and financial data, collaborating across departments to build and refine data models, and contributing to the automation of data processes and the development of machine learning workflowsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Data Engineer

Overview:Insight Global is seeking a Data Engineer to support the migration from WhereScape to Coalesce and build scalable, production-grade data pipelines on Snowflake. This role is deeply technical... More and focused on ELT development, refactoring legacy workflows, and modernizing the data platform.Responsibilities:? Build, refactor, and optimize Snowflake ELT pipelines using Coalesce.? Translate existing WhereScape jobs into Coalesce components, ensuring logic parity and improved maintainability.? Develop efficient, reusable Python scripts for automation, data processing, and orchestration.? Implement scalable data models, transformations, and performance-optimized SQL.? Partner with architects and data engineers to align pipelines with new platform standards.? Support testing, validation, documentation, and productionizing of migrated pipelines.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

REMOTE Data Engineer

Insight Global is seeking a Data Engineer to join our actuarial consultant customer 100% remotely. In this position as a Data Engineer of our client?s Data Platform, you will be responsible for... More designing and implementing robust Data Platform solutions that meet business objectives while ensuring compliance with industry-leading data privacy standards. You will collaborate closely with cross-functional agile teams to drive data architecture decisions, implement best practices, and contribute to the success of our client?s projects. Responsibilities include: ?Data Platform: Creation of a Databricks Data Warehouse(s) and Lakehouse solutions for a healthcare data focused enterprise. oData Governance: Configuring and maintaining unity catalog to enable enterprise data lineage and data quality oData Security: Building out Data Security protocols and best practices including the management of identified and de-identified (PHI/PII) solutionsoExternal Data Products: Building data solutions for clients while upholding the best standards for reliability, quality, and performanceoETL: Building solutions within Delta Live Tables and automation of transformationsoMedallion Architecture: Building out performant enterprise-level medallion architecture(s) oStreaming and Batch Processing: Building fit-for-purpose near real-time streaming and batch solutions oLarge Data Management: Building out performant and efficient enterprise solutions for internal and external users for both structured and unstructured healthcare dataoPlatform Engineering: Building out Infrastructure as Code using Terraform and Asset BundlesoCosts: Working with the business to build cost effective and cost transparent Data solutions?Pipeline/ETL Management: You will help architect, build, and maintain robust and scalable data pipelines, monitoring, and optimizing performanceoExperience working with Migration tools i.e., AWS DMS, AWS Glue, Fivetran, integrate.iooIdentify and implement improvements to enhance data processing efficiencyoExperience with building out effective pipeline monitoring solutionsoBuild the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Delta Live Tables, Python, Scala, and cloud-based ?big data? technologies.?Data Modeling: Lead design, implementation, and maintenance of standards based (FHIR, OMOP, etc.) and efficient data models for both structured and unstructured dataoAssemble large, complex data sets that meet functional and non-functional business requirementsoDevelop and maintain data models, ensuring they align with business objectives and data privacy regulations?Collaboration: Partner internally with key stakeholders to ensure we are providing meaningful, functional, and valuable dataoEffectively work with Data, Development, Analysts, Data Science, and Business team members to gather requirements, propose, and build solutions. oCommunicate complex technical concepts to non-technical stakeholders and provide guidance on best practices.oEnsure that technology execution aligns with business strategy and provides efficient, secure solutions and systems?Processes and Tools: Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.oBuild analytics tools that utilize the data pipeline to provide actionable insights into operational efficiency and other key business performance metrics.oCreate data tools for clinical, analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Senior Project Manager (Data)

We are seeking an experienced Senior Technical Project Manager to lead the delivery of a complex, multi-year data engineering transformation program. This role will oversee large-scale initiatives... More involving modern data platform builds, migration of legacy systems, API integration, data governance uplift, and enterprise-level architectural change. The ideal candidate has a strong mix of technical understanding, program delivery expertise, and leadership capability in dynamic environments.Key ResponsibilitiesProgram & Project Delivery? Lead end-to-end delivery of a multi-year data engineering transformation roadmap, managing timelines, budgets, risks, and dependencies.? Oversee delivery of workstreams including data platform modernization, ETL/ELT pipeline development, API integrations, and cloud architecture changes.? Establish and maintain delivery frameworks using Agile, Scrum, Kanban, and Hybrid/Waterfall models.? Ensure technical designs, data models, integration patterns, and solution architectures align with programmer goals.Stakeholder Management? Act as primary delivery lead between engineering teams, business units, and executive stakeholders.? Translate complex technical detail into clear business language.? Facilitate workshops, backlog reviews, sprint planning, governance forums, and steering committees.Risk, Governance & Reporting? Build and maintain programmer RAID logs, delivery dashboards, and reporting packs.? Ensure governance alignment with PMO, architecture review boards, and regulatory/compliance requirements.? Identify delivery risks and drive mitigation strategies.Technical Leadership? Understand modern data engineering practices including Azure Data Services, Databricks, Synapse, Data Lakes, Delta Lake, APIs, ETL/ELT pipelines, and integration patterns.? Support teams in breaking down technical work into epics, features, and stories.? Challenge solution design decisions for scalability and performance.Team Leadership & Collaboration? Lead cross-functional squads, suppliers, contractors, and third-party vendors.? Foster a culture of continuous improvement and iterative delivery.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Data Scientist - INTL - India

We are looking for a highly skilled Data Scientist to join our Customer Analytics team. This role focuses on driving customer activation strategies by leveraging data science techniques, particularly... More classification models, to identify, predict, and influence customer behavior. You will work extensively with PySpark on Databricks, and lead efforts in model development, hyperparameter tuning, and performance optimization.Key Responsibilities:? Develop and deploy classification models to predict customer activation, engagement, and retention.? Design, implement, and optimize PySpark pipelines in Databricks for large-scale data processing.? Apply advanced hyperparameter tuning techniques (e.g., grid search, random search, Bayesian optimization) to enhance model performance.? Work cross-functionally with data engineering, product, and marketing teams to translate business objectives into data-driven solutions.? Monitor and evaluate model performance using robust validation techniques and real-world KPIs.? Conduct exploratory data analysis and feature engineering tailored to activation use cases.? Create dashboards, visualizations, and reports to communicate findings to non-technical stakeholders.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

INTL- MEXICO Data Engineer

Insight Global is seeking a Data Engineer in Mexico for one of our top manufacturing clients. This candidate can sit anywhere fully remote in Mexico. In this role you will be joining the Corporate... More Enterprise Data Engineering Team. As an engineer you will need to have professional experience in data integration, data transformation and developing data pipelines. You will be designing data models and data storage solutions in an Azure cloud environment, need to have proficiency in Python as a programming language along with Scala and some Java, be able to build processes to support data transformation, data structures, metadata, dependency, and workload management, experience with API based data management and acquisition and communicate technical and business acumen in both Spanish and English proficiently. Day to Day: * Design data models and data storage solutions in the cloud (Azure) * Program with languages commonly used in data engineering: Python (primary), Java, or Scala * Build processes supporting data transformation, data structures, metadata, dependency, and workload management * API based data acquisition and management * Conduct data storage and processing technologies including (Hadoop, Spark, Kafka, SQL databases) * Work with data scientists to facilitate technical design of complex data sourcing, transformation, and aggregation logic, ensuring business analytics requirements are met * Work with big data pipelines to develop streaming analytics * Utilize business intelligence data visualization tools and techniques to translate business analytics into solutions * Work with parallel processing / multithreading and compute optimization * Communicate in an articulate and poised manner technical / business information Collaborate with management to prioritize business and information needsWe are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

GCP Data Engineer

Insight Global is seeking 2 GCP Data Engineers to support a specific Workstream called Sync- specifically focused on delivering a large set of reporting pipelines. This individual will work hands on... More within Google Cloud Platform for pipeline development, utilizing tools like Python and SQL for scripting and query building.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Data Process Optimization Consultant (Remote)

An employer in San Francisco, CA is seeking a Remote Data Process Optimization Consultant to join their Land Acquisition team. This person will evaluate current data system process and document... More system enhancements for more streamlined connections and opportunities for automation. This is a critical role for an expert who can transition a manual, spreadsheet-heavy environment into a streamlined, automated ecosystem.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Sr Data Architect

We are seeking a visionary Senior Data Architect to lead our data analytics initiatives and architect the foundation for our next generation of AI capabilities. In this role, you will be the primary... More technical authority for our Databricks landscape. You will move beyond simple data management to architecting a scalable "Data Intelligence Platform" that powers Generative AI, Machine Learning, and advanced analytics. You will act as a force multiplier?setting the direction for engineering teams, defining architectural standards, and bridging the gap between complex technical execution and high-level business goals. Key Responsibilities ? Databricks & AI Architecture Strategy: Define and implement the end-to-end architecture for the Lakehouse, ensuring support for high-volume batch processing, real-time streaming, and GenAI/LLM initiatives using Mosaic AI and MLflow.? Champion Data Health & Integrity: ? Design solutions that prioritize data quality at the source. ? Establish and enforce architectural patterns that ensure reliability and trust in our data assets. ? Implement automated testing and observability frameworks (e.g., Delta Live Tables expectations) to maintain data health. ? Strategic Data Modeling & Business Translation: ? Bridge the gap between business goals and technical execution. ? Translate complex business requirements into robust logical and physical data models. ? Document and maintain clear data flow architectures for applications to ensure alignment between business intent and engineering output. ? Technical Leadership & Team Enablement: ? Lead virtual Scrum teams and provide deep technical mentorship to data engineers and developers. ? Advocate for Spark/Databricks best practices, conduct code reviews, and drive the adoption of CI/CD and DevOps principles in data workflows. ? Note: You will provide the guidance that junior members rely on for success.? Enterprise Governance & Lifecycle Management: ? Architect the frameworks for data lineage, security, and lifecycle management (utilizing Unity Catalog). ? Ensure strict compliance with internal policies and external regulations from the point of data ingestion to final consumption. ? Stakeholder Management & Value Prioritization: ? Partner directly with business stakeholders to understand their roadmap and priorities. ? Ensure all data and AI initiatives are strictly aligned with tangible business value. ? Manage the architectural roadmap to balance immediate business needs with long-term technical scalabilitypay varies depending on experience - 70-75/hrWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

ETL Developer (Java)

A client of Insight Global is looking for a ETL Developer to join their linking team which is responsible for linking billions of public and proprietary records to create a unique entity identifier... More for consumers, organizations, and health care providers. We're looking for an experienced, smart, driven individual who will help analyze our data we utilize in our linking solutions by using quantitative approaches with a unique blend of analytical, mathematical, and technical skills. Accountabilities:?Work in iterative processes to perform advanced big data analysis, validate findings, or test hypotheses, and communicate results and methodology.?Provide recommendations on who to utilize our data to optimize our search, increase recall and/or precision of results, and help us to better understand or existing data.?Communicate technical information successfully with technical and non-technical audiences such as third-party vendors, external customer technical departments, various levels of management and other relevant parties.?Collaborate effectively with all team members as well as attend regular team meetings. The pay rate ranges based on years of experience between $40-50/hour.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less