Job Search Results for big data

INTL- MEXICO Data Engineer

Insight Global is seeking a Data Engineer in Mexico for one of our top manufacturing clients. This candidate can sit anywhere fully remote in Mexico. In this role you will be joining the Corporate... More Enterprise Data Engineering Team. As an engineer you will need to have professional experience in data integration, data transformation and developing data pipelines. You will be designing data models and data storage solutions in an Azure cloud environment, need to have proficiency in Python as a programming language along with Scala and some Java, be able to build processes to support data transformation, data structures, metadata, dependency, and workload management, experience with API based data management and acquisition and communicate technical and business acumen in both Spanish and English proficiently. Day to Day: * Design data models and data storage solutions in the cloud (Azure) * Program with languages commonly used in data engineering: Python (primary), Java, or Scala * Build processes supporting data transformation, data structures, metadata, dependency, and workload management * API based data acquisition and management * Conduct data storage and processing technologies including (Hadoop, Spark, Kafka, SQL databases) * Work with data scientists to facilitate technical design of complex data sourcing, transformation, and aggregation logic, ensuring business analytics requirements are met * Work with big data pipelines to develop streaming analytics * Utilize business intelligence data visualization tools and techniques to translate business analytics into solutions * Work with parallel processing / multithreading and compute optimization * Communicate in an articulate and poised manner technical / business information Collaborate with management to prioritize business and information needsWe are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Data Scientist/MLE - INTL - India

We are looking for a highly skilled Data Scientist to join our Customer Analytics team. This role focuses on driving customer activation strategies by leveraging data science techniques, particularly... More classification models, to identify, predict, and influence customer behavior. You will work extensively with PySpark on Databricks, and lead efforts in model development, hyperparameter tuning, and performance optimization.Key Responsibilities:? Develop and deploy classification models to predict customer activation, engagement, and retention.? Design, implement, and optimize PySpark pipelines in Databricks for large-scale data processing.? Apply advanced hyperparameter tuning techniques (e.g., grid search, random search, Bayesian optimization) to enhance model performance.? Work cross-functionally with data engineering, product, and marketing teams to translate business objectives into data-driven solutions.? Monitor and evaluate model performance using robust validation techniques and real-world KPIs.? Conduct exploratory data analysis and feature engineering tailored to activation use cases.? Create dashboards, visualizations, and reports to communicate findings to non-technical stakeholders.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Data Engineer II

Insight Global is seeking a Data Engineer for a top healthcare technology client. This candidate will be responsible for supporting and enhancing critical healthcare data integrations, including HL7... More and flat file feeds, while also contributing to analytics, reporting, and data warehousing initiatives. The ideal candidate is detail-oriented, technically curious, and enjoys collaborating with both technical teams and business stakeholders to ensure accurate, reliable, and scalable data solutions.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Data Scientist (Remote)

Day to Day:Insight Global is looking for a Senior Data Scientist who will spend each day developing and maintaining a consistent, scalable approach to institutional data analysis while building... More knowledge management tools that help leaders understand key insights across the student lifecycle. Their work will involve applying statistical models, such as regression, classification, and forecasting, to support strategic decision-making, as well as creating and maintaining dashboards, reports, forecasts, and databases that communicate findings clearly to both technical and non-technical audiences. They will regularly mine large datasets, performing data cleaning, validation, and error analysis to ensure accuracy, and analyze trends and patterns with institutional goals in mind. The role also requires developing deep expertise in academic, operational, and financial data, collaborating across departments to build and refine data models, and contributing to the automation of data processes and the development of machine learning workflowsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

GCP Data Engineer

Insight Global is seeking 2 GCP Data Engineers to support a specific Workstream called Sync- specifically focused on delivering a large set of reporting pipelines. This individual will work hands on... More within Google Cloud Platform for pipeline development, utilizing tools like Python and SQL for scripting and query building.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Sr Data Architect

We are seeking a visionary Senior Data Architect to lead our data analytics initiatives and architect the foundation for our next generation of AI capabilities. In this role, you will be the primary... More technical authority for our Databricks landscape. You will move beyond simple data management to architecting a scalable "Data Intelligence Platform" that powers Generative AI, Machine Learning, and advanced analytics. You will act as a force multiplier?setting the direction for engineering teams, defining architectural standards, and bridging the gap between complex technical execution and high-level business goals. Key Responsibilities ? Databricks & AI Architecture Strategy: Define and implement the end-to-end architecture for the Lakehouse, ensuring support for high-volume batch processing, real-time streaming, and GenAI/LLM initiatives using Mosaic AI and MLflow.? Champion Data Health & Integrity: ? Design solutions that prioritize data quality at the source. ? Establish and enforce architectural patterns that ensure reliability and trust in our data assets. ? Implement automated testing and observability frameworks (e.g., Delta Live Tables expectations) to maintain data health. ? Strategic Data Modeling & Business Translation: ? Bridge the gap between business goals and technical execution. ? Translate complex business requirements into robust logical and physical data models. ? Document and maintain clear data flow architectures for applications to ensure alignment between business intent and engineering output. ? Technical Leadership & Team Enablement: ? Lead virtual Scrum teams and provide deep technical mentorship to data engineers and developers. ? Advocate for Spark/Databricks best practices, conduct code reviews, and drive the adoption of CI/CD and DevOps principles in data workflows. ? Note: You will provide the guidance that junior members rely on for success.? Enterprise Governance & Lifecycle Management: ? Architect the frameworks for data lineage, security, and lifecycle management (utilizing Unity Catalog). ? Ensure strict compliance with internal policies and external regulations from the point of data ingestion to final consumption. ? Stakeholder Management & Value Prioritization: ? Partner directly with business stakeholders to understand their roadmap and priorities. ? Ensure all data and AI initiatives are strictly aligned with tangible business value. ? Manage the architectural roadmap to balance immediate business needs with long-term technical scalabilitypay varies depending on experience - 70-75/hrWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Solutions Architect (Data Analytics & Digital Platforms)

Position Summary The Solutions Architect will serve as the primary architectural authority for the Data Analytics organization. You will oversee the design and implementation of our data... More ecosystem?including Data Warehouses, Data Lakes, and real-time pipelines?while ensuring seamless integration with our digital web applications. This role requires a unique blend of "big data" expertise, cloud-native architecture, and full-stack development knowledge to lead our technical strategy into the next generation of GenAI and predictive analytics.Roles and Responsibilities:Architectural Leadership & Strategy?Define the end-to-end architectural vision for the data analytics platform, ensuring scalability, security, and high availability across AWS and Databricks environments.?Evaluate and select emerging technologies in the GenAI and LLM space to enhance data discovery and automated insights.Data Ecosystem Oversight?Design and govern robust data pipelines and storage solutions (Data warehouse, Data Lake, Data Lakehouse) that support both structured RDBMS and high-volume NoSQL requirements.?Collaborate with Data Scientists to architect environments for model training, deployment, and MLOps, ensuring seamless integration between data engineering and machine learning workflows.Full-Stack & Digital Integration?Oversee the architectural integrity of internal and external web applications built on Java Spring Boot and Angular.?Ensure that frontend applications are optimized for data visualization and provide high-performance user experiences for complex data sets.Agile Execution & Collaboration?Operate as a key technical leader within the Agile Scrum framework, participating in sprint planning, backlog grooming, and architectural reviews to ensure technical debt is managed and milestones are met.?Act as a bridge between Data Architects, Data Engineers, and stakeholders to translate business requirements into technical blueprints.?Mentor lead engineers and developers, providing code reviews and architectural guidance to ensure best practices across the SDLC.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Data Process Optimization Consultant (Remote)

An employer in San Francisco, CA is seeking a Remote Data Process Optimization Consultant to join their Land Acquisition team. This person will evaluate current data system process and document... More system enhancements for more streamlined connections and opportunities for automation. This is a critical role for an expert who can transition a manual, spreadsheet-heavy environment into a streamlined, automated ecosystem.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

ETL Developer (Java)

A client of Insight Global is looking for a ETL Developer to join their linking team which is responsible for linking billions of public and proprietary records to create a unique entity identifier... More for consumers, organizations, and health care providers. We're looking for an experienced, smart, driven individual who will help analyze our data we utilize in our linking solutions by using quantitative approaches with a unique blend of analytical, mathematical, and technical skills. Accountabilities:?Work in iterative processes to perform advanced big data analysis, validate findings, or test hypotheses, and communicate results and methodology.?Provide recommendations on who to utilize our data to optimize our search, increase recall and/or precision of results, and help us to better understand or existing data.?Communicate technical information successfully with technical and non-technical audiences such as third-party vendors, external customer technical departments, various levels of management and other relevant parties.?Collaborate effectively with all team members as well as attend regular team meetings. The pay rate ranges based on years of experience between $40-50/hour.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

INTL - Sr. Data Quality Engineer (Python) - Bangalore, India

A streaming client is in need of hiring a unique candidate who is a Data Quality Engineer who not only understands data and has the technical background, but also someone who has a 'quality... More engineering and testing mindset', who is passionate about testing. This role is crucial for a company-wide integration initiative that affects business, technology, and content integrations of this company's streaming services into it's broader streaming ecosystem. It involves:? Merging platforms? Consolidating tech stacks and data pipelines? Unifying content and sports rights? Migrating users and subscriptions at massive scale? Reorganizing teams and governanceThis is a technical role where you are required write clean/strong Python code, but also have strong QA/testing skills (i.e. create test plans and test cases, and ensure extensive coverage). In addition, you may also be responsible for helping build the automation process/framework(s) for data validation for all streaming-related data for subscriber info (etc.), from this client's multiple streaming platforms. You will be required to attend team/scrum meetings and sprint stand ups and planning sessions. You will use automation while doing ETL validations (i.e. the ETL is already built by a different team), so you will be responsible for validating the ETL and adhere to standards. In addition, this team is really looking for a candidate who is passionate about learning, is collaborative, and has excellent communication. This is NOT a Python programming role, it is strictly a QA testing role within data engineering/quality.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less