Job Search Results for data engineer

-Design and develop scalable, reusable data ingestion frameworks using Azure Databricks and PySpark-Build metadata-driven pipelines that decouple configuration from execution-Implement and maintain... More Bronze, Silver, and Gold data layers following Medallion architecture-Integrate data pipelines with data catalog and governance tools (e.g., DataHub, Purview)-Implement schema enforcement, data contracts, and data quality checks within pipelinesWork with ingestion tools (e.g., Fivetran) and file-based ingestion patterns-Enable automation for dataset onboarding using configuration-driven approaches-Collaborate with architecture, governance, and business teams to ensure scalable and governed data access-Contribute to evolving toward event-driven and near real-time ingestion patterns-Support CI/CD and DevOps practices for data platform components-Pay Rate between 50-65/hrWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for a Lead Data Engineer to come join their team. This candidate will be helping design and deliver modern data solutions using cloud-based platforms and AI-driven... More innovations. You will partner with business, technology, and governance teams to enable scalable, secure and compliant data platforms that power advanced analytics and AI. You will act as the enterprise expert for designing, developing, and optimizing data processing systems and pipelines used to populate data into transactional databases, data warehouses, data marts, or other data repositories. You will also coordinate with other IT teams to configure and implement security, monitoring, tooling, and related capabilities as they apply to their assigned systems. The Day-to-Day:?Use Agile practices to elicit and refine requirements through an iterative process of planning, defining acceptance criteria, prioritizing, developing and delivering enterprise data asset solutions in collaboration with business intelligence teams or other IT teams?Develop, configure, customize and manage integration tools, databases, warehouses and analytical systems?Design, build, and deploy data extraction, transformation, and loading processes and pipelines from various sources including databases, APIs, and data files?Develop and deploy structured, semi-structured, and unstructured data storage models such as data vault or dimensional modeling on a various platforms to meet business requirements?Coordinate security, application monitoring, development tooling, and related capabilities with responsible teams?Provide operational support and incident management for data pipelines and data flows, including proactively updating internal clients and relevant parties on status changes and issues encountered?Author and maintain accurate and up-to-date documentation for processes, procedures, and technical designs?Coach junior data and business intelligence personnel across the company, including developing material and guiding junior personnel on their technical skill growthWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Responsibilities:Maintaining operations for big data ETL/ ELT pipelines using Google Cloud Composer, Python, SQL and DBT on GCP.Maintaining operations for data ingestion processes landing data into... More Google Storage, Big Query and Big Table. Troubleshoot data pipeline errors and follow incident management and escalation procedures.Maintain and enhance, and follow runbooks, SOPs, and handoff documentation for operational processes.Manage operational tasks such as platform maintenance, upgrades, and KTLO (keep-the-lights-on) work.Execute incident response and escalation, including after-hours/on-call support when required.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

One of our clients within the Financial Services space is looking for a full-time Data Engineer to support their organization. This position is part of the Enterprise Data & Analytics Capability... More team under Global Technology Organization. In this role, you will lead the design, development, and optimization of large-scale data solutions on the Databricks platform. Day to day responsibilities include the following:?Design, build, and maintain scalable data pipelines on Databricks (using Spark, Delta Lake, etc.)?Write clean, efficient and maintainable PySpark or SQL code for data transformation?Design robust data models for analytics and reporting?Ensure data quality, consistency, and governance?Handle batch and streaming data workflows?Provide architectural guidance and support in platform usage?Drive best practices in data engineering across the team?Monitor and optimize performance of Spark jobs and cluster usage?Ensure compliance with security and data privacy standardsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Data Engineer to support a large-scale modernization program within the Analytics & Behavioral Change organization at a major enterprise healthcare company. This is a... More builder role, where engineers will execute against a well-defined roadmap and independently deliver high-quality solutions within an agile framework.Day to day work will be mainly hands-on coding, sprint planning, and grooming. The team operates in an agile manner working in squads comprised of two data engineers, two full stack engineers, and two captains responsible for gathering and translating requirements. Key Responsibilities:- Hands on coding to build and modernize the application- Execute against pre-defined user stories within a squad-based agile model- Take full ownership of assigned user stories, driving implementation end-to-end- Work within structured sprint cycles participating in planning and grooming sessions (3 weeks of development followed by 1 week of testing)- Deliver production-ready solutions aligned to established requirements and deployment cyclesWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We?re seeking a highly skilled Data Engineer to design, build, and maintain production-grade data pipelines that process and transform terabytes of data. In this role, you?ll collaborate closely with... More data scientists and other SWEs to ensure that our data infrastructure is scalable, reliable, and cost-effective.Salary Range - $150,000 - $220,000We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Our leading entertainment client is expanding their data team and seeking a Data Engineer with deep expertise in GCP, Big Data, Python, SQL, DBT, and ERD architecture. This cross-functional team... More operates across three core areas: AI/ML, Data Engineering, and Data Analytics.? Collaborate with stakeholders across subscription, viewership, marketing, paid media, CRM, and more. ? Support data visualization initiatives and ensure data is accessible and actionable.? Work in a highly collaborative environment that values fast learners and team players. Spend approximately 80% of your time in hands-on development using Python and SQL.Team Dynamic:Data Analytics Engineering (Approx. 80% of time) - Primary Focus: Analyze and maintain data pipelines, conduct root-cause analysis to resolve data-related issues, and create data models leveraging DBT and Medallion architecture.Tools & Skills: ? Proficient in Python and SQL for pipeline development. ? Initially focused on learning and maintaining existing pipelines, with a gradual transition to building new ones. Mindset: Business-oriented with a strong analytical approach. AI/ML Initiatives (Approx. 5% of time) Objective: Support AI and machine learning efforts using modern platforms such as Vertex AI. Scope: Limited involvement, primarily assisting with existing initiatives and tools. Data Engineering (Approx. 15% of time) Responsibilities: Design and implement scalable data models, pipelines, and architecture.Technical Stack: Heavy use of Python and SQL to ensure robust and efficient data infrastructure.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Our client, a leading telecommunications and technology company, is seeking an experienced Data Network Engineer to join their Managed Service Assurance team on a fully remote, contract basis. This... More is a staff augmentation engagement supporting an ITIL Tier 3 engineering team that resolves escalated network issues across Cisco, Cisco Meraki, and Fortinet platforms for managed services customers. The ideal candidate will bring vendor-level hands-on expertise and strong verbal and written communication skills, as they will be expected to step in with minimal ramp-up time and coordinate directly with their manager during on-call rotations. If you believe you are the right fit for the role, we welcome you to apply!Key Responsibilities-Receive and resolve escalated engagement tickets from Tier 1/Tier 2 support teams, serving as the first layer of engineering (ITIL Tier 3) for managed services customers-Diagnose and troubleshoot complex network issues across Cisco, Cisco Meraki, and Fortinet hardware and platforms-Manage and maintain network configurations for a large Meraki customer base, including switches, access points, and security appliances-Collaborate with the help desk and internal support teams to ensure timely resolution of customer-impacting network incidents-Participate in an on-call rotation (Fridays 7PM Central through Thursdays 7AM Central), proactively communicating availability and schedule to the team manager-Document troubleshooting steps, resolutions, and network configurations to support team knowledge sharing and ticket closure-Work end-of-day shift hours (approximately 10AM?7PM CST) to provide coverage during peak escalation windows-Support continuous service assurance by identifying recurring issues and contributing to root cause analysis effortsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

The developer will work within biweekly sprints, completing assigned work packages and tasks that have been pre analyzed by the architecture team. Their day-to-day includes building and optimizing... More Snowflake SQL queries, enhancing existing ETL pipelines, and creating new data workflows using Azure Data Factory. They will support scalable data engineering efforts by designing data models, maintaining data quality, and ensuring secure operations across environments. The role also includes contributing to reporting initiatives using Sigma, building area pipelines, and participating in training and improving an AI agent for the research project. Additionally, they will collaborate closely with analytics and business teams to troubleshoot issues and meet project reporting needs.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking an AI Engineer with a strong data engineering foundation to build and productionize AI solutions end-to-end; from data ingestion and orchestration (Azure Data Factory)... More through transformation/compute (Azure Databricks) and into core AI/ML/GenAI services, with the ability to contribute to modern web applications (JavaScript / React / Next.js)We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less