Job Search Results for data engineer

Insight Global is seeking a Data Engineer to join a large retail client on a remote 6-month contract. The data engineering team builds and maintains the data infrastructure that powers analytics,... More reporting, and data-driven decision making across the companys digital platforms, retail operations, and business units. They work with cross-functional agile squads to develop reliable data pipelines, improve data quality, build self-serve analytics tools for our business stakeholders, and ensure timely access to accurate data for our analysts and data scientists.As a Data Engineer, you'll join a large retail client on their Data and Analytics team which play a key role in developing reporting and analytics for key business units. The data engineer will join the Data Platform Squad which is currently supporting the generation of a large data lake to host guest data. This data lake will store guest data from various sources such as Salesforce, social media campaigns on Facebook, tik tok, etc, and clickstream data from their website. On the day to day, the Data Engineer will take data from various sources, clean and ingest it to get onto the Azure data platforms in order to produce data models for the business stakeholders. They will be designing and implementing complex data pipelines from different internal/external sources using the Microsoft stack and Azure BI services. Leveraging Databricks Unity Catalog, they will also manage and govern machine learning models and associated data assets. There will also be close collaboration with data architects to transform requirements into code and prepare database structures needed for reporting, analytics, and visualizations. They will also create recommendations to advise on optimal data strategies for data ingestion, integration, and visualization to improve code performance and query optimization to meet demanding data analytics and visualization needs.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Insight Global is currently seeking a Cloud Data and AI/ML Engineer to join one of our large oil and gas clients in Houston, TX. The ideal candidate will have a strong background in Machine Learning... More and AI fundamentals, as well as Data Engineering or Scientist experience. Key responsibilities include gathering and analyzing requirements, managing data pipeline jobs, and optimizing ML performance. You'll develop processes to analyze platform performance, support data pipelines, participate in data model design, manage databases, and implement Azure Functions with API integration. To be considered, you must have strong knowledge of MS Analytics Platforms (MS Fabric, Synapse, Data Lakes), 3 years of experience developing AI/ML models, experience with Gen AI Models and ML Ops, and proficiency in the Azure cloud ecosystem, particularly with Data Lake Storage and Synapse. The role requires 3 years of programming experience in SQL, Python, and Pyspark, plus strong troubleshooting abilities. This position is 4 days onsite in Houston, TX with remote, half-day Fridays. The starting pay for this position will be between $45-55/hr.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

We are seeking an experienced and passionate Lead Data Engineer to join our Data Engineering Team. In this critical role, you will develop and manage scalable data pipelines on our Azure cloud-based... More data platform. You will guide a team of data engineering professionals, demonstrating exceptional technical expertise and leadership, while fostering a culture of innovation, craftsmanship, and continuous improvement.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

? Design, develop, and maintain ETL processes using Azure Databricks.? Collaborate with data engineers, data scientists, and business stakeholders to understand data requirements and deliver... More efficient data pipelines.? Optimize and troubleshoot ETL workflows to ensure high performance and reliability.? Implement data quality checks and validation processes to ensure data integrity.? Develop and maintain documentation for ETL processes and data pipelines.Monitor and manage data pipeline performance, identifying and resolving issues as they arise.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Insight Global is seeking a Data Engineer to join a large retail client on a remote 6 month contract. As a Data Engineer, you'll join a large retail client on their Data and Analytics team which play... More a key role in developing reporting and analytics for key business units. The data engineer will join the Data Platform Squad which is currently supporting the generation of a large data lake to host guest data. This data lake will store guest data from various sources such as Salesforce, social media campaigns on Facebook, tik tok, etc, and clickstream data from their website. On the day to day, the Data Engineer will take data from various sources, clean and ingest it to get onto the Azure data platforms in order to produce data models for the business stakeholders. They will be designing and implementing complex data pipelines from different internal/external sources using the Microsoft stack and Azure BI services. Leveraging Databricks Unity Catalog, they will also manage and govern machine learning models and associated data assets. There will also be close collaboration with data architects to transform requirements into code and prepare database structures needed for reporting, analytics, and visualizations. They will also create recommendations to advise on optimal data strategies for data ingestion, integration, and visualization to improve code performance and query optimization to meet demanding data analytics and visualization needs.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

We are looking for an experienced and highly skilled Senior Data Engineer to join our Data Engineering Team. In this role, you will design, develop, and optimize data solutions leveraging Microsoft... More Azure data services. You will collaborate closely with a team of data professionals, business stakeholders, and data analysts to deliver robust, efficient, and secure data solutions.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

An Oil & Gas customer of Insight Global is looking for a Master Data Engineer to join their team full-time to sit in The Woodlands, TX, on a hybrid schedule 3 days a week and as needed with travel up... More to 5% within the Texas area. The IT division's primary goal over the next few years is focused on their Data Transformation efforts that will support all of the company's domains for midstream assets. This person will be designing, developing, and deploying innovative data and analytical solutions to enhance current operations and shape the future of the organization. The salary range for this role is dependent on level of experience with a flexible range of $120,000-$200,000 annually.Responsibilities:Collaborate with data stewards to design, develop and prioritize capabilities to accurately capture high quality data.Maintain and improve existing master data management systems while evaluating and implementing future improvements and solutions.Review integration complexities of current and future systems and understand the effects of combining data from different systems.Design, build, and manage data pipelines to ingest, transform, and distribute master data between enterprise systems and Azure destinations.Write complex system queries into operational systems to extract datasets that meet master data source ingestion requirements.Employ programming languages like Java and Python in relation to enhancing master data applications.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Insight Global is seeking a forward thinking Senior AI/ML Engineering professional to support an enterprise manufacturing company's innovation center to develop custom solutions used across 50+... More facilities within multiple divisions all things AI/ML/GenAI. Day to Day: Optimizing AI/ML data science models. Standardizing access patterns for data and AWS resources. Deploying data pipelines and AI/ML models. Aggregating sources and harmonizing data for efficient AI/ML model consumption. Orchestrate Sagemaker and SAS models across both SAS and AWS environments. Collaborate closely with data science team, operations, and customers dedicated to ensuring proper testing, business outcomes and support. Hands on lead for data consolidation and syndication (from various source systems including machine and sensor data in batch, near real-time, and real-time). Participate in collaborative software design and development of pipelines and optimizing code on cloud technologies including tools like RedShift, S3, Lambda, Glue and other AWS services. Manage own learning and contribute to technical skill building of the team. Embrace the engineering mindset and systems thinking. Collaborate with IT Architect to design forward looking data solutions. Support various business users in their need for existing and new data elements and subject areas. Demonstrate technical, team, and solution leadership through strong communication skills to recommend actionable, data-driven solutions Collaborate with team members, business stakeholders and data SMEs to elicit requirements and to develop a technical design.This is not a remote position and will require you to go into the office in Atlanta, GA 3 days a week. Compensation will be determined by the hiring manager during the interview process, but will be within the range of 130-140k upon conversion after 6 months.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Job DescriptionThis Databricks subject matter expert will be coming in to assist a senior data engineering team to evaluate and assess their current usage of Databricks at an enterprise-level. They... More will consult on areas like: code best practices, performance tuning, cluster configurations, visualization and reporting as well as table and schema design to make recommendations. This person will collaborate with the team to implement these recommendations. This is an opportunity to work across multiple cloud providers with cutting edge technology and have an impact across an entire corporation.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Insight Global is looking for a skilled Data Engineer in Vancouver or Montreal to work for a large AAA gaming company on a contract until end of February 2026. You will be assisting the Data and... More Analytics team on one of the company's largest game titles. Your team consists of four (4) other Data Engineers, and your day-to-day will be creating data engineering pipelines, making sure tags in Airflow are running, and basic troubleshooting in CI/CD and DevOps. Experience working with big data in an enterprise environment is a necessity for this position. The environment and tools are: Snowflake, Redshift, Airflow, Gitlab, and DBT. Your languages are SQL and Python. Someone who is proficient and confident in data engineering best practices as well as takes initiative, works well with others cross-functionally, and can navigate complex situations and decision-making will be successful in this role.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less