Job Search Results for data engineer

Must-Have:?2-4 years?of?experience?in?designing,?developing?and implementing Data Science?solutions. ?Experince working with Confluence Kafka ?Advanced programming experience in python?Experience... More working with Airflow to build data pipelines?Advanced database skills (MSSql, Oracle, Postgres)?Familiarity with Kubernetes?Experience with Linux?Bachelor?s Degree in related fieldWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

This enterprise games organization is looking for a data focused Software Engineer to join their team. This position will aid the Data & AI division of a central game testing organization, which... More services a portfolio of first party AAA games. As part of a team dedicated to ensuring top-quality data solutions that drive testing efficiency and insights, you will play a critical role in building, maintaining, and optimizing our data pipelines and AI-driven processes. You?ll work closely with cross-functional teams to design and implement scalable data solutions, leveraging your expertise in C#, .NET, PowerShell, ETL processes, and data pipelines.Key Responsibilities:Design, develop, and maintain robust ETL (Extract, Transform, Load) processes for our data pipeline infrastructure to support data ingestion, transformation, and integration.Collaborate with data scientists, analysts, and software engineers to understand data requirements and create scalable solutions.Write and optimize efficient C# and .NET code for applications and tools supporting data integration and transformation.Develop and maintain Python scripts to automate data workflows, monitor system health, and optimize data operations.Use Kusto Query Language (KQL) to develop complex queries, create dashboards, and analyze data effectively to support business decisions.Manage, optimize, and troubleshoot data pipelines to ensure high performance and reliability across different stages of the ETL process.Collaborate with product managers and stakeholders to understand data needs and ensure solutions are aligned with overall goals.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Lead for their Data Warehouse Quality Engineering Practice, for a full-time opportunity with a large banking client. This person will join a team of other Practice Leads,... More all of who oversee a different areas of Data Warehousing. This role will oversee the "Data Foundations" group. They will oversee a team of Quality Engineers, and is responsible for coaching on knowledge, skills, and performance, building and evolving the practice's capabilities, and advising practitioners on their work to ensure solutions are sound. This Lead is responsible for the test planning, design, and execution for bringing data from legacy systems into modern data sources. These are backend focused systems, and tasks include file and CSV manipulation, working with legacy mainframe systems, high level SQL and ETL tasks, and utilizing automation tools such as Tosca.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We?re seeking Senior Data Engineers with expertise in large-scale data migration, real-time streaming, and cloud-native architecture. You?ll play a key role in designing and implementing data... More pipelines using GCP technologies and ensuring data quality, performance, and reliability.Key Responsibilities-Design and implement scalable ETL/ELT pipelines using GCP tools-Lead large-scale data migration efforts from legacy systems to cloud platforms-Develop real-time streaming solutions using Kafka and Pub/Sub-Work with Cloud Dataflow, BigQuery, Bigtable, and Cloud StorageEnsure data validation, quality assurance, and monitoring-Deliver cloud-native architecture documentation and code through SCRUM processes-Build comprehensive monitoring and alerting systems-Optimize performance through benchmarking and tuning-Contribute to knowledge transfer and internal documentationWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

? Maintain and build onto a new Microsoft Fabric data platform. ? Design, build, and optimize data pipelines using Azure Data Factory (ADF) and Fabric to move data from enterprise systems to a... More central warehouse. ? Evaluate and execute SQL queries and PySpark Notebooks to move data inside ETL pipelines. ? Enhance, evolve, and maintain a data lake architecture built in Microsoft Fabric involving data lakes, lakehouses, and cloud databases. ? Apply best practices in ETL development, data modeling, and performance optimization. ? Collaborate with stakeholders to gather requirements and translate business needs into technical solutions. ? Ensure data governance, security, and compliance best practices are upheld in cloud-based environments. ? Work in an agile environment, providing technical leadership and driving project success.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Equinox is seeking a Sr. Data Engineer to join our technology team. This role is a hands-on position responsible for the build and continued evolution of the data platform, business applications and... More integration tools. We are looking for a hands on engineer that can recommend best practices to work with enterprise data. The ideal candidate is going to be a hands on engineer, and very strong with AWS Products to help build out data pipelines, create jobs, manage the quality of the data warehouse and integrated tools.RESPONSIBILITIES? Design, develop, and maintain scalable, efficient data pipelines to support ETL/ELT processes across multiple sources and systems? Partner with Data Science, Analytics, and Business teams to understand data needs, prioritize use cases, and deliver reliable datasets and models? Monitor, optimize, and troubleshoot data jobs, ensuring high availability and performance of data infrastructure? Build and manage data models and schemas in Redshift and other data technologies, enabling self-service analytics? Implement data quality checks, validation rules, and alerting mechanisms to ensure trust in data? Leverage AWS services like Glue, Lambda, S3, Athena, and EMR to build modular, reusable data solutions? Drive improvements in data lineage, cataloging, and documentation to ensure transparency and reusability of data assets? Create and maintain technical documentation and version-controlled workflows (e.g., Git, dbt)? Contribute to and promote a culture of continuous improvement, mentoring peers and advocating for scalable and modern data practices? Participate in sprint planning, code reviews, and team retrospectives as part of an Agile development process? Stay current on industry trends and emerging technologies to identify opportunities for innovation and automationWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Big Data Engineer to assist with a application modernization and taking reports currently in the mainframe and recreate in a new modernized application. The output of... More those reports would be in Tableau or Excel and while this role is focused on Big Data Technologies, will primarily focus on the reporting for the initial duration of the contract.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

An employer is looking for a Sr. Data Engineer in the Seattle, WA area. This entertainment company is looking for a Sr. Data Engineer to join their consumer business division. They are dealing with... More large amounts of television and digital data around their customers. This person will be responsible for their Data Warehouse as they evolve into a more cloud based environment. Someone with AWS and Snowflake experience would be a standout candidate. However, if you have an expertise in Python for developing ETL pipelines, data warehousing, and some cloud experience, this could be a fit for you. This group is looking for a team player who's interested in learning new technologies in an evolving organization. If this sounds like you, please apply today!We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

An Oil & Gas customer of Insight Global is looking for a Data Engineering Advisor to join their team full-time to sit in The Woodlands, TX, on a hybrid schedule 3 days a week and as needed with... More travel up to 5% within the Texas area. The IT division's primary goal over the next few years is focused on their Data Transformation efforts that will support all of the company's domains for midstream assets. This person will be designing, developing, and deploying innovative data and analytical solutions to enhance current operations and shape the future of the organization. The salary range for this role is dependent on level of experience with a flexible range of $120,000-$200,000 annually. Responsibilities:Design and create data architecture and strategies to facilitate efficient storage and retrieval of structured and unstructured data.Design, build, and manage data pipelines to ingest, transform, and distribute data between on-premises and Azure-based destinations.Implement measures to ensure the quality and integrity of data, including data cleaning, validation, and error handling within data pipelines.Utilize technologies from Qlik, OpenText, SAP Datasphere, and Azure cloud services, including Copilot, Dataverse, Fabric, Data Factory, Logic Apps, Power Automate, Azure Synapse Analytics, Fabric to enable custom applications and BI efforts.Employ programming languages like Java or Python for automation and API integration tasks.Work closely with data scientists and developers to provide data necessary for custom applications, visualizations, and analytic models.Assess, recommend, and integrate new data management technologies, data modeling, relational data structures, and change data capture.Identify bottlenecks, optimize queries, and fine-tune database or data processing configurations.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

Must Haves:-Bachelor?s Degree in Comp Sci, IT, Business Analytics, etc.-3-11 years? experience in Data Engineering-Snowflake ? Leveraging as a Data Warehouse-SQL Experience ? Creating complex queries... More from scratch in a Snowflake environment-Experience w/ Azure + SQLPlusses:-SnowPipe exp-Healthcare/Hospital experience-Reporting experienceWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less