Job Search Results for data engineer

A client is seeking a Data Engineer to support their data pipeline with the below responsibilities:?Design and develop scalable data pipelines to collect, process, and store large volumes of... More data.?Collaborate with data scientists and analysts to drive scope & requirements as well as deliver strong technical design of data analytics solutions.?Ensure data quality and integrity through cleansing processes, validation, and automated testing.$130,000 to $140,000 - Exact compensation may vary based on several factors, including skills, experience, and education. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a highly skilled Data Engineer with over 4+ years of experience to join our team to help a strategic banking client in various data transformation activities. Key... More Responsibilities: ?Collaborating with cross-functional teams to understand data requirements, and design efficient, scalable, and reliable ETL processes using Python and Databricks?Developing and deploying ETL jobs that extract data from various sources, transforming them to meet business needs.?Taking ownership of the end-to-end engineering lifecycle, including data extraction, cleansing, transformation, and loading, ensuring accuracy and consistency.?Creating and managing data pipelines, ensuring proper error handling, monitoring and performance optimizations?Working in an agile environment, participating in sprint planning, daily stand-ups, and retrospectives.?Conducting code reviews, providing constructive feedback, and enforcing coding standards to maintain a high quality.?Developing and maintaining tooling and automation scripts to streamline repetitive tasks.?Implementing unit, integration, and other testing methodologies to ensure the reliability of the ETL processes?Utilizing REST APIs and other integration techniques to connect various data sources?Maintaining documentation, including data flow diagrams, technical specifications, and processes.?Designing and implementing tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.?Collaborate seamlessly across diverse technical stacks, including Databricks, Snowflake, etc.?Developing various components in Python as part of a unified data pipeline framework.?Contributing towards the establishment of best practices for the optimal and efficient usage of data across various on-prem and cloud platforms.?Assisting with the testing and deployment of our data pipeline framework utilizing standard testing frameworks and CI/CD tooling.?Monitoring the performance of queries and data loads and perform tuning as necessary.?Providing assistance and guidance during QA & UAT phases to quickly confirm the validity of potential issues and to determine the root cause and best resolution of verified issues.?Adhere to Agile practices throughout the solution development process.?Design, build, and deploy databases and data stores to support organizational requirements.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global?s client is looking for a Senior Data Engineer to join their Finance and Operations team, responsible for designing and maintaining Azure-based data pipelines and APIs, building and... More optimizing ETL processes, managing large datasets, troubleshooting data issues, and documenting technical solutions. The ideal candidate will have strong coding skills in Python and SQL, experience with dbt, Azure DevOps, and CI/CD best practices, and a solid understanding of data warehousing principles. Success in this role requires excellent communication, a collaborative mindset, and proactive problem-solving to mitigate blockers and deliver scalable solutions. Candidates with experience in tools like Snowflake, Airflow, or Terraform, familiarity with infrastructure as code, and exposure to financial and operational data domains will stand out. This is a full-time onsite position in either the Jacksonville, D.C., or New Jersey office, working closely with global teams to ensure data quality, automation, and continuous improvement. Compensation ranges from $70-74 an hour based on experience.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

-Administer and optimize Azure Databricks, including clusters, jobs, and user access.-Manage Snowflake environments (warehouses, roles/permissions, performance tuning, cost optimization).-Design,... More implement, and monitor Azure Data Factory (ADF) pipelines for batch and streaming workloads.-Enable data movement and replication across global environments.-Orchestrate pipelines using ADF, Apache Airflow, and automation frameworks.-Automate processes and reduce manual effort with Python, PySpark, SQL, and PowerShell.-Work with Azure Data Lake Storage (ADLS), Function Apps, and Key Vault for secure and efficient data operations.-Ensure compliance with security, governance, and cost management best practices.-Collaborate with Data Engineering, DNA, and Data Science teams to ensure high availability and reliable data delivery.-Troubleshoot platform issues, implement fixes, and contribute to runbooks and documentation.-Partner with architects and engineers to continuously improve platform scalability, reliability, and efficiency.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

GCP Data Engineer certificationHealthcare/clinical data experiencedbt, data mesh, ML workflows, Docker/KubernetesWe are a company committed to creating diverse and inclusive environments where people... More can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

An employer is looking for a Sr. Data Engineer in the Seattle, WA area. This entertainment company is looking for a Sr. Data Engineer to join their consumer business division. They are dealing with... More large amounts of television and digital data around their customers. This person will be responsible for their Data Warehouse as they evolve into a more cloud based environment. Someone with AWS and Snowflake experience would be a standout candidate. However, if you have an expertise in Python for developing ETL pipelines, data warehousing, and some cloud experience, this could be a fit for you. This group is looking for a team player who's interested in learning new technologies in an evolving organization. If this sounds like you, please apply today!We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

An Oil & Gas customer of Insight Global is looking for a Data Engineering Advisor to join their team full-time to sit in The Woodlands, TX, on a hybrid schedule 3 days a week and as needed with... More travel up to 5% within the Texas area. The IT division's primary goal over the next few years is focused on their Data Transformation efforts that will support all of the company's domains for midstream assets. This person will be designing, developing, and deploying innovative data and analytical solutions to enhance current operations and shape the future of the organization. The salary range for this role is dependent on level of experience with a flexible range of $120,000-$200,000 annually. Responsibilities:Design and create data architecture and strategies to facilitate efficient storage and retrieval of structured and unstructured data.Design, build, and manage data pipelines to ingest, transform, and distribute data between on-premises and Azure-based destinations.Implement measures to ensure the quality and integrity of data, including data cleaning, validation, and error handling within data pipelines.Utilize technologies from Qlik, OpenText, SAP Datasphere, and Azure cloud services, including Copilot, Dataverse, Fabric, Data Factory, Logic Apps, Power Automate, Azure Synapse Analytics, Fabric to enable custom applications and BI efforts.Employ programming languages like Java or Python for automation and API integration tasks.Work closely with data scientists and developers to provide data necessary for custom applications, visualizations, and analytic models.Assess, recommend, and integrate new data management technologies, data modeling, relational data structures, and change data capture.Identify bottlenecks, optimize queries, and fine-tune database or data processing configurations.We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Less

The candidate will manage and optimize the Power BI reporting environment, design and maintain dashboards, and ensure data accuracy and integrity. They will build data pipelines using... More Databricks/Azure tools, automate data ingestion, and collaborate with cross-functional teams to gather requirements and deliver actionable insights. Responsibilities include troubleshooting user issues, performance optimization, enforcing governance standards, and maintaining documentation.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are seeking a highly skilled Software Engineer with expertise in Python, AWS, and coding best practices. The ideal candidate will have a strong background in software development, cloud computing.... More You will be responsible for developing and maintaining scalable software solutions that power our products and services.Key Responsibilities:?Design, develop, and maintain high-quality software solutions using Python.?Utilize AWS services to build, deploy, and manage applications in the cloud.?Has strong knowledge of cloud data engineering principles and manages Python based data pipelines.?Write clean, maintainable, and efficient code.?Collaborate with cross-functional teams to define, design, and ship new features.?Troubleshoot and resolve complex technical issues and bugs.?Perform code reviews and provide constructive feedback to peers.?Stay up-to-date with the latest industry trends and technologies to ensure our solutions remain current and competitive.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

A top financial service client is seeking an Associate to join the Investment Infrastructure and Technology team. The role is focused on designing, building, and optimizing core technology... More infrastructure that powers applications and tools used by front-office professionals, executives, and other internal business units. Key areas include data warehouse, database management, application development, reporting systems, and ad-hoc initiatives that support business operations. The position offers significant opportunities to apply modern technologies and innovative solutions to drive operational efficiency. The candidate will contribute to system integration efforts and data pipeline development, enabling seamless connectivity between enterprise systems and the data warehouse. The candidate will develop and maintain reports and dashboards related to the firm?s investment portfolio, and act as a technical liaison across all departments and affiliated business partners. The ideal candidate has an entrepreneurial personality with a strong ownership mentality, technical background, and the ability to handle multiple, ongoing projectsResponsibilities include:? Manage Snowflake infrastructure for efficient data warehousing, including real-time change data capture (CDC) to support data and reporting needs ? Design and implement internal application and automation solutions, including LLM enabled agents, to streamline workflows across investment verticals and operational teams ? Develop and maintain internal dashboards and reporting tools that support data-driven decision-making by senior leadership ? Design and integrate pipelines into the data warehouse for reporting and analytics ? Contribute to the creation and enforcement of standardized, systematic processes and best practices ? Collaborate cross-functionally with Portfolio Analytics, Originations, Underwriting, Investor Relations, Operations, Finance, and Marketing teams on data requests and special projectsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less