Job Search Results for data engineer

The primary role of the Data Engineer-Developer is to function as a critical member of a data team by designing data integration solutions that deliver business value in line with the company?s... More objectives. They are responsible for the design and development of data/batch processing, data manipulation, data mining, and data extraction/transformation/loading into large data domains using Python/Pyspark and AWS tools. Responsibilities:?Provide scoping, estimating, planning, design, development, and support services to a project.?Identify and develop the Technical detail design document.?Work with developers and business areas to design, configure, deploy and maintain custom ETL Infrastructure to support project initiatives.?Design and develop data/batch processing, data manipulation, data mining, and data extraction/transformation/loading (ETL Pipelines) into large data domains.?Document and present solution alternatives to clients, which support business processes and business objectives.?Work with business analysts to understand and prioritize user requirements?Design, development, test, and implement application code?Follow proper software development lifecycle processes and standards?Quality Analysis of the products, responsible for the Defect tracking and Classification?Track progress and intervene as needed to eliminate barriers and ensure delivery.?Resolve or escalate problems and manage risk for both development and production support.?Maintain deep knowledge and awareness of technical & industry best practices and trends, especially in technology & methodologies.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

An employer in The Woodlands, TX area is seeking a Sr. Data Engineer to join their team. Currently, this team is responsible for integration and enhancement of the enterprise organization's... More applications and systems. This role will own the integration and enterprise data architecture supporting the Dynamics 365 ecosystem and related business platforms, ensuring reliable and scalable data flows across the organization. The individual designs and delivers Microsoft Fabric data solutions that enable operational reporting, analytics, and data-driven decision-making across the company?s diverse portfolio. They will lead Power BI and semantic model strategy, supporting trusted reporting and dashboards used by business leaders and executive stakeholders. This position will play a key role in modernizing ERP reporting, supporting the transition from legacy systems to Dynamics 365 while maintaining financial accuracy and business continuity. Additionally, by partnering closely with technology, cybersecurity, and business teams, this role will ensure data solutions align with governance, compliance, and security standards. This is a permanent opportunity paying $140,000 - 150,000 annuallyWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking to hire a Sr. Data Engineer for a retail client based in Vancouver. This role is a hybrid position and requires 3 days onsite per week in Downtown Vancouver. You will be... More joining a team that works heavily with customer data?owning the customer data pipelines that gather data coming from multiple sources and consolidating that data for different use cases. Some use cases include segmentation, data and analytics, advanced analytics for ML models to generate product recommendations, etc.You will have a strong knowledge of the Azure infrastructure and can build Azure pipelines. You will make general recommendations to the client on how to improve the current infrastructure. This role is not tied to a certain body of work; rather, you will support multiple workstreams and work with the Product teams to prioritize. Other duties and responsibilities include:Data pipeline creation and maintenanceStack: GCP, Azure Cloud, Azure Databricks, SnowflakeIncludes engineering documentation, knowledge transfer to other engineers, future enhancements, and maintenanceCreate secure data views and publish them to the Enterprise Data Exchange via Snowflake for other teams to consumeData pipeline modernization and migration via Databricks Delta Live Tables (DLT) and Unity CatalogLeverage existing CI/CD processes for pipeline deploymentAdhere to PII encryption and masking standardsOrchestration tools: ADF, Airflow, FivetranLanguages: SQL, PythonData Modeling: Star and Snowflake schemasStreaming: Kafka, Event Hubs, Spark, Snowflake StreamingDevOps Support: Support improvements for current CI/CD processesProduction monitoring and failure supportWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is seeking a Data Engineer for one of our largest financial clients in Chandler, AZ. This individual is responsible for designing, building, and maintaining scalable data pipelines and... More integration platforms that support enterprise configuration management, service management, and automation use cases. This role requires strong expertise in data engineering fundamentals, CMDB data models, and ServiceNow platform integrations, with a focus on data quality, lineage, and operational reliability.The Data Engineer will collaborate closely with CMDB owners, ServiceNow developers, infrastructure teams, and business stakeholders to ensure accurate, timely, and governed data flows that enable reliable IT operations, dependency mapping, reporting, and automation across the enterprise.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are seeking a Senior / Staff Data Engineer with deep Python and Google Cloud Platform (GCP) experience to design, build, and support scalable, cloud-native data pipelines. This role is highly... More hands-on while also providing technical leadership across data engineering initiatives.You will work closely with data engineers, analytics, BI, and business stakeholders to deliver high-quality, reliable data products that power analytics, reporting, and near real-time insights. This role plays a key part in shaping data engineering standards, mentoring others, and enabling self-service analytics across the organization.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

An employer is looking for a highly-skilled Field Engineer to join one of our largest national general contractor clients for a long term contract (18-months) supporting a large-scale data center... More buildout. In order to be successful on this team you must live within a commutable distance to Pampa, TX as you'll be required to go on site daily to work cross functionally with stakeholders and senior level leadership.Responsibilities:Jobsite:? Responsible for the implementation and management of jobsite-wide IT work providing input and deliverables in all phases.? Analyzes, prioritizes, troubleshoots, and resolves technical issues with the network connections in the primary and all trailers and buildings where Mortenson internet exists.? Interacts in person, via telephone, email, IM, and web interface to assist the jobsite team and HQ IT teams with network configuration.? Installs and maintains software/hardware/networks at jobsites and offices.? Determines, recommends, procures, and executes which products or services best fit the needs of the project teams, while maintaining Mortenson IT standards and best practices.? Works with service providers and trade partners to install and implement jobsite technologies.? Implements and follows jobsite standardization practices.? Responsible for scheduling and organizing visits to jobsites and offices.? Primary support includes but is not limited to diagnosing & troubleshooting network connections, configurations and hardware.? Coordinates and tracks IT project deadlines and tasks.Standards:? Responsible for maintaining company security through established tools.? Provides IT training during onboarding and provisions assets following established best practices.? Provides relevant input for technical and process improvements to contribute and the overall effectiveness of Mortenson?s IT and Network organization.? Takes initiative to work with other cross-functional IT team members to improve the quality of service.? Responsible for mobilization and demobilization of IT equipment at jobsites.Support:? Secondary support, as needed, includes liaising with jobsite teams and assisting with troubleshooting and resolving any technology questions or software solution. Questions that cannot be resolved right away will have tickets submitted in ServiceNow.? Ensures quality customer service by maintaining ownership of escalated issues until resolved, including communication and root cause analysis.? Responsible for creating, tracking, and resolving incidents and tasks in ServiceNow.? Follows ITIL processes for incident and problem management.? Records, tracks, and audits equipment using the established asset management system (ServiceNow) and processes, including asset recovery at jobsites.? Documents best practices and known fixes in ServiceNow knowledge base.? Creates a positive support experience and builds strong relationships through deep problem understanding, ensuring timely resolution or escalation, communicating promptly on progress, and handling customers with a consummately professional attitude.Position Requirements:? Primary: Technically skilled in networking Cisco/Meraki (MX, Router, Switch, VPN), Networking Protocols (TCP/IP, DHCP).? Secondary: Able to support video conferencing and scheduling hardware/software. Skilled in Microsoft Office 365 and supporting diverse applications.? Ability to learn on the fly.? Ability to react quickly and efficiently to high pressure situations.? Excellent organizational and interpersonal skills.? Perform quality work within deadlines with or without direct supervision.? Interact professionally with other employees, customers, and suppliers.? Work effectively as a team contributor on all assignments.? Work independently while understanding the necessity for communicating and coordinating work efforts with other employees and organizations.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

We are seeking a mid to senior level Business/Data Analyst with a strong engineering and solution design mindset to partner with the business on the retirement of a long standing SAS analytics... More platform. This role will play a critical part in understanding current-state analytics usage, gathering and documenting requirements, and designing future-state solutions using modern data and reporting tools.The primary mission is to support the decommissioning of the existing SAS product (licenses not being renewed) and help transition the organization to appropriate alternative platforms by the end of 2026. Key Responsibilities:?Partner directly with business stakeholders to understand how the current SAS platform is being used today?Conduct deep-dive discovery sessions to gather detailed reporting, analytics, and data requirements?Document current-state functionality, including: oWhat reports, jobs, and processes existoWhat business needs they supportoHow and where the logic is implemented?Analyze existing SAS jobs, workflows, and analytical processes to determine migration or retirement paths?Design future-state analytics and reporting solutions aligned to organizational standards and capabilities?Evaluate and recommend alternative platforms and tools based on use case and complexity, including: oSnowflake with SQLoSAP BusinessObjectsoOther enterprise analytics or reporting solutions?Determine whether business needs are best met through: oBusinessObjects reportingoDatabase-level logicoNew dashboards or enhanced access to existing data?Work with engineering and data teams to develop solutions into production, including pipelines or reusable functionality where appropriate?Act as a technical liaison who can translate between business needs and technical implementation?Support solutioning discussions such as: o?We need XYZ report? ? determine tool selection, data source, and implementation approach?Contribute to broader data and analytics transformation initiatives as the organization modernizes its analytics stackPay Rate: 60/hrWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Responsibilities? Work closely with Subject Matter Experts (SMEs) to design and develop the ontology (data model) and data pipelines.? Design, implement, and maintain robust data pipelines and ETL... More processes.? Develop and optimize cloud-based data storage and processing solutions.? Collaborate with data analysts and data scientists to understand data requirements and deliver high-quality data solutions.? Ensure data integrity and security across all data workflows and storage solutions.? Monitor and troubleshoot data pipelines, addressing any issues promptly to ensure the smooth flow of data.? End to End data pipeline development ? responsible for using Python and Pyspark to perform ETL and derive new datasets necessary for business applications.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Design, build, and optimize BigQuery datasets and SQL modelsDevelop and maintain batch and streaming pipelines using Dataflow/BeamOrchestrate workflows in Airflow/Cloud ComposerImplement scalable... More ETL/ELT pipelines with incremental and CDC patternsTune performance and manage query/storage costsEnsure data quality, schema evolution, and lineage trackingCollaborate with analytics, engineering, and business teamsSecure sensitive data using best practices for complianceMonitor pipelines, troubleshoot failures, and improve reliabilityContribute to code reviews, documentation, and platform standardsWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less

Insight Global is looking for a Sr. Data Engineer (DevOps) to work 4 days on-site in Santa Clara, CA for a fast-growing technology company specializing in secure networking solutions?including... More SD-WAN, SASE, and SSE?that is helping global enterprises modernize their IT infrastructure for the cloud era. Led by industry veterans and backed by top-tier investors, the company is focused on innovation, scalability, and preparing for a future IPO.The Data DevOps Engineer will join the Machine Learning and AI team to build and maintain scalable data infrastructure supporting intelligent systems and analytics. This role involves close collaboration with DevOps, Data Science, and Software Engineering teams.? Design, build, and maintain robust data pipelines for ML/AI products.? Integrate infrastructure automation and deployment workflows with DevOps teams.? Implement new features and optimize data flow in collaboration with Data Scientists and Engineers.? Enhance monitoring, logging, and debugging capabilities across data systems.Ensure scalability, reliability, and performance of data infrastructure.Salary Range - $180,000 - $220,000We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.Less