Data Engineer

We are seeking a highly skilled and proactive Data Engineer to join our Data Management team, with a focus on optimizing cloud-based analytics infrastructure and mentoring technical analysts. This role is critical to enabling data-driven decision-making by ensuring fast, reliable, and governed access to data across the organization. You will work within a cloud-first environment (primarily AWS) to assess and enhance existing data pipelines, reporting workflows, and architecture—especially those built during a recent ERP transition. You’ll also support metadata and master data management initiatives, collaborate across technical and business teams, and help build scalable, secure, and well-governed data solutions.

• Mentor and upskill technical Data Analysts, providing guidance on cloud data engineering best practices.
• Evaluate and optimize existing analytics architecture, workflows, and pipelines—especially those supporting Power BI reporting from AWS Redshift.
• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows for efficient data integration, transformation, and reporting.
• Automate data workflows including validation, monitoring, and CI/CD-based deployments.
• Ensure data quality, consistency, and integrity through validation frameworks and anomaly detection.
• Support metadata management and governance by building connectors and workflows for platforms like Collibra, Informatica, Microsoft Purview, and Ataccama.
• Integrate master data sources (e.g., SAP, Salesforce, Workforce Software) to ensure consistency and a single source of truth.
• Collaborate with architecture leads and business stakeholders to align technical solutions with organizational goals and future capabilities.
• Support migration efforts from legacy dashboards (e.g., Qlik on-prem) to cloud platforms, with a priority on Power BI.
• Contribute to RFPs and platform evaluations for metadata and governance tools.
• Monitor and optimize database performance, storage efficiency, and data processing speed.
• Implement data governance and security at the infrastructure level in compliance with enterprise policies and industry regulations.
Stay current with modern data architecture trends (e.g., Lakehouse, containerization, orchestration)

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

• 3–5 years of hands-on experience in cloud data engineering, with strong expertise in AWS (Redshift, Glue, Lambda, S3, IAM, Step Functions).
• Familiarity with Azure, GCP, and cloud-agnostic architectures to support POCs and evolving platform needs.
• Strong proficiency in SQL (including Spark SQL), Python (PySpark), and Scala.
• Experience with ETL/ELT tools (e.g., AWS Glue, Apache Airflow).
• Experience with big data technologies (e.g., Spark, Redshift, Kafka, Iceberg).
• Experience with NoSQL databases (e.g., DynamoDB, MongoDB).
• Experience managing infrastructure with IaC tools (e.g., Terraform, CloudFormation) and container orchestration (e.g., Docker, Kubernetes).
• Experience designing and implementing CI/CD pipelines using GitHub Actions, SonarQube, etc.
• Solid understanding of cloud monitoring and logging tools (e.g., CloudWatch).
Strong communication and collaboration skills across technical and business teams.

• Experience with metadata management and governance platforms (e.g., Collibra, Atlan, Informatica MDM, Microsoft Purview).
• Comfortable providing technical guidance and mentorship to peers and stakeholders.
• Exposure to master data management practices and integration with platforms like SAP, Salesforce, and Snowflake.
• Experience working in ERP transition environments and optimizing rushed reporting setups.
Ability to work independently and make informed decisions with minimal guidance.

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.