Job Description
Summary:
We are seeking a hands-on Principal Data Engineer to lead the development of a new, strategic data initiative focused on regulatory reporting and enterprise data centralization. This is a high-impact role embedded within a cross-functional team, working directly with stakeholders, architects, and engineers to build scalable data solutions that support Large Financial Institution (LFI) compliance and long-term growth.
This is a new development project—not maintenance—offering the opportunity to shape architecture, mentor teammates, and drive innovation in a fully Azure-based environment.
Responsibilities:
- Lead the design and development of data pipelines using Azure Data Factory (ADF) and Databricks
-Build and optimize data flows into a centralized Enterprise Data Platform (EDP) for regulatory and analytical use cases
- Collaborate with architects and business stakeholders to translate requirements into scalable data solutions
- Mentor 2–3 engineers and 1 analyst (dotted-line reporting, no direct reports)
- Ensure strong documentation and promote a collaborative, transparent development culture
- Work closely with onshore and offshore resources to deliver high-quality solutions
- Support data governance initiatives using Informatica and other tools
- Apply strong soft skills to communicate complex technical concepts in layman’s terms
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
- Bachelor’s Degree
- 8+ years of experience in data engineering
- Proven track record in lead roles or having leadership responsibilities
- Expertise in Azure Data Factory (ADF) and building ADF pipelines
- Hands-on experience with Databricks
- Comfortable building and maintaining CI/CD pipelines as part of daily responsibilities
- Proficient in Synapse Analytics and Synapse Notebooks
- Strong skills in PL/SQL and SQL stored procedures
- Familiarity with Python and PySpark (plug-in usage; fluency not required)
- Solid understanding of data warehousing concepts
- Experience working with data governance tools
- Excellent communication, documentation, and stakeholder engagement skills
Nice to Have Skills & Experience
- Familiarity with regulatory reporting and LFI requirements
- Experience with data governance tools, preferably Informatica
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.