Data Pipeline Development
Design and implement complex, scalable ETL pipelines using Azure Fabric, Data Factory, and Synapse.
Build and maintain transformation pipelines and data flows in Azure Fabric.
Source data from diverse systems including APIs, legacy systems, and mainframes (nice to have).
Automate data ingestion, transformation, and validation processes using PySpark and Python.
Maintain source control hygiene and CI/CD pipelines (e.g., Azure DevOps, Jenkins).
Database Design & Optimization
Design and maintain relational and NoSQL databases (SQL Server, Oracle, etc.).
Ensure referential integrity, indexing, and query optimization for performance.
Data Infrastructure Management
Manage data warehouses, data lakes, and other storage solutions on Azure.
Monitor system performance, ensure data security, and maintain compliance.
Data Modeling & Governance
Develop and maintain logical and physical data models.
Implement data governance policies and ensure data quality standards.
Collaboration & Agile Development
Work closely with business and technical teams to gather requirements and deliver solutions.
Participate in agile ceremonies, sprint planning, and code reviews.
Provide technical guidance and mentorship to team members.
We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to
Human Resources Request Form. The EEOC "Know Your Rights" Poster is available
here.
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:
https://insightglobal.com/workforce-privacy-policy/ .
Proven experience with Azure Data Services, especially Azure Fabric for data flows and transformation pipelines.
Strong proficiency in SQL, Python, and PySpark.
Experience with data warehousing, ETL/ELT, and data modeling.
Familiarity with CI/CD, DevOps, and microservices architecture.
Experience with relational (SQL Server, Oracle) and NoSQL databases.
Strong analytical and problem-solving skills.
Excellent communication skills, both written and verbal.
Experience integrating data from mainframes or other legacy systems.
Familiarity with mock data generation, data validation frameworks, and data quality tools.
Exposure to data visualization and BI tools for delivering insights
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.