Job Description
We are seeking a highly skilled and experienced Data Architect to join our team and play a critical role in ensuring the quality, reliability, and performance of our data platform. This role involves close collaboration with data engineering, analytics, IT, and vendor teams to support data operations, infrastructure optimization, and AI/ML model deployment.
Responsibilities:
Collaborate with Data Engineering and Business teams to define and monitor KPIs, SLAs, and SLIs for data quality and availability.
Validate data pipeline executions to ensure timely completion within defined SLAs.
Troubleshoot and resolve issues related to data pipelines, integrations, bugs, and performance bottlenecks.
Work cross-functionally with Data Engineering, Business Analytics, IT, and Vendor Support to resolve incidents and problems.
Continuously monitor data flows and set up alerts for anomalies and disruptions.
Implement role-based security, including Active Directory integration, security policies, and auditing across the data platform.
Test data against business logic and operational thresholds to ensure accuracy and reliability.
Support AI/ML model development and operationalization in collaboration with Data Scientists.
Monitor and optimize data platform infrastructure costs.
Provide on-call support for critical (P1) issues on a rotational basis, including weekends and holidays.
Thrive in a collaborative and intellectually curious environment.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
Bachelor’s degree in Computer Science or a related field.
8+ years of experience as a Data Engineer, with a strong background in Azure big data tools.
Hands-on experience with Azure Databricks, Azure Synapse, HDInsight, and ADLS.
Proficiency in SQL and NoSQL databases.
Strong analytical and problem-solving skills for working with structured and unstructured datasets.
Experience with data pipeline and workflow management tools such as Azure Data Factory (ADF) and Logic Apps.
Familiarity with Azure cloud services including VMs, Azure SQL DB, and Azure Synapse.
Experience with stream-processing systems like Azure Streams.
Proficient in Python scripting, including development of Python notebooks.
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.