Job Description
Insight Global is looking for two Data Engineer Azure Consultants who will be responsible for designing data models, data flows and integrations patterns necessary to build a robust and optimized cloud-based Azure data warehouse.
-Work with business to understand their current state architecture and contributing data sources, technologies, interfaces, performance issues and system configurations.
-Work closely with the team across the overall data warehousing program including data acquisition, data curation and data syndication.
-Apply knowledge of the Microsoft platform tooling involved in successful Azure implementations.
-Serve as the subject matter expert with respect to Azure, cloud applications and system administration best practices.
-Experience designing data lakes, database schemas and data models for large scale data platform implementation on Azure.
-Develop system integrations using, Azure Logic Apps, Integration services, Power Automate, PowerApps, etc.
-Perform project management activities including project documentation, business requirements and project tracking.
-Ensuring data quality and consistency through data cleaning, transformation, and integration processes.
-Monitoring and troubleshooting data-related issues within the Azure environment to maintain high availability and performance.
-Collaborating with data scientists, business analysts, and other stakeholders to understand data requirements and implement appropriate data solutions.
-Implementing data security measures, including encryption, access controls, and auditing, to protect sensitive information.
-Automating data pipelines and workflows to streamline data ingestion, processing, and distribution tasks.
-Utilizing Azure's analytics services, such as Azure Synapse Analytics, to provide insights and support data-driven decision-making.
-Keeping abreast of the latest Azure features and technologies to enhance data engineering processes and capabilities.
-Documenting data procedures, systems, and architectures to maintain clarity and ensure compliance with regulatory standards.
-Providing guidance and support for data governance, including metadata management, data lineage, and data cataloguing.
Tech Stack:
Python
SQL and NoSQL databases
Scala
Spark-SQL
Experience with Azure: ADLS, Databricks, Stream Analytics, SQL DW, COSMOS DB, Analysis Services, Azure Functions, Serverless Architecture, ARM Templates
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
- 5-10 years of experience
-Experience with Azure: ADLS, Databricks, Stream Analytics, SQL DW, COSMOS DB, Analysis Services, Azure Functions, Serverless Architecture, ARM Templates
-Working knowledge of Azure Analytics features such as Stream Analytics, Machine Learning and Application Insights.
-Modelling and ETL knowledge with Erwin, Azure Databricks, Data Factory, SSIS and Azure Synapse.
-Develop and maintain system integrations using, Azure Logic Apps, Integration Services, Power Automate, PowerApps, etc.
-Microsoft Azure data platform experience with Power BI, Azure Data Lake, data warehouse and Data Factory.
-Knowledge on migrating on-premises applications to Azure PaaS and Azure LaaS.
-Attention to detail and ability to coordinate multiple tasks, set priorities and meet deadlines
-Should be well versed with Data Structures & algorithms
- Excellent analytical and problem-solving skills.
- Ability to work independently as a self-starter, and within a team environment.
- Good Communication skills- Written and Verbal
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.