We are seeking an experienced Senior Data Engineer to join our team. The ideal candidate will have extensive experience working with the Azure stack, including Databricks, and expertise in cloud ETL tools such as Informatica. Strong skills in cost optimization and performance optimization are essential, as is a deep understanding of SQL. This person will design, develop, and maintain scalable and efficient data pipelines and ETL processes leveraging Azure services and Databricks. Implement robust data transformation and data integration solutions using Informatica or other cloud ETL tools. Optimize data processing workflows for cost-effectiveness and performance, ensuring high availability and reliability. Write complex SQL queries and stored procedures to extract, transform, and load data from various sources. Collaborate with cross-functional teams, including data analysts and business stakeholders, to understand data requirements and translate them into technical solutions. Constantly research and evaluate new technologies, tools, and best practices to enhance the data engineering capabilities of the organization. Mentor and provide guidance to junior data engineers, sharing knowledge and best practices. Participate in project planning, estimation, and delivery to meet business objectives.
We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to
Human Resources Request Form. The EEOC "Know Your Rights" Poster is available
here.
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:
https://insightglobal.com/workforce-privacy-policy/ .
Hands on - SQL, Python, Data Integration/Ingestion and associated patterns ETL tooling ADF, Notebooks, Databricks, Delta Lake, Warehousing technologies and associated patterns, Cloud platforms Azure preferred.
5+ years of experience as a data engineer, with a strong focus on the Azure stack and Databricks. Experience in data modeling, data architecture, and data warehousing concepts.
Experience with on-prem and cloud versions of databases such as Oracle and SQL Server.Cloud data processing in Azure, AWS, or GCP
Proficient in using cloud ETL tools, such as Informatica, ADF to design and implement data pipelines.
Proven track record in cost optimization and performance optimization of data processing workflows.
Excellent SQL skills, including advanced querying, optimization, and writing stored procedures.
Strong programming skills in languages like Python, Scala, or Spark.
Familiarity with version control systems (e.g., Git) and DevOps practices (CI/CD).
Experience in migrating data and associated systems from on-prem to Cloud environments Ability to work collaboratively in a cross-functional team environment.
Agile delivery frameworks/methodologies (e.g. Scrum, SAFe) and tools (i.e. Jira, AzureDevOps).
Professional certifications in public cloud and tooling Informatica and Azure are highly desired.
Experience with scheduling tools such as Control-M preferred.
Master Data Management/RDM tools: Informatica MDM, IBM MDM, Reltio, R360 is a plus
Prior experience in insurance and/or reinsurance in support of specialty lines is a plus.
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.