Job Description
We are seeking a Data Engineer to design, build, and optimize data pipelines and analytics solutions supporting CELA Customer Security & Trust cybersecurity and compliance initiatives. This role involves working with large-scale datasets, enabling real-time insights, and ensuring data integrity across distributed systems.
Responsibilities
Develop and maintain ETL pipelines using Azure Data Factory, Databricks, and Azure Synapse or Fabric.
Implement data ingestion and transformation workflows for Kusto (Azure Data Explorer) and other analytical platforms.
Optimize data models and storage strategies for high-volume telemetry and security datasets.
Collaborate with engineering and product teams to define requirements and deliver scalable solutions.
Ensure data quality through automated testing, validation, and monitoring.
Contribute to CI/CD processes for data workflows using Azure DevOps.
Troubleshoot performance issues and implement best practices for secure and efficient data handling.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
Technical Requirements (Industry Standard)
Languages: Proficiency in Python, SQL, and familiarity with C# for integration tasks.
Cloud Platforms: Strong experience with Azure services (Data Factory, Synapse, ADLS, Event Hub, Service Bus).
Data Systems: Knowledge of Kusto Query Language (KQL), relational databases, and NoSQL stores.
Big Data Tools: Exposure to Spark, Databricks, or equivalent frameworks.
Version Control & CI/CD: Hands-on experience with Git, Azure DevOps, and automated deployment pipelines.
Security & Compliance: Understanding of secure data handling, encryption, and governance standards.
Preferred: Experience with Power BI for reporting and visualization.
Soft Skills
Strong problem-solving and analytical mindset.
Ability to work in a fast-paced, cross-functional environment.
Excellent communication and documentation skills.
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.