Job Description
Selected candidates will coordinate Enterprise Data projects and services delivered to internal clients and will participate on other Data projects that involves a wide range of activities from capability assessment, through architecture and tools deployment, and configuration up to operations and maintenance of relevant processes and technologies.
The Enterprise DevSecOps Data (DSOD) Engineer must have:
Day to Day Responsibilities:
In this role you will assume the responsibility of constructing data ingestion pipelines
Additionally, you will play a vital role in contributing to the development operations (DevOps) process by establishing and maintaining the necessary cloud infrastructure.
Collaboration with other DevSecOps Team members and leadership as we will be a key aspect of this role.
As an Enterprise DevSecOps Data (DSOD) Engineer, you will be an integral member of our Enterprise Data Fabric team responsible for design and development of data pipelines.
You will also have an opportunity to work closely with our existing data science team and work on various business critical predictive use-cases
Build data profiling and ETL jobs using heterogeneous sources such as Salesforce, SAP, Teradata and others
Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability
Accountable for Big Data and batch/real time analytical solutions leveraging Cloud technologies
Work Requirements:
Architect, Design, implement, and maintain scalable and reliable infrastructure solutions in cloud environments; AWS , Snowflake and Databricks. Working knowledge of HCL, GoLang, SQL, Python, Spark,Hands on experience. Stay up to date with emerging technologies, industry trends, and best practices in DevOps, DataOps, and cloud computing. Understanding of infrastructure and data pipelines using Cloud Formation, Terraform, PySpark, Airflow, or similar technologies. Contribute to thought leadership in DevSecOps journey. Working knowledge of common AWS technologies -- EC2, S3, IAM, Lambda, Glue, SNS, others
Have a non-technical debt mindset, Have a Shift Left mindset. Expert knowledge with CI/CD tools, Version control system, JIRA. Develop and maintain CI/CD pipelines, integrating testing and monitoring frameworks to enable rapid and continuous software delivery. Identify the needs for build automation, designing, and implementing CICD solutions. Create plug-and-play/reusable solutions and patterns for CICD pipelines. Create, develop, and implement automation and system integration for various build platforms, Publish and disseminate CICD best practices, patterns, and solutions. Build or maintain CICD building blocks and shared libraries proactively for app and development teams to enable quicker build and deployment, Design action plans to address CICD platform/tools/solutions' shortcomings and difficulties, Actively participate in bridge calls with team members and contractors/vendors to prevent or quickly address problems, Troubleshoot, identify, and fix problems in the DevSecOps domain, Ensure incident tracking tools are updated in accordance with established norms and processes, gather all essential data and document any discoveries and concerns, Identify management concerns and problems, assess them, and offer prompt solutions and/or escalation, Align with technological Systems/Software Development Life Cycle (SDLC) processes and industry-standard service management principles (such as ITIL), Good understanding on release management standard methodologies and data security
Required Skills & Experience
* Bachelor's Degree in Computer Science, Telecommunications or Information Technology or DevSecOps
* 5+ Data Engineering experience in multi cloud environments -- heavy AWS required!
o Professional experience managing infrastructure and data pipelines using Cloud Formation, Terraform, PySpark, Airflow, or similar technologies
Working knowledge of common AWS technologies -- EC2, S3, IAM, Lambda, Glue, SNS, others
o Working knowledge of SQL, Python, Spark,
* Hands on experience. Stay up to date with emerging technologies, industry trends, and best practices in DevOps, DataOps, and cloud computing
Architect, Design, implement, and maintain scalable and reliable infrastructure solutions in cloud environments; AWS, Snowflake and Databricks.
* At least 8 years of experience in the Application Development (DevOps)
o Expert knowledge with CI/CD tools, Version control system, JIRA. Develop and maintain CI/CD pipelines, integrating testing and monitoring frameworks to enable rapid and continuous software delivery.
o Good understanding on release management standard methodologies and data security
* Proficiency in scripting languages, such as HCL, GoLang, Python, Bash, PowerShell.
Nice to Have Skills & Experience
* Internal client focus experience
* Communications skills including the ability to understand client process in any area in detail
* Excellent coordination and communication skills
* Business writing skills (capturing needs and writing it down on formal documents)
* Reliable and with attention to detail
* Ability to work alone and bring results
* Assist us with creating and implementing an IAC Framework
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.