Job Description
The Senior Data Engineer is a hands-on technical role focused on full stack software development within the Enterprise Data organization. The role will pay curtail part in shaping future bigdata and analytics initiatives. They will be dedicated to a project titled "Project PPK" which is centered around a Knowledge Management application built to standardize the data entry for Service Area Compass documents and enhance CRC user experience. This application is built in Pega with MarkLogic as the backend database, rendering HTML documents for the end users. Responsibilities Include:
* Designs and develops code and data pipelines to ingest from databases (Oracle, SQL Server, DB2, Aurora, MarkLogic), file shares, and web services.
* Streaming ingestion with Kinesis Streams, Kinesis Firehose, Kinesis Analytics and Kafka(MSK)
* Build Data Lake on AWS S3 with optimal performance considerations by partitioning and compressing data.
* Data Engineering and Analytics using AWS Glue, Informatica, EMR, Spark, Athena, Python.
* Data modeling and building Data Warehouse using Snowflake.
* Designs and develops code and data pipelines to ingest relational databases, file shares, and web services.
* Designs JavaScript modules and REST APIs utilizing MarkLogic to support complex searches.
* Develops MarkLogic integrations with existing enterprise platforms.
* Participates in requirements definition, system architecture design, and data architecture design.
* Participates in all aspects of the software life cycle using Agile development methodologies.
Required Skills & Experience
* Bachelor's degree in Computer Science, Computer Information Systems, Engineering, Statistics or closely related field (willing to accept foreign education equivalent).
* Basic knowledge of AWS services for data and analytics.
* 5 years of experience in Data Ingestion, Data Extraction, and Data Integration.
* 5+ years of hands-on experience with a MarkLogic framework.
Nice to Have Skills & Experience
* 7+ years of experience in Enterprise Information Solution Architecture, Design, and development.
* 7+ years of experience with integration architectures such as SOA, Microservices, ETL or other integration technologies.
* 7+ years of experience with working content or knowledge management systems, search engines, relational databases, NoSQL databases, ETL tools, geospatial systems, or semantic technology.
* 5+ years of hands-on experience with AWS services ( S3, Kinesis, Lambda, Athena, Glue, EMR).
* 5+ years of analytics tools like SAS, R, Python, and other advanced statistical software.
* 5+ years of Web development experience with Angular, JavaScript, and Node.js.
* Experience with JSON or XML data modeling.
* Experience with Git/GitHub, branching, and other modern source code management methodologies.
* Domain knowledge of NoSQL or relational database.
* Understanding of database architecture and performance implications.
* Experience integrating Business Intelligence applications like Qlik Sense, Tableau, or PowerBI.
* Experience with Machine Learning and Artificial Intelligence.
* Ability to work collaboratively as part of an Agile Team.
* Extensive knowledge and experience with Python, JavaScript and Java.
* 5+ years of hands-on experience with a MarkLogic framework, DynamoDB preferred.
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.