Project Scope / Components: This is part of the OptumInsight project where we are working to develop ingestion pipelines for EIP à Extract data and put it into the raw space -- we are using Databricks as the ETL tool. Rather than doing drag and drop dev, we want to use Java & Python to create custom ingestion frameworks. Full tool set is Databricks w/Pyspark or Scala & Java. We will also exposing the analytical interface to EIP w/Scala.
Development Methodology: Agile -- 2 week sprints
* Databricks (NOT looking for Databricks & SQL-[must be w/Scala or Java)
* Pyspark
* Scala is most important
* Azure is HIGHLY preferred but AWS would be ok
* Spark based ETL process
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.