We are seeking a highly motivated data engineer to join The Analytics and information management (AIM) team of a global aerospace company. You will be working collaboratively to deliver strategics data driven initiatives in respect of best-in-class data and analytics principles. You will play an active role in designing and building big data pipelines and enabling the technologies to create the efficient data flows required by various data models of both transactional and analytics solutions in a wide variety of areas across the business.
This role requires a deep understanding of Databricks, AWS/ Cloud services with hands-on implementation experience in batch and streaming architectures and Software Engineering best practices.
hat your day to day will look like
· Design, Write and deploy high volume data applications to ingest, transform, and store data
· Design, develop, test, deploy, maintain and improve data integration pipeline
· Develop pipeline objects using Apache Spark / Pyspark / Python / SQL (SQL in the context of spark)
· Data engineer profile data lake
· Good python, spark developer, understands datalake
· Databricks MH ideally (super guy doing Hadoop would be open to it)
· Understands software development lifecycle
· Translate business and analytics requirements into technical solutions
· Write and deploy ETL applications and scripts across a range of data sources and stores
· Practice disciplined software engineering (e.g. automated testing, code reviews, and writing beautiful, pragmatic code)
Actively contribute to team and company standards
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to
HR@insightglobal.com.
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:
https://insightglobal.com/workforce-privacy-policy/ .
· Bachelors degree or M.S. in Computer Science, Computer Engineering.
· 5+ years of experience working in data engineering.
· Expertise with Databricks and knowledge of the AWS technologies.
· Conceptual knowledge of data and analytics, such as dimensional modeling, ELT, reporting tools, data governance, data warehousing, structured and unstructured data
· Strong understanding of agile methodologies, experience as a Data Engineer in a cross-functional agile team preferred
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.