Data Engineer

Insight Global is looking for a Data Engineer to join the Business Intelligence and Analytics team for one of our largest manufacturing clients in South Carolina. This role is to help support a backlog of projects that are in danger of not being delivered on time this year. One of the missions for this team is the flow of data incoming from all other areas of the business and organizing it to the correct flow. The current team is made up of a team leader, technical leader, product developer, and a couple of analysts. This person will lead the design and deployment of data infrastructure, guide junior engineers on best practices in data engineering, participate in DevHuddles to discuss what they are working, and ask questions to align with the other team members. They will also ensure data security and governance standards are met, collaborate with data scientists to optimize data processes, and review and enhance data integration and ETL processes.

We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC "Know Your Rights" Poster is available here.

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Must Haves:
3+ Years experience as a Data Engineer
Pyspark, Python, SQL programming experience (comparable skills can be considered if the candidate knows how to transcript into one of these programs)
Experience with Databricks (specifically DeltaLake)
Must have experience working in the Cloud they use Azure, but GCP or AWS are acceptable
Reliable and secure data infrastructure.
Efficient and scalable data solutions.
Must have soft skills to work with the team to contribute strategic data to make engineering improvements.

Mastery of data engineering tools and frameworks.
Knowledge of data governance and security.
Expert in ETL optimization.
Power BI (Performance) they do not need to build in Power BI, just make improvements for their group.
Advanced scripting and programming skills.

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.