Job Description
A fortune 50 organization is seeking a Data Engineer that will work hybrid onsite in Sao Paulo Brazil for a contract to hire position. We are seeking a Data Engineer, someone who thrives in an environment continuously integrating and deploying data products and analytics driving business value. The Data Engineer is responsible for delivery, adherence to standards, and collaborating with team members. The Data Engineer collaborates with teams to ensure delivery and contributes to technical design and process improvements. The Data Engineer is a team player who sees problems as challenges to be creatively solved in collaboration with other data engineers, data scientists, and business colleagues. The ideal candidate is a driven learner who develops and sharpens skills building data pipelines, transforming raw data into useful data systems, and optimizing the data delivery architecture.
Job Responsibilities
• Responsible to design, build, refactor, and maintain data pipelines using SQL, Azure Data Factory, Databricks, and PySpark to meet business requirements for reporting, analysis, and data science
• Responsible to teach, adhere to, and contribute to DataOps and MLOps standards and best practices to accelerate and continuously improve data system performance
• Responsible to integrate fault tolerance and enhancements into data pipelines to improve quality and performance
• Responsible to perform root cause analysis and solve problems using analytical and technical skills to optimize data delivery and reduce costs
• Engages business end users and shares responsibility leading a delivery team.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
5+ years of experience as a Data Engineer
4+ years of experience with SQL
2+ years of experience creating ETL/ELT pipelines using Azure Data Factory (ADF)
2+ years of experience with PySpark
2+ years of experience with Databricks
Experience deploying to the cloud (preferably Azure)
Strong communication skills in both English and Portuguese
Nice to Have Skills & Experience
Data Visualization using PowerBI or Databricks
Experience with Azure DevOps (ADO)
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.