Job Description
Insight Global is looking for a Senior Databricks Platform Engineer to support one of our clients. The individual must have deep hands on expertise in Databricks, cloud migrations, Terraform automation, Spark performance optimization, and cloud fundamentals—specifically across AWS and GCP, as the project involves migrating Databricks workloads from AWS to GCP. The engineer will be expected to assess migration complexity, contribute to platform design, and support real time/streaming use cases. A strong understanding of infrastructure as code, cluster configuration, asset bundling, and performance tuning is essential. This is a contract remote opportunity open to India based resources but must work US Hours.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
• Previous Databricks Migration experience (preferably Databricks on AWS to Databricks on GCP or similar cross cloud re platforming).
• Expertise with Terraform as code for Databricks + cloud; can design TF templates/modules from scratch.
• Strong knowledge on Spark
• Strong GCP Cloud fundamentals - should have an understanding of concepts like blob storage, containers, IAM principals
• GitHub (or similar VCS) – branching, PRs, CI triggers for notebooks/jobs/Terraform
• Python
Nice to Have Skills & Experience
• Previous databricks migration/deployment experience from AWS to GCP
• Streaming applications experience
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.