Job Description
○ Strong expertise with Apache Spark for batch/scheduled processing.
○ Experience with Spark Streaming for real-time data pipelines.
○ Proficiency in the Kafka ecosystem, including Kafka Streams and Kafka Avro schemas.
○ Strong programming skills in Python (primary for data platform jobs) and Java.
○ Hands-on experience with SQL for data modeling, transformation, and analytics.
○ Experience working with Databricks (notebooks, jobs, clusters).
○ Knowledge of Azure Data Factory (ADF) for orchestrating pipeline workflows.
○ Demonstrated AI-assisted coding proficiency using modern LLM-based developer tools.
○ Experience with build tools: Maven and Gradle.
○ Familiarity with Grafana dashboards and observability practices.
○ Experience with Jenkins and/or ArgoCD for DevOps and CI/CD.
○ Hands-on experience working with Kubernetes clusters.
○ Familiarity with Docker and docker-compose.
○ Exposure to Spring, Spring Boot, Spring Kafka, and Spring Cache.
○ Strong experience using Git for version control and collaboration.
○ Full-stack development experience with JavaScript and React.js.
○ Cloud experience with Azure and GCP.
○ Experience with BigQuery (BQ) and GCP Cloud Functions as part of a full-stack workflow.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
Optional/Preferred Skills:
○ Experience with Prometheus for monitoring.
○ Knowledge of Redis and Redis Insight tooling.
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.