Insight Global is seeking a skilled and motivated Big Data Engineer to join our clients GenAI applications team based out of India. This role is part of a strategic initiative to migrate their data infrastructure from on-premise to Google Cloud Platform (GCP). You will work closely with a high-performing team of engineers and leaders to build scalable data solutions and support cloud-native application development.
Key Responsibilities:
Design, develop, and maintain scalable big data pipelines and applications.
Collaborate with cross-functional teams to support the migration from on-prem to GCP.
Contribute to the development of GenAI-powered applications and services.
Participate in whiteboarding sessions and technical discussions to solve complex problems.
Ensure high performance, reliability, and scalability of data systems.
Work closely with senior engineers and leadership to align with project goals.
We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to
Human Resources Request Form. The EEOC "Know Your Rights" Poster is available
here.
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:
https://insightglobal.com/workforce-privacy-policy/ .
35 years of hands-on experience in Big Data engineering.
Proficiency in Python (Java is a plus).
Strong understanding of Google Cloud Platform (GCP) services and architecture. GCP certification is a plus.
Solid problem-solving skills and a structured thought process.
Experience with data migration and cloud-native development is highly desirable.
Experience with building RESTful APIs
Thorough understanding of JSON, and data structure fundamentals
Expertise in objected oriented analysis and design across a variety of platforms
Fundamental knowledge of distributed computing and Experience in Big Data Technologies like Spark, Hive, distributed computing.
Experience with workflow scheduling tools. Airflow experience is desirable.
Demonstrated experience in Agile development, application design, software development, and testing
Hands-on expertise with application design, software development and automated testing
Experience with distributed (multi-tiered) systems, algorithms, and relational databases
Aptitude for learning and applying programming concepts
Ability to effectively communicate with internal and external business partners
Experience working in hybrid teams and agile environments.
Exposure to GenAI or AI/ML-based applications.
Familiarity with vendor collaboration (e.g., Infosys, IBM, CDS).
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.