Job Description
• Design and implement ETL/ELT pipelines (batch and real-time) using SQL, Python, PySpark, and Scala.
• Develop and support CDC-based integrations using IBM InfoSphere CDC, ensuring data consistency and recoverability.
• Support orchestration, routing, and integration patterns using App Connect Enterprise (ACE) or similar middleware.
• Enable downstream data delivery using SQL Server Replication where required for legacy consumers.
• Troubleshoot and resolve production pipeline incidents; perform root cause analysis and implement durable remediation.
• Optimize pipeline performance and reliability, including job tuning and SQL optimization.
• Create and maintain technical documentation, runbooks, and operational procedures.
• Mentor other engineers and contribute to standards, code reviews, and delivery best practices.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
• Strong SQL skills with deep experience on SQL Server (data transformation, optimization, and operational troubleshooting).
• Hands-on development with Python and distributed processing using PySpark and/or Scala.
• Experience building and supporting real-time / near-real-time pipelines using CDC tooling (IBM InfoSphere CDC preferred) and replication-based delivery patterns.
• Experience with SSIS for ETL development and support (preferred).
• Experience with enterprise integration/orchestration tooling such as IBM App Connect Enterprise (ACE) (preferred).
• Experience with Databricks and Apache Spark; familiarity with Flink-style streaming patterns.
• Working knowledge of integrating across PostgreSQL and legacy/mainframe-connected sources (integration-focused).
• Strong operational maturity: incident response, root cause analysis, and runbook/documentation discipline.
• Excellent communication skills and ability to collaborate across application, DBA, middleware, and cloud/DevOps teams.
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.