Job Description
We are looking for an experienced Infrastructure Engineer to support a growing backlog of work and help deploy a data observability platform. This is a net-new need driven by increased demand and capacity constraints.
This individual will play a key role in building visibility into data pipelines—tracking data from ingestion through processing and storage—while surfacing issues and improving overall data reliability.
Key Responsibilities
Build and deploy a data observability layer/pane of glass to track data flow from ingestion through final storage
Develop solutions to answer: “Where is my data, and how is it moving?”
Integrate with Snowflake and AWS-based ETL tools
Create a lightweight web interface/dashboard to surface data insights and issues
Identify and surface data quality or pipeline issues proactively
Deploy and manage infrastructure using Infrastructure as Code (IaC)
Support event-driven architectures within AWS
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.
Required Skills & Experience
Strong experience with AWS
Terraform
Experience with EventBridge and SQS / SNS
Basic understanding of Azure Devops
Solid understanding of Infrastructure as Code (IaC) principles
Ability to deploy and manage code in cloud environments
Experience with Linux/Unix environments
Nice to Have Skills & Experience
Snowflake
Matillion or similar ETL tools
Experience building data observability/monitoring solutions
Exposure to data pipeline architecture
PII industry knowledge (medical, healthcare, finance, banking, fintech)
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.