An Oil & Gas customer of Insight Global is looking for a Data Engineering Advisor to join their team full-time to sit in The Woodlands, TX, on a hybrid schedule 3 days a week and as needed with travel up to 5% within the Texas area. The IT division's primary goal over the next few years is focused on their Data Transformation efforts that will support all of the company's domains for midstream assets. This person will be designing, developing, and deploying innovative data and analytical solutions to enhance current operations and shape the future of the organization. The salary range for this role is dependent on level of experience with a flexible range of $120,000-$200,000 annually.
Responsibilities:
Design and create data architecture and strategies to facilitate efficient storage and retrieval of structured and unstructured data.
Design, build, and manage data pipelines to ingest, transform, and distribute data between on-premises and Azure-based destinations.
Implement measures to ensure the quality and integrity of data, including data cleaning, validation, and error handling within data pipelines.
Utilize technologies from Qlik, OpenText, SAP Datasphere, and Azure cloud services, including Copilot, Dataverse, Fabric, Data Factory, Logic Apps, Power Automate, Azure Synapse Analytics, Fabric to enable custom applications and BI efforts.
Employ programming languages like Java or Python for automation and API integration tasks.
Work closely with data scientists and developers to provide data necessary for custom applications, visualizations, and analytic models.
Assess, recommend, and integrate new data management technologies, data modeling, relational data structures, and change data capture.
Identify bottlenecks, optimize queries, and fine-tune database or data processing configurations.
We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to
HR@insightglobal.com. The EEOC "Know Your Rights" Poster is available
here.
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:
https://insightglobal.com/workforce-privacy-policy/ .
12+ years of IT experience as a Data Engineer, Data Architect, or Software Developer
In-depth knowledge of Azure cloud services, relational database design principles, data warehousing, performance tuning, and optimization
Strong analytic skills related to working with both structured and unstructured datasets
High level proficiency in T-SQL, ADF Pipelines, SSIS packages, Lift and Shift of existing On-premises processes, database design principles, data modeling and data warehousing
Experience using/setting up Azure DevOps integration with cloud services and setting up CI/CD processes
Understanding of performance analysis and tuning activities to ensure optimal database performance
Excellent communication skills with the ability to interact with developers supporting requirements gathering
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.