Insight Global is seeking a Senior Data Engineer to join a real estate tech company. The successful resource must be located in the Greater Vancouver Area. The successful candidate will be supporting the group with the following tasks -
Database Design and Development:
Design and implement robust, scalable, and performance-optimized database solutions using SQL Server and Snowflake.
Develop and maintain database procedures, schemas, tables, indexes, and views to support application requirements.
SQL Server Query Optimization:
Analyze and optimize SQL queries for maximum efficiency and performance.
Identify and resolve performance bottlenecks in database systems through the use of query plans.
Collaborate with application developers to enhance query performance and database responsiveness.
Data Modeling:
Work closely with data engineering to design and implement data models that align with business requirements.
Ensure data integrity and consistency across the database environment.
ETL Processes:
Design, implement, and maintain ETL processes for efficient data extraction, transformation, and loading.
Collaborate with cross-functional teams to integrate data from various sources into the SQL Server database.
Monitoring and Maintenance:
Implement effective monitoring solutions to proactively identify and address potential issues.
Perform routine maintenance tasks such as backups, restores, data purges, and index de-fragmentation.
Experience with Unix and Powershell scripting technologies (running back scripts, basic) --> SSIS for defining ETL pipelines so has call command lines and will call from powershel, backfile, move datafile into S3, scripting simple stuff, not advanced
Collaboration and Documentation:
Collaborate with cross-functional teams, including data scientists, product analysts, and application developers, to understand data requirements.
Participate in architectural discussions and technical decision-making processes.
Effectively communicate technical concepts to non-technical stakeholders.
Document database design, configurations, and procedures.
We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to
HR@insightglobal.com. The EEOC "Know Your Rights" Poster is available
here.
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:
https://insightglobal.com/workforce-privacy-policy/ .
Strong experience with Snowflake, Arora, Postgres, Glue (Spark) or EMR or Spark and Kinesis (streaming)
Strong experience working with QL Server, AWS Glue, Snowflake, Lambda, python
Experience with cloud technologies such as S3 [AWS], EC2, Linux
Strong SQL query experience including having the ability to write high performing queries
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.