Senior Data Engineer

Job Description

Insight Global is seeking a Senior Data Engineer to join a real estate tech company. The successful resource must be located in the Greater Vancouver Area. The successful candidate will be supporting the group with the following tasks:

1. Database Design and Development:
   Design and implement robust, scalable, and performance-optimized database solutions using SQL Server and Snowflake. Develop and maintain database procedures, schemas, tables, indexes, and views to support application requirements.
2. SQL Server Query Optimization:
   Analyze and optimize SQL queries for maximum efficiency and performance. Identify and resolve performance bottlenecks in database systems through the use of query plans. Collaborate with application developers to enhance query performance and database responsiveness.
3. Data Modeling:
   Work closely with data engineering to design and implement data models that align with business requirements. Ensure data integrity and consistency across the database environment.
4. ETL Processes:
   Design, implement, and maintain ETL processes for efficient data extraction, transformation, and loading. Collaborate with cross-functional teams to integrate data from various sources into the SQL Server database.
5. Monitoring and Maintenance:
   Implement effective monitoring solutions to proactively identify and address potential issues. Perform routine maintenance tasks such as backups, restores, data purges, and index de-fragmentation. Experience with Unix and Powershell scripting technologies (running back scripts, basic) --> SSIS for defining ETL pipelines so has call command lines and will call from powershell, backfile, move datafile into S3, scripting simple stuff, not advanced.
6. Collaboration and Documentation:
   Collaborate with cross-functional teams, including data scientists, product analysts, and application developers, to understand data requirements. Participate in architectural discussions and technical decision-making processes. Effectively communicate technical concepts to non-technical stakeholders. Document database design, configurations, and procedures.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: Workforce Privacy Policy.

Minimum Qualifications:
Strong experience with Snowflake, Arora, Postgres, Glue (Spark) or EMR or Spark and Kinesis (streaming). Strong experience working with SQL Server, AWS Glue, Snowflake, Lambda, Python. Experience with cloud technologies such as S3 [AWS], EC2, Linux. Strong SQL query experience including having the ability to write high performing queries.

Nice to Have Skills & Experience

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.