Senior Data Engineer

Are you an experienced Senior Data Engineer looking for your next challenge? Our client is seeking a skilled professional to lead the delivery of data on their cutting-edge Data and Analytics Platform. In this role, you'll design and implement batch and real-time data pipelines, ensuring high-quality data is onboarded efficiently while aligning with enterprise data governance standards. You'll collaborate with business stakeholders, data scientists, and IT teams to refine data requirements and drive data engineering best practices. The ideal candidate has expertise in Spark programming with Scala, modern data architectures like Azure Data Lake Storage, Databricks, and Synapse, and a strong background in DevSecOps, streaming data technologies, and database modeling. If you have experience modernizing data platforms and working with Data Vault methodologies, we want to hear from you! Take the next step in your career—apply today!

• 8 month contract
• Fully remote
• Candidates must be eligible for Government of Canada Reliability Security Clearance (5+ years in Canada)

Advantages

Lead Cutting-Edge Projects – Design and implement modern data engineering solutions using Azure, Databricks, and Spark, driving innovation and best practices.

High-Impact Collaboration – Work closely with business leaders, data scientists, and IT teams, shaping data strategies and modernizing platforms.

Responsibilities

Primary Responsibilities

• Proven design, build and implementation of batch and real-time data pipelines. Driven by automated repeatable delivery of data that aligns to enterprise data governance standards.
• Experience in developing and proposing data models that conform to requirements. Responsible to ensure the proposed design optimally addresses access and query patterns; data consumption and adheres to internal architecture standards.
• Experienced collaboration working with various stakeholders across the business, data scientists, and IT. Working closely building relationships, refining data requirements to meet various data and analytics initiatives and data consumption requirements.

Specific Project Requirements

• Increase the overall speed in which data is onboarded to the Data and Analytics platform.
• Building robust data pipelines to enable larger data consumption on the Data and Analytics Platform.
• Increase the overall quality of data pipeline development through DevSecOps.

Qualifications

Top Skills Required :

• Programming experience in Spark using modern languages such as Scala.
• Experience working with modern data architectures like Azure Data Lake Storage, Azure Databricks, Azure Synapse (formerly SQL Data Warehouse) and Delta Lakes.
• Experience leading Data Engineering principles within an organization/team.

Other Skills Required :

• Knowledge and expertise of database modeling techniques: Data Vaults, Star, Snowflake, 3NF, etc.
• Experience working with streaming data architecture and technologies for real-time: Spark Streaming, Kafka, Flink, Storm.
• Experience working with relational and non-relational database technologies: SQL Server, Oracle, Cassandra, MongoDB, CosmosDB, HBase.
• Experience working with source code and configuration management environments such as Azure DevOps, Git, Maven, Nexus.

Assets :

• Experience within Azure environment.
• Strong Scala and Spark experience.
• Experience modernizing data platforms.
• 2 to 3 projects developing Data Vault.

Summary

If you are qualified and interested we encourage you to apply for this exciting opportunity.