Data Engineer

Description

Job Summary:

Ledcor is hiring a Data Engineer to join us on a full-time permanent basis. As the Data Engineer, you will report to the Manager, Data Platform and be responsible for building, maintaining, and optimizing our data infrastructure to empower informed decision-making. As part of your new position, you will be building, testing, and refining data from diverse source systems using modern medallion data lakehouse architecture.

We are committed to the long-term success and wellbeing of our employees. Our total rewards package is designed to provide compensation and benefits programs that support your health, wellness, and financial security, including competitive salaries, profit-sharing programs, exceptional health, dental, and vision plans, life and disability coverages, comprehensive retirement plans, generous vacation and leave, family support benefits, mental health resources, and more. We offer ongoing employee training and development, team building, and career growth opportunities.

This is a work-from-home position with the understanding you will be required in-office as the business needs. Apply today to join our True Blue team in Edmonton, Vancouver, or Toronto!

Essential Responsibilities

• Building, maintaining, and supporting the connection and ingestion of data from source systems to the data platform, e.g., JDE to Databricks.
• Monitor the performance and quality of data transfers between source and target systems.
• Collaborate with the Information Security team on securing connections.
• Build the appropriate connections between source systems and data lakehouse and troubleshoot any issues in relation to the connections.
• Set up pipelines to enable efficient scheduled and triggered full and incremental data ingestion.
• Design, build, and test data pipelines within the data lakehouse.
• Work closely with stakeholders to define objectives and expected outcomes.
• Profile the source data to understand its structure, quality, and relationships.
• Support the Data Architect in defining data models and mapping logic for the lakehouse, including defining schemas, tables, and relationships to organize and store data efficiently, as well as source to target mapping and transformation logic.
• Assist the team in the development of a comprehensive testing strategy covering various aspects such as data quality, accuracy, completeness, and performance, including integration testing, regression testing, and end-to-end testing.
• Develop the Extract, Load, Transform (ELT) processes to transform raw data into the desired format.
• Use appropriate tools and technologies for data integration, manipulation, and transformation (Azure and Databricks).
• Build and test the data flows from source systems to the data lakehouse.
• Implement batch and real-time data processing solutions and data partitioning, indexing, and compression techniques to optimize data storage and query performance.
• Develop processes and documentation for data collection and integration and support training and awareness.
• Establish methods and procedures for tracking data quality, completeness, redundancy, and improvement.

Qualifications

• 6+ years of relevant data engineering experience.
• A bachelor’s degree in a relevant field such as Computer Science, Statistics, or Information Management.
• Experience with business and technical requirements analysis, business process modeling, methodology development, and data mapping.
• Strong project management skills using waterfall and agile methodologies.
• Working experience with Azure, Databricks, Denodo, Snowflakes, Github, Hackolade, and Qlik is preferred.
• Experience with data integration using APIs.
• Computer programming skills in SQL and Python (Must have) and R, JSON, HTML (Nice to have).
• Working knowledge in Agile, DevOps, CI/CD.

Additional Information:

Company Description

The Ledcor Group of Companies is one of North America’s most diversified construction companies, built on a rich history of long-standing project successes.

Do you want a career that means more? Join our True Blue team now!

Employment Equity

At Ledcor, we believe diversity, equity, and inclusion should be part of everything we do. We are proud to be an equal-opportunity employer. All qualified individuals, regardless of race, color, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, Veteran status, or any other identifying characteristic are encouraged to apply.

Our True Blue team consists of individuals from all backgrounds who contribute diverse perspectives and experiences to Ledcor. For more information about Ledcor’s Inclusion and Diversity initiatives, please visit our I&D page. Adjustments will be provided in all parts of our hiring process. Applicants need to make their needs known in advance by submitting a request via email.

2 International Blvd #200, Toronto, ON