Data Platform Engineer

Refer below link for corporate privacy link:

Work with stakeholders to understand data sources and Data, Analytics and Reporting team strategy in supporting within our on-premises environment and enterprise AWS cloud solution.

Work closely with Data, Analytics and Reporting Data Management and Data Governance teams to ensure all industry standards and best practices are met.

Ensure metadata and data lineage is captured and compatible with enterprise metadata and data management tools and processes.

Run quality assurance and data integrity checks to ensure accurate reporting and data records.

Ensure ETL pipelines are produced with the highest quality standards, metadata and validated for completeness and accuracy.

Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.

Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization.

Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.

Write unit/integration tests, contribute to engineering wiki, and document work.

Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.

Define company data assets (data models), spark, sparkSQL jobs to populate data models.

Design data integrations and data quality framework.

Design and evaluate open source and vendor tools for data lineage.

Work closely with all business units and engineering teams to develop strategy for long term data platform architecture.

Understand database, storage, collection and aggregation models, techniques, and technologies – and how to apply them in business.

Focus on structured problem solving.

Demonstrate phenomenal communication and business awareness.

Work with ETL tools, querying languages, and data repositories.

Working experience with the following Cloud platforms is a plus: Amazon Web Services, Google Cloud Platform, Azure.

Support technical Data Management Solutions.

Provide support to the development and testing teams to resolve data issues.

Working knowledge of source code control tools such as GIT.

Knowledge about file formats (e.g. XML, CSV, JSON), databases (e.g. Redshift, Oracle) and different types of connectivity is also very useful.

Working experience with data modeling, relational modeling, and dimensional modeling.

Possess strong interpersonal skills. You have a way of speaking that engages your audience and instills confidence and credibility. You know how to leverage communication tools and methodologies. You can build relationships with internal and external team members, positioning yourself as a trusted advisor. You are always looking for ways to improve processes, and you always ensure your communications have been received and are clearly understood. Your commitment and focus influence those around you to do better.

Qualifications:

A strong foundation in Object-Oriented Design and Programming (Design Patterns, SOLID principles, etc.).

Experience in projects involving AWS Lambda, Glue, Redshift, Step Functions, CloudFormation, Athena, QuickSight, and AppFlow.

Must have intermediate to advanced-level programming experience in Python and SQL.

Capability to perform performance analysis, troubleshooting, and remediation.

Understanding of cloud ecosystem and leading-edge cloud emerging technologies.

A software developer that obsesses over their craft to write smart, simple, and clean code.

Experience with Test-Driven Development.

Experience with refactoring, and able to manage technical debt within each iteration.

Comfortable with Collective Code Ownership and Pair Programming.

Understand and able to balance the trade-offs between up-front and emergent architecture.

Skilled with Automated Builds and Continuous Integration.

Experience with data models and DB interface development and optimization.

Skilled with Linux including scripting.

Experience with SFDC is an asset.

Bachelor’s degree in Computer Science, Computer Engineering or equivalent training and experience.

5 years related experience in data engineering.

Our Offer

• Competitive salary, bonus structure.
• Competitive vacation package.
• Community culture.
• Continued education budget.
• Expect excellence: Collaborative team, learn, and grow with a high-performance team.

407 ETR's Information Technology division is responsible for the infrastructure and software to enable the efficient operation of the highway—including toll capture, account management, financials, and data storage/analytics—as well as customer services including call-center, web, IVR and supporting workflows.

Delivery is accomplished using an Agile-Scrum approach, including self-organization, short iterations, strong collaboration, and dedicated teams in scrum rooms.

About 407 ETR

Highway 407 ETR is an all-electronic open-access toll highway located in the Greater Toronto Area in Ontario, Canada. The highway spans 108 kilometres from Burlington in the west to Pickering in the east.

407 International Inc. is the sole shareholder of 407 ETR and is owned by:

• Canada Pension Plan Investment Board (CPP Investments) through indirectly-owned subsidiaries (50.01%);
• Cintra Global S.E. which is a wholly-owned subsidiary of Ferrovial S.A. (43.23%); and
• AtkinsRéalis, formerly known as SNC-Lavalin (6.76%).

Note:At 407 ETR, we are committed to fostering a diverse, equitable, and inclusive work environment. We value the unique perspectives and backgrounds of all individuals, and we firmly believe that our individual differences make us stronger as a whole.

Our commitment to inclusion extends beyond recruitment and encompasses an inclusive workplace culture through raising awareness, ongoing training, and encouraging feedback. We aim to create a safe and supportive environment where all employees can thrive.

Accommodation for disabilities or other grounds protected by human rights legislation are available upon request for candidates taking part in all aspects of the employment selection process.