Title: Senior ETL Developer Location: Toronto, ON (Hybrid) Duration: 18+ Months Contract with possible extension
Job Description:
ETL Development-Data Integration:
Extensive experience in gathering requirements and business process knowledge in order to design correct and high-quality data transformation.
Extensive experience in design, development, and implementation with Azure Data Factory, Databricks, including:
Self-Hosted Integration Runtime
Data movement, ETL pipelines
Performance tuning on large data volumes
Complex data transformations
ADF Debugger to validate data transformation.
Azure Roles
Experience with Informatica, including:
Workflow Manager
Repository Manager
Designer
Workflow Monitor
Experience with developing solutions using Logic App and Function App.
Experience in rapid application development (RAD) methodologies.
Experience in maintaining and improving existing ETL processes.
Experience in investigating data to identify potential issues within ETL pipelines.
Experience with Business Intelligence tools IBM Cognos and Microsoft PowerBI.
Azure Technologies:
Experience with CI/CD (DevOps) pipelines and concepts, including:
Azure Resource Management
GitHub Repo
Source code version control
Branching, pull requests, build, release, multiple parallel development repositories merge.
Experience with Azure DevOps, including:
Azure Boards
Azure Test Plans
Azure Pipelines
Azure Repos
Azure Artefacts
Oracle PL/SQL Development:
Extensive experience in designing and developing SQL Server Stored Procedure, Oracle PL/SQL programs.
Database Technologies:
Experience with Oracle, Microsoft SQL Server database and tools.
Experience with relational and hierarchical database technologies.
Extensive knowledge of Azure SQL DB and Synapse platforms, including:
Performance tuning on large data volume
Must Haves:
Design, Develop and Implement data pipelines using Azure Data Factory (ADF), stored procedure, and Informatica PowerCenter performing extraction, transformation, and loading activities.
Develop Azure CI/CD pipeline to automate ADF release.
Extensive experience in design, development, and implementation with Azure Data Factory, Databricks, Informatica including - Data movement, ETL pipelines.
Experience with CI/CD (DevOps) pipelines and concepts, including Azure Resource Management, GitHub Repo, Source code version control.
Extensive experience in designing and developing SQL Server Stored Procedure, Oracle PL/SQL programs.
Knowledge of Databases - Oracle, Microsoft SQL Server database and tools.