RQ07956 - Sr Software Developer - ETL

Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities.

Required to translate technical systems specifications into working tested applications. This includes developing detailed programming specifications, writing and/or generating code, compiling data-driven programs, maintaining, and conducting unit tests.

Resolves and troubleshoots technical problems which arise during the use and operation of software packages including technical assistance in implementation, conversion, and migrations.

General Skills:

1. Experience in programming and analysis; specialized software package support at the specified experience level.
2. Ability to collaborate with IT Professionals throughout the Software Development Life Cycle.
3. Experience in structured methodologies for the development, design, implementation, and maintenance of applications.
4. Experience in design, code, test, debug, and document applications.
5. Experience in the use of object and/or third generation language development tools.
6. Experience in one or more programming languages.
7. Experience in application design, latest design patterns, deployment, and troubleshooting.
8. Experience with relational and hierarchical database technologies.
9. Experience in the use of information retrieval packages using query languages.
10. Experience with one or more communications protocols.
11. Experience eliciting and documenting information from diverse business area stakeholders and subject matter experts.
12. Excellent analytical, problem-solving, and decision-making skills; verbal and written communication skills; interpersonal and negotiation skills.
13. A team player with a track record for meeting deadlines.

ETL Skills:

1. Knowledge and experience in gathering requirements and business process knowledge in order to transform the data in a way that's geared towards the needs of end users.
2. Knowledge and experience maintaining and improving already existing processes.
3. Knowledge and experience ensuring that the data architecture is scalable and maintainable.
4. Knowledge and experience working with the business in designing and delivering correct high-quality data.
5. Experience investigating data to identify potential issues within ETL pipelines, notify end-users, and propose adequate solutions.
6. Experience preparing detailed documentation for further reference.
7. Knowledge and experience with programming Internet-ready applications.
8. Knowledge and experience in rapid application development (RAD) methodologies.
9. Knowledge and understanding of Information Management principles, concepts, policies, and practices.

Experience with middleware and gateways:

1. Experience reviewing, analyzing, and modifying product installation scripts including encoding, testing, debugging.
2. Ability to provide post-implementation support and resolve any post-implementation technical issues.
3. Experience conducting design walkthrough sessions with project team.
4. Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards.
5. Ability to provide user and system documentation as required.

Skills/Experience and Skill Set Requirements:

Core Technical Skills 45%:

1. Demonstrates 5-10 years of experience designing, developing, and implementing ETL solutions using Azure Data Factory.
2. Demonstrates development and solution design experience in an environment where Azure Data Factory and Power BI are used together.
3. Experience in designing data warehouses and data marts for databases such as Oracle, SQL Server, Azure Blob, Azure SQL Database, as well as having a strong understanding of the architectural implications associated with each platform in regard to ETL.
4. Experience in debugging mappings, transformations, mapplets, source qualifier files, and queries.
5. Demonstrates experience with developing ETL solutions to populate data warehouses and create data extracts for the purpose of business intelligence reporting.
6. Demonstrates experience developing star schema multidimensional models.
7. Experience with developing, debugging, and enhancing the performance of complex SQL queries.
8. Demonstrates experience using Power Designer to review data models as well as make changes and generate DDL scripts.
9. Demonstrates development experience with SQL Server 2016, Azure Blob, Azure SQL Database, Oracle 12.x.
10. Demonstrates experience with documenting code changes, creating release packages, and deployment instructions.
11. Experience with performing unit testing and conducting System Integration Testing and User Acceptance Testing.
12. Demonstrated Experience with Informatica and PowerCenter would be an asset.

General skills/experience 35%:

1. Working knowledge of aggregate reporting:
2. Demonstrates experience supporting business users working on projects or programs involving multiple highly interdependent applications and/or data sources.
3. Demonstrates experience implementing star schema multidimensional models and documenting detailed design models.
4. Demonstrates development and design experience with SDLC processes, Agile, and Waterfall methodologies.
5. Demonstrates experience with documenting code changes and deployment instructions.
6. Experience with performing unit testing and conducting System Integration Testing and User Acceptance Testing.
7. Analytical and problem-solving skills to assess clients' business priorities and needs; to evaluate business and technical design alternatives.

Communications Skills/experience 15%:

1. Analytical and problem-solving skills to assess clients' business priorities and needs; to evaluate business and technical design alternatives.
2. Demonstrates the ability to collaboratively work with other groups (both technical and business) to ensure optimal solution integration.
3. Demonstrates ability to communicate day-to-day task and issue tracking, reporting, and facilitating resolution of issues and risks for all project activities.
4. Demonstrates ability in providing input to changes required to business and/or system requirements change requests, project artefacts, as well as requirement gathering sessions.
5. Experience with documenting, consulting, and presenting for a diverse audience of stakeholders (both technical and non-technical).
6. Experience with liaising with IT specialists and unit leads and working closely with support team members and relevant stakeholders.
7. Strong analytical, problem-solving, and decision-making skills; verbal and written communication skills; interpersonal and negotiation skills.

Public Sector Experience 5%:

1. Previous experience in an organization of equivalent size and complexity to the Public Sector.
2. Demonstrates experience designing and developing applications that comply with GOITS standards would be an asset.

Must Have:

Senior ETL Developer

7 years:

1. Demonstrates 5-10 years of experience designing, developing, and implementing ETL solutions using Azure Data Factory.
2. Demonstrates development and solution design experience in an environment where Azure Data Factory and Power BI are used together.
3. Experience in designing data warehouses and data marts for databases such as Oracle, SQL Server, Azure Blob, Azure SQL Database, as well as having a strong understanding of the architectural implications associated with each platform in regard to ETL.

Key Skills:

SQL, Pentaho, PL/SQL, Microsoft SQL Server, SSIS, Informatica, Shell Scripting, T-SQL, Teradata, Data Modeling, Data Warehouse, Oracle.