Senior Data Engineer

Senior Data Engineer

Client is a Toronto-based IT consulting boutique that strives for excellence in customer service and delivery in financial services and fintech industry. They focus on technology advisory services, application development, cloud computing, integration solutions, and enterprise big data and analytics. With a team of highly knowledgeable business and technical experts, we provide strategic, mission-critical solutions to our clients.

Looking for a senior Data Engineer who has hands-on experience in data integration and database development in a hybrid environment and who will contribute to successfully deliver hybrid data integration or custom database development projects in the Greater Toronto Area.

Company location: Downtown Toronto,
Hybrid work environment: mix of home, office and client site
Perm / FTE role: Salary: Market rate + benefits and performance bonus

RESPONSIBILITIES

1. Understand business requirements for data and information especially in the financial services industry.
2. Responsible for overall design of the data integration solution or data pipeline strategy for client engagements based on an approach that is holistic, scalable, pragmatic, and effective design of data processing.
3. Work with Data Architect on the overall design fulfilling the data and business requirements.
4. Develop high performing data pipelines in Microsoft SSIS, Azure Data Factory, or Databricks.
5. Develop database stored procedures based on Microsoft T-SQL and/or Oracle PL/SQL.
6. Develop data processing modules in one of these programming languages: C#, Java, Python.
7. Perform data profiling and data quality audit.
8. Design automated unit-testing framework as per project requirement.
9. Integrate pipelines with Continuous Integration/Delivery framework as needed.
10. Produce estimates for analysis, design, development, and testing for data pipelines.
11. Lead, mentor, and coach the technical team on client engagements.
12. Assist with proposals and pre-sales activities.
13. Lead development to our best practices in data integration and data engineering.
14. Ensure compliance with business, data, and technical requirements.
15. Ensure that client’s enterprise architecture standards, policies, and procedures are followed.

REQUIREMENTS

1. Minimum Bachelor’s degree in Computer Science or Engineering.
2. Minimum 8 years experience in Information Technology, participating in complex projects.
3. Strong communication skills.
4. Strong knowledge in data analysis, database development, data warehousing life cycle and data integration methodologies (ETL, ELT, EAI, EII).
5. Strong knowledge and extensive experience using Microsoft SSIS or Informatica.
6. Strong SQL knowledge in Microsoft SQL Server or Oracle databases and its languages: T-SQL, PL/SQL.
7. Working knowledge in one or more of the following languages: Java, C#, Python, Bash, PowerShell.
8. Familiar with capabilities of various platform services (e.g. Compute, Storage, Web, Developer, Integration, Data, Security, or Management) from the cloud vendors.
9. Working knowledge of Azure Data Factory.
10. Working knowledge of one of data analytics tools (such as Microsoft Power BI).
11. Knowledgeable in both relational and dimensional data modeling (with both Kimball and Inmon approaches).
12. Knowledge in data management, REST-oriented API, Continuous Integration and Delivery (CI/CD) principles.
13. Good overall business knowledge in financial industries (i.e. one or more in retail banking, commercial banking, capital markets, wealth management, insurance, pension fund, and fintech).
14. Preferably exposures to Hadoop ecosystem data tools (e.g. Hive, Hbase, Nifi, Spark).
15. Ability to work independently and excel in a team environment.