Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.
The Wealth Data engineering team within the Global Wealth Engineering (GWE) delivers operational data solutions to various stakeholders within Wealth Management.
We are seeking an experienced Lead Data Engineer with deep expertise in Google Cloud Platform (GCP) to join our growing team. In this role, you will be responsible for designing, building, and maintaining scalable data architectures that support our data-driven initiatives. You will lead a team of engineers, collaborate with cross-functional teams including data architects, solution architects, business systems analysts, and data engineers, and ensure that our data infrastructure is robust, secure, and optimized for performance.
Is this role right for you? In this role you will:
- Design, build, and operationalize the Wealth Data Hub (WDH) using Google Cloud Platform (GCP) data services such as DataProc, Dataflow, CloudSQL, BigQuery, CloudSpanner, in combination with third parties such as Spark, Apache Beam/Composer, DBT, Cloud PubSub, Confluent Kafka, Cloud Storage, Cloud Functions, and GitHub.
- Lead, mentor, and develop a team of data engineers, fostering a culture of continuous learning and technical excellence. Oversee project timelines, resource allocation, and deliverables to ensure successful project completion. Drive the adoption of best practices in code quality, testing, and deployment.
- Design and implement data ingestion patterns that will support batch, streaming, and API interfaces on both the Ingress and Egress.
- Lead in designing and building production data pipelines from data ingestion to consumption using GCP services, Java, Python, Scala, BigQuery, DBT, SQL, etc.
- Experience using Cloud Dataflow and Java/Python for deploying streaming jobs in GCP as well as batch jobs using text/JSON files and writing them to BigQuery.
- Ability to do proof of technology using GCP technologies and work with data architects and solution architects to achieve the desired results and performance.
- Communicate complex technical concepts to non-technical stakeholders, providing insights and recommendations. Collaborate with the DevOps team to automate and streamline CI/CD processes for data pipelines.
- Optimize data processing performance, ensure high availability, scalability, and fault tolerance of data systems. Implement monitoring and alerting mechanisms to proactively identify and resolve issues. Conduct regular performance tuning and capacity planning.
- Stay up to date with the latest trends and technologies in data engineering and cloud computing. Evaluate new tools and technologies to enhance the efficiency and effectiveness of our data infrastructure. Continuously improve processes and workflows to drive operational excellence.
Do you have the skills that will enable you to succeed in this role? We’d love to work with you if you have:
- 10+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 4+ years of working experience as a Google Cloud Platform (GCP) developer.
- Proven experience leading and mentoring engineering teams.
- Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub, etc.
- Experience with data streaming and technologies such as Kafka, Spark-streaming, etc.
- Experience with Infrastructure as Code (IaC) practices and frameworks like Terraform.
- Knowledge of Java microservices and Spring Boot.
- Strong architecture knowledge with experience in providing technical solutions for cloud infrastructure.
- Good communication and problem-solving skills. Ability to effectively convey ideas to business and technical teams.
- Understanding of Wealth business line and the various data domains required for building an end-to-end solution.
- Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or a related field.
What's in it for you?
- Diversity, Equity, Inclusion & Allyship - We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and embraced through bias-free practices and inclusive values across Scotiabank.
- Accessibility and Workplace Accommodations - We value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone.
- Upskilling through online courses, cross-functional development opportunities, and tuition assistance.
- Competitive Rewards program including bonus, flexible vacation, personal, sick days, and benefits will start on day one.
- Dynamic Ecosystem - Free tea & coffee, universal washrooms, and lots of space for team collaboration.
- Community Engagement - Opportunities for community engagement & belonging with various programs such as hackathons, contests, cooking with friends, Humans of Digital, and much more!
Working location condition: Hybrid
#LI-Hybrid
Location(s): Canada : Ontario : Toronto
Scotiabank is a leading bank in the Americas. Guided by our purpose: "for every future", we help our customers, their families, and their communities achieve success through a broad range of advice, products, and services.
If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process, please let our Recruitment team know. Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at Scotiabank; however, only those candidates who are selected for an interview will be contacted.