Test Lead (Azure- Databricks)
Job description
Must Have
- At least 10+ years of work experience in Quality Engineering (Testing) in Data platforms
- Canadian Banking domain experience
- Experience in leading and testing large scale, complex Data Modernization initiatives
- Led Data Platform migration projects such as from Cognos to PowerBI, etc.
- Automation first mindset
- Coordinating with Data Engineering, Infrastructure, other Technical teams, etc.
- Experience working in a matrix organization
- Stakeholder management across multiple areas such as Business, Infrastructure, Network, IT Custodians, Development, etc.
Required Skills
- In-depth knowledge in testing Azure Databricks, Azure ADLS Gen2, Azure Data Factory, Azure PowerBI, SQL Server
- Excellent coding skills in Python, PySpark, Scala, SQL, Java
- Excellent analytical and problem-solving skills, communication skills
- Knowledge in Data testing, ETL testing, implementation of Automation test frameworks in Data platforms
- Knowledge in Data governance, Data pipeline framework, Data ingestion, Data ops, Data profiling, Unity catalog, etc.
- Proactive in identifying gaps and raising issues; Self-motivated, possessing initiative to get things done with high quality
Job Description
- Identify, prepare and develop a comprehensive Test strategy/approach to test Azure Databricks ecosystem
- Create and maintain QE documentation
- Coordinate, perform or lead UAT, Business and E2E testing activities
- Design, develop, and maintain automated Data test framework, engineering pipelines and scripts
- Identify performance bottlenecks and provide support to Performance and Security testing
- Communicate and plan with development teams and stakeholders
- Track & plan QE testing progress and provide analysis & metrics on the QE effort
- Log and track detailed product defects and support the RCA identification
- Coach and provide mentorship to the testing team, and not afraid to get hands dirty
- Be the single point of contact for all Data testing related activities