Int. Gen AI QA Analyst to design, implement, and maintain manual and automated testing procedur[...]

Int. Gen AI QA Analyst to design, implement, and maintain manual and automated testing procedures for our professional services client - RQ01332

Job Type: Contract

Positions to fill: 1

Start Date: Feb 10, 2025

Job End Date: Jan 31, 2026

Pay Rate: Hourly: Negotiable

Job ID: 142988

Duration: 12 months

Location: Remote

Reporting to the Gen AI QA Lead and as part of Canada’s Products & Technology organization, the responsibilities will include designing, implementing, and maintaining both manual and automated testing procedures, as well as conducting functional, system, integration, and performance testing. This role will collaborate closely with development and product management teams to ensure Gen AI technology solutions undergo comprehensive testing and meet acceptance criteria.

Must Have Skills:

• 4+ years experience as a QA performing different types of testing for complex applications
• 2+ years using automated testing tools and platforms (Playwright, JMeter, SoapUI, Postman)
• Experience with software development tools and defect tracking systems like Azure DevOps, Jira
• Database experience (SQL)
• Knowledge of Python for Gen AI development and testing
• Competent in designing and executing AI prompt engineering and testing scenarios, ensuring the robustness of AI and large language models
• Working with high-level UX principles such as user stories, persona building, prototype/prototype development approaches, and information architecture and customer/product research methodologies (e.g., A/B testing and MVT)
• Experience with Agile methodologies

Nice To Have Skills:

• Undergraduate Degree in a technical field

Job Responsibilities:

• Participate in all testing activities during the agile product implementation process, ensuring the quality and reliability of our Gen AI solutions
• Facilitate communication between development teams, UX/UI designers, and product managers to ensure alignment on project goals and quality standards
• Contribute to insights, risk evaluations, and estimation discussions, ensuring that testing considerations are well-integrated into project planning
• Analyze project requirements, user feedback, and architectural and design documents to ensure completeness and testability
• Formulate and execute robust test strategies tailored to the specific requirements of Gen AI projects
• Craft comprehensive test plans and test cases
• Update test documentation, and create comprehensive reports while maintaining traceability back to project requirements
• Investigate and determine the source of problems, which may include identifying test deficiencies or deviations from requirements
• Utilize defect tracking system to record, trace, and drive the resolution of defects and issues discovered during testing
• Assist in reproducing issues and conducting root cause analysis to facilitate swift resolution
• Participate in daily stand-up meetings and provide regular updates on issues, status, and progress to the scrum master, ensuring transparent communication within the team
• Propose innovative ideas and improvements to the testing process for the Gen AI solutions, continuously enhancing its effectiveness, speed, and quality
• Identify and implement in-house testing automation frameworks to streamline and expedite the testing process