Quality Assurance Tester

About the Role:

Penta Consulting are a technology service provider and leading outsourced partner helping to deliver professional and managed solutions across South Africa.

We are supporting a system integration client of ours on a large-scale project in Cape Town.

Responsibilities:

1. Develop and execute comprehensive test plans to validate the functionality and accuracy of large language models (LLMs).
2. Design and automate test cases using Python to evaluate NLP performance and model outputs.
3. Identify, document, and track bugs, inconsistencies, and edge cases in AI model behaviour.
4. Collaborate closely with developers, data scientists, and product teams to improve model quality and user experience.

Technical Requirements:

1. Proficiency in Python, with experience in writing automated test scripts.
2. Strong understanding of NLP concepts and familiarity with tools such as spacy, Hugging Face, or similar libraries.
3. Experience testing machine learning models, particularly large language models (LLMs).
4. Familiarity with testing frameworks and CI/CD pipelines for scalable QA processes.

If you are interested in this position please reply with your CV and mobile number and I will reach out.

Please note: we're searching for candidates with contracting experience.