Role overview: Candidate will be working with, testing, and training AI and will be responsible for building linguistic content that enables our client’s content moderation solutions to detect and classify a wide variety of online harms with cultural context.
Responsibilities relating to Maintenance and Future Development
- Building and maintaining their language of expertise in tools, using your knowledge of both the language and the cultures which speak this language to ensure that classification is accurate and context-based.
- Classifying words/phrases based on a defined taxonomy of online harms.
- Reviewing chat data to ensure accurate classification and address misclassifications as needed.
- Analyzing data for trends and creating classification improvement plans based on impact.
- Identify and add vocabulary based on client requests, global issues, current events, and other trends.
- Collaborating with the Client Success team to answer client questions and assist in tackling problems they may be facing within their communities.
- Participating in developing new and better ways of detecting content intended to circumvent content moderation.
- Support product testing when needed and identify and report product outages.
Responsibilities relating to AI
- Using various tools to curate and build datasets for evaluating and testing models and/or prompt effectiveness.
- Labeling or analyzing data for our data scientists to assist in training AI.
- Test for potential harms in new AI features, evaluate response, report results.
- Work with internal teams to refine policy input for AI.
- Contribute native language prompts to red-teaming library for future use.
- Label audit data provided.
- Report results, identify areas of weakness and recommendations for improvement.
Requirements
- Native level fluency (Italian).
- In-depth understanding of the cultural specificities that govern the usage of the language.
- Capable of following and executing deliverables according to a planning autonomously and on constrained timelines.
- Capable of documenting pertinent cultural information into a knowledge repository; enjoys research-related tasks.
- Capable of presenting observations and information in a digestible format such as reports, presentations, or documents.
Technical skills:
- Native speaker of required language (Italian).
- Excellent written & spoken English.
- Computer literacy: Microsoft Office Suite, Google Suite.
Behavioural skills:
- Communicative and outgoing; likes to share ideas with others.
- Enjoys working in a team but is autonomous and capable of driving own work.
- Strong critical thinking & decision-making skills.
- Willing to be exposed to unpleasant content at times in Trust & Safety roles.
Bonus experience:
- Moderation experience either professional or hobby.
- Experienced gamer.
- Studies in cultural fields for the locale (sociology, ethics, education, anthropology, etc.).
- Experiences related to inclusivity, child protection, or legal protection.
Benefits
- Part-time schedule, plus employee benefits, including health and dental care, when eligible.
- Partnerships with STM, Telus, and BIXI (among others).
- Employee Assistance Program.
PHASES OF OUR RECRUITMENT JOURNEY:
1. You send us your application with the resume.
2. After reviewing your candidacy, we invite you to our online language (English and Italian) assessment to better evaluate your written skills. Our language test will require typing, so we encourage you to take it on a computer and ensure you have the keyboard in your language settings to facilitate its completion. Check your inbox to find the test invitation and keep your phone close!
3. If you successfully pass the test, we’ll invite you for the online interview via MS Teams with one of our recruiters. It’s a perfect chance to exchange questions and get to know each other better. For some projects, there might be a second interview with a Team Lead or an Operations Manager.
4. At the end of our journey, hopefully, you will receive an offer and become our new Keywordian! Our recruitment process is fully online and remote. We value each application and review every candidate individually.
Please be advised that this position requires the successful applicants to effectively communicate in English (both verbally and in writing) due to the need for constant communication with clients and team members outside of Canada.
Privacy Notice: By providing your information in this application, you understand that we will collect and process your information in accordance with our Applicant Privacy Notice. For more information, please see our Applicant Privacy Notice at https://www.keywordsstudios.com/en/applicant-privacy-notice.
Role Information:
IT
Studio: Keywords Studios
Location: Americas, Canada
Area of Work: Business Development, Player Engagement
Service: Engage
Employment Type: Permanent
Working Pattern: Part Time, Remote