Annotations Business Analyst, Community Feedback Annotation Team

Our overall mission is simple: To be earth’s most customer centric company. We want Amazon to be the place where our customers can find, discover and buy anything online. Whatever our customers want, we will find the means to deliver it. With your help, Amazon will deliver world class AI generated experiences to our customers.

Amazon is looking for a Business Analyst based in Cape Town with experience working to deliver annotated training and evaluation data to train AI models. You will assess the output produced by human in the loop annotators and ML models, assessing the quality and providing helpful insights to science teams to improve ML models. Our mission is to employ a leader of leaders who is able to empower, develop and grow their team and to support them in achieving our organizational goals.

The role will require you to be a leader who prioritizes supporting their team and ensuring defects do not persist. Your role will be to help set and oversee the quality standards of the data the team produces.

The ideal business analyst ensures that the team's priorities and tasks are aligned to supporting the delivery of high-quality labeled/annotated data to support the delivery of ML AI model experiences. To achieve this, an ideal Business Analyst coaches, develops and supports the team to build a work environment where annotators are engaged and feel a positive sense of achievement about their role in delivering world class data.

You will also be responsible for producing reports that show the quality assessments completed by your team as well as conducting data analysis to identify key drivers and insights that may be reducing the effectiveness of the models outputs. You will produce reports and evidence backed by data and present these findings to science, engineering and business teams.

Key job responsibilities

Leadership:

1. Knows and communicates the Amazon mission, vision and strategy
2. Demonstrates passion for delivering a positive customer experience, and maintain composure in difficult situations
3. Demonstrates the ability to give overall direction, performance, coordination and evaluation
4. Experience interviewing and selecting people who will maintain a high-performance bar in Amazon
5. Strong interpersonal and communication skills, good listener, used to interact with up to Director level
6. Positive communicator who understands when necessary how to have tough conversations
7. Ability to confidently facilitate team discussions and communicate business messages
8. Maintains a high level of professionalism and approachability
9. Can adapt well to changing circumstances, direction, and strategy
10. Ability to organize, prioritize and schedule work assignments
11. Proven ability to manage reporting, data manipulation and analysis
12. Experience managing core business KPI’s
13. Assist in developing and implementing training programs to improve the quality and productivity of the team

Operational Delivery:

1. Understands operational principles of service delivery and uses data to support continuous improvement
2. Ability to use data and insights to prepare metric reviews
3. Acts as the operational representative for business teams to understand voice of the partner in key process or policy changes
4. Builds plans to test and experiment new approaches to service delivery

Continuous Improvement:

1. Uses data to identify areas of ongoing improvement in how service is delivered
2. Collaborate with the annotation team and linguistic experts to refine and develop annotation guidelines, taking into consideration different language nuances, linguistic phenomena, and use cases
3. Continuously communicate with the model development team to provide insights and observations regarding annotation challenges, linguistic subtleties, and potential improvements for the language model's performance
4. Ensure the accuracy and integrity of the annotated data by performing regular quality checks, identifying and addressing inconsistencies, and maintaining a high standard of data cleanliness
5. Work closely with other annotation team members, data scientists, and linguists to ensure effective collaboration and knowledge sharing, contributing to a positive and productive work environment
6. Keep up-to-date with the latest linguistic trends, developments, and emerging language phenomena to adapt annotation strategies and guidelines accordingly

A day in the life:

This is an IC role focused on quality assessments and data insights for the business team to action and drive improvement.

You will provide reports that include the outcome and quality assessment of the audit and present findings, trends, and insights to business and science teams, to improve the models training.

About the team

Our team is passionate about human motivation and behavior and uses machine learning, classification algorithms and scalable platform services to have a cross-org impact every day. We evaluate user research, customer experience knowledge, data, and cross-Amazon Moderation expertise to ensure other teams think about customer trust.

Amazon is an equal opportunities employer, and we value your passion to discover, invent, simplify and build. We welcome applications from all members of society irrespective of age, sex, disability, sexual orientation, race, religion or belief. Amazon is strongly committed to diversity within its community and especially welcomes applications from South African citizens who are members of designated groups who may contribute to Employment Equity within the workplace and the further diversification of ideas.

In this regard, the relevant laws and principles associated with Employment Equity will be considered when appointing potential candidates. We are required by law to verify your ability to work lawfully in South Africa. Amazon requires that you submit a copy of either your identity document or your passport and any applicable work permit if you are a foreign national, along with an updated curriculum vitae.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit this link for more information.