Content Risk Analyst – Alexa Sensitive Content Intelligence

About the role

The Content Risk Analyst will support the Alexa Sensitive Content Intelligence (ASCI) team in protecting user experience by managing data, annotations, and red‑team testing for AI models. The role focuses on back‑end operations, test‑data creation, and ensuring high‑quality monitoring of policy violations.

Key responsibilities

• Lead creation and annotation of MLOGs to improve AI models across multiple domains.
• Conduct audits of machine‑generated and manual annotations, delivering detailed insights.
• Oversee data collection and quality assurance for complex AI models, including security and social‑engineering scenarios.
• Design and execute red‑team strategies across Alexa experiences and analyse results to identify trends and high‑priority issues.
• Collaborate with stakeholders to develop mitigation strategies for identified vulnerabilities.
• Lead analysis of complex customer feedback, surfacing emerging trends and edge cases.
• Monitor policy violations, handle escalations, and coordinate cross‑functional resolution.
• Propose and implement process improvements to boost operational efficiency.
• Mentor L2 team members and contribute to training material development.

Required profile

• Detail‑oriented and eager to learn.
• Strong analytical and problem‑solving abilities for complex AI‑related issues.
• Excellent communication skills for cross‑functional collaboration.
• Ability to manage multiple priorities in a rapidly changing environment.
• 1+ years experience in data‑driven business operations.
• High school diploma or equivalent.
• Fluent in English (reading, writing, speaking).

Required skills

• Microsoft Excel
• Microsoft Office suite