Content Risk Analyst, ASCI
Technology, Data & Digital · Data, AI & Analytics · Data Analysis · QA & Testing
In short
The Content Risk Analyst, ASCI role involves executing AI model improvement, red teaming, customer feedback triage, and incident monitoring tasks. This position requires a Bachelor's degree and over 2 years of experience in content moderation, data annotation, AI/ML operations, or compliance operations, utilizing AI tools for enhanced quality and safety.
Responsibilities
- Perform multi-domain data annotation and golden dataset curation for AI model improvement.
- Validate and audit LLM judge outputs through human-in-the-loop review.
- Execute adversarial testing across multiple Alexa experiences.
- Identify, document, and categorize policy violations, safety gaps, and vulnerabilities.
- Classify and triage daily customer feedback records per SOPs.
- Monitor for policy violations and emerging issues per established protocols.
- Draft escalation tickets, incident summaries, and root-cause hypotheses.
- Identify and propose process improvements to enhance operational efficiency.
- Draft and maintain SOPs, training materials, and onboarding guides.
- Mentor junior associates and peers.
Requirements
- Bachelor's degree
- 2+ years of experience in content moderation, data annotation, AI/ML operations, or compliance operations
Desired Qualifications
- Experience with AI annotation tools, LLM outputs, or model evaluation frameworks
- Familiarity with red teaming, content safety, or responsible AI operations
- Exposure to incident management or escalation handling workflows
Benefits
- Inclusive culture empowering Amazonians to deliver the best results.
- Workplace accommodation and adjustment support for individuals with disabilities during the application and hiring process.
#Content moderation#Data annotation#AI/ML operations#Compliance operations#LLM#Red teaming#Customer feedback analysis#Incident monitoring#Process improvement#Responsible AI
Company
Amazon
Job Posted
6 hours ago
Employment Type
Full Time
WorkMode
On Site
Experience Level
Mid-Senior
Locations
Bengaluru, India
Qualification
Bachelor
Applicants
Be an early applicant