Content Risk Analyst, ASCI
Technology, Data & Digital · Data, AI & Analytics · Data Science · Artificial Intelligence · Machine Learning
In short
As a Sr. Prod Compliance Associate (Content Risk Analyst) in the ASCI team, you will focus on AI model improvement, red teaming, customer feedback triage, and incident monitoring for Alexa experiences. You will utilize AI-powered tools and human judgment to ensure quality and safety standards are met across various Alexa domains.
Responsibilities
- Execute AI model improvement, red teaming, customer feedback triage, and incident monitoring tasks across Alexa experiences.
- Perform multi-domain data annotation and golden dataset curation for AI model improvement.
- Validate and audit LLM judge outputs through human-in-the-loop review.
- Execute adversarial testing across multiple Alexa experiences using AI to generate attack vectors.
- Identify, document, and categorize policy violations, safety gaps, and vulnerabilities.
- Classify and triage daily customer feedback records, identifying recurring issues and trends.
- Monitor for policy violations and emerging issues, drafting escalation tickets and incident summaries.
- Identify and propose process improvements to enhance operational efficiency.
- Draft and maintain SOPs, training materials, and onboarding guides.
Requirements
- Bachelor's degree
- Experience in Artificial Intelligence/Machine Learning (AI/ML) Standards Law
- 1+ years of experience in content moderation, data annotation, AI/ML operations, or compliance operations
- Ability to follow SOPs and apply judgment in a fast-changing environment
Desired Qualifications
- Experience working with Data & AI related technologies, including AI/ML, GenAI, Analytics, Database, and/or Storage
- Experience with AI annotation tools, LLM outputs, or model evaluation frameworks
- Familiarity with red teaming, content safety, or responsible AI operations
- Exposure to incident management or escalation handling workflows
Benefits
- Inclusive culture empowers Amazonians to deliver the best results for customers.
- Workplace accommodations and adjustments available for individuals with disabilities.
#ASCI#AI Safety#Compliance#Improvement#Alexa#Red Teaming#Customer Feedback#Incident Monitoring#Process Improvement
Company
Amazon
Job Posted
4 hours ago
Employment Type
Full Time
WorkMode
On Site
Experience Level
Mid-Senior
Locations
Bengaluru, India
Qualification
Bachelor
Applicants
Be an early applicant