ML Data Associate III, AWS Quick
Technology, Data & Digital · Data, AI & Analytics · Data Science · Machine Learning
In short
Design and execute linguistic test cases for natural language features, evaluating model outputs for accuracy and relevance. Analyze results using Python and SQL, and collaborate with engineering teams to address quality gaps and triage bugs.
Responsibilities
- Design and execute linguistic test cases to validate natural language features.
- Evaluate model outputs for accuracy, fluency, and relevance, identifying quality gaps.
- Develop and maintain testing guidelines for consistent evaluation standards.
- Analyze test results using Python and SQL to report findings and prioritize issues.
- Collaborate with engineers, scientists, and PMs to define acceptance criteria and triage bugs.
- Perform high-complexity annotations and audits.
- Manage competing tasks and adapt to shifting priorities.
- Uphold a high bar for quality and deliver accurate work at pace.
- Apply attention to detail and critically assess data quality.
- Take ownership and exercise sound judgment in escalating issues.
- Handle highly complex tasks and scale with growing workloads.
Requirements
- 3+ years of working with Data & AI related technologies (AI/ML, GenAI, Analytics, Database, Storage).
- Experience with Machine Learning and Large Language Model fundamentals (architecture, training/inference lifecycles, optimization).
- Completed a bachelor’s degree in engineering, Computer Science, Machine Learning, Operations Research, Data Science, or Linguistics.
- Knowledge of linguistic fundamentals (handling ambiguity, NLP concepts, Q&A interpretation).
Desired Qualifications
- Experience programming in Python or a related language.
- Proficient in SQL.
Benefits
- Inclusive culture that empowers employees.
- Workplace accommodation and adjustment support for individuals with disabilities.
#AWS#Machine Learning#Data Associate#Linguistic Testing#Python#SQL#GenAI