The Job

Senior Product Quality Analyst

Teknik, data och digitalt · Data, AI och analys · Datavetenskap · Artificiell intelligens · Dataanalys

Gå med för uppdateringar

I korthet

As a Senior Product Quality Analyst on the AI Voice team, you will define and measure the quality bar for Spotify's AI voice models across various products and use cases. This hybrid role in London involves designing evaluation rubrics, conducting campaigns, benchmarking against competitors, and collaborating with cross-functional teams to ensure high-quality AI voice experiences.

Ansvarsområden

  • Own the quality bar for Spotify’s AI voice models, defining "good enough" for different products, audiences, languages and use cases.
  • Independently design evaluation rubrics and build an evaluation approach that measures qualities such as naturalness, tone, pacing, pronunciation, accent, audio quality and overall experience.
  • Plan and carry out evaluation campaigns, turning qualitative and quantitative findings into clear recommendations for Voice Production, Speak and product teams.
  • Establish an ongoing evaluation rhythm, including when and how to reassess model quality as technology and products evolve.
  • Benchmark Spotify’s AI voices against third-party models and competitors to understand where experiences lead, differ, and present opportunities for improvement.
  • Help determine appropriate quality trade-offs as Spotify expands into additional languages and regions, considering market needs.
  • Partner closely with voice experts, machine learning teams, product partners and vendors to maintain a consistent quality bar.
  • Surface the most meaningful gaps in model performance and use evaluation insights to help influence future research and technical priorities.

Krav

  • Experience in product quality, evaluation, data curation, or a related field where human judgment assesses model or product performance.
  • Ability to independently define evaluation criteria and turn subjective qualities into clear, repeatable rubrics.
  • Comfort designing and running both qualitative and MOS-style evaluations and synthesizing results into actionable insights.
  • Understanding of voice or audio quality (naturalness, pacing, tone, accent, pronunciation) or ability to develop this expertise quickly.
  • Strong judgment and ability to maintain a consistent quality bar while balancing different product requirements, markets, and stakeholder perspectives.
  • Comfort working autonomously, identifying evaluation needs, and establishing useful processes and cadences over time.
  • Clear communication skills across creative, technical, and product teams; ability to act as a reliable point of contact for internal partners and external vendors.
  • Curiosity about generative AI, speech technology, and the evolving AI voice landscape; ability to translate industry changes into meaningful benchmarks.

Förmåner

  • Extensive learning opportunities, through our dedicated team, GreenHouse.
  • Flexible share incentives letting you choose how you share in our success.
  • Global parental leave, six months off - for all new parents.
  • All The Feels, our employee assistance program and self-care hub.
  • Flexible public holidays, swap days off according to your values and beliefs.
#AI#voice#quality#analysis#evaluation#product#research#generative AI
Spotify Logo

Företag

Spotify

Publicerade jobb

för 1 månad sedan

Anställningstyp

Heltid

Arbetsform

Hybrid

Erfarenhetsnivå

Senior

Platser

London, United Kingdom

Sökande

Ansök tidigt