The Job

Senior Software Engineer, Search Platforms, LLM Evaluation Infrastructure

Teknik, data och digitalt · Mjukvaru- och webbutveckling · Mjukvaruutveckling · Artificiell intelligens · Datavetenskap

Gå med för uppdateringar

I korthet

Google is seeking a Senior Software Engineer for its Search Platforms team to build and lead LLM Evaluation Infrastructure. This role involves architecting and implementing scalable back-end systems for evaluating Generative AI models in Google Search, impacting billions of users globally.

Ansvarsområden

  • Architect, build, and maintain high-throughput, low-latency platform services and orchestration pipelines that execute automated evaluation, benchmark suites, and metric computations for Generative Artificial Intelligence (GenAI) Search experiences.
  • Design robust evaluation systems to detect metric drift, optimize evaluation throughput, and scale model-assisted rating (e.g., LLM-as-a-judge/Autorater) workflows while maintaining compute efficiency.
  • Drive the modernization and consolidation of fragmented, bespoke evaluation pipelines into a unified core platform, identifying capability gaps and creating reusable, extensible frameworks.
  • Optimize system throughput, execution turnaround times, and resource efficiency for continuous, high-volume evaluation workloads supporting production-critical Search models.
  • Integrate modern AI tooling, automated validation harnesses, and AI-assisted workflows into daily engineering practices to boost developer velocity, evaluation excellence, and system robustness.

Krav

  • Bachelor’s degree or equivalent practical experience.
  • 5 years of experience with software development in one or more programming languages.
  • 3 years of experience working with embedded operating systems.
  • 3 years of experience testing, maintaining, or launching software products.
  • 1 year of experience with software design and architecture.

Önskade kvalifikationer

  • Master's degree or PhD in Computer Science or a related technical field.
  • 5 years of experience with data structures and algorithms.
  • 1 year of experience in a technical leadership role.
  • Experience developing accessible technologies.

Förmåner

  • Google is proud to be an equal opportunity and affirmative action employer.
  • We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law.
  • Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc.
#LLM#GenAI#Evaluation#Infrastructure#Search
Google Logo

Företag

Google

Publicerade jobb

för 6 timmar sedan

Anställningstyp

Heltid

Arbetsform

På plats

Erfarenhetsnivå

Senior

Platser

Bengaluru, India

Kvalifikation

Kandidatexamen, Masterexamen, Doktorand

Sökande

Ansök tidigt