Senior Software Engineer, Search Platforms, LLM Evaluation Infrastructure
Technology, Data & Digital · Software & Web Development · Software Engineering · Artificial Intelligence · Data Science
In short
Google is seeking a Senior Software Engineer for its Search Platforms team to build and lead LLM Evaluation Infrastructure. This role involves architecting and implementing scalable back-end systems for evaluating Generative AI models in Google Search, impacting billions of users globally.
Responsibilities
- Architect, build, and maintain high-throughput, low-latency platform services and orchestration pipelines that execute automated evaluation, benchmark suites, and metric computations for Generative Artificial Intelligence (GenAI) Search experiences.
- Design robust evaluation systems to detect metric drift, optimize evaluation throughput, and scale model-assisted rating (e.g., LLM-as-a-judge/Autorater) workflows while maintaining compute efficiency.
- Drive the modernization and consolidation of fragmented, bespoke evaluation pipelines into a unified core platform, identifying capability gaps and creating reusable, extensible frameworks.
- Optimize system throughput, execution turnaround times, and resource efficiency for continuous, high-volume evaluation workloads supporting production-critical Search models.
- Integrate modern AI tooling, automated validation harnesses, and AI-assisted workflows into daily engineering practices to boost developer velocity, evaluation excellence, and system robustness.
Requirements
- Bachelor’s degree or equivalent practical experience.
- 5 years of experience with software development in one or more programming languages.
- 3 years of experience working with embedded operating systems.
- 3 years of experience testing, maintaining, or launching software products.
- 1 year of experience with software design and architecture.
Desired Qualifications
- Master's degree or PhD in Computer Science or a related technical field.
- 5 years of experience with data structures and algorithms.
- 1 year of experience in a technical leadership role.
- Experience developing accessible technologies.
Benefits
- Google is proud to be an equal opportunity and affirmative action employer.
- We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law.
- Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc.
#LLM#GenAI#Evaluation#Infrastructure#Search
Company
Job Posted
6 hours ago
Employment Type
Full Time
WorkMode
On Site
Experience Level
Senior
Locations
Bengaluru, India
Qualification
Bachelor, Master, Doctoral
Applicants
Be an early applicant