The Job

Principal Software Engineer

Teknik, data och digitalt · Mjukvaru- och webbutveckling · Mjukvaruutveckling · Artificiell intelligens · Site reliability engineering

Gå med för uppdateringar

I korthet

As a Principal Software Engineer, you will own the technical vision for Microsoft Copilot's offline evaluation platform, focusing on AI-first and agent-first principles. You will architect solutions to measure the quality of autonomous agents and ensure trustworthy results at scale.

Ansvarsområden

  • Set technical direction for the Copilot offline evaluation platform and partner with Copilot teams to create rigorous evaluations.
  • Lead the architecture of an AI-first, agentic-first evaluation platform where autonomous agents act as operators.
  • Own the challenge of delivering trustworthy results across deep dependency chains under heavy load.
  • Define end-to-end evaluation for Copilot's agentic experiences, including simulation and scoring.
  • Mentor engineers and drive modernization of the evaluation runtime for scalability and cost efficiency.
  • Stay at the forefront of agentic systems and AI evaluation, bringing new patterns and practices to the organization.

Krav

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements.
  • Microsoft Cloud Background Check required upon hire/transfer and every two years thereafter.

Önskade kvalifikationer

  • Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Deep experience with large-scale distributed systems and reliability engineering, especially delivering dependable outcomes across many interacting service dependencies operating under heavy or unusual load.
  • Experience building AI-first or agentic systems, and designing systems, APIs, and tooling intended to be operated by autonomous agents.
  • Experience with AI/ML evaluation, measurement, or benchmarking systems, such as LLM-based grading, metric design, or large-scale data and quality pipelines.

Förmåner

  • The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year.
  • For specific work locations within the San Francisco Bay area and New York City metropolitan area, the base pay range is USD $188,000 - $304,200 per year.
  • Certain roles may be eligible for benefits and other compensation.
  • Opportunity to shape the evaluation strategy for a highly visible AI product.
  • Work at the frontier of large-scale agentic systems and reliability engineering.
  • Grow influence as a technical leader across a large engineering organization.
#AI#Software Engineering#Platform#Evaluation#Copilot#Agentic Systems#Reliability Engineering
Microsoft Logo

Företag

Microsoft

Publicerade jobb

för 1 månad sedan

Anställningstyp

Heltid

Arbetsform

Hybrid

Erfarenhetsnivå

Senior

Platser

United States

Kvalifikation

Kandidatexamen

Sökande

Ansök tidigt