Staff Engineer - AI Infrastructure Reliability
Technology, Data & Digital · Software & Web Development · Software Engineering · Data Engineering
In short
Responsibilities
- Design, build, and optimize components of distributed AI platforms to improve availability, performance, scalability, reliability, and cost efficiency.
- Lead incident-management efforts and engineer technical solutions that systematically reduce Time to Detect (TTD), Time to Mitigate (TTM), and Time to Resolve (TTR) across AI training and inference workloads.
- Build and scale automated validation frameworks and test suites that identify regressions early and maintain system stability.
- Implement graphics processing unit (GPU) and compute fleet optimizations that improve resource utilization, throughput, and operational efficiency at scale.
- Develop platform services, internal tools, and automation that streamline engineering workflows, improve developer velocity, and raise code quality standards.
- Write production code, build telemetry and observability tools, and debug complex system issues to resolve root causes and prevent incident recurrence.
- Provide technical leadership, mentor engineers, and lead multi-team initiatives across infrastructure, security, networking, and service teams.
Requirements
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
- Experience reading, writing, and debugging high-quality production code across a large, complex codebase for internet-scale services, distributed systems, or compute platforms.
- Experience building automated validation frameworks and developer-productivity tools.
- Experience serving as a technical lead, mentoring engineers, and executing multi-team engineering initiatives.
- Experience with AI training and inference infrastructure, incident management, and reliability measures such as TTD, TTM, and TTR.
Benefits
- The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year.
- There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.
- Certain roles may be eligible for benefits and other compensation.
Skills
About Microsoft
Empowering every person and organization on the planet to achieve more
Every company has a mission. What's ours? To empower every person and every organization to achieve more. We believe technology can and should be a force for good and that meaningful innovation contributes to a brighter world in the future and today. Our culture doesn’t just encourage curiosity; it embraces it. Each day we make progress together by showing up as our authentic selves. We show up with a learn-it-all mentality. We show up cheering on others, knowing their success doesn't diminish our own. We show up every day open to learning our own biases, changing our behavior, and inviting…
Company
MicrosoftJob Posted
1 day ago
Employment Type
Full Time
Work mode
Hybrid
Salary
US$119,800–234,700 / year
Experience Level
Senior
Locations
United States
Qualification
Applicants
Be an early applicant
Similar Jobs
Senior Administrator - Saviynt, Java
Senior Technical Specialist
Senior Administrator - Saviynt, Java
Senior Full Stack Java Technical Architect - DevOps
Senior Technical Specialist