Senior Applied AI Engineer
Technology, Data & Digital · Software & Web Development · Software Engineering · Machine Learning
In short
The Azure Engineering Operations (EngOps) team is seeking a Senior Applied AI Engineer to design, build, and operate production agentic AI services. This role involves using AI to solve complex problems, focusing on LLM orchestration, RAG, and agent workflows. You will write production-quality code, own service components, and lead technical execution.
Responsibilities
- Design and build scalable agentic AI solutions using LLM orchestration, RAG pipelines, agent workflows, tool integrations, memory and state management, and human-in-the-loop experiences.
- Write, review, test, and maintain production-quality C# and Python code.
- Build reusable components, reference implementations, and engineering patterns.
- Translate customer support scenarios and product requirements into technical designs and take solutions through implementation, testing, deployment, monitoring, and continuous improvement.
- Develop evaluation frameworks using rubrics, golden datasets, simulations, judge models, and offline/online evaluation.
- Ensure services meet requirements for correctness, reliability, availability, latency, scalability, maintainability, cost, and safety.
- Implement secure and responsible AI patterns, including privacy protections and prompt-injection defenses.
- Integrate with Azure services and data sources to ground agent responses.
- Operate services in production with CI/CD, automated testing, tracing, logging, metrics, and alerting.
- Diagnose production issues, participate in incident response, and drive corrective improvements.
- Evaluate models, frameworks, prompts, and retrieval approaches using experiments and production telemetry.
- Instrument solutions and use data to improve automation quality, case-volume reduction, and customer satisfaction.
- Provide technical leadership within projects, leading design reviews and resolving technical challenges.
- Mentor other engineers through code reviews, technical guidance, and practical coaching.
- Collaborate with product managers, researchers, platform engineers, and Azure service teams.
Requirements
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements.
- Must pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Desired Qualifications
- Familiarity with Azure services (Azure OpenAI, Azure AI Foundry, Azure Functions, Cosmos DB, or similar cloud-native technologies).
- Experience building or integrating with LLM-based systems (prompt engineering, RAG, or agent frameworks).
- Experience with CI/CD pipelines, automated testing, and production observability.
- Strong understanding of data structures, algorithms, and system design fundamentals.
- Experience building and shipping agentic AI services or multi-agent workflows in production.
- Experience with Azure AI Foundry, Azure OpenAI, Microsoft Agent Framework, or comparable enterprise AI platforms.
- Experience designing AI evaluation systems using rubrics, golden datasets, judge models, simulation, adversarial testing, and offline or online evaluation.
- Experience with RAG systems, including indexing, retrieval, ranking, grounding, citation, knowledge freshness, and access control.
- Experience implementing agent-security patterns such as prompt-injection defense, identity propagation, least-privilege tool access, data-boundary enforcement, approval gates, and auditable actions.
- Experience building reliable distributed services with strong standards for scalability, resiliency, performance, observability, and cost efficiency.
- Experience with infrastructure as code, container orchestration, feature management, and staged production deployment.
- Demonstrated ability to lead technical execution, influence design decisions, and mentor engineers without formal people-management authority.
- Experience collaborating with product, platform, research, and partner engineering teams on complex co-development initiatives.
- Strong business judgment and experience connecting engineering investments to customer and operational outcomes.
- Background in customer support engineering, supportability, diagnostics, or customer-experience platforms is a plus.
Benefits
- Typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year.
- Base pay range in San Francisco Bay area and New York City metropolitan area is USD $160,200 - $261,000 per year.
- Certain roles may be eligible for benefits and other compensation.
Skills
PythonC#LLM orchestrationRetrieval-Augmented Generation (RAG)Agent workflowsTool integrationCI/CDAutomated testingObservabilityData structuresAlgorithmsSystem designAzure OpenAIAzure FunctionsCosmos DB
#AI#Machine Learning#Software Engineering#Cloud
About Microsoft
Empowering every person and organization on the planet to achieve more
Every company has a mission. What's ours? To empower every person and every organization to achieve more. We believe technology can and should be a force for good and that meaningful innovation contributes to a brighter world in the future and today. Our culture doesn’t just encourage curiosity; it embraces it. Each day we make progress together by showing up as our authentic selves. We show up with a learn-it-all mentality. We show up cheering on others, knowing their success doesn't diminish our own. We show up every day open to learning our own biases, changing our behavior, and inviting…
Company
MicrosoftJob Posted
2 days ago
Employment Type
Full Time
Work mode
Hybrid
Salary
US$119,800–234,700 / year
Experience Level
Senior
Locations
United States
Qualification
Bachelor
Applicants
Be an early applicant
Similar Jobs
Qualcomm
Tijuana, MexicoPrincipal/Manager, SoC Systems Validation Engineering
Full Time Be an early applicant Posted 4 days ago
Qualcomm
Markham, CanadaFY27 Intern - Automotive Engineering Internship - Canada (16 months)
US$54.6–103k/yr Internship Be an early applicant Posted 4 days ago
Qualcomm
San Diego, United States of AmericaStaff Product Manager, Product Planning
US$182–273k/yr Full Time Be an early applicant Posted 4 days ago
Qualcomm
San Diego, United States of AmericaSoC Infrastructure/NoC, Power & Performance Validation Engineer
US$122–183k/yr Full Time Be an early applicant Posted 4 days ago
Qualcomm
San Diego, United States of AmericaGPU Low Power Engineer
US$119–179k/yr Full Time Be an early applicant Posted 3 days ago
Microsoft
United StatesPrincipal Product Manager
US$143–275k/yr Full Time Be an early applicant Posted 4 days ago