Senior Applied AI Engineer
Technology, Data & Digital · Software & Web Development · Software Engineering · Artificial Intelligence · Data Engineering
In short
Responsibilities
- Analyze data signals to uncover recurring failure patterns and gaps in Azure diagnostics and documentation.
- Design and build scalable agentic AI solutions for Azure diagnostics and documentation using LLM orchestration, RAG pipelines, and agent workflows.
- Write, review, test, and maintain production-quality C# and Python code, building reusable components.
- Own end-to-end technical delivery from design to monitoring and continuous improvement.
- Build evaluation-driven AI systems using various evaluation frameworks and quality thresholds.
- Ensure services meet production quality requirements for correctness, reliability, availability, latency, scalability, maintainability, cost, and safety.
- Implement secure and responsible AI patterns, including privacy protections and prompt-injection defenses.
- Integrate with Azure services and data sources to ground agent responses in trusted signals.
- Operate services in production using CI/CD, automated testing, monitoring, and alerting.
- Make evidence-based technical decisions by evaluating models and frameworks.
- Drive measurable customer impact through automation quality, case-volume reduction, and improved customer satisfaction.
- Provide technical leadership within projects, leading design reviews and resolving challenges.
- Mentor other engineers through code reviews, technical guidance, and practical coaching.
- Collaborate with product managers, researchers, platform engineers, and other teams.
Requirements
- Bachelor's Degree in Computer Science or related technical field.
- 4+ years technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python, OR equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements.
- Must pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Desired Qualifications
- Experience building or integrating with LLM-based systems (prompt engineering, RAG, or agent frameworks).
- Familiarity with Azure services (Azure OpenAI, Azure AI Foundry, Azure Functions, Cosmos DB, or similar cloud-native technologies).
- Experience with CI/CD pipelines, automated testing, and production observability.
- Experience with Azure AI Foundry, Azure OpenAI, Microsoft Agent Framework, or comparable enterprise AI platforms.
- Experience designing AI evaluation systems using rubrics, golden datasets, judge models, simulation, adversarial testing, and offline or online evaluation.
- Experience with RAG systems, including indexing, retrieval, ranking, grounding, citation, knowledge freshness, and access control.
- Experience implementing agent-security patterns such as prompt-injection defense, identity propagation, least-privilege tool access, data-boundary enforcement, approval gates, and auditable actions.
- Experience building reliable distributed services with strong standards for scalability, resiliency, performance, observability, and cost efficiency.
- Experience with infrastructure as code, container orchestration, feature management, and staged production deployment.
- Demonstrated ability to lead technical execution, influence design decisions, and mentor engineers without formal people-management authority.
- Experience collaborating with product, platform, research, and partner engineering teams on complex co-development initiatives.
- Strong business judgment and experience connecting engineering investments to customer and operational outcomes.
- Background in customer support engineering, supportability, diagnostics, or customer-experience platforms is a plus.
Benefits
- Certain roles may be eligible for benefits and other compensation.
- Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
Skills
Every company has a mission. What's ours? To empower every person and every organization to achieve more. We believe technology can and should be a force for good and that meaningful innovation contributes to a brighter world in the future and today. Our culture doesn’t just encourage curiosity; it embraces it. Each day we make progress together by showing up as our authentic selves. We show up with a learn-it-all mentality. We show up cheering on others, knowing their success doesn't diminish our own. We show up every day open to learning our own biases, changing our behavior, and inviting…
Company
MicrosoftJob Posted
5 days ago
Employment Type
Full Time
Work mode
Hybrid
Salary
US$119,800–234,700 / year
Experience Level
Senior
Locations
United States
Qualification
Applicants
Be an early applicant
