AI Engineer, Applied AI Research

Technology, Data & Digital · Data, AI & Analytics · Machine Learning · Data Science · Software Engineering

In short

Microsoft's Applied AI Research team seeks an AI Engineer to develop AI-powered security and compliance solutions using LLMs and agentic systems. Responsibilities include designing and deploying ML models, optimizing performance, and collaborating with stakeholders to deliver intelligent experiences.

Responsibilities

Design, build, and maintain AI systems that host ML Models, tools/APIs, manage state/memory, and reliably complete multi-step workflows.
Own the entire ML/DL development cycle through production, including deployment, monitoring, and live-site reliability, with an eval-first development lifecycle.
Define success criteria, build evaluation datasets and automated harnesses, and run human-in-the-loop reviews where needed.
Debug AI behavior and performance using log analysis, data inspection, and model/tool-call traces, and translate failure patterns into targeted improvements.
Establish and track AI quality metrics (e.g., accuracy, relevance, hallucination rate) and integrate them into CI/CD release gates.
Optimize runtime performance and economics (token usage, inference cost, latency, caching, model selection/routing, batching) and implement monitoring and continuous improvement loops (online signals, drift detection, structured user feedback).
Partner with product, design, and domain stakeholders to define use cases, acceptance criteria, and rollout plans for AI features.
Live site responsibility.

Requirements

Bachelor's Degree in Computer Science, Data Science or related technical field.
At least 5 years in building and maintaining ML/AI Systems.
Hands-on experience with MLOps, AIOps.
4+ years of experience in shipping at least 2 large-scale ML/AI-based services or applications on cloud platforms (Azure, AWS, GCP, etc.).
4+ years technical engineering experience with coding in languages including C#, Python and Pytorch.
Proficiency in writing production-quality software code in one or more modern programming languages (Python, C#).
1-2 years of experience with LLMs and open-source GenAI frameworks, such as LangChain, LlamaIndex, Haystack, or equivalents (e.g., Transformers, AutoGen, DSPy), including agent-based orchestration, prompt engineering, retrieval-augmented generation (RAG), and fine-tuning and evaluation.
Ability to meet Microsoft, customer and/or government security screening requirements.
Must pass Microsoft background and Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Skills

PythonC#PyTorchLangChainLlamaIndexHaystackTransformersAutoGenDSPyLLMsRAG

#AI#Machine Learning#Deep Learning#Large Language Models#Agentic Systems#Reasoning Frameworks#Security#Compliance#Governance#Risk Management#MLOps#AIOps#Cloud Platforms#Azure#AWS#GCP#Python#C##PyTorch#LangChain#LlamaIndex#Haystack#Transformers#AutoGen#DSPy#Prompt Engineering#Retrieval Augmented Generation (RAG)#Fine-tuning#Evaluation

About Microsoft

Empowering every person and organization on the planet to achieve more

Every company has a mission. What's ours? To empower every person and every organization to achieve more. We believe technology can and should be a force for good and that meaningful innovation contributes to a brighter world in the future and today. Our culture doesn’t just encourage curiosity; it embraces it. Each day we make progress together by showing up as our authentic selves. We show up with a learn-it-all mentality. We show up cheering on others, knowing their success doesn't diminish our own. We show up every day open to learning our own biases, changing our behavior, and inviting…

See all open jobs at Microsoft Read more about Microsoft Website