Senior Applied Scientist

Technology, Data & Digital · Data, AI & Analytics · Data Science · Machine Learning · Artificial Intelligence

In short

The Senior Applied Scientist will advance Outlook's Copilot initiatives in LLM, Evaluation, Relevance, and Responsible AI. This role involves developing evaluation infrastructure and measurement frameworks, collaborating across teams, and using data science and AI expertise to guide decision-making for global-scale communication products.

Responsibilities

Develop and execute a strategy for LLM evaluation covering quality, costs, performance, utility, and responsible AI.
Propose and drive cost-effective solutions like small language models (SLMs), finetuned models, and ensemble models.
Oversee large-scale, cross-functional evaluation programs and develop a robust measurement framework.
Design experimentation, analyze data, create OKRs and metrics, and derive actionable insights for LLM systems.
Lead efforts to assess and improve the performance and effectiveness of language models and agents.
Collaborate with User Experience teams to evaluate and optimize user interactions with AI systems.
Implement Responsible AI (RAI) and DSB principles and guidelines in AI systems.
Contribute to LLM research in evaluation and user experience optimization.
Work with engineering, research, product, and other teams for seamless integration of evaluation processes.
Communicate findings and recommendations to executive leadership.

Requirements

Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research).
OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research).
OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research).
OR equivalent experience.
Ability to meet Microsoft, customer and/or government security screening requirements.
Must pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Desired Qualifications

Ph.D. or Master’s in a relevant field (e.g., Data Science, Computer Science, Social science, HCI, etc.)
Experience in data science, machine learning, experimentation, and AI, with a track record of delivering impactful results.
Experience in program management and leading cross-functional teams.
Experience with LLM in finetuning, reinforcement learning, evaluation techniques, implementing RAG techniques, agentic workflows and industry best practices.
Development experience in Python
Analytical, problem-solving and presentation skills.
Understanding of responsible AI principles.
Ability to work in a fast-paced and dynamic environment.

Benefits

USD $119,800 - $234,700 per year (typical base pay range across the U.S.)
USD $160,200 - $261,000 per year (base pay range for San Francisco Bay area and New York City metropolitan area)
Certain roles may be eligible for benefits and other compensation.

Skills

PythonMachine LearningData ScienceLarge Language ModelsGenerative AIResponsible AI

#Outlook#OPG

About Microsoft

Empowering every person and organization on the planet to achieve more

Every company has a mission. What's ours? To empower every person and every organization to achieve more. We believe technology can and should be a force for good and that meaningful innovation contributes to a brighter world in the future and today. Our culture doesn’t just encourage curiosity; it embraces it. Each day we make progress together by showing up as our authentic selves. We show up with a learn-it-all mentality. We show up cheering on others, knowing their success doesn't diminish our own. We show up every day open to learning our own biases, changing our behavior, and inviting…

See all open jobs at Microsoft Read more about Microsoft Website

Company

Microsoft

Job Posted

1 day ago

Employment Type

Full Time

Work mode

Hybrid

Salary

US$119,800–261,000 / year

Experience Level

Senior

Locations

United States

Qualification

Bachelor, Master, Doctoral

Applicants

Be an early applicant

Similar Jobs

Ericsson

Noida, India

Senior Applied Scientist

Responsibilities

Requirements

Desired Qualifications

Benefits

Skills

About Microsoft

Similar Jobs

Senior NOC Engineer

Senior Manager (Industrial Engineering)

Supply Chain Coordinator (Back Office Customer Service Representative)

Senior Administrator - Program & Project Management

Service Centre Technician

Data Center Engineering Operations , DCEO