AI Security Engineer
Technology, Data & Digital · IT Infrastructure & Security · Cybersecurity · Software Engineering · Artificial Intelligence
In short
The AI Security Engineer will join Microsoft Red Team to evaluate advanced AI models and agentic systems. This role involves designing and implementing offensive cyber-capability evaluations, building and maintaining realistic evaluation tasks, and analyzing model behavior in controlled cyber environments.
Responsibilities
- Design, implement, and operate offensive cyber-capability evaluations for frontier, preview, production, and open-weight AI models.
- Build and maintain realistic evaluation tasks covering vulnerability analysis, exploit development, application and system exploitation, attack-path reasoning, post-exploitation activities, and multi-step offensive workflows.
- Execute controlled experiments using AI models; define success criteria and baselines; collect reliable telemetry; and document results.
- Analyze model trajectories and investigate unexpected behavior to determine whether it reflects genuine capability, task leakage, environmental flaws, scoring errors, or other evaluation artifacts.
- Develop and maintain cyber ranges, vulnerable applications, exploit-development targets, and evaluation harnesses, and apply security controls for sandboxing, secrets management, telemetry, access, and containment when testing autonomous AI systems.
- Partner with red-team operators, researchers, engineers, and Responsible AI stakeholders to translate evaluation findings into security insights, and communicate results through reports, documentation, and briefings.
Requirements
- Master's Degree in Statistics, Mathematics, Computer Science, Computer Security, or related field AND 1+ year(s) experience in software development lifecycle, large-scale computing, threat analysis or modeling, cybersecurity, vulnerability research, and/or anomaly detection.
- OR Bachelor's Degree in Statistics, Mathematics, Computer Science, Computer Security, or related field AND 2+ years experience in software development lifecycle, large-scale computing, threat analysis or modeling, cybersecurity, vulnerability research, and/or anomaly detection.
- OR equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements.
- Verification of citizenship due to citizenship-based legal restrictions.
- Programming ability, particularly in Python, with experience building automation, scripts, or security tooling.
- Familiarity with large language models, generative AI systems, coding models, AI agents, or model APIs.
- Ability to follow experimental methodology, record results accurately, and document technical findings clearly.
- Exposure to security labs, cyber ranges, capture-the-flag environments, or vulnerable applications.
- Experience contributing to cyber-capability evaluations or model-evaluation work for AI or agentic systems.
- Coursework, internship, competition, or project experience in exploit development, vulnerability research, penetration testing, application security, or red teaming.
- Experience working with coding agents, tool-using models, or autonomous agent frameworks.
- Experience building capture-the-flag challenges, vulnerable applications, or exploit-development targets.
- Familiarity with PyRIT, adversarial-testing tools, or comparable model-evaluation frameworks.
- Familiarity with containers, sandboxed execution, or cloud-based test infrastructure.
- Hands-on cybersecurity experience with systems, networks, applications, vulnerability analysis, penetration testing, red teaming, or exploitation in authorized environments.
- Experience working with large language models, generative AI systems, coding models, AI agents, model APIs, or model-evaluation frameworks.
- Experience designing controlled experiments, defining success criteria, analyzing results, and documenting technical findings.
- Familiarity with common evaluation risks, including contamination, task saturation, unreliable scoring, weak baselines, environmental leakage, and limited reproducibility.
Desired Qualifications
- Doctorate in Statistics, Mathematics, Computer Science, Computer Security, or related field OR Master's Degree in Statistics, Mathematics, Computer Science, Computer Security, or related field AND 3+ years experience in software development lifecycle, large-scale computing, threat analysis or modeling, cybersecurity, vulnerability research, and/or anomaly detection.
- OR Bachelor's Degree in Statistics, Mathematics, Computer Science, Computer Security, or related field AND 5+ years experience in software development lifecycle, large-scale computing, threat analysis or modeling, cybersecurity, vulnerability research, and/or anomaly detection.
- OR equivalent experience.
Benefits
- Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
Skills
PythonPyRIT
#AI Security#Cybersecurity#Red Team#Vulnerability Research#Penetration Testing#Exploit Development#AI Models#Agentic Systems
About Microsoft
Empowering every person and organization on the planet to achieve more
Every company has a mission. What's ours? To empower every person and every organization to achieve more. We believe technology can and should be a force for good and that meaningful innovation contributes to a brighter world in the future and today. Our culture doesn’t just encourage curiosity; it embraces it. Each day we make progress together by showing up as our authentic selves. We show up with a learn-it-all mentality. We show up cheering on others, knowing their success doesn't diminish our own. We show up every day open to learning our own biases, changing our behavior, and inviting…
Company
MicrosoftJob Posted
3 weeks ago
Employment Type
Full Time
Work mode
Remote
Salary
US$102,100–202,200 / year
Experience Level
Mid-Senior
Locations
United States
Qualification
Master, Bachelor, Doctoral
Applicants
Be an early applicant
Similar Jobs
Google
Bengaluru, IndiaAI Customer Engineer, Google Cloud
Full Time Be an early applicant Posted 5 days ago
Google
Gurugram, IndiaAI Customer Engineer, Google Cloud
Full Time Be an early applicant Posted 5 days ago
Google
Gurgaon, IndiaAI Customer Engineer, Google Cloud
Full Time Be an early applicant Posted 5 days ago
Google
Gurgaon, India +1 moreSenior Technical Solutions Consultant
Full Time Be an early applicant Posted 5 days ago
Qualcomm
Bengaluru, IndiaNOC DV Sr Lead Engineer
Full Time Be an early applicant Posted 4 days ago
Qualcomm
Bangalore, IndiaEmbedded Systems and CPU Content Developer (Staff/Senior Staff)
Full Time Be an early applicant Posted 4 days ago