The Job

Responsible Content Analyst 2

Teknik, data och digitalt · IT-infrastruktur och säkerhet · Cybersäkerhet · Dataanalys

Gå med för uppdateringar

I korthet

Microsoft seeks a Responsible Content Analyst 2 to join the CoreAI organization, focusing on investigating cyber-based misuse of AI systems and ensuring safe, responsible AI deployment. This hybrid role involves analyzing abuse patterns, reviewing content, and collaborating with cross-functional teams to mitigate risks and improve AI safeguards.

Ansvarsområden

  • Investigate emerging abuse patterns and safety risks across Microsoft AI products, with an emphasis on cyber-based misuse.
  • Investigate potential malicious code generation, phishing, social engineering, credential abuse, malware-related activity, reconnaissance, exploitation, and attempts to circumvent safety controls.
  • Review and adjudicate user prompts, model outputs, account activity, and other evidence using Responsible AI policies and Cyber Safety guidance.
  • Analyze safety, abuse, quality, and operational data to identify trends and support enforcement decisions.
  • Document emerging abuse behaviors, indicators, tactics, techniques, and patterns, including cyber-related adversarial activity involving generative AI.
  • Develop, refine, and validate moderation guidelines, Cyber Safety taxonomies, and reviewer instructions.
  • Translate investigative findings into recommendations for improved detections, safeguards, policies, and operational processes.
  • Produce high-quality annotations and judgments to support AI training, evaluation, and safety system improvements.
  • Lead or contribute to complex escalations, customer appeals, and priority investigations.
  • Analyze operational metrics and quality signals to improve accuracy, consistency, and efficiency.
  • Partner with engineering, data science, policy, legal, security, and Responsible AI teams to resolve cases.
  • Communicate investigative findings, trends, risks, and mitigation recommendations through written analyses and stakeholder briefings.
  • Perform all work in accordance with Microsoft privacy, security, compliance, and Responsible AI requirements.

Krav

  • Bachelor's Degree in Communication, Media, Behavioral Psychology, Criminal Justice, Linguistics, Education, Business, Computer Science, or related field AND 3+ years relevant experience in work requiring privacy, discretion, and/or exposure to sensitive situations or content, OR High School Diploma (or local equivalent) AND 5+ years relevant experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements, including the Microsoft Cloud Background Check.

Önskade kvalifikationer

  • Experience conducting evidence-based investigations and making decisions using structured policies or frameworks.
  • Working knowledge of cyber threats and adversary tradecraft (e.g., phishing, malware, credential abuse).
  • Experience analyzing operational, investigative, or security data using tools like SQL, Kusto Query Language, Python, or Power BI.
  • Ability to distinguish benign, dual-use, and harmful activity with sound judgment in complex situations.
  • Understanding of generative AI capabilities, limitations, and potential misuse.
  • Strong written and verbal communication skills to explain technical findings to various audiences.
  • Ability to manage competing priorities and deliver high-quality work in a rapidly evolving environment.
  • Ability to handle sensitive or potentially disturbing content.
  • Experience investigating cyber-based misuse, content abuse, fraud, or policy violations.
  • Experience in Responsible AI, trust and safety, content moderation, security operations, or threat intelligence.
  • Familiarity with cyber threat frameworks like MITRE ATT&CK.
  • Experience reviewing or investigating text, image, audio, video, or multimodal content.
  • Experience evaluating or testing generative AI systems or safety controls.
  • Experience developing or improving operational guidelines or abuse taxonomies.
  • Experience working with engineering, data science, policy, legal, security, or threat intelligence teams.
  • Experience with Microsoft Azure, Power BI, Kusto Query Language, SQL, or Python.

Förmåner

  • Salary range of USD $77,800 - $153,700 per year (US); $102,200 - $169,900 (SF Bay Area/NYC).
  • Potential eligibility for benefits and other compensation.
#AI#Responsible AI#Cybersecurity#Content Moderation#Threat Intelligence#Risk Management
Microsoft Logo

Företag

Microsoft

Publicerade jobb

för 1 dag sedan

Anställningstyp

Heltid

Arbetsform

Hybrid

Erfarenhetsnivå

Mellannivå

Platser

United States

Kvalifikation

Kandidatexamen, Yrkeshögskola

Sökande

Ansök tidigt