The Job

Member of Technical Staff, Multimodal Infrastructure

Teknik, data och digitalt · Mjukvaru- och webbutveckling · Mjukvaruutveckling · Datavetenskap · Artificiell intelligens

Gå med för uppdateringar

I korthet

Microsoft AI is seeking a highly motivated Member of Technical Staff to build and scale multimodal generative model infrastructures for Copilot. This role involves close collaboration with researchers and engineers on data processing, model training, inference, and serving, contributing to cutting-edge AI advancements in a fast-paced environment.

Ansvarsområden

  • Design, develop, and maintain large-scale multimodal data processing pipelines.
  • Design, develop, and maintain large-scale multimodal model pretraining and post-training frameworks.
  • Design, develop, and maintain large-scale multimodal model inference and serving frameworks.
  • Collaborate with research scientists and product engineers to solve infra-related problems.
  • Find paths to get things done despite roadblocks to deliver work to users quickly and iteratively.
  • Enjoy working in a fast-paced, design-driven, product development cycle.
  • Embody Microsoft's Culture and Values.

Krav

  • Bachelor's Degree in Computer Science or related technical discipline AND 6+ years technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python.
  • OR equivalent experience.

Önskade kvalifikationer

  • Experience in multi-modal data processing with proficiency in distributed data processing infra (resource utilization management, fault tolerance, ray & spark) and CPU/GPU batch processing optimizations.
  • Experience with state-of-art model inference and serving frameworks.
  • Experience with image/video/audio data processing.
  • Experience with common data formats for efficient I/O.
  • Experience in multi-modal pretraining and post-training with proficiency in deep learning frameworks such as PyTorch, Megatron and Deepspeed.
  • Knowledge of auto-regressive and diffusion transformer models.
  • Experience with distributed training techniques such as data parallelism, model parallelism, and pipeline parallelism.
  • Proven experience in at least one of the following: image/video generation and editing; efficient architectures (e.g., MoE, window attention); efficient model design; or reinforcement learning training methods (e.g., RLHF, DPO, GRPO).
  • Experience in multi-modal inference and serving with proficiency in serving frameworks such as vLLM, TensorRT-LLM, SGLang, xDiT, Cache-DiT etc.
  • Knowledge of distillation techniques such as Progressive Distillation, DMD, Self forcing etc.
  • Knowledge of quantization and compression techniques like AWQ, GPTQ, and FP8 for multi-modal pipelines.
  • Experience in distributed inference scaling across multi-node clusters using Ray Serve and Triton.
  • Experience in leading technical projects and supporting architectural decisions with data.

Förmåner

  • Potential for benefits and other compensation.
  • Opportunity to work on foundational models for responsible and efficient artificial general intelligence.
  • Directly impact business goals and facilitate AI innovation.
  • Be part of a team shaping the future of personal computing.
#AI#Copilot#Generative AI#Multimodal
Microsoft Logo

Företag

Microsoft

Publicerade jobb

för 3 veckor sedan

Anställningstyp

Heltid

Arbetsform

Hybrid

Erfarenhetsnivå

Mellannivå

Platser

United States

Kvalifikation

Kandidatexamen

Sökande

Ansök tidigt