The Job

Principal Software Engineer

Technology, Data & Digital · Software & Web Development · Software Engineering · Machine Learning · Data Engineering

Join for updates

In short

Microsoft is seeking a Principal Software Engineer to focus on GPU techniques for online advertising platforms, leveraging LLMs and deep learning for innovation. This hybrid role requires end-to-end stack expertise with an emphasis on GPU acceleration for AI use cases, collaborating with partners to deliver high-performance inference capabilities.

Responsibilities

  • Engage directly with key partners to understand, design, and implement complex inferencing capabilities for state-of-the-art deep learning models, driving innovations in AI infrastructure.
  • Design and build robust, extensible and reusable frameworks that can support experimentation as well as production use-cases seamlessly.
  • Work with cutting-edge hardware and software stacks to deliver best-in-class inference performance while optimizing for cost, leveraging open-source projects to advance deep learning applications.
  • Collaborate with external and internal teams to identify new areas for improvement and contribute to innovations that enhance model performance and deployment.
  • Discover/solve impactful technical problems, advance state-of-the-art technologies, and translate ideas into production.
  • Develop internal tools to support the AI lifecycle, including experiment tracking, model versioning, and performance monitoring.
  • Create deep connections within communities, focus on increasing representation, retaining, and growing team members, while fostering awareness and growth through an inclusive environment.

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements.
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Desired Qualifications

  • Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • 2+ years of experience working with deep learning frameworks (e.g., PyTorch, OnnxRuntime, Tensorflow, vLLM, TensorRT-LLM).
  • Experience in end-to-end system design and development, with some familiarity with MLOps.
  • Experience with low-level GPU architecture, optimizations, kernel programming, model quantization.
  • Knowledge and experience with Docker, Kubernetes, High-performance application development.
  • Technical leadership skills and ability to mentor early-in-profession engineers.

Benefits

  • USD $142,800 - $274,800 per year (US, excluding Bay Area/NYC)
  • USD $188,000 - $304,200 per year (San Francisco Bay area and New York City metropolitan area)
  • Certain roles may be eligible for benefits and other compensation.
#AI#Machine Learning#GPU#Deep Learning#LLM#Inference
Microsoft Logo

Company

Microsoft

Job Posted

4 weeks ago

Employment Type

Full Time

WorkMode

Hybrid

Experience Level

Executive

Locations

United States

Qualification

Bachelor, Master

Applicants

Be an early applicant