Senior Software Engineer - Performance Tooling
Teknik, data och digitalt · Mjukvaru- och webbutveckling · Mjukvaruutveckling · Datavetenskap
I korthet
As a Senior Software Engineer on the AI Frameworks team at Microsoft, you will develop AI software enabling AI models to run everywhere. You will benchmark, debug, and optimize the performance of OpenAI and other LLMs on GPUs and CPUs, collaborating with researchers and engineers to improve deployment efficiency and reduce hardware footprint.
Ansvarsområden
- Work across multiple layers of the AI software stack (abstractions, programming models, compilers, runtimes, libraries, and APIs) to enable large-scale model training and inference.
- Benchmark OpenAI and other LLMs for performance on GPUs and Microsoft hardware.
- Debug, profile, and optimize performance for training/inference workloads on Central Processing Units (CPUs)/Graphics Processing Units (GPUs).
- Monitor performance regressions and drive continuous improvements to reduce time-to-deploy and hardware footprint.
- Collaborate across teams of researchers and engineers to deliver scalable, production-ready AI performance improvements.
Krav
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C++, or Python OR equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. This includes passing the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Önskade kvalifikationer
- Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C++, or Python
- OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C++, or Python
- OR equivalent experience.
- 4+ years’ practical experience working on high performance applications and performance debugging and optimization on CPUs/GPUs.
- Experience in DNN/LLM inference and experience in one or more DL frameworks such as PyTorch, Tensorflow, or ONNX Runtime and familiarity with CUDA, ROCm, Triton.
- Technical background and solid foundation in software engineering principles, computer architecture, GPU architecture, hardware neural net acceleration.
- Experience in end-to-end performance analysis and optimization of state of the art LLMs and HPC applications, including proficiency using GPU profiling tools.
- Cross-team collaboration skills and the desire to collaborate in a team of researchers and developers.
- Ability to independently lead projects
Förmåner
- The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year.
- There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.
- Certain roles may be eligible for benefits and other compensation.
- This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Färdigheter
C++PythonCUDAPyTorchTensorflowONNX RuntimeROCmTriton
#AI#Software Engineering#Performance Tooling#Large Language Models#GPUs#CPUs#Inference#Training#Compilers#Runtimes#APIs
Om Microsoft
Empowering every person and organization on the planet to achieve more
Every company has a mission. What's ours? To empower every person and every organization to achieve more. We believe technology can and should be a force for good and that meaningful innovation contributes to a brighter world in the future and today. Our culture doesn’t just encourage curiosity; it embraces it. Each day we make progress together by showing up as our authentic selves. We show up with a learn-it-all mentality. We show up cheering on others, knowing their success doesn't diminish our own. We show up every day open to learning our own biases, changing our behavior, and inviting…
Företag
MicrosoftPublicerade jobb
för 1 dag sedan
Anställningstyp
Heltid
Arbetsform
Hybrid
Lön
119 800–234 700 US$ / år
Erfarenhetsnivå
Senior
Platser
United States
Kvalifikation
Kandidatexamen, Masterexamen
Sökande
Ansök tidigt
Liknande jobb
Saab
Fareham, United KingdomField Support Technician
Heltid Ansök tidigt Publicerad för 4 dagar sedan
Saab
Bedfordshire, United KingdomSenior UAV Design Engineer
Heltid Ansök tidigt Publicerad för 4 dagar sedan
Saab
Växjö, SwedenMjukvaruarkitekt
Heltid Ansök tidigt Publicerad för 4 dagar sedan
Saab
Huskvarna, SwedenPraktikplats / NFK hos Saab Training & Simulation
Praktik Ansök tidigt Publicerad för 4 dagar sedan
ICA Gruppen
Solna, SwedenTech lead
Heltid Ansök tidigt Publicerad för 4 dagar sedan
Alfa Laval
Lund, SwedenSenior C#/.NET Developer – PIM & Inriver
Heltid Ansök tidigt Publicerad för 4 dagar sedan