Principal Software Engineer, HPC/AI
Technology, Data & Digital · Software & Web Development · Software Engineering · Data Engineering
In short
Microsoft's HPC/AI team seeks a Principal Software Engineer to design and build next-generation networking infrastructure for large-scale AI training on Azure Cloud. This role involves architecting high-performance, low-latency communication frameworks for distributed systems and working with cutting-edge AI hardware and software to drive innovation in AI supercomputing.
Responsibilities
- Partner with stakeholders to determine user requirements.
- Lead identification of dependencies and development of design documents.
- Mentor others to produce extensible and maintainable code.
- Design, develop, and optimize networking solutions for large-scale AI training infrastructure.
- Architect and implement high-performance, low-latency, and low-jitter communication frameworks.
- Benchmark, analyze, and enhance the scalability and reliability of networking systems.
- Debug and resolve complex networking issues.
- Act as a Designated Responsible Individual (DRI) and guide other engineers.
- Proactively seek new knowledge and adapt to new AI trends and technical solutions.
Requirements
- Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python, OR equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements.
- Must pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Desired Qualifications
- Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python, OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python, OR equivalent experience.
- 1+ years hands-on experience with networking technologies in AI-specific hardware (e.g., InfiniBand, ROCE, NVLink).
- In-depth understanding of networking protocols (e.g., Ethernet, TCP/IP, RDMA, gRPC) and distributed systems.
- Familiarity with network virtualization, software-defined networking (SDN), or network performance tuning.
- Familiarity with AI accelerators such as GPUs (NVIDIA, AMD) or TPUs, and how they interact with networking infrastructure.
- 1+ years experience with telemetry and observability tools for network monitoring at scale.
Benefits
- Typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year.
- Different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, is USD $188,000 - $304,200 per year.
- Certain roles may be eligible for benefits and other compensation.
Skills
CC++C#JavaJavaScriptPythonInfiniBandROCENVLinkEthernetTCP/IPRDMAgRPCNVIDIAAMD
#HPC#AI#Supercomputing#Networking#Distributed Systems#Cloud Computing#Azure
About Microsoft
Empowering every person and organization on the planet to achieve more
Every company has a mission. What's ours? To empower every person and every organization to achieve more. We believe technology can and should be a force for good and that meaningful innovation contributes to a brighter world in the future and today. Our culture doesn’t just encourage curiosity; it embraces it. Each day we make progress together by showing up as our authentic selves. We show up with a learn-it-all mentality. We show up cheering on others, knowing their success doesn't diminish our own. We show up every day open to learning our own biases, changing our behavior, and inviting…
Company
MicrosoftJob Posted
2 days ago
Employment Type
Full Time
Work mode
Remote
Salary
US$142,800–274,800 · Negotiable
Experience Level
Senior
Locations
United States
Qualification
Bachelor, Master
Applicants
Be an early applicant
Similar Jobs
ASSA ABLOY Group
United StatesManager, Business Development - Multi-Family
US$100–110k/yr Full Time Be an early applicant Posted 4 days ago
ASSA ABLOY Group
Indian Trail, United StatesService Parts Distribution & Logistics Manager
Full Time Be an early applicant Posted 4 days ago
ASSA ABLOY Group
Milan, United StatesTechnical Order Processor
Full Time Be an early applicant Posted 4 days ago
Alfa Laval
Richmond, United StatesTeam Leader - Material Handling
US$23.5/hr Full Time Be an early applicant Posted 4 days ago
Microsoft
United StatesProduct Marketing IC4
US$106–204k/yr Full Time Be an early applicant Posted 4 days ago
Microsoft
United StatesSenior Solution Area Specialists - Security
US$108–188k/yr Full Time Be an early applicant Posted 4 days ago