Software Development Engineer, AI Runtime
Technology, Data & Digital · Software & Web Development · Software Engineering · Data Science · Machine Learning
In short
We are seeking a Software Development Engineer to build and scale AI runtime infrastructure for Alexa+. You will design and implement distributed systems for LLM inference and expert agent orchestration, ensuring high availability and low latency for millions of customers.
Responsibilities
- Design, build, and operate large-scale distributed services that power Alexa+ Expert executions
- Develop and optimize LLM orchestration pipelines, including model serving, prompt routing, and inference optimization
- Build multi-agent coordination systems for low-latency request routing
- Ensure operational excellence of Tier-1 services with high availability
- Collaborate with applied scientists and ML engineers to integrate new AI capabilities
- Drive architectural decisions balancing performance, reliability, and cost
- Mentor teammates and improve engineering standards through reviews and leadership
Requirements
- 3+ years of professional software development experience (non-internship)
- 2+ years of experience in design or architecture of systems (design patterns, reliability, scaling)
- Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or related field
- Experience programming with at least one software programming language
Desired Qualifications
- 3+ years of full software development life cycle experience (coding standards, code reviews, source control, build processes, testing, operations)
- Bachelor's degree in computer science or equivalent
- System design experience with AI components, evaluating latency, cost, reliability, and accuracy
Benefits
- Inclusive culture that empowers employees
- Opportunity to shape how millions of customers experience Alexa+ daily
#AI#Runtime#Software Development#Distributed Systems#LLM#Alexa+
Company
Amazon
Job Posted
1 day ago
Employment Type
Full Time
WorkMode
On Site
Experience Level
Senior
Locations
Pune, India
Qualification
Bachelor, Master, Doctoral
Applicants
Be an early applicant