Engineer, Staff
Technology, Data & Digital · Software & Web Development · Software Engineering · Data Science
In short
As a Datacenter Systems and Solutions Staff Engineer at Qualcomm in Bangalore, you will lead AI inference programs on Qualcomm's datacenter AI platform, from architecture to deployment, and serve as the technical lead for customer engagements. This role requires broad expertise across the AI stack, including hardware, inference serving, model optimization, and distributed systems, along with cross-functional leadership.
Responsibilities
- Lead the architecture and end-to-end design of AI inference solutions on Qualcomm AI hardware.
- Define system requirements, interface specifications, and performance targets for complex deployments.
- Own customer AI engagements as technical lead, translating requirements into deployment-ready serving architectures.
- Drive model optimization and validate production readiness for customer AI solutions.
- Drive development and deployment of GenAI and LLM applications, including architecture decisions for fine-tuning, quantization, speculative decoding, and disaggregated serving.
- Define and execute benchmarking programs across the hardware and software stack.
- Perform root-cause analysis on complex system-level issues and communicate findings.
- Mentor and coach engineers on technical approaches, debugging methodology, and best practices.
- Provide leadership on project execution and set clear expectations.
- Identify and prototype solutions to unmet technical challenges.
- Collaborate across compiler, runtime, serving, model engineering, and customer engineering teams.
- Define reusable platform capabilities, tooling, and documentation.
- Contribute to strategic decisions on model portfolio prioritization, inference stack investment, and customer deployment architecture.
- Track advancements in AI and ML research and translate relevant techniques into actionable product and solution improvements.
Requirements
- Strong proficiency in Python and ML frameworks (PyTorch, TensorFlow).
- Deep understanding of ML model development, deployment, and production inference.
- Deep understanding of system performance profiling and parallel computing.
- Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 4+ years of Software Engineering or related work experience.
- OR Master's degree in Engineering, Information Systems, Computer Science, or related field and 3+ years of Software Engineering or related work experience.
- OR PhD in Engineering, Information Systems, Computer Science, or related field and 2+ years of Software Engineering or related work experience.
- 2+ years of work experience with Programming Language such as C, C++, Java, Python, etc.
Desired Qualifications
- Advanced understanding of GenAI architectures including transformers, diffusion models, LLMs, large vision-language models and embedding models.
- Hands-on experience with inference optimization techniques: speculative decoding, KV cache management, continuous batching and tensor/pipeline parallelism.
- Experience fine-tuning and distilling GenAI models at scale; familiarity with RLHF and RLAIF methods is a plus.
- Background in compiler optimizations for ML workloads targeting heterogeneous hardware.
- Experience designing and operating large-scale distributed AI systems with knowledge of microservice and event-driven architectures.
- Proficiency with MLOps practices and ML lifecycle tooling; experience with containerization and automation (Docker, Kubernetes, GitOps) is expected.
- Experience with observability and performance analysis for ML pipelines: metrics collection, distributed tracing and capacity modeling.
- Track record of leading complex technical programs across large, matrixed organizations.
- Experience with open-source development workflows and version control systems (Git, GitHub, GitLab, Gerrit).
- Experience with rack-level orchestration and datacenter automation is a plus.
Skills
PythonPyTorchTensorFlowCC++JavaDockerKubernetesGitGitHubGitLabGerrit
#AI#Datacenter#Inference#GenAI#LLM#Systems Engineering#Software Engineering
About Qualcomm
Enabling a world where everyone and everything can be intelligently connected.
Enabling a world where everyone and everything can be intelligently connected.\n\n
Company
QualcommJob Posted
4 weeks ago
Employment Type
Full Time
Work mode
On Site
Experience Level
Senior
Locations
Bangalore, India
Qualification
Bachelor, Master, Doctoral
Applicants
Be an early applicant