AI Compiler & Kernel Engineer
Technology, Data & Digital · Software & Web Development · Software Engineering
In short
Qualcomm Cloud AI is looking for an AI Compiler & Kernel Engineer to optimize AI operators for cloud inference. Responsibilities include developing and optimizing AI kernels, enabling LLMs and MoE models, and improving performance and memory efficiency on Qualcomm platforms.
Responsibilities
- Develop and optimize AI kernels and operators for Qualcomm Cloud AI platforms.
- Enable and optimize LLM, MoE, and multimodal models for large-scale cloud inference.
- Drive accuracy, performance and efficiency optimizations across the software stack.
- Improve model memory footprint and ROM / RAM efficiency through kernel, graph, and compiler optimizations.
- Collaborate with performance and modeling teams to deliver best-in-class inference efficiency.
- Analyze and resolve performance bottlenecks using profiling, benchmarking, and modeling methodologies.
Requirements
- Master's degree or above in Computer Science, Artificial Intelligence, Mathematics, Electrical Engineering, or related fields.
- 5+ years of experience in Cloud AI inference, kernel/operator development, or AI compiler technologies.
- Good verbal and written English communication skills.
- Proficiency in C++, Python, and Linux development environments.
- Deep understanding of Transformer architectures, such as LLMs, MoE, and modern foundation models.
- Strong experience with compiler technologies such as MLIR, Triton, TVM, or similar frameworks, including graph transformation, operator lowering, scheduling, operator fusion, kernel auto-tuning, code generation and memory scheduling.
- Strong experience with parallel computing architectures and performance optimization techniques, including vectorization, tiling, memory hierarchy optimization, and workload scheduling.
- Strong experience with graph optimization, model accuracy validation, performance optimization, and memory optimization.
- Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 4+ years of Software Engineering or related work experience.
- Master's degree in Engineering, Information Systems, Computer Science, or related field and 3+ years of Software Engineering or related work experience.
- PhD in Engineering, Information Systems, Computer Science, or related field and 2+ years of Software Engineering or related work experience.
- 2+ years of work experience with Programming Language such as C, C++, Java, Python, etc.
Desired Qualifications
- Experience optimizing transformer-related operators such as Attention, FlashAttention, KV Cache, Embedding, GEMM, Softmax, and MoE routing is highly desirable.
- Hands-on experience developing custom operators and high-performance kernels, either manually or through compiler frameworks such as MLIR or Triton with AI accelerator platforms, such as GPUs, NPUs, TPUs, or custom AI hardware.
Benefits
- Qualcomm is an equal opportunity employer.
- Qualcomm is committed to providing an accessible process for individuals with disabilities.
- Qualcomm is committed to making our workplace accessible for individuals with disabilities.
Skills
C++PythonLinuxMLIRTritonTVM
#AI#Compiler#Kernel#Engineer#Cloud#Inference#LLM#MoE#Performance Optimization
About Qualcomm
Enabling a world where everyone and everything can be intelligently connected.
Enabling a world where everyone and everything can be intelligently connected.\n\n
Company
QualcommJob Posted
5 hours ago
Employment Type
Full Time
Work mode
On Site
Experience Level
Mid-Senior
Locations
Beijing, China
Qualification
Bachelor, Master, Doctoral
Applicants
Be an early applicant
Similar Jobs
Microsoft
United StatesPrincipal Software Engineering, AI Infrastructure
US$143–275k/yr Full Time Be an early applicant Posted 5 days ago
Microsoft
United StatesSenior Supply Chain Engineer
US$120–235k/yr Full Time Be an early applicant Posted 5 days ago
Synopsys Inc
Nepean, CanadaValidation / Verification Eng, Staff Engineer
CA$93–139k/yr Full Time Be an early applicant Posted 4 days ago
Synopsys Inc
Nepean, CanadaPrincipal Firmware Engineer
CA$146–219k/yr Full Time Be an early applicant Posted 4 days ago
Synopsys Inc
Mississauga, CanadaAnalog Design Internship - Summer 2027
CA$0/yr Internship Be an early applicant Posted 4 days ago
Synopsys Inc
Sunnyvale, United StatesDirector of R&D Engineering
US$230–344k/yr Full Time Be an early applicant Posted 4 days ago