AI Compiler & Kernel Engineer

Technology, Data & Digital · Software & Web Development · Software Engineering

In short

Qualcomm Cloud AI is looking for an AI Compiler & Kernel Engineer to optimize AI operators for cloud inference. Responsibilities include developing and optimizing AI kernels, enabling LLMs and MoE models, and improving performance and memory efficiency on Qualcomm platforms.

Responsibilities

Develop and optimize AI kernels and operators for Qualcomm Cloud AI platforms.
Enable and optimize LLM, MoE, and multimodal models for large-scale cloud inference.
Drive accuracy, performance and efficiency optimizations across the software stack.
Improve model memory footprint and ROM / RAM efficiency through kernel, graph, and compiler optimizations.
Collaborate with performance and modeling teams to deliver best-in-class inference efficiency.
Analyze and resolve performance bottlenecks using profiling, benchmarking, and modeling methodologies.

Requirements

Master's degree or above in Computer Science, Artificial Intelligence, Mathematics, Electrical Engineering, or related fields.
5+ years of experience in Cloud AI inference, kernel/operator development, or AI compiler technologies.
Good verbal and written English communication skills.
Proficiency in C++, Python, and Linux development environments.
Deep understanding of Transformer architectures, such as LLMs, MoE, and modern foundation models.
Strong experience with compiler technologies such as MLIR, Triton, TVM, or similar frameworks, including graph transformation, operator lowering, scheduling, operator fusion, kernel auto-tuning, code generation and memory scheduling.
Strong experience with parallel computing architectures and performance optimization techniques, including vectorization, tiling, memory hierarchy optimization, and workload scheduling.
Strong experience with graph optimization, model accuracy validation, performance optimization, and memory optimization.
Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 4+ years of Software Engineering or related work experience.
Master's degree in Engineering, Information Systems, Computer Science, or related field and 3+ years of Software Engineering or related work experience.
PhD in Engineering, Information Systems, Computer Science, or related field and 2+ years of Software Engineering or related work experience.
2+ years of work experience with Programming Language such as C, C++, Java, Python, etc.

Desired Qualifications

Experience optimizing transformer-related operators such as Attention, FlashAttention, KV Cache, Embedding, GEMM, Softmax, and MoE routing is highly desirable.
Hands-on experience developing custom operators and high-performance kernels, either manually or through compiler frameworks such as MLIR or Triton with AI accelerator platforms, such as GPUs, NPUs, TPUs, or custom AI hardware.

Benefits

Qualcomm is an equal opportunity employer.
Qualcomm is committed to providing an accessible process for individuals with disabilities.
Qualcomm is committed to making our workplace accessible for individuals with disabilities.

Skills

C++PythonLinuxMLIRTritonTVM

#AI#Compiler#Kernel#Engineer#Cloud#Inference#LLM#MoE#Performance Optimization

About Qualcomm

Enabling a world where everyone and everything can be intelligently connected.

Enabling a world where everyone and everything can be intelligently connected.\n\n

See all open jobs at Qualcomm Read more about Qualcomm Website

Company

Qualcomm

Job Posted

1 day ago

Employment Type

Full Time

Work mode

On Site

Experience Level

Mid-Senior

Locations

Beijing, China

Qualification

Bachelor, Master, Doctoral

Applicants

Be an early applicant

Similar Jobs

Alstom

Västerås, Sweden

AI Compiler & Kernel Engineer

Responsibilities

Requirements

Desired Qualifications

Benefits

Skills

About Qualcomm

Similar Jobs

Mechanical Integration Engineer

Student Data Engineer

Software Designer

Senior Electrical Engineer

Utilities Strategy Manager

Junior Software Developer