Engineer, Senior-Machine Learning, embedded, C++

Technology, Data & Digital · Data, AI & Analytics · Machine Learning · Software Engineering · Embedded Systems

In short

Join Qualcomm's Generative AI team as a Senior Machine Learning Engineer in Hyderabad. This role focuses on developing on-device AI inference engines for LLMs and LVMs on Qualcomm chipsets, leveraging C++ and optimizing for hardware accelerators. Requires strong experience in AI models and software development.

Responsibilities

Spearhead the development and commercialization of the Qualcomm AI Runtime (QAIRT) SDK on Qualcomm SoCs.
Push the limits of performance from large models as an AI inferencing expert.
Deploy large C/C++ software stacks using best practices.
Stay on the cutting edge of GenAI advancements, understanding LLMs/Transformers and the nuances of edge-based GenAI deployment.
Design, develop, create, modify, and validate embedded and cloud edge software, applications, and/or specialized utility programs.
Collaborate with systems, hardware, architecture, and test engineers to design system-level software solutions and obtain information on performance requirements and interfaces.

Requirements

Master’s/Bachelor’s degree in computer science or equivalent.
4+ years of relevant work experience in software development.
Strong understanding of Generative AI models – LLM, LVM, LMMs and building blocks (self-attention, cross attention, kv caching etc.).
Understanding of Floating-point, Fixed-point representations and Quantization concepts.
Experience with optimizing algorithms for AI hardware accelerators (like CPU/GPU/NPU).
Strong in C/C++ programming, Design Patterns and OS concepts.
Good scripting skills in Python.
Excellent analytical and debugging skills.
Good communication skills (verbal, presentation, written).
Ability to collaborate across a globally diverse team and multiple interests.

Desired Qualifications

Strong understanding of SIMD processor architecture and system design.
Proficiency in object-oriented software development.
Familiarity with Linux and Windows environment.
Strong background in kernel development for SIMD architectures.
Familiarity with frameworks like llama.cpp, MLX, and MLC is a plus.
Good knowledge of PyTorch, TFLite, and ONNX Runtime is preferred.
Experience with parallel computing systems and languages like OpenCL and CUDA is a plus.

Benefits

Qualcomm is an equal opportunity employer.
Qualcomm is committed to providing an accessible process for individuals with disabilities during the application/hiring process.
Qualcomm is committed to making our workplace accessible for individuals with disabilities.

Skills

C++PythonGenerative AILLMLVMLMMself-attentioncross attentionkv cachingFloating-point representationFixed-point representationQuantizationNPUOS conceptsLinuxWindowsPyTorchTFLiteONNX RuntimeOpenCLCUDA

#Machine Learning#embedded#C++#Generative AI#AI