Lead Engineer, Senior-System Performance Engineer (NSP, AI/ML, CPU, DDR)

Technology, Data & Digital · IT Infrastructure & Security · Systems Engineering

In short

Qualcomm is seeking a Lead Engineer, Senior-System Performance Engineer in Bangalore, India, to optimize system performance on Snapdragon Data Center chipsets, with a focus on AI/ML performance using NPU cores. The role requires a strong understanding of NPU, CPU, and DDR architectures, deep learning fundamentals, model optimization techniques, and various performance profiling tools.

Responsibilities

Drive Performance analysis on silicon using various System and Cores (i.e. NPU, AI/ML, CPU, Memory) benchmarks like Dhrystone, GeekBench, SPECInt, CNN/GenAI ML networks etc.
Use of Performance tools to analyze the load patterns across IPs and identify any performance bottlenecks in system.
Analyzing Perf KPIs of SoC subsystems like NPU, CPU, Memory, and corelate performance with projection.
Evaluate and characterize performance at various junction temperatures and optimize running at high ambient temperatures.
Analyze and optimize the System performance parameters of SoC infrastructure like NoC, LP5 DDR, etc.
Collaborate with cross-functional global teams to plan and execute performance activities on chipsets as well as make recommendations for next generation chipsets.

Requirements

5+ years of industry experience in the following:
Experience working on any ARM/x86 based platforms, mobile/automotive/Data center operating systems and/or performance profiling tools.
Experience in application or driver development in Linux\QNX and ability to create/customize make files with various compiler options is a plus.
Must be quick learner and should be able to adapt to new technologies.
Must have excellent communication skills.
Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 3+ years of Systems Engineering or related work experience.
OR Master's degree in Engineering, Information Systems, Computer Science, or related field and 2+ years of Systems Engineering or related work experience.
OR PhD in Engineering, Information Systems, Computer Science, or related field and 1+ year of Systems Engineering or related work experience.

Desired Qualifications

A deep understanding of NPU, CPU and DDR architecture internals
Understanding of NPU micro-architecture, including its specialized processing elements for operations like matrix multiplications and convolutions.
A strong grasp of deep learning fundamentals, including neural network architectures like Convolutional Neural Networks (CNNs), transformers, GenAI etc.
Understanding the distinction between the compute-intensive training of a model (often done on GPUs) and running inference (making predictions) on NPUs.
Knowledge of Model optimization and compression techniques (Quantization, Pruning, Distillation etc.)
Understanding CPU caches (L1, L2, L3), instruction pipelines, branch prediction, memory hierarchy (including register, cache, and main memory) and multi-core/multi-threaded processing.
Understanding of JEDEC specifications LPDDR4, LPDDR5, LPDDR6, including command and timing parameters (e.g., 𝑡𝐶𝐿, 𝑡𝑅𝐶𝐷, tRP), memory organization (rows, columns, banks), and basic view of training and initialization sequences, how a memory controller works and its specific features like command queue, port arbitration, and various control schemes.
Familiarity with frameworks like TensorFlow Lite, PyTorch Mobile, and ONNX Runtime for preparing models for deployment.
Experience with NPU-specific compilers, such as those from Qualcomm (QNN), Arm (Vela), Intel (OpenVINO), to optimize and orchestrate AI workloads.
Evaluating hardware and software to determine the best fit for specific AI tasks and measure performance metrics like TOPS/W (trillions of operations per second per watt).
Using tools like the Windows Performance Toolkit and Qualcomm's Snapdragon Profiler to analyze and optimize NPU and system-level performance
A core understanding of how to use parallel processing architectures for efficient AI computations.
Expertise in how operating systems manage processes, threads, memory, MMU, and interrupt handling.
Good understanding of Benchmarks CPU (like GeekBench, SpecInt, CoreMark etc) and DDR (like lat_mem, stream, bw_mem etc.) and how they exercise the underlying CPU/GPU/DDR architecture.
Experience with a variety of performance monitoring tools like Intel VTune, Linux perf, and Utilities like top, vmstat, iostat, and netstat to monitor system resources like CPU, memory, and I/O.
Experience with software tools to monitor system hotspots, command bus utilization, and identify memory traffic patterns is critical.
Good understanding of memory allocation policies, prefetching, and caching to minimize latency and maximize bandwidth.
Skills in profiling code to analyze memory access patterns and then optimizing the code for better data locality.
Analyzing large datasets from performance tests requires strong statistical skills.
Knowledge of Computer architecture, LP5 DDR, Bus/NOC profiling is a big plus.
Fundamentals on any operating system like Linux/QNX/Hypervisor & experience working on any Data center applications.
Experience in creating professional quality reports and slides using MS Office or any advanced visualization tools.
Experience in PoC development and competitive analysis
Knowledge on Voltage/Power/ Thermal domain is plus.
Required: Bachelor's, Computer Engineering, and/or Electrical Engineering
Preferred: Master's, Computer Engineering, and/or Electrical Engineering

Benefits

Qualcomm is an equal opportunity employer.
Qualcomm is committed to providing an accessible process.
Qualcomm is committed to making our workplace accessible for individuals with disabilities.

Skills

NPU architectureCPU architectureDDR architectureDeep learningCNNTransformersGenAIModel optimizationModel compressionQuantizationPruningDistillationCPU cachesInstruction pipelinesBranch predictionMemory hierarchyMulti-core processingMulti-threaded processingDDR specificationsLPDDR4LPDDR5LPDDR6Memory controllerTensorFlow LitePyTorch MobileONNX RuntimeQNNVelaOpenVINOTOPS/WWindows Performance ToolkitSnapdragon ProfilerParallel processingOperating systemsMMUInterrupt handlingKernel schedulerBenchmarksGeekBenchSpecIntCoreMarklat_memstreambw_memIntel VTuneLinux perftopvmstatiostatnetstatMemory allocation policiesPrefetchingCachingCode optimizationData localityStatistical analysisDhrystoneLinuxQNXMS Office

#NSP#AI/ML#CPU#DDR#Systems Engineering#Performance Engineering#Snapdragon#Data Center#Chipsets#NPU#Deep Learning#CNN#Transformers#GenAI#Quantization#Pruning#Distillation#Cache#Memory Hierarchy#LPDDR#TensorFlow Lite#PyTorch Mobile#ONNX Runtime#QNN#Vela#OpenVINO#TOPS/W#Windows Performance Toolkit#Snapdragon Profiler#Parallel Processing#Operating Systems#Benchmarks#GeekBench#SpecInt#Intel VTune#Linux perf#Statistical Analysis#ARM#x86#Linux#QNX#MS Office