Embedded ML Staff Engineer -- Snapdragon Mobile

Technology, Data & Digital · Data, AI & Analytics · Machine Learning · Software Engineering · Embedded Systems

In short

Als erfahrener Embedded ML Staff Engineer für Snapdragon Mobile sind Sie für die Softwarearchitektur und das Systemdesign für KI-Funktionen verantwortlich. Sie optimieren die Leistung und Energieeffizienz auf ressourcenbeschränkten Geräten unter Verwendung von CPU, GPU und NPU und arbeiten an Bereichen wie Computer Vision, Audio und Generative AI. Praktische Erfahrung mit LLMs, SLMs und agentischen KI-Systemen wird stark bevorzugt.

Responsibilities

Design and implement architecture for complex AI features and experiences within your subsystem for Snapdragon Mobile products; propose architecture improvements.
Research and collaborate cross-functionally to help define requirements; build hands-on prototypes.
Design and implement on-device agentic experience components, including context and memory management, perception (e.g., screen/scene understanding, sensor fusion), and heterogeneous compute placement for LLM/SLM workloads across CPU, GPU, and NPU under tight power, thermal, and memory budgets.
Implement closed-loop, telemetry-driven resource scheduling components for heterogeneous compute (CPU/GPU/NPU), re-evaluating workload placement against live power, thermal, and SLA signals.
Implement memory and model-state lifecycle management for on-device LLM/SLM serving -- including KV-cache and context-state caching, eviction, paging, and reuse/sharing across sessions under tight device memory budgets.
Evaluate and help architect around memory bandwidth and data-movement constraints (e.g., high-bandwidth memory, on-chip interconnects) to maximize achievable AI throughput and efficiency on constrained silicon.
Serve as a technical resource in design reviews; recommend improvements aligned to business and customer needs.
Collaborate with external partners on subsystem implementation plans and milestones.
Stay current on AI and Mobile industry trends, competitors' products, and advances in various engineering fields; share expertise within the team.
Contribute technical input and trend analysis to roadmap discussions led by architecture and product leadership.

Requirements

Bachelor's degree in Computer Science, Engineering, Information Systems, or related field and 8+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
Master's degree in Computer Science, Engineering, Information Systems, or related field and 7+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
PhD in Computer Science, Engineering, Information Systems, or related field and 6+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
Strong software engineering principles.
Proficiency in programming languages such as C, C++, Python.
Detail-oriented with strong problem-solving, analytical, and debugging skills with the ability to think strategically and drive innovative solutions.
Demonstrated ability to learn, think and adapt in a fast-changing environment.
Familiarity with software development methodologies, version control systems, and agile project management practices.

Desired Qualifications

Excellent understanding of AI frameworks (e.g., TensorFlow, PyTorch).
Experience with large language models/foundational models and small language models (SLMs), including LoRA/adapter-based fine-tuning and on-device personalization techniques, MCP's a plus.
Experience with agentic AI architectures -- planning, tool-use/orchestration, context and memory management -- and their deployment on resource-constrained embedded devices.
Experience in architecting, designing, and implementing SW frameworks for complex heterogeneous or multi-processor systems, including runtime placement of ML/agentic workloads across CPU, GPU, and NPU.
Experience designing graph-based (DAG) or state-machine-driven schedulers for multi-workload resource allocation across heterogeneous compute, with closed-loop adaptation to live system telemetry.
Experience with resource allocation across multiple concurrent AI workloads/agents competing for shared compute and memory, not just single-model placement.
Background in closed-loop or control-systems thinking (feedback-driven scheduling, adaptive/self-correcting systems) is a plus.
Experience with embedded ML at the system level -- model deployment, scheduling, and lifecycle management under tight memory, power, and thermal constraints on mobile/embedded platforms.
Experience with LLM/SLM serving internals -- KV-cache and model-state management, paging/eviction strategies, and state sharing or reuse across concurrent sessions or agents.
Good Understanding of complete AI Software stack and familiarity with AI hardware acceleration technologies.
Understanding of memory subsystem and interconnect bandwidth (e.g., HBM/LPDDR, cache hierarchies, NPU memory architecture) and how bandwidth -- not just compute -- bottlenecks AI inference performance; experience architecting to minimize redundant data movement.
Experience in modeling AI networks and workloads to extract performance and power estimates, and converting that into optimization.
Experience with context and perception pipelines (sensor fusion, screen/scene understanding, multimodal context) that power personalized or agentic on-device experiences.
Strong background in algorithm development, performance analysis using profiling tools, and algorithmic modification methods for performance improvement.
Knowledge of state of the art in AI for one or more domains such as Computer Vision, Audio, Generative AI.
Knowledge of Mobile platforms, Android framework, Embedded system implementations.
Understanding Typescript, Java, Kotlin is a plus.
The ability to use agentic tooling for development is a plus.
Excellent communication skills to articulate complex technical concepts to non-technical and technical stakeholders.
Experience mentoring junior and mid-level engineers; ability to influence technical direction without formal authority.
Bachelor's or Master's in Computer Science or Electrical Engineering.
5-8 years of experience in High-Performance Computing System Engineering or Software, with 2+ years in AI system optimization.

Benefits

Competitive annual discretionary bonus program
Opportunity for annual RSU grants
Highly competitive benefits package designed to support your success at work, at home, and at play
Access to US benefits link for more details

Skills

Machine LearningSoftware DevelopmentSystem DesignPythonC++CTensorFlowPyTorchLLMSLMAndroid

#Embedded#ML#Staff Engineer#Snapdragon#Mobile#AI#System Design#Performance Optimization#CPU#GPU#NPU#Computer Vision#Audio#Generative AI#Agentic AI#LLM#SLM#Resource-constrained devices#Heterogeneous compute#Context/perception pipelines#Mobile platforms#C++#Python#C