Theme

Language

Global EN
Sweden ENSV
India EN

LLM Serving Engineer

Technology, Data & Digital · Data, AI & Analytics · Machine Learning · Software Engineering · Embedded Systems

In short

Qualcomm is looking for an LLM Serving Engineer in San Diego, California. This role involves developing and optimizing machine learning frameworks, hardware, and software for inference and training solutions, requiring collaboration across teams. The position demands significant experience with ML frameworks, operating systems, and programming languages, with a focus on embedded systems and ML applications.

Responsibilities

  • Leverages advanced Machine Learning knowledge to extend training or runtime frameworks or model efficiency software tools with new features and optimizations.
  • Models, architects, and develops highly advanced machine learning hardware (co-designed with machine learning software) for inference or training solutions.
  • Develops critical optimized software to enable AI models deployed on hardware (e.g., machine learning kernels, compiler tools, or model efficiency tools, etc.) to allow specific hardware features; collaborates with hardware teams for joint design and development.
  • Leads the development and application of machine learning techniques into products and/or AI solutions to enable customers to do the same.
  • Develops, adapts, or prototypes novel machine learning solutions aligned with and motivated by proposals or roadmaps for complex products and system-level features.
  • Oversees and provides technical expertise to others conducting experiments to train and evaluate machine learning solutions.

Requirements

  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related field and 6+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
  • Master's degree in Computer Science, Engineering, Information Systems, or related field and 5+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
  • PhD in Computer Science, Engineering, Information Systems, or related field and 4+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
  • 5+ years of experience with Machine Learning frameworks (e.g., Tensor Flow, Caffe, Caffe 2, Pytorch, Keras).
  • 5+ years of experience with low level interactions between operating systems (e.g., Linux, Android, QNX) and Hardware.
  • 5+ years of experience in embedded system development and optimization with application to a specific problem domain in ML (e.g., NLP, multi-media).
  • 5+ years of experience with one or more programming language suitable for machine learning (e.g., Python, R, C, C++)
  • 5+ years of experience using statistics and probability (e.g., conditional probability, Bayes rule).

Desired Qualifications

  • Master's degree in Computer Science, Engineering, Information Systems, or related field.
  • 3+ years experience working in a large matrixed organization.
  • 2+ years of work experience in a role requiring interaction with senior leadership (e.g., Director and above).
  • 1+ year in a technical leadership role with or without direct reports (only applies to positions with direct reports).
  • Developed 1+ novel Machine Learning architecture(s).

Benefits

  • Competitive annual discretionary bonus program
  • Opportunity for annual RSU grants
  • Highly competitive benefits package designed to support your success at work, at home, and at play.

Skills

TensorFlowCaffeCaffe 2PyTorchKerasLinuxAndroidQNXPythonRCC++
#Machine Learning#LLM#Engineering#Inference#Training#Optimization#Embedded Systems#Software#Hardware
Qualcomm Logo

About Qualcomm

Enabling a world where everyone and everything can be intelligently connected.

Enabling a world where everyone and everything can be intelligently connected.\n\n

Qualcomm Logo

Company

Qualcomm

Job Posted

1 week ago

Employment Type

Full Time

Work mode

On Site

Salary

US$122,800–184,200 / year

Experience Level

Senior

Locations

San Diego, United States of America

Qualification

Bachelor, Master, Doctoral

Applicants

Be an early applicant