Principal SW Engineer - LLM Serving (Cloud AI)
Technology, Data & Digital · Software & Web Development · Software Engineering
In short
Qualcomm's Cloud AI team is hiring a Principal SW Engineer in Cork, Ireland, to develop software solutions for Inference Acceleration. This role involves the full product lifecycle, requiring strong communication, planning, and execution skills, with a focus on LLMs and serving frameworks.
Responsibilities
- Develop software solutions for Inference Acceleration within the Qualcomm Cloud AI team.
- Engage in activities spanning the entire product life cycle, from early R&D to commercial deployment.
- Collaborate cross-functionally on a daily basis.
- Plan, manage, and deliver large commercial software projects.
- Execute, analyze, and optimize neural networks.
- Write high-performance software for multicore systems.
- Analyze performance of software/hardware solutions on multi-core architectures.
- Model performance of SoC architectures.
Requirements
- Bachelor's degree in Computer Science, Engineering, Information Systems, or related field and 8+ years of relevant work experience; OR Master's degree and 7+ years; OR PhD and 6+ years.
- Experience in serving frameworks, like vLLM.
- Strong development skills in PyTorch.
- Strong understanding of LLMs, Multi-modal and reasoning models.
- Experience with C++, Python.
- Strong skills in analyzing performance of software/hardware solutions on multi-core architectures.
- Understanding of multi-core processor architecture and SoC architectures (NoCs, caches, memories, etc.).
- Excellent communication skills (written and verbal) and team player.
Desired Qualifications
- Experience with machine learning accelerators and related software is highly desired.
- Background and understanding of neural network operators and mathematical operations: linear algebra, math libraries, desirable.
Benefits
- Salary, stock and performance related bonus
- Maternity/Paternity Leave
- Employee stock purchase scheme
- Matching pension scheme
- Education Assistance
- Relocation and immigration support (if needed)
- Life, Medical, Income and Travel Insurance
- Subsidised memberships for physical and mental well-being
- Bicycle purchase scheme
- Employee run clubs
#LLM Serving#Cloud AI#Software Engineering#Inference Acceleration