Master thesis: Key-Value Cache Management in Mobile Networks

Technology, Data & Digital · Data, AI & Analytics · Machine Learning · Data Science · Artificial Intelligence

In short

This Master's thesis project focuses on Key-Value (KV) cache management in dynamic mobile networks, investigating strategies for LLM inference under conditions of user mobility and varying wireless links. The project involves literature review, testbed development simulating realistic mobile network scenarios, and evaluation of cache management approaches.

Responsibilities

Examine KV cache management for LLM inference, including load balancing, quantization and compression, prefix caching, and prefix-cache-aware request routing.
Build a testbed to simulate realistic mobile-network conditions such as time-varying wireless links, fading, interference, throughput and latency variation, congestion, user mobility, and handovers between base stations.
Support multiple users sharing cache and network resources, different KV cache strategies, and different network traces.
Benchmark existing and proposed approaches, such as transferring versus rebuilding the cache during handover and mobility-aware prefix routing.
Compare compute cost, latency, and energy efficiency across network conditions, and analyze the trade-offs.
Write a thesis report and present your results at Ericsson Research.
Propose and develop own ideas within the project.

Requirements

Pursuing a master’s degree in Computer Science, Artificial Intelligence, Data Science, Electrical Engineering, Computer Engineering, or a related field.
Strong programming skills in Python and PyTorch.
Fluency in English.

Desired Qualifications

Coursework or experience in AI; a background in machine learning and neural networks is preferred.
Interest in AI research or building end-to-end AI prototypes.
Knowledge of Git is an advantage.
Familiarity with network simulators such as ns-3 is beneficial.

Benefits

Opportunity to propose and develop own ideas within the project.
Present results at Ericsson Research.

Skills

PythonPyTorchGitns-3

#KV cache#mobile networks#AI#machine learning#neural networks#LLM

About Ericsson

Pioneering technology for connecting billions of people worldwide

Our purpose \nTo create connections that make the unimaginable possible.\n\nOur vision\nA world where limitless connectivity improves lives, redefines business and pioneers a sustainable future.\n\nOur values\nPerseverance, professionalism, respect and integrity.\n\nThe future is a place for purpose & vision – ours are clear, and we invite partners, customers and consumers to join us in our journey. \n\nFor a brighter future. For all. Let's #ImaginePossible

See all open jobs at Ericsson Read more about Ericsson Website