Master Thesis: Observability and Analytics for AI-Assisted Development

Technology, Data & Digital · Software & Web Development · Software Engineering · Data Science · Artificial Intelligence

In short

This Master Thesis project focuses on developing an analytics and observability framework for AI-assisted command-line development tools. You will instrument a tool, collect data on token consumption, latency, and user experience, and propose optimizations to improve efficiency and reduce costs, while also investigating user-centric metrics and privacy-preserving telemetry.

Responsibilities

Design and implement an instrumentation and analytics framework for AI-assisted command-line tools.
Identify valuable signals and metrics for understanding AI development workflows.
Capture relevant events respecting privacy and usability requirements.
Analyze usage patterns, identify cost/delay sources, and develop optimization recommendations.
Validate recommendations through controlled cohorts or user studies.
Explore designing observability models, creating dashboards, comparing context compaction strategies, evaluating model-routing, measuring retry/orchestration impact, defining UX metrics, and investigating privacy-preserving telemetry.

Requirements

Knowledge in Computer Science, Software Engineering, Data Science, or a related field.
Experience with at least one programming language, preferably Python, JavaScript, TypeScript, or similar.
Interest in observability, analytics, distributed systems, developer tools, or artificial intelligence.
Ability to work independently, investigate open-ended problems, and communicate findings clearly.

Desired Qualifications

Familiarity with data collection, visualization, experimentation, or statistical analysis is beneficial.
Experience with command-line tools or developer productivity platforms is a bonus.
Experience with large language models, AI agents, or multi-agent systems is a bonus.
Knowledge of telemetry, event-driven systems, metrics, tracing, or dashboard development is a bonus.
Experience designing user studies or controlled experiments is a bonus.

Benefits

Outstanding opportunity to push the boundaries of what's possible.
Work on solutions to tough problems.
Be challenged within a team of diverse innovators.
Join a company that champions diversity and inclusion.

Skills

PythonJavaScriptTypeScript

#AI#observability#analytics#software development#developer tools#command-line#thesis

About Ericsson

Pioneering technology for connecting billions of people worldwide

Our purpose \nTo create connections that make the unimaginable possible.\n\nOur vision\nA world where limitless connectivity improves lives, redefines business and pioneers a sustainable future.\n\nOur values\nPerseverance, professionalism, respect and integrity.\n\nThe future is a place for purpose & vision – ours are clear, and we invite partners, customers and consumers to join us in our journey. \n\nFor a brighter future. For all. Let's #ImaginePossible

See all open jobs at Ericsson Read more about Ericsson Website