Master Thesis, 30 hp: Valid and Reachable Counterfactual Explanations for Reinforcement-Learning Policies in Pursuit–Evasion
Technology, Data & Digital · Data, AI & Analytics · Machine Learning · Artificial Intelligence · Software Engineering
In short
Responsibilities
- Investigate to what extent do minimal counterfactual state changes provide faithful, feasible, and stable explanations of an RL agent’s decisions in a sequential pursuit-evasion environment.
- Implement a baseline method that identifies minimal state changes required to alter an agent’s action.
- Compare the baseline method with a dynamics-constrained method that generates only feasible and reachable counterfactuals.
- Quantitatively evaluate counterfactual explanations for action validity, reachability, stability, intervention faithfulness, and trajectory-level consequences.
- Develop a simple user interface to visualize the counterfactuals.
- Evaluate the user interface through user studies.
- Engage with the Planning, Optimization and Reinforcement Learning unit’s RL evaluation and debugging team.
- The resulting XRL tool will be added to the toolbox and made available to the unit’s evaluation and debugging capabilities of advanced AI techniques.
Requirements
- Student eager to apply theoretical knowledge and fresh perspectives to real-world challenges.
- Interest in reinforcement learning, eXplainable AI and interface design using visualization techniques.
- In the final stage of civilingenjör programmes – Computer Science and Engineering, Systems and Controls, Autonomous Systems, Robotics and AI and Machine Learning profile or equivalent.
- About to begin a 30 hp thesis project.
- Experience with PyTorch, TensorFlow or JAX.
- Good understanding of MDPs, policies, value functions and deep RL.
- Ability to work with an existing research codebase using Git.
- Basic knowledge in statistics, e.g., confidence intervals, multiple random seeds, hypothesis testing and interpreting variance.
- Interested in analysing why an agent behaves as it does.
- Must pass a security vetting.
Desired Qualifications
- Academic rigor and enthusiasm for cutting-edge technology.
- Unique and insightful lens to approach problems.
Benefits
- Opportunity to collaborate with experienced engineers and specialists.
- Gain invaluable practical experience.
- Make a tangible contribution to our growth and development.
- Support and guidance needed to translate theoretical knowledge into practical solutions.
- Work with cutting edge technology, creativity and an innovative environment.
- Contribution to keeping people and society safe.
- Opportunities to explore a wealth of possibilities, take on challenges, create smart inventions, and grow beyond.
Skills
As a leading defence and security company, we offer solutions that range from the depths of the oceans to high in the sky, on land and in cyberspace, to keep people and society safe. Empowered by our 22,000 talented people, we constantly push the boundaries of technology to create a safer, more sustainable and more equitable world. We design, manufacture and maintain advanced systems in aeronautics, weapons, command and control, sensors and underwater systems. We are headquartered in Sweden and have major operations all over the world and are part of the domestic defence capability of several…
Company
SaabJob Posted
2 days ago
Expires
in 1 week
Employment Type
Internship
Work mode
On Site
Experience Level
Entry
Locations
Linköping, Sweden
Qualification
Applicants
Be an early applicant
