Thesis Work -Active Vision for AI-based Robot Manipulation with a 2-DOF Movable Camera Head

Technology, Data & Digital · Software & Web Development · Software Engineering · Machine Learning

In short

This thesis focuses on active vision for AI-based robot manipulation using a 2-DOF movable camera head. The intern will work on data collection, training Vision-Language-Action (VLA) models, and deploying them on a real robot, comparing performance with and without the movable head. This opportunity is for a Master's student interested in robot learning and AI, with programming experience in Python and deep learning frameworks.

Responsibilities

Extend data collection software for a movable head setup.
Upgrade teleoperation system with neck control using an AR headset.
Collect robot manipulation demonstration data with the movable head.
Train and evaluate VLA or other suitable models incorporating neck/head motion.
Investigate the benefits of a movable head versus fixed cameras.
Deploy the model on a real robot, handling synchronization and control delays.
Compare results with and without a movable camera.

Requirements

Master's student in Computer Science, Electrical Engineering, Robotics, Mechatronics, or related fields.
Strong interest in robot learning, machine learning, computer vision, or physical AI.
Programming experience in Python.
Familiarity with deep learning frameworks (e.g., PyTorch, huggingface, LeRobot platform).

Desired Qualifications

Experience with git, docker, Unity, AR is a plus.
Experience with or interest in 3D data (depth images, point clouds) is a plus.
Hands-on experience with real robot systems is a plus but not required.

Benefits

30 ECTS credits
Work with world-class experts in a fast-moving, innovation-driven environment.
Opportunity to shape the future of robotics.

Skills

PythonPyTorchhuggingfaceLeRobot platformgitdockerUnityAR3D datadepth imagespoint clouds

#robotics#AI#computer vision#machine learning#manipulation#thesis

About ABB

We are a technology leader in electrification and automation, enabling a more sustainable and resource-efficient future.

ABB is a technology leader in electrification and automation, enabling a more sustainable and resource-efficient future. The company’s solutions connect engineering know-how and software to optimize how things are manufactured, moved, powered and operated. Building on more than 130 years of excellence, ABB’s ~105,000 employees are committed to driving innovations that accelerate industrial transformation. www.abb.com\nPrivacy notice & house rules: https://social.abb/social-media-information\n\nBefore applying for a job at ABB , please read our Fraud Warning:…

See all open jobs at ABB Read more about ABB Website