OPAL: A Stereo Vision Obstacle Processing ALgorithm for a Walking Lunar Rover

OPAL: A Stereo Vision Obstacle Processing ALgorithm for a Walking Lunar Rover

Rovers, Stijn (TU Delft Aerospace Engineering)

Speretta, S. (mentor)

Delft University of Technology

Aerospace Engineering

2021-06-30

The Lunar Zebro is a small six-legged robot. It has the potential to be used in a swarm carrying out objectives like exploring planetary surfaces. A new step towards autonomous navigation is made with the newly developed Obstacle Processing ALgorithm (OPAL) using primarily open-source libraries. This study showed that the initial iteration of OPAL could detect rocks and determine their absolute position to the rover’s low-positioned cameras using a stereo vision system. Obstacles and their relative distances are detected using the disparity map—the amount of shift of pixels in the stereo image pair. When translating the disparity to V-disparity, a histogram of the disparity per row, the ground and the obstacle could be isolated. It took six steps to realise this thesis goal. After setting the requirements, a test model, called Bars, was developed and tested at a location containing a Mars-like environment (Decos). This test model uses, along with Lunar Zebro’s hardware, mostly Commercial Off-The-Shelf products. With the footage, all the different components of OPAL were integrated into one algorithm. Hereafter, a pipeline on a server was created, and multiple test cases were run to establish results. The predetermined requirements of the algorithm were validated using measuring tape measurements and ground-truth bounding boxes tracked by a CSRT-algorithm. Together, Bars and the initial iteration of OPAL prove feasibility and expose opportunities and challenges, which could be a starting point for optimisations or other approaches.

OPAL
Bars
Lunar Zebro
Stereo vision
Obstacle detection

http://resolver.tudelft.nl/uuid:151fbef7-28a4-445b-bad1-924f1eea4b20

Student theses

master thesis

© 2021 Stijn Rovers