Hybrid Semantic Mapping for Autonomous Off-Road Driving

Unmanned Ground Vehicle (UGV) navigation in unstructured off-road environments can benefit from accurate traversability estimation. Often, experiments with UGVs use semantic segmentation networks for visual scene understanding. Based on the pixel-wise classification of a semantic segmentation network, the UGV can distinguish traversable from non...

Including traffic light recognition in general object detection with YOLOv2

With an in vehicle camera many different things can be done that are essential for ADAS or autonomous driving mode in a vehicle. First, it can be used for detection of general objects, for example cars, cyclists or pedestrians. Secondly, the camera can be used for traffic light recognition, which is localization of traffic light position and...

Towards Natural Language Understanding using Multimodal Deep Learning

This thesis describes how multimodal sensor data from a 3D sensor and microphone array can be processed with deep neural networks such that its fusion, the trained neural network, is a) more robust to noise, b) outperforms unimodal recognition and c) enhances unimodal recognition in absence of multimodal data. We built a framework for a complete...

Walking and Talking: Using persuasive game elements to increase physical activity

Physical activity (PA) benefits a healthy condition. On the broader canvas public health benefits from promoting a healthy lifestyle, which includes sufficient PA. Apart from the lives that are improved, The financial merit of improved public health is substantial. Walking is deemed one of the most effective forms of PA. It is for this reason...