Grasp recognition with spatiotemporal deep learning and proximity sensors in transradial prostheses

The traumatic loss of a hand is a horrific experience usually followed by significant psychological, functional and rehabilitation challenges. Even though much progress has been made in the past decades, the prosthetic challenge of restoring the human hand functionality is still far from being achieved. Autonomous prosthetic hands showed...

RN-XCM: A Neural Network for Classifying Skill Level in Multi-Axis Tracking Tasks

The aviation industry's reliance on automation raises concerns about pilot complacency, necessitating continuous pilot proficiency measures. To that end, real-time pilot skill feedback is vital—through alerts on declining skill levels or scalable levels of autonomy. Current cybernetic methods are limited as they assume linearity and time...

Multi Agent Deep Deterministic Policy Gradient for Active Wake Control

In wind farms wind turbines are often placed close to each other. Each turbine generates a turbulent wake field, this field negatively affects subsequent turbines. This can cost more than 12% efficiency. To decrease this loss we can steer the turbines away from the wind direction, this will decrease the individual turbine power output, but can...

Sampling-Based MPC with Learning-Based Trajectory Predictions for Interaction-Aware Motion Planning: Autonomous navigation in urban canals

With the world’s population recently surpassing the 8 billion mark, population growth poses significant challenges on the planet. This growth is particularly evident in urban areas, and as a consequence, cities must find innovative ways to accommodate the increasing pressure on the current road infrastructure. In Amsterdam, a city with an...

Explainable Artificial Intelligence Techniques for the Analysis of Reinforcement Learning in Non-Linear Flight Regimes

Reinforcement Learning is being increasingly applied to flight control tasks, with the objective of developing truly autonomous flying vehicles able to traverse highly variable environments and adapt to unknown situations or possible failures. However, the development of these increasingly complex models and algorithms further reduces our...

Autonomous Lunar Orbit Navigation With Ellipse R-CNN

The resurgence of interest in landing on the Moon has sparked the creation of a number of novel technologies concerning Terrain-Relative Navigation (TRN) algorithms. They aid in the need for increasingly precise landing, as well as ensuring fully autonomous operations. To achieve this, most technologies use a ubiquitous feature present on the...

Safe and natural navigation in dynamic environments, learned from human behavior

Social Navigation is the task of robot motion planning in an environment shared with humans.This is an especially hard sub-problem of motion planning because the planner has to dealwith a dynamic, continuous and unpredictable environment. We present a local motionplanner, namely Neural Network Model Predictive Control, for autonomous ground...

The Landing of a Quadcopter on Inclined Surfaces using Reinforcement Learning

Deep Reinforcement Learning (DRL) enables us to design controllers for complex tasks with a deep learning approach. It allows us to design controllers that are otherwise cumbersome to design with conventional control methodologies. Often, an objective for RL is binary in nature. However, exploring in environments with sparse rewards is a problem...

Sample effficient deep reinforcement learning for control

The arrival of intelligent, general-purpose robots that can learn to perform new tasks autonomously has been promised for a long time now. Deep reinforcement learning, which combines reinforcement learning with deep neural network function approximation, has the potential to enable robots to learn to perform a wide range of new tasks while...

Constrained Concealment Attacks against Reconstruction-based Anomaly Detectors in Industrial Control Systems

Recently, reconstruction-based anomaly detection was proposed as an effective technique to detect attacks in dynamic industrial control networks. Unlike classical network anomaly detectors that observe the network traffic, reconstruction-based detectors operate on the measured sensor data, leveraging physical process models learned a priori....

Deep vs Shallow Reinforcement Learning for low dimensional continuous control tasks

Deep Learning performance dependents on the application and methodology. Neural Networks with convolutional layers have been a great success in multiple tasks trained under Supervised Learning algorithms. For higher dimensional problems, the selection of a deep network architecture can significantly improve the accuracy of the network, however...

Generative CoLearn: steering and cost prediction with generative adversarial nets in kinodynamic RRT

Kinodynamic planning is motion planning in state space and aims to satisfy kinematic and dynamic constraints. To reduce its computational cost, a popular approach is to use sampling based methods such as RRT with off-line machine learning for estimating the steering cost and inputs. However, scalability and robustness are still open challenges...

Deep Reinforcement Learning - Pretraining actor-critic networks using state representation learning

In control, the objective is to find a mapping from states to actions that steer a system to a desired reference. A controller can be designed by an engineer, typically using some model of the system or it can be learned by an algorithm. Reinforcement Learning (RL) is one such algorithm. In RL, the controller is an agent that interacts with the...