Natural User Interface in Augmented Reality to Control Spot: A Large Scale User Study on Speech and Gesture Control of Robots With The Microsoft HoloLens

The increasing presence of robots calls for a more seamless and information-rich communication method between humans and robots. This paper explores how natural user interface (NUI) modalities, particularly speech and gesture controls, can be used through augmented reality (AR) to operate robots. The increasing presence of robots calls for...

Uncertainty Estimation in Vision-Aided Robot Teleoperation System

Teleoperation allows the use of human intelligence and decision making in remote tasks which are too dangerous for humans to perform. Technologies such as force feedback and haptic guidance have shown to increase task efficiency during teleoperation. In an unmodeled environment, sensors provide input for haptic guidance or present extra...