Flying and Ground Robot Collaboration for Camera-based Search and Rescue

Search and Rescue (SaR) missions present challenges due to the complexity of the disaster scenarios. Most life losses and injuries occur in developing countries. Robotics has become indispensable for rapidly locating disaster victims. Combining flying and ground robots more effectively serves this purpose due to their complementary features. To...

Design of a Spacecraft Pose Estimation System Using Convolutional Neural Networks

Performing crucial activities for space exploration, e.g., debris removal and on-orbit servicing, systems for Rendezvous and Proximity Operations (RPO) are required to be autonomous and scalable. Within this context, learning-based relative navigation has gained significant traction due to the latest advancements in AI and the cost-effectiveness...

3D Kinematics Estimation with Biomechanics Model

Human 3D kinematics estimation involves measuring joint angles and body segment scales to quantify and analyze the mechanics of human movements. It has applications in areas such as injury prevention, disease identification, and sports science. Conventional marker-based motion capture methods are expensive both in terms of financial investment...

VideoMuscle: Estimating human musculoskeletal model using neural networks from monocular video

We present the first deep learning approach to estimate the human skeletal system of the musculoskeletal model from monocular video. The current practice of musculoskeletal modeling relies on a motion capture system and OpenSim. The data is recorded in a restricted environment, and OpenSim workflow for musculoskeletal modeling is costly. Our...

Robust Navigation Framework for Proximity Operations around Uncooperative Spacecraft: A monocular vision-based navigation approach using deep learning

Autonomous vision-based navigation is a crucial element for space applications involving a potentially uncooperative target, such as proximity operations for on-orbit servicing or active debris removal. Due to low mass and power characteristics, monocular vision sensors are an attractive choice for onboard vision-based navigation systems. This...

Tilting at windmills: Data augmentation for deep pose estimation does not help with occlusions

Occlusion degrades the performance of human pose estimation. In this paper, we introduce targeted keypoint and body part occlusion attacks. The effects of the attacks are systematically analyzed on the best-performing methods. In addition, we propose occlusion specific data augmentation techniques against keypoint and part attacks. Our extensive...

3D Human Pose Estimation: Using a Top-View Depth Camera

The onset of delirium, a disturbance in the mental activities of a patient, can be potentially detected by understanding activities within an Intensive Care Unit (ICU) room. Such activities can be extracted by estimating human pose via a visual capture of the scene. This work uses a top-view depth camera in an ICU room to estimate pose of the...