Design of a Spacecraft Pose Estimation System Using Convolutional Neural Networks

Performing crucial activities for space exploration, e.g., debris removal and on-orbit servicing, systems for Rendezvous and Proximity Operations (RPO) are required to be autonomous and scalable. Within this context, learning-based relative navigation has gained significant traction due to the latest advancements in AI and the cost-effectiveness...

Efficient Temporal Action Localization via Vision-Language Modelling: An Empirical Study on the STALE Model's Efficiency and Generalizability in Resource-constrained Environments

Temporal Action Localization (TAL) aims to localize the start and end times of actions in untrimmed videos and classify the corresponding action types. TAL plays an important role in understanding video. Existing TAL approaches heavily rely on deep learning and require large-scale data and expensive training processes. Recent advances in...

Does text matter?: Extending CLIP with OCR and NLP for image classification and retrieval

Contrastive Language-Image Pretraining (CLIP) has gained vast interest due to its impressive performance on a variety of computer vision tasks: image classification, image retrieval, action recognition, feature extraction, and more. The model learns to associate images with their descriptions, a powerful method which allows it to perform well on...

Pedestrian Detection and Tracking for Mobile Robots in Human Environments

With the performance of current motion planning methods being highly dependent on the quality of the perception system, robust 3D multi-object detection and tracking are vital for autonomous driving applications. Despite all the advancements in 2D and 3D object detectors, robust tracking of pedestrians in dense scenarios is still a challenging...

Heart Rate Estimation in Intense Exercise Videos using Temporal Superpixels

Estimation of physiological signals like heart rate using remote photoplethysmography (rPPG) provides non-contact health monitoring with important applications in remote healthcare, patient interaction, and sport related activities. Existing rPPG approaches can robustly measure heart rate from facial videos under some degree of motion through...

Robust Navigation Framework for Proximity Operations around Uncooperative Spacecraft: A monocular vision-based navigation approach using deep learning

Autonomous vision-based navigation is a crucial element for space applications involving a potentially uncooperative target, such as proximity operations for on-orbit servicing or active debris removal. Due to low mass and power characteristics, monocular vision sensors are an attractive choice for onboard vision-based navigation systems. This...

Rotation invariant filters in CNNs: applied to segmentation of aerial images for land-use classification

Convolutional neural networks are showing incredible performance in image classification, segmentation, object detection and other computer vision applications in recent years. But they lack understanding of affine transformations to input data. In this work, we introduce rotational invariant<br/>convolutional neural networks that learn...

Audio-visual authentication for mobile devices

Authentication is becoming an increasingly important application in the connected world and is driven by the growing use of mobile and IoT devices that use an increasing number of applications that require transactions of sensitive data. Security usually relies on passwords and/or two-factor authentication which are too intrusive for daily use....

Ready for detection: Stair-detecting in depth images using spatial features and Adaboosting

Space exploration could be significantly aided by combining the disciplines of machine learning and computer vision, but these disciplines need to be developed further for specific space-related applications to have merit. One of the applications for space exploration is the detection of certain structures designating areas of interest. This...