Interactive Intelligence: Multimodal AI for Real-Time Interaction Loop towards Attentive E-Reading

E-learning has shifted the traditional learning paradigms in higher education, offering more flexible, ubiquitous, and personalized learning experiences. The previous years COVID-19 pandemic required a re-calibration of education to accommodate virtual learning environments from the traditional classroom-based education. Widespread learning...

End-to-End Chess Recognition

Chess recognition refers to the task of identifying the chess pieces configuration from a chessboard image. Contrary to the predominant approach that aims to solve this task through the pipeline of chessboard detection, square localization, and piece classification, we rely on the power of deep learning models and introduce two novel...

An interactive assessment framework for residential space layouts using pix2pix predictive model at the early-stage building design

Purpose: In this study, a novel framework based on deep learning models is presented to assess energy and environmental performance of a given building space layout, facilitating the decision-making process at the early-stage design. Design/methodology/approach: A methodology using an image-based deep learning model called pix2pix is proposed...

Data efficient pick location learning from images for sequential tasks

Learning from demonstration is a technique where the robot learns directly from humans. It can be beneficial to learn from humans directly because humans can easily demonstrate complex behaviors without being experts in demonstrating required tasks. However, it can be challenging to gather large amounts of data from humans because humans often...

Lane Detection using Spatio-Temporal Attention

Lane detection represents a fundamental task for automated/autonomous vehicles. Current lane detection methods do not provide the versatility of real-time performance, robustness,and accuracy required for real-world scenarios. The reasons include lack of computing power while being portable and inability to observe the continuity and structure...

Lookahead adversarial learning for near real-time semantic segmentation

Semantic segmentation is one of the most fundamental problems in computer vision with significant impact on a wide variety of applications. Adversarial learning is shown to be an effective approach for improving semantic segmentation quality by enforcing higher-level pixel correlations and structural information. However, state-of-the-art...

Contrastive Learning of Visual Representations from Unlabeled Videos

This thesis presents a novel self-supervised approach of learning visual representations from videos containing human actions. Our approach tackles the complex problem of learning without the need of labeled data by exploring to what extent the ideas successfully used for images can be transferred, adapted and extended to videos for action...

A data-driven approach for pavement surface distress classification

Pavement undergoes a fast deterioration process either due to the damages induced by weather conditions, an increase in traffic flow and load, or passive factors like aging of infrastructure. Thus requiring periodic rehabilitation measures to maintain the condition of the underlying asset. Since damages on the asphalt road, impose economic...

Face recognition using traditional machine learning algorithms and deep neural networks with application to face verification

Biometrics authentication has been very useful and necessary nowadays due to the great developments in technology and the transaction of huge amounts of sensitive data on a daily basis. Traditionally, access to some data or service is achieved by means of some documents or a password. However, these methods are not very convenient. Alternatively...

Automated land use classification: Supervised segmentation of road structures on aerial images using shape regression

Recent advances in Artificial Intelligence and Computer Vision have been showed to be promising for automated land use classification of remotely sensed data. However, current state-of-the-art per-pixel segmentation networks fail to accurately capture geometrical and topological properties on land use segmentation, as these methods have...

Efficient real-time camera based estimation of heart rate and its variability

Remote photo-plethysmography (rPPG) uses a remotely placed camera to estimating a person's heart rate (HR). Similar to how heart rate can provide useful information about a person's vital signs, insights about the underlying physio/psychological conditions can be obtained from heart rate variability (HRV). HRV is a measure of the fine...