Interactive Intelligence: Multimodal AI for Real-Time Interaction Loop towards Attentive E-Reading

E-learning has shifted the traditional learning paradigms in higher education, offering more flexible, ubiquitous, and personalized learning experiences. The previous years COVID-19 pandemic required a re-calibration of education to accommodate virtual learning environments from the traditional classroom-based education. Widespread learning...

An interactive assessment framework for residential space layouts using pix2pix predictive model at the early-stage building design

Purpose: In this study, a novel framework based on deep learning models is presented to assess energy and environmental performance of a given building space layout, facilitating the decision-making process at the early-stage design. Design/methodology/approach: A methodology using an image-based deep learning model called pix2pix is proposed...

Lookahead adversarial learning for near real-time semantic segmentation

Semantic segmentation is one of the most fundamental problems in computer vision with significant impact on a wide variety of applications. Adversarial learning is shown to be an effective approach for improving semantic segmentation quality by enforcing higher-level pixel correlations and structural information. However, state-of-the-art...

Efficient real-time camera based estimation of heart rate and its variability

Remote photo-plethysmography (rPPG) uses a remotely placed camera to estimating a person's heart rate (HR). Similar to how heart rate can provide useful information about a person's vital signs, insights about the underlying physio/psychological conditions can be obtained from heart rate variability (HRV). HRV is a measure of the fine...