The First Multimodal Information Based Speech Processing (Misp) Challenge: Data, Tasks, Baselines And Results

In this paper we discuss the rational of the Multi-model Information based Speech Processing (MISP) Challenge, and provide a detailed description of the data recorded, the two evaluation tasks and the corresponding baselines, followed by a summary of submitted systems and evaluation results. The MISP Challenge aims at tack-ling speech processing...

Audio-Visual Wake Word Spotting in MISP2021 Challenge: Dataset Release and Deep Analysis

In this paper, we describe and release publicly the audio-visual wake word spotting (WWS) database in the MISP2021 Challenge, which covers a range of scenarios of audio and video data collected by near-, mid-, and far-field microphone arrays, and cameras, to create a shared and publicly available database for WWS. The database and the code ...

Metaverse for Connected and Automated Vehicles and Intelligent Transportation Systems [From the Guest Editors]

The metaverse aims to blur the boundary between the physical world and digital content. To achieve this goal, the metaverse relies heavily on extended reality (XR), the Internet of Things, and communication technologies. Concurrently, connected vehicles and intelligent transportation systems (ITSs) are envisioned as the future paradigm of...

A bio-inspired and switchable H⁺/OH⁻ ion-channel for room temperature exhaled CO₂ chemiresistive sensing

Inspired by the CO₂-induced reversible activation mechanism of the slow anion channel 1 (SLAC1) in plant stomatal guard cells during plant photosynthesis, we designed and prepared a CO₂- switchable H⁺/OH⁻ ion channel (CSPH ion channel). A high-performance chemiresistive room temperature CO<sub>2<...

A Plant-inspired Light Transducer for High-performance Near-infrared Light Mediated Gas Sensing

Constructing near-infrared light (NIR) light-enhanced room temperature gas sensors is becoming more promising for practical application. In this study, learning from the structure and photosynthetic process of chlorophyll thylakoid membranes in plants, the first “Thylakoid membrane” structural formaldehyde (HCHO) sensor is constructed by...