The abundant bandwidth in the mmWave band supports high data rates and low latency communication, making it ideal for delivering realistic and seamless virtual reality experiences. However, a key challenge lies in adapting the mmWave beams to the highly dynamic user movements, which often cause beam misalignment, resulting in signal degradation and potential outages. Additionally, maintaining uninterrupted signal reception during beam re-alignment due to head rotation requires low-overhead and timely beam transitions to prevent signal drops caused by delayed switching. This paper addresses these challenges with a joint solution at both the access point (AP) and head-mounted display (HMD) ends. Specifically, the proposed solution integrates coordinated multi-point networks with dual-beam reception at the HMD to enhance diversity, improve channel gain, and mitigate outages caused by user movement. Evaluation using real HMD movement datasets demonstrates that dual-beam reception within a coordinated multi-AP setup achieves up to a 22.8% improvement in reliability by reducing outage rates compared to single-beam reception. Experimental validation further highlights the effectiveness of combining widely distributed APs with a locally distributed subarray configuration on the HMD, improving angular coverage during head rotations. Furthermore, our predictive beam transition approach anticipates the future beam during user movements, preventing received signal degradation from delayed transitions while reducing overhead by 43.8% compared to exhaustive periodic beam searches.

Hidden spy cameras are a growing global threat to personal privacy. With the emergence of translucent screen technology, a new security risk has arisen: cameras can now hide behind devices’ screens like TVs and monitors that are common in private places, e.g., hotel rooms. The screen’s covering over the hidden camera not only makes the cameras behind it unnoticeable to human eyes but also makes existing camera detection methods less effective. Inspired by recent advances in representing real-world scenes accurately using neural networks, we propose Neural Infrared Reflectance Field (NIRF) to learn the intricate optical properties of the screen and the cameras hidden behind it. Through NIRF, we design a new camera detection system by leveraging the unique reflective properties of behind-screen cameras and screens. We evaluate NIRF with thorough experiments on five smartphones. Our NIRF archives over 90% detection rate and is robust to different conditions, including varied backgrounds, ambient light levels, screen protectors, and screen contents. Besides, we conduct a field study by deploying 18 common spy cameras behind a 65-inch translucent TV and recruiting 27 people to compare NIRF with commercial hidden camera detectors. NIRF achieves an 89.5% detection rate, significantly outperforming the best commercial hidden camera detector that only has a 14.4% detection rate of behind-screen cameras.

Over the past decade, visible light positioning has become increasingly important for precise localization systems, yet its widespread adoption is limited due to the necessity of modifying existing lighting systems. This paper presents HueLoc, a novel method that bypasses this issue by using inherent features of light, such as the dominant colours in white LED lights, and employs affordable, energy-efficient hue sensors for location services. We propose that by extracting the power at dominant wavelengths of LEDs, these can be uniquely identified using a specifically designed signature. The unique signatures can be used by mobile objects for spatial awareness and further localization using the proposed regression-based learning approach. Our experiments demonstrate that HueLoc attains a location-mapping accuracy of 100% and achieves decimeter-level localization precision with a moving object in uncontrolled lighting conditions. Moreover, these unique signatures can be combined with other RF-based technologies to enhance their localization accuracy. As an example, this paper details the integration of Bluetooth features with light signatures using a three-stage incremental learning approach.

This paper introduces an Integrated Sensing and Communication (ISAC) approach to safeguard communication User Equipment (UE) from approaching objects or people, such as potential blockers, without the need to scan the entire environment, while providing continuous communication services. The proposed UE-centered ISAC system utilizes a communication-centric waveform, transmitted through guard beams to monitor the area within the UE proximity. These guard beams are generated through a multi-beamforming technique employing a shared analog array that also generates the communication beam. The parameters for generating the guard beams are optimized to maximize sensing coverage while adhering to the communication Signal-to-Noise Ratio (SNR) constraints. In comparison to the detection using the communication-beam-only system, our optimized guard beams enhance the detection range and coverage area by over 1.5 times while maintaining the required communication SNR. Our multi-stage sensing pipeline applied to the guard beams significantly reduces the complexity of sensing signal processing required to detect approaching blockers while maintaining accuracy comparable to that of exhaustive scanning based on the grid-searching method. Furthermore, the guard beams approach reduces the impact on communication SNR by 0.7 dB factor compared to exhaustive scanning with a balanced communication-sensing power allocation, offering a less pronounced impact on the communication performance in an ISAC system.

Achieving accurate and low-latency spectrum sensing on resource-constrained devices is essential but very difficult. Traditional In-phase and Quadrature (I/Q)-based and the ShortTime Fourier Transform (STFT)-based methods fail to balance the computational overhead and classification accuracy. In this paper, we propose a novel framework -Spectrum Painting (SP)- which enables on-device signal classification with low latency and high accuracy. We design new signal processing methods to compress spectrograms while keeping global signal features and augmenting the salient features of small objects. SP achieves high-accuracy signal classification, assisted further by our proposed Dual-channel Convolutional Neural Network (DualCNN). We collect diverse datasets to evaluate the proposed SP, including synthesized data, and testbed data (from up to 18 commodity devices) obtained from real-world environments in the wild and office settings. Experimental results of SP running on Raspberry Pi 4B show a great reduction in latency up to 20 × while maintaining a 95% accuracy. Furthermore, SP demonstrates superior performance within both the centralized learning architecture and the Federated Learning (FL) architecture. For example, the challenging cross-environment evaluation of the SP in the iid-FL scenario yields a substantial accuracy improvement, on average from 24.6% to 83.8%.

Federated Learning (FL) is an important privacy-preserving learning paradigm that plays an important role in the Intelligent Internet of Things. Training a global model in FL, however, is vulnerable to the data noise across the clients. In this paper, we introduce FedTrans, a novel client-transparent client utility estimation method designed to guide client selection for noisy scenarios, mitigating performance degradation problems. To estimate the client utility, we propose a Bayesian framework that models client utility and its relationships with the weight parameters and the performance of local models. We then introduce a variational inference algorithm to effectively infer client utility at the FL server, given only a small amount of auxiliary data. Our evaluation results demonstrate that leveraging FedTrans to select the clients can improve the accuracy performance (up to 7.8%), ensuring the robustness of FL in noisy scenarios.

Visible light positioning (VLP) based on the received signal strength (RSS) can leverage a dense deployment of LEDs in future lighting infrastructure to provide accurate and energy-efficient indoor positioning. However, its positioning accuracy heavily depends on the density of collected fingerprints, which is labor-intensive. In this work, we propose a data pre-processing method, including data cleaning and data augmentation, to construct reliable and dense fingerprint samples, thereby alleviating the impact of noisy samples as well as reducing labor intensity. Extensive experiments demonstrate that our proposed method achieves an average positioning error of 1.7 cm, utilizing a sparse dataset that reduces the fingerprint collection effort by 98 percent. Running a tinyML-based model for VLP on the Arduino Nano microcontroller, we also show the possibilities for deploying RSS fingerprint-based VLP systems on resource-constrained embedded devices for real-world applications.

With the development of communication networks and Artificial Intelligence (AI) technologies, Digital Twin (DT) now emerges to support various applications such as engineering, monitoring, controlling, healthcare and the optimization of cyber-physical systems. There is an increasing demand to create DTs that can represent physical entities for improving operational efficiency. A conventional DT consists of monitoring, imitation, and feedback control. However, conventional DTs cannot ensure efficient real-time imitation due to the high dynamics of physical systems such as UAV-based target tracking scenario. To address this issue, we propose a federated DT framework to support the imitation of mobile systems. It can guarantee real-time and accurate imitations under the prerequisite of comprehensive information acquired by a cooperative collection algorithm with the aid of UAVs. The framework can rapidly aggregate local DT models using an attention-based mechanism to improve mobile imitation accuracy. Additionally, we propose a multimodal-based DT inspection algorithm that can correct the postures of UAVs affected by winds for reliable imitations. We implement the framework in Gazebo. Our system simulations demonstrate the efficiency of the proposed federated DT framework. Our solution can reduce the imitation latency by an average of 68.4%, meanwhile, can improve the imitation accuracy by 16.4% on average when compared to traditional centralized and distributed imitation schemes.

Federated Learning (FL) has emerged as a privacy-preserving paradigm for collaborative deep learning model training across distributed data silos. Despite its importance, FL faces challenges such as high latency and less effective global models. In this paper, we propose ShuffleFL, an innovative framework stemming from the hierarchical FL, which introduces a user layer between the FL devices and the FL server. ShuffleFL naturally groups devices based on their affiliations, e.g., belonging to the same user, to ease the strict privacy restriction-"data at the FL devices cannot be shared with others", thereby enabling the exchange of local samples among them. The user layer assumes a multi-faceted role, not just aggregating local updates but also coordinating data shuffling within affiliated devices. We formulate this data shuffling as an optimization problem, detailing our objectives to align local data closely with device computing capabilities and to ensure a more balanced data distribution at the intra-user devices. Through extensive experiments using realistic device profiles and five non-IID datasets, we demonstrate that ShuffleFL can improve inference accuracy by 2.81% to 7.85% and speed up the convergence by 4.11x to 36.56x when reaching the target accuracy.

This paper presents a novel transparent amplifying intelligent surface (TAIS) architecture for uplink enhancement in indoor-To-outdoor mmWave communications. The TAIS is an amplifier-based transmissive intelligent surface that can refract and amplify the incident signal, instead of only refracting it with adjustable phase shift by most passive reconfigurable intelligent surfaces (RIS). With advanced indium tin oxide film and printing technology, TAIS can be fabricated on the windows without any visual effects. This paper primarily focuses on exploiting the TAIS-based architecture to boost the uplink spectral efficiency (SE) in indoor-To-outdoor mmWave communications. By jointly optimizing the TAIS's phase shift matrix and transmit power of the user equipment, the uplink SE can be maximized by exploiting the nonlinearity in the TAIS's amplification process. The key enabler is that we drive the optimal phase shift matrix that maximizes the SE and deduces its closed-form representation. The SE maximization is then proved to be transferred to the transmit power optimization problem. Another important enabler is that we design a low-complexity algorithm to solve the optimization problem using the difference of convex programming. Moreover, the asymptotic spectral efficiency under nonlinear amplification and power scaling law with infinitely large elements under both the sparse and rich scattering channel models are analyzed. Simulation results show that our proposed TAIS can increase the SE by up to 24.7% as compared to its alternative methods.

This paper presents a novel transparent amplifying intelligent surface (TAIS) architecture for uplink enhancement in indoor-to-outdoor mmWave communications. The TAIS is an amplifier-based transmissive intelligent surface that can refract and amplify the incident signal, instead of only refracting it with adjustable phase shift by most passive reconfigurable intelligent surfaces (RIS). With advanced indium tin oxide film and printing technology, TAIS can be fabricated on the windows without any visual effects. This paper primarily focuses on exploiting the TAIS-based architecture to boost the uplink spectral efficiency (SE) in indoor-to-outdoor mmWave communications. By jointly optimizing the TAIS's phase shift matrix and transmit power of the user equipment, the uplink SE can be maximized by exploiting the nonlinearity in the TAIS's amplification process. The key point is that we drive the optimal phase shift matrix that maximizes the SE and deduces its closed-form representation. The SE maximization is then proved to be transferred to the transmit power optimization problem. Another important aspect is that we design a low-complexity algorithm to solve the problem using the difference of convex programming. Simulations show that our proposed TAIS can increase the SE by up to 32.6% as compared to its alternative methods.

The development of the intelligent Internet of Things has facilitated the adoption of high-efficiency Multiple Targets Tracking (MTT) in many civil security applications. However, existing MTT technologies cannot offer full capability in accurate and real-time MTT for civil security. Many attractive applications in the next-generation wireless network, like Unmanned Aerial Vehicle (UAV) swarm, are envisioned to be exploited for enhanced MTT with the advantage of flexibility. Nonetheless, highly dynamic moving targets impose some new challenges. UAVs cannot always perform expected cooperative tracking in conventional architectures as well. To address these problems, we design a tiered Digital Twin-assisted tracking framework in this paper, which leverages multi-grained imitation for real-time and accurate MTT. We imitate a coarse-grained MTT to ensure a high successful tracking ratio. We then design a fine-grained imitation with a reaction-diffusion mechanism to explore the feasible cooperators based on trajectory prediction. Hardware-in-the-loop simulations demonstrate that our tiered framework can reduce 66.7% of the system latency overhead compared to the conventional DDPG benchmark while improving the successful tracking ratio by 30.6%.

Various interconnected Internet of Things (IoT) devices have emerged, led by the intelligence of the IoT, to realize exceptional interaction with the physical world. In this context, UAV swarm-enabled Multiple Targets Tracking (UAV-MTT), which can sense and track mobile targets for many applications such as hit-and-run, is an appealing topic. Unfortunately, UAVs cannot implement real-time MTT based on the traditional centralized pattern due to the complicated road network environment. It is also challenging to realize low-overhead UAV swarm cooperation in a distributed architecture for the real-time MTT. To address the problem, we propose a cyber-twin-based distributed tracking algorithm to update and optimize a trained digital model for real-time MTT. We then design a distributed cooperative tracking framework to promote MTT performance. In the design, both short-distance and long-distance distributed tracking cooperation manners are first realized with low energy consumption in communication by integrating resources of sensing and communication. Resource integration promotes target sensing efficiency with a highly successful tracking ratio as well. Theoretical derivation proves our algorithmic convergence. Hardware-in-the-loop simulation results demonstrate that our proposed algorithm can remarkably save 65.7% energy consumption in communication compared to other benchmarks while efficiently promoting 20.0% sensing performance.

While radio communication still dominates in 5G, light and radios are expected to complement each other in the coming 6G networks. Visible Light Communication (VLC) is therefore attracting a tremendous amount of attention from both academia and industry. Recent studies showed that the front camera of pervasive smartphones is an ideal candidate to serve as the VLC receiver. While promising, we observe a recent trend with smartphones that can greatly hinder the adoption of smartphones for VLC, i.e., smartphones are moving towards full-screen for the best user experience. This trend forces front cameras to be placed under the devices' screen - -leading to the so-called Under-Screen Camera (USC) - -but we observe a severe performance degradation in VLC with USC: the transmission range is reduced from a few meters to merely 0.04 m, and the throughput is decreased by more than 90%. To address this issue, we leverage the unique spatiotemporal characteristics of the rolling shutter effect on USC to design a pixel-sweeping algorithm to identify the sampling points with minimal interference from the translucent screen. We further propose a novel slope-boosting demodulation method to deal with color shift brought by the leakage interference. We build a proof-of-concept prototype using two commercial smart-phones. Experiment results show that our proposed design reduces the BER by two orders of magnitude on average and improves the data rate by 59×: from 914 b/s to 54.43 kb/s. The transmission range is extended by roughly 100×: from 0.04 m to 4.2 m.

Radio-Frequency (RF) backscatter has emerged as a low-power communication technique. Backscatter systems either rely on active signal generators (spectrum efficient, but dedicated infrastructure) or existing ambient wireless transmissions (existing infrastructure, but spectrum inefficient). In this paper, we aim to make RF backscatter spectrum efficient and at the same time work with existing infrastructure. We propose to leverage the deployment of LiFi networks built upon LED bulbs for pervasive RF backscatter. We experimentally demonstrate that LiFi, which passively leaks RF signals, can be exploited as a radio carrier generator for low-power RF backscatter. We further design LeakageScatter, the first backscatter system operating in the ISM band and exploiting LiFi-leaked RF signals, without the need to actively generate the carrier wave. We customize the design of the loop at the LiFi transmitter, as well as the coil antennas at the tag and RF backscatter receiver, to optimize the system performance. We propose to opportunistically enable the oscillator of the backscatter tag in the software that could reduce the energy consumption on backscattering by up to 75%. Experimental results show that LeakageScatter achieves a backscattering distance up to 10 m and 18 m in indoor and outdoor scenarios, respectively, without using a dedicated RF carrier generator.

Cardiac patterns are being used to provide hard-to-forge biometric signatures in identification applications. However, this performance is obtained under controlled scenarios where cardiac signals maintain a relatively uniform pattern, facilitating the identification process. In this work, we analyze cardiac signals collected in more realistic (uncontrolled) scenarios and show that their high signal variability makes them harder to obtain stable and distinct features. When faced with these irregular signals, the state-of-the-art (SOTA) reduces its performance significantly. To solve these problems, we propose the CardioID framework¹ with two novel properties. First, we design an adaptive method that achieves stable and distinct features by tailoring the filtering process according to each user’s heart rate. Second, we show that users can have multiple cardiac morphologies, offering us a bigger pool of cardiac signals compared to the SOTA. Considering three uncontrolled datasets, our evaluation shows two main insights. First, while using a PPG sensor with healthy individuals, the SOTA’s balanced accuracy (BAC) reduces from 90–95% to 75–80%, while our method maintains a BAC above 90%. Second, under more challenging conditions (using smartphone cameras or monitoring unhealthy individuals), the SOTA’s BAC reduces to values between 65–75%, and our method increases the BAC to values between 75–85%.

Smartphones are moving towards the fullscreen design for better user experience. This trend forces front cameras to be placed under screen, leading to Under-Screen Cameras (USC). Accordingly, a small area of the screen is made translucent to allow light to reach the USC. In this paper, we utilize the translucent screen's features to inconspicuously modify its pixels, imperceptible to human eyes but inducing perturbations on USC images. These screen perturbations affect deep learning models in image classification and face recognition. They can be employed to protect user privacy, or disrupt the front camera's functionality in the malicious case. We design two methods, one-pixel perturbation and multiple-pixel perturbation, that can add screen perturbations to images captured by USC and successfully fool various deep learning models. Our evaluations, with three commercial full-screen smartphones on testbed datasets and synthesized datasets, show that screen perturbations significantly decrease the average image classification accuracy, dropping from 85% to only 14% for one-pixel perturbation and 5.5% for multiple-pixel perturbation. For face recognition, the average accuracy drops from 91% to merely 1.8% and 0.25%, respectively.

Visible Light Communication (VLC) has emerged in the last few years as a promising technology not only for high-speed communication but also for serving a new generation of Internet of Things (IoT) devices that may leverage the pervasive lighting infrastructures. Integrating VLC in lighting environments for IoT requires the design of networked and intelligent luminaries and new IoT devices, encompassing the development of innovative technologies and new algorithms. A common experimental platform is necessary to lower the entrance barriers of VLC and speed up the research development. In this article, we provide guidelines for prototyping VLC for IoT applications, assisted by the open-source platform OpenVLC. We also introduce the new development on OpenVLC, which guarantees support for more powerful LEDs and much longer distance (extending the communication distance from 6 m to 19 m), dimming adaption, among other features. Its low-cost, open-source, and open-hardware designs allow researchers in the community to swiftly adapt it to suit their research purposes.

Federated Learning (FL) is an important privacy-preserving learning paradigm that is expected to play an essential role in the future Intelligent Internet of Things (IoT). However, model training in FL is vulnerable to noise and the statistical heterogeneity of local data across IoT clients. In this paper, we propose FedNaWi, a “Go Narrow, Then Wide” client selection method that speeds up the FL training, achieves higher model performance, while requiring no additional data or sensitive information transfer from clients. Our method first selects reliable clients (i.e., going narrow) which allows the global model to quickly improve its performance and then includes less reliable clients (i.e., going wide) to exploit more IoT data of clients to further improve the global model. To profile client utility, we introduce a unified Bayesian framework to model the client utility at the FL server, assisted by a small amount of auxiliary data. We conduct extensive evaluations with 5 state-of-the-art FL methods, on 3 IoT tasks and under 7 different types of label and feature noise. We build an FL testbed with 38 IoT nodes (20 nodes run on Raspberry Pi 4B and 18 nodes run on Jetson Nano) for the evaluation. Our results show that FedNaWi improves the FL accuracy substantially and significantly reduces energy consumption. In particular, FedNaWi improves the accuracy from 35% to 75% in the non-IID Dirichlet setting, and reduces the average energy consumption by 55%.

This paper studies a promising use case of a private 5G network for the sports industry: wearable bodycams and sensors in a football match. This use case requires a reliable and dedicated massive MIMO network to provide uniform coverage with a high capacity in the whole pitch area. The coverage of co-located and distributed (cell-free) massive MIMO, differing in the configuration of base station antenna placement inside the stadium, are evaluated through ray tracing using a 3D stadium model and players' mobility dataset. The results give insight into how distributed antennas inside the stadium should be deployed to enhance the uniform coverage of moving wearable devices. Besides that, the uplink capacity performance and the impact of channel aging on the capacity are also evaluated. The results demonstrate the advantages and disadvantages of different base station antenna distribution strategies in terms of coverage, capacity and channel aging impact.