Title
Pervasive AI for IoT Applications: A Survey on Resource-Efficient Distributed Artificial Intelligence
Author
Baccour, Emna (Hamad Bin Khlifa University)
Mhaisen, N. (TU Delft Embedded Systems; Qatar University)
Abdellatif, Alaa Awad (Qatar University)
Erbad, Aiman (Hamad Bin Khlifa University)
Mohamed, Amr (Qatar University)
Hamdi, Mounir (Hamad Bin Khlifa University)
Guizani, Mohsen (Mohamed Bin Zayed University of Artificial Intelligence)
Date
2022
Abstract
Artificial intelligence (AI) has witnessed a substantial breakthrough in a variety of Internet of Things (IoT) applications and services, spanning from recommendation systems and speech processing applications to robotics control and military surveillance. This is driven by the easier access to sensory data and the enormous scale of pervasive/ubiquitous devices that generate zettabytes of real-time data streams. Designing accurate models using such data streams, to revolutionize the decision-taking process, inaugurates pervasive computing as a worthy paradigm for a better quality-of-life (e.g., smart homes and self-driving cars.). The confluence of pervasive computing and artificial intelligence, namely Pervasive AI, expanded the role of ubiquitous IoT systems from mainly data collection to executing distributed computations with a promising alternative to centralized learning, presenting various challenges, including privacy and latency requirements. In this context, an intelligent resource scheduling should be envisaged among IoT devices (e.g., smartphones, smart vehicles) and infrastructure (e.g., edge nodes and base stations) to avoid communication and computation overheads and ensure maximum performance. In this paper, we conduct a comprehensive survey of the recent techniques and strategies developed to overcome these resource challenges in pervasive AI systems. Specifically, we first present an overview of pervasive computing, its architecture, and its intersection with artificial intelligence. We then review the background, applications and performance metrics of AI, particularly Deep Learning (DL) and reinforcement learning, running in a ubiquitous system. Next, we provide a deep literature review of communication-efficient techniques, from both algorithmic and system perspectives, of distributed training and inference across the combination of IoT devices, edge devices and cloud servers. Finally, we discuss our future vision and research challenges.
Subject
deep learning
distributed inference
federated learning
Pervasive computing
reinforcement learning
To reference this document use:
http://resolver.tudelft.nl/uuid:430746a5-76e0-4571-803d-a05e0b670ae9
DOI
https://doi.org/10.1109/COMST.2022.3200740
Embargo date
2023-07-01
ISSN
1553-877X
Source
IEEE Communications Surveys and Tutorials, 24 (4), 2366-2418
Bibliographical note
Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.
Part of collection
Institutional Repository
Document type
journal article
Rights
© 2022 Emna Baccour, N. Mhaisen, Alaa Awad Abdellatif, Aiman Erbad, Amr Mohamed, Mounir Hamdi, Mohsen Guizani