On Designing Smart Agents for Service Provisioning in Blockchain-Powered Systems

On Designing Smart Agents for Service Provisioning in Blockchain-Powered Systems

Mhaisen, N. (TU Delft Embedded Systems; Qatar University)
Allahham, Mhd Saria (Qatar University; Queen’s University)
Mohamed, Amr (Qatar University)
Erbad, Aiman (Hamad Bin Khlifa University)
Guizani, Mohsen (Qatar University)

2022

Service provisioning systems assign users to service providers according to allocation criteria that strike an optimal trade-off between users' Quality of Experience (QoE) and the operation cost endured by providers. These systems have been leveraging Smart Contracts (SCs) to add trust and transparency to their criteria. However, deploying fixed allocation criteria in SCs does not necessarily lead to the best performance over time since the blockchain participants join and leave flexibly, and their load varies with time, making the original allocation sub-optimal. Furthermore, updating the criteria manually at every variation in the blockchain jeopardizes the autonomous and independent execution promised by SCs. Thus, we propose a set of light-weight agents for SCs that are capable of optimizing the performance. We also propose using online learning SCs, empowered by Deep Reinforcement Learning (DRL) agent, that leverage the chained data to continuously self-tune its allocation criteria. We show that the proposed learning-assisted method achieves superior performance on the combinatorial multi-stage allocation problem while still being executable in real-time. We also compare the proposed approach with standard heuristics as well as planning methods. Results show a significant performance advantage over heuristics and better adaptability to the dynamic nature of blockchain networks.

Blockchain
Deep reinforcement learning
Edge computing
IoT
Service provisioning
Smart contracts

http://resolver.tudelft.nl/uuid:071512df-f124-4b08-86ff-517a3a9e354e

https://doi.org/10.1109/TNSE.2021.3118970

2023-07-01

IEEE Transactions on Network Science and Engineering, 9 (2), 401-415

Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Institutional Repository

journal article

© 2022 N. Mhaisen, Mhd Saria Allahham, Amr Mohamed, Aiman Erbad, Mohsen Guizani