Learning Tracking Control for Cyber-Physical Systems

Learning Tracking Control for Cyber-Physical Systems

Wu, C. (Harbin Institute of Technology)
Pan, W. (TU Delft Robot Dynamics)
Sun, Guanghui (Harbin Institute of Technology)
Liu, Jianxing (Harbin Institute of Technology)
Wu, Ligang (Harbin Institute of Technology)

2021

This paper investigates the problem of optimal tracking control for cyber-physical systems (CPS) when the cyber realm is attacked by denial-of-service (DoS) attacks which can prevent the control signal transmitting to the actuator. Attention is focused on how to design the optimal tracking control scheme without using the system dynamics and analyze the impact of DoS attacks on tracking performance. First, a Riccati equation for the augmented system including the system model and the reference model is derived under the framework of dynamic programming. The existence and uniqueness of its solution are proved. Second, the impact of the successful DoS attack probability on tracking performance is analyzed. A critical value of the probability is given, beyond which the solution to the Riccati equation cannot converge. The tracking controller cannot be designed. Third, reinforcement learning is introduced to design the optimal tracking control schemes, in which the system dynamics are not necessary to be known. Finally, both a dc motor and an F16 aircraft are used to evaluate the proposed control schemes in this paper.

Actuators
Cyber-physical systems
DoS attacks.
Mathematical model
Optimal tracking control
Reinforcement learning
Riccati equations
Signal to noise ratio
System dynamics
Trajectory

http://resolver.tudelft.nl/uuid:7c7e01c9-d953-4ec8-8463-93dc9a286eec

https://doi.org/10.1109/JIOT.2021.3056633

2327-4662

IEEE Internet of Things Journal, 8 (11), 9151-9163

Accepted Author Manuscript

Institutional Repository

journal article

© 2021 C. Wu, W. Pan, Guanghui Sun, Jianxing Liu, Ligang Wu