Deep reinforcement learning control approach to mitigating actuator attacks

This paper investigates the deep reinforcement learning based secure control problem for cyber–physical systems (CPS) under false data injection attacks. We describe the CPS under attacks as a Markov decision process (MDP), based on which the secure controller design for CPS under attacks is formulated as an action policy learning using data....

A Secure Robot Learning Framework for Cyber Attack Scheduling and Countermeasure

The problem of learning-based control for robots has been extensively studied, whereas the security issue under malicious adversaries has not been paid much attention to. Malicious adversaries can invade intelligent devices and communication networks used in robots, causing incidents, achieving illegal objectives, and even injuring people....

Secure Control for Cyber-Physical Systems under Malicious Attacks

This article investigates the secure control problem for cyber-physical systems when the malicious data are injected into the cyber realm, which directly connects to the actuators. Based on moving target defense (MTD) and reinforcement learning, we propose a novel proactive and reactive defense control scheme. First, the system (A,B) is...

Learning Tracking Control for Cyber-Physical Systems

This paper investigates the problem of optimal tracking control for cyber-physical systems (CPS) when the cyber realm is attacked by denial-of-service (DoS) attacks which can prevent the control signal transmitting to the actuator. Attention is focused on how to design the optimal tracking control scheme without using the system dynamics and...

Design exploration of quantitative performance and geometry typology for indoor arena based on self-organizing map and multi-layered perceptron neural network

During the early design process, simulations allow numeric assessment and 3D models allow visual inspection for qualitative criteria. However, exploring different design alternatives based on both is challenging. To support the design exploration of quantitative performance and geometry typology of various design alternatives during the early...

Integrating multi-functional space and long-span structure in the early design stage of indoor sports arenas by using parametric modelling and multi-objective optimization

Indoor multi-functional sports arenas are a complex building type. Integration of the (multi-) functional space and of the large-span structure of the roof mainly determines the overall geometry of the building, and is one of the most challenging phases of the design. Several interdisciplinary numeric assessments and numerous solutions with...

Design exploration of architectural geometries and structural performance for sports arenas based on SOM-clustering and structural performance simulation

Indoor sports arenas are a kind of important public buildings, which require iconic architectural forms and well performing structures for the long-span roofs. Hence, during the early stage of an arena design, it is crucial for designers to define a proper building form based on integrated design exploration of both geometric typology and...

Hydrostatic analyses of uprighting processes of a capsized and damaged ship

Integrating the Multi-Functional Space and Long-Span Structure for Sports Arena Design: A design exploration process based on design optimization and self-organizing map

The multi-functional space of sports arena is highly related to the long-span structure. To support the integration of these two aspects, design optimization combining parametric modeling, performance simulations, and searching algorithm can be used. However, optimization is powerful in dealing with quantitative performance, but for some soft...

A Parametric Modelling Process for the Integration of Architecture and Structure in Large Multi-functional Sports Hall Design: a Case Study

The integration of architectural (functional spaces) and structural design is especially crucial for the conceptual design of large multi-functional sports halls, due to the strict regulations for functional spaces, the requirement of large-span structure, and the complex interrelationships between these two aspects. This on-going research aims...