Online intelligent flight control using reinforcement learning

Advancements in aerial vehicles have presented new challenges for flight control system design. The disturbed airflow caused by rotors and flapping wings and the nonlinearity and uncertainty increased by morphing components impede the identification of a globally accurate model of these vehicles. Additionally, complex components can increase the...

A Landscape-Based Regional Design Approach for Sustainable Urban Development in the Pearl River Delta, China

Adaptive urban transformations employ landscape-based regional design as an integrative and multiscale design and planning approach for sustainable urban development. In this approach, natural and urban dynamics as derived from systems analysis set the pace and nature of adaptation. This chapter presents an initial strategy for adaptive urban...

Introduction: Adaptive Urban Transformation in the Pearl River Delta, China.

Deltaic areas are amidst the most favourable territories around the globe. Their strategic location and superior quality of their soils are core factors supporting both human development and the rise of these regions as global economic hubs. At the same time, deltas are extremely vulnerable to multiple threats from both climate change and the...

Adaptive Parameterized Control for Coordinated traffic Management Using Reinforcement Learning

Traffic control is essential to reduce congestion in both urban and freeway traffic networks. These control measures include ramp metering and variable speed limits for freeways, and traffic signal control for urban traffic. However, current traffic control methods are either too simple to respond to complex traffic environment, or too...

Event-triggered constrained control using explainable global dual heuristic programming for nonlinear discrete-time systems

This paper develops an event-triggered optimal control method that can deal with asymmetric input constraints for nonlinear discrete-time systems. The implementation is based on an explainable global dual heuristic programming (XGDHP) technique. Different from traditional GDHP, the required derivatives of cost function in the proposed method...

Event-triggered intelligent critic control with input constraints applied to a nonlinear aeroelastic system

In this paper, we establish an event-triggered intelligent control scheme with a single critic network, to cope with the optimal stabilization problem of nonlinear aeroelastic systems. The main contribution lies in the design of a novel triggering condition with input constraints, avoiding the Lipschitz assumption on the inverse hyperbolic...

ArduPilot-Based Adaptive Autopilot: Architecture and Software-in-The-Loop Experiments

This article presents an adaptive method for ArduPilot-based autopilots of fixed-wing unmanned aerial vehicles (UAVs). ArduPilot is a popular open-source unmanned vehicle software suite. We explore how to augment the PID loops embedded inside ArduPilot with a model-free adaptive control method. The adaptive augmentation, adopted for both...

Vision-Based Nonlinear Incremental Control for A Morphing Wing with Mechanical Imperfections

Morphing structures have acquired much attention in the aerospace community because they enable an aircraft to actively adapt its shape during flight, leading to fewer emissions and fuel consumption. Researchers have designed, manufactured, and tested a morphing wing named SmartX-Alpha, which can actively alleviate loads while achieving the...

Incremental fault-tolerant control for a hybrid quad-plane UAV subjected to a complete rotor loss

Quad-plane is a popular type of electric vertical and takeoff/landing (eVTOL) vehicle that hybridizes a quadrotor and a fixed-wing airplane. However, the mechanical simplicity of a quad-plane also makes it vulnerable to rotor failures. When a complete rotor fails, it becomes physically impossible to stop the quad-plane from fast yaw spinning,...

Designing Coastal Interfaces: Landscape architecture explorations in the Pearl River Delta, the Haringvliet and Pekalongan City through six MSc-graduation projects

This graduation studio explores the potential of a landscape-based regional design approach to contribute to more resilient coastal landscapes around the globe. Such an approach addresses the interaction between the natural and urban landscape throughout the scales of space and time. It takes the landscape as the basis for sustainable urban...

Intelligent adaptive optimal control using incremental model-based global dual heuristic programming subject to partial observability

The scarcity of information regarding dynamics and full-state feedback increases the demand for a model-free control technique that can cope with partial observability. To deal with the absence of prior knowledge of system dynamics and perfect measurements, this paper develops a novel intelligent control scheme by combining global dual...

动态的遗产策略：文化、经济、历史维度下的荷兰建筑遗产改造实践

The dynamic heritage strategy is an era choice to respond to the “modern monument paradox”. As a highly malleable concept, heritage, whether it is the concept itself or its related practices, has to be discussed, and criticized before recognition in a constant movement. The typical Dutch tolerant society has been facing the impact of...

Markov-based solution for information diffusion on adaptive social networks

There is currently growing interest in modeling the information diffusion on social networks across multi-disciplines, including the prediction of the news popularity, the detection of the rumors and the influence of the epidemiological studies. Following the framework of the epidemic spreading, the information spreading models assume that...

Learning from Agri-Aquaculture for Multiscale Water-Sensitive Design in the Pearl River Delta

The Pearl River Delta (PRD) is a river dominated floodplain in southeast China. Decreasing space for water, through dike-ring construction, channelization, and urbanization, has led to increased flood risk from river, rain, and sea. To protect from flood risk, a more adaptive urbanization strategy is required; one takes into account a multiscale...

Incremental Model-Based Global Dual Heuristic Programming for Flight Control

This paper proposes a novel adaptive dynamic programming method, called Incremental model-based Global Dual Heuristic Programming, to generate a self-learning adaptive controller, in the absence of sufficient prior knowledge of system dynamics. An incremental technique is employed for online model identification, instead of the artificial...

Epidemic dynamics on information-driven adaptive networks

Research on the interplay between the dynamics on the network and the dynamics of the network has attracted much attention in recent years. In this work, we propose an information-driven adaptive model, where disease and disease information can evolve simultaneously. For the information-driven adaptive process, susceptible (infected)...

Model and Sensor Based Nonlinear Adaptive Flight Control with Online System Identification

Consensus exists that many loss-of-control (LOC) in flight accidents caused by severe aircraft damage or system failure could be prevented if flight performance could be recovered using the valid and remaining control authorities. However, the safe maneuverability of a post-failure aircraft will inevitably be reduced due to the malfunction. Non...

A novel adaptive kernel method with kernel centers determined by a support vector regression approach

The optimality of the kernel number and kernel centers plays a significant role in determining the approximation power of nearly all kernel methods. However, the process of choosing optimal kernels is always formulated as a global optimization task, which is hard to accomplish. Recently, an algorithm, namely improved recursive reduced least...