Distributed Actor-Critic Algorithms for Multiagent Reinforcement Learning Over Directed Graphs

Actor-critic (AC) cooperative multiagent reinforcement learning (MARL) over directed graphs is studied in this article. The goal of the agents in MARL is to maximize the globally averaged return in a distributed way, i.e., each agent can only exchange information with its neighboring agents. AC methods proposed in the literature require the...

Leaderless Consensus of Heterogeneous Multiple Euler-Lagrange Systems With Unknown Disturbance

This article studies the leaderless consensus problem of heterogeneous multiple networked Euler-Lagrange systems subject to persistent disturbances with unknown constant biases, amplitudes, initial phases, and frequencies. The main characteristic of this study is that none of the agents has information of a common reference model or of a...

A Fixed-Wing UAV Formation Algorithm Based on Vector Field Guidance

The vector field method was originally proposed to guide a single fixed-wing Unmanned Aerial Vehicle (UAV) towards a desired path. In this work, a non-uniform vector field method is proposed that changes in both magnitude and direction, for the purpose of achieving formations of UAVs. As compared to related work in the literature, the...

Adaptive Vector Field Guidance Without a Priori Knowledge of Course Dynamics and Wind

The high maneuverability of fixed-wing unmanned aerial vehicles (UAVs) exposes these systems to several dynamical and parametric uncertainties, severely affecting the fidelity of modeling and causing limited guidance autonomy. This article shows enhanced autonomy via adaptation mechanisms embedded in the guidance law: a vector-field method is...

The problem of reliable design of vector-field path following in the presence of uncertain course dynamics

Reliable guidance of fixed-wing Unmanned Aerial Vehicles (UAVs) is challenging, as their high maneuverability exposes them to several dynamical changes and parametric uncertainties. Reliability of state-of-the-art guidance methods is often at stake, as these methods heavily rely on precise UAV course dynamics, assumed in a decoupled first...

A semi-physical platform for guidance and formations of fixed-wing unmanned aerial vehicles

Unmanned Aerial Vehicles (UAVs) have multi-domain applications, fixed-wing UAVs being a widely used class. Despite the ongoing research on the topics of guidance and formation control of fixed-wing UAVs, little progress is known on implementation of semi-physical validation platforms (software-in-the-loop or hardware-in-the-loop) for such...

Addressing Unmodeled Path-Following Dynamics via Adaptive Vector Field: A UAV Test Case

The actual performance of model-based path-following methods for unmanned aerial vehicles (UAVs) shows considerable dependence on the wind knowledge and on the fidelity of the dynamic model used for design. This study analyzes and demonstrates the performance of an adaptive vector field (VF) control law which can compensate for the lack of...

A software-in-the-loop implementation of adaptive formation control for fixed-wing UAVs

This paper discusses the design and software-in-the-loop implementation of adaptive formation controllers for fixed-wing unmanned aerial vehicles (UAVs) with parametric uncertainty in their structure, namely uncertain mass and inertia. In fact, when aiming at autonomous flight, such parameters cannot assumed to be known as they might vary...

A DSC method for strict-feedback nonlinear systems with possibly unbounded control gain functions

In dynamic surface control (DSC) methods, the control gain functions of systems are always assumed to be bounded, which is a restrictive assumption. This work proposes a novel DSC approach for an extended class of strict-feedback nonlinear systems whose control gain functions are continuous and possibly unbounded. Appropriate compact sets are...

A university building test case for occupancy-based building automation

Heating, ventilation and air-conditioning (HVAC) units in buildings form a system-of-subsystems entity that must be accurately integrated and controlled by the building automation system to ensure the occupants' comfort with reduced energy consumption. As control of HVACs involves a standardized hierarchy of high-level set-point control and...