Learning-Based Multi-UAV Flocking Control With Limited Visual Field and Instinctive Repulsion

This article explores deep reinforcement learning (DRL) for the flocking control of unmanned aerial vehicle (UAV) swarms. The flocking control policy is trained using a centralized-learning-decentralized-execution (CTDE) paradigm, where a centralized critic network augmented with additional information about the entire UAV swarm is utilized...

Distributed Nonlinear Trajectory Optimization for Multi-Robot Motion Planning

This work presents a method for multi-robot coordination based on a novel distributed nonlinear model predictive control (NMPC) formulation for trajectory optimization and its modified version to mitigate the effects of packet losses and delays in the communication among the robots. Our algorithms consider that each robot is equipped with an...

Speed and heading control-based collision avoidance for a ship towing system

Collision avoidance is a priority task for ensuring the safety of a maritime transportation system. However, for a ship towing system, which is characterized by multiple vessels and physical connections, the research works about collision avoidance is limited. Thus, this paper proposes a speed and heading control-based conflict resolution of...

COLREGS-Compliant collision avoidance for physically coupled multi-vessel systems with distributed MPC

This paper proposes a distributed control scheme for autonomous tugboats to tow a ship in a restricted water traffic environment ensuring collision avoidance while being compliant with maritime regulation called COLREGS. The complex problem is cooperatively solved by addressing three sub-optimization problems. The first is to optimize the...

Model-Reference Reinforcement Learning for Collision-Free Tracking Control of Autonomous Surface Vehicles

This paper presents a novel model-reference reinforcement learning algorithm for the intelligent tracking control of uncertain autonomous surface vehicles with collision avoidance. The proposed control algorithm combines a conventional control method with reinforcement learning to enhance control accuracy and intelligence. In the proposed...

Scenario-Based Trajectory Optimization in Uncertain Dynamic Environments

We present an optimization-based method to plan the motion of an autonomous robot under the uncertainties associated with dynamic obstacles, such as humans. Our method bounds the marginal risk of collisions at each point in time by incorporating chance constraints into the planning problem. This problem is not suitable for online optimization...

Integrated nonlinear model predictive control for automated driving

This work presents a Nonlinear Model Predictive Control (NMPC) scheme to perform evasive maneuvers and avoid rear-end collisions. Rear-end collisions are among the most common road fatalities. To reduce the risk of collision, it is necessary for the controller to react as quickly as possible and exploit the full vehicle maneuverability (i.e.,...

Online trajectory planning and control of a MAV payload system in dynamic environments

Micro Aerial Vehicles (MAVs) can be used for aerial transportation in remote and urban spaces where portability can be exploited to reach previously inaccessible and inhospitable spaces. Current approaches for path planning of MAV swung payload system either compute conservative minimal-swing trajectories or pre-generate agile collision-free...

Model predictive ship collision avoidance based on Q-learning beetle swarm antenna search and neural networks

Real-time collision avoidance with full consideration of ship maneuverability, collision risks and International Regulations for Preventing Collisions at Sea (COLREGs) is difficult in multi-ship encounters. To deal with this problem, a novel method is proposed based on model predictive control (MPC), an improved Q-learning beetle swarm...

Distributed multi-robot formation control in dynamic environments

This paper presents a distributed method for formation control of a homogeneous team of aerial or ground mobile robots navigating in environments with static and dynamic obstacles. Each robot in the team has a finite communication and visibility radius and shares information with its neighbors to coordinate. Our approach leverages both...