The authors regret to inform that an incorrect transfer function was included in Eq. (12). The correct transfer function is: [Formula Presented] The selected gains were [Formula Presented]. This leads to a real pole at 0.964 and two complex poles at 0.965 ± 0.0445i. The difference of the model compared to the measured step response has now reduced, the largest difference being 4.8% of the final step value at 0.14 s. The mistake does not influence any of the conclusions drawn in the paper. The authors would like to apologize for any inconvenience caused.

Optical flow-based control strategies have always inspired robotic scientists, especially those in the field of Micro Air Vehicles (MAVs), thanks to their computational efficiency and relative simplicity. A major problem is that the success of optical flow control is governed by the availability of distance estimates, while optical flow provides only the ratio of velocity to distance. Therefore, with only monocular visual information, the inherent nonlinearity of optical flow observables has imposed several challenges in the controller design. In this paper, we propose a newly formulated controller, Extended Incremental Nonlinear Dynamic Inversion (EINDI), to deal with nonlinearities in the system output, such as optical flow control problems. The proposed method unlocks the potential of its predecessor (INDI) in output feedback control by removing the common assumption of time-scale separation, allowing internal dynamics to exist, and requiring only the input and output measurements. Furthermore, the EINDI method has been implemented on an MAV and tested successfully for optical flow landing in a simulation and a real-world outdoor environment. Both simulation and flight test results show 1) good tracking performance of the EINDI control compared to the conventional feedback control, 2) smooth landing trajectories without any oscillation, and 3) fast adaptation of the EINDI control even for landings at different heights and desired setpoints.

Managing air data sensor fault detection and diagnosis (FDD) in the presence of atmospheric turbulence is challenging since the effects of faults and turbulence are coupled. Existing FDD approaches cannot decouple the faults from the turbulence. To address this challenge, this brief first proposes a novel kinematic model that incorporates the effects of the turbulence. This model is valid inside the entire flight envelope, and there is no need to design a linear parameter varying system. Then, the double-model adaptive estimation algorithm is extended to achieve unbiased state estimation even in the presence of unknown disturbances. The proposed approach is validated using generated turbulence data with various scale lengths and intensities. More importantly, the proposed approach is successfully validated using the real flight test data of a business jet when it is experiencing atmospheric turbulence.

In this paper, an online flight envelope protection system is developed and implemented on impaired aircraft with structural damage. The whole protection system is designed to be a closed loop of several subsystems, including system identification, damage classification, flight-envelope prediction, and fault-tolerant control. Based on the information given by damage classification, the flight envelopes are explicitly retrieved, processed online from the database, and fed into the fault-tolerant controller, which makes the protection system adaptive to a wide range of abnormal conditions. Simulation results show that with envelope protection, loss-of-control accidents are more likely to be prevented, since excessive commands to the controller are restricted based on the updated information of the changed flight envelopes. In this way, the fault tolerance of the impaired aircraft can be effectively enhanced.

Heuristic dynamic programming is a class of reinforcement learning, which has been introduced to aerospace engineering to solve nonlinear, optimal adaptive control problems. However, it requires an off-line learning stage to train a global system model to represent the system dynamics. This paper uses an incremental model in heuristic dynamic programming to improve the online learning ability, which is incremental model based heuristic dynamic programming. The trait of the online identification of the incremental model makes this method an option for fault-tolerant control and partially observable control problems. This study, therefore, also extends this method to deal with partial observability. The presented method has been validated on two different online tracking problems: missile fault-tolerant control with full-state measurements and also spacecraft attitude control disturbed with liquid sloshing under partially observable conditions. The results reveal that the proposed method outperforms the conventional heuristic dynamic programming method in fault-tolerant control tasks, deals with partial observability, and is robust to internal uncertainties and external disturbances.

A variable stability in-flight simulator has the capabilities to change the response of an aircraft in-flight, often without changing the physical properties of the aircraft. The ability to adjust the aircraft response characteristics and handling qualities has various purposes, such as pilot training, control system development, and handling quality research. A variable stability control system is designed for a medium-range business jet using incremental nonlinear dynamic inversion. The performance of the in-flight simulator is verified by two experiments, one conducted in a fixed-base flight simulator and one in a Cessna Citation II laboratory aircraft. The fly-by-wire actuation system in the Cessna Citation II is based on its existing autopilot, inheriting the limited performance and safety protections. The simulator experiment shows differences between the experienced handling qualities for a reference model and the designed controller combined with aircraft dynamics. These differences mainly arise due to actuator saturation for specific handling quality settings. The in-flight experiment supports the simulator findings but also reveals how the available control authority around the initial condition is limited due to constraints of the fly-by-wire system.

This paper presents an agile and robust spacecraft attitude tracking controller using the recently reformulated incremental nonlinear dynamic inversion (INDI). INDI is a combined model- and sensor-based control approach that only requires a control effectiveness model and measurements of the state and some of its derivatives, making a reduced dependency on exact system dynamics knowledge. The reformulated INDI allows a non-cascaded dynamic inversion control in terms of Modified Rodrigues Parameters (MRPs) where scheduling of the time-varying control effectiveness is done analytically. This way, the controller is only sensitive to parametric uncertainty of the augmented spacecraft inertia and its wheelset alignment. Moreover, we draw some parallels to time-delay control (TDC) -more familiar in the robotics community- which have been shown to be equivalent to the incremental formulation of proportional-integral-derivative (PID) control for second order nonlinear systems in controller canonical form. Simulation experiments for this particular problem demonstrate that INDI has similar nominal performance as TDC/PID control, but superior robust performance and stability.

High-speed flight in GPS-denied environments is currently an important frontier in the research on autonomous flight of micro air vehicles. Autonomous drone races stimulate the advances in this area by representing a very challenging case with tight turns, texture-less floors, and dynamic spectators around the track. These properties hamper the use of standard visual odometry approaches and imply that the micro air vehicles will have to bridge considerable time intervals without position feedback. To this end, we propose an approach to trajectory estimation for drone racing that is computationally efficient and yet able to accurately estimate a micro air vehicle’s state (including biases) and parameters based on sparse, noisy observations of racing gates. The key concept of the approach is to optimize unknown and difficult-to-observe state variables so that the observations of the racing gates best fit with the known control inputs, estimated attitudes, and the quadrotor dynamics and aerodynamics during a time window. It is shown that a gradient-descent implementation of the proposed approach converges ∼4 times quicker to (approximately) correct bias values than a state-of-the-art 15-state extended Kalman filter. Moreover, it reaches a higher accuracy, as the predicted end-point of an open-loop turn is on average only ∼20 cm away from the actual end-point, while the extended Kalman filter and the gradient descent method with kinematic model only reach an accuracy of ∼50 cm. Although the approach is applied here to drone racing, it generalizes to other settings in which a micro air vehicle may only have sparse access to velocity and/or position measurements.

This paper discusses the design, implementation and flight testing of an incremental Backstepping (IBS) based manual flight control law with angular accelerometer (AA) feedback. The main advantages of incremental control laws are that they only require a partial model of the system and are of low complexity. Incremental control laws for aircraft rotational motion, however, need angular acceleration measurements to compute the control increments. Previously, estimates based on angular rate measurements were used for this. The newly implemented AA feedback is expected to improve the performance of the controller by decreasing the sensor delay. The manual control laws command roll rate/angle, vertical load factor, and side slip angle and have been implemented on a Cessna Citation II aircraft, equipped with an experimental fly-by-wire system. The IBS based control law has an integrated integral control term and uses Pseudo Control Hedging to handle actuator saturations. The IBS based control law is shown to have highly satisfactory performance in flight. Test manoeuvres included standard roll and load factor commands and asymmetric thrust handling. Robustness to model mismatch has been compared in a nonlinear simulation for the controllers with and without AA feedback. In general, the AA feedback improved the tolerance to mismatch substantially.

For mitigating the chattering effect in the sliding mode control (SMC), many adaption mechanisms have been proposed to reduce the switching gains. However, less attention is paid to the control structure, which influences the resulting uncertainty term and determines the minimum possible gains. This paper compares three control structures for inducing higher-order sliding modes in finite time: nonlinear dynamic inversion (NDI) based SMC, higher-order sliding mode control (HOSMC) with artificially increased relative degree, and the recently proposed incremental nonlinear dynamic inversion (INDI) based SMC. The latter two control structures have reduced model dependency as compared to NDI-SMC. Moreover, their nominal control increments are found to be approximately equivalent if the sampling interval is sufficiently small and if their gains satisfy certain conditions. Under the same circumstances, the norm value of the resulting uncertainty using INDI-SMC is several orders of magnitude smaller than those using other control structures. For maintaining the sliding modes, the minimum possible gains required by HOSMC approximately equal those needed by INDI-SMC divided by the sampling interval. Nevertheless, these two approaches have comparable chattering degrees, which are effectively reduced as compared to NDI-SMC. The analytical results are verified by numerical simulations.

Autonomous guidance and navigation problems often have high-dimensional spaces, multiple objectives, and consequently a large number of states and actions, which is known as the ‘curse of dimensionality’. Furthermore, systems often have partial observability instead of a perfect perception of their environment. Recent research has sought to deal with these problems by using Hierarchical Reinforcement Learning, which often uses same or similar reinforcement learning methods within one application so that multiple objectives can be combined. However, there is not a single learning method that can benefit all targets. To acquire optimal decision-making most efficiently, this paper proposes a hybrid Hierarchical Reinforcement Learning method consisting of several levels, where each level uses various methods to optimize the learning with different types of information and objectives. An algorithm is provided using the proposed method and applied to an online guidance and navigation task. The navigation environments are complex, partially observable, and a priori unknown. Simulation results indicate that the proposed hybrid Hierarchical Reinforcement Learning method, compared to flat or non-hybrid methods, can help to accelerate learning, to alleviate the ‘curse of dimensionality’ in complex decision-making tasks. In addition, the mixture of relative micro states and absolute macro states can help to reduce the uncertainty or ambiguity at high levels, to transfer the learned results within and across tasks efficiently, and to apply to non-stationary environments. This proposed method can yield a hierarchical optimal policy for autonomous guidance and navigation without a priori knowledge of the system or the environment.