O.A. Sharpans'kykh
Please Note
23 records found
1
Towards Sample-Efficient Offline Reinforcement Learning in Flight Control
A Study on Sample-Efficient Model-Free Algorithms for Flight Control Tasks
Sample efficiency is a critical metric in intelligent control systems as it directly influences the feasibility and effectiveness of learning-based approaches. This paper presents the study of how Randomized Ensemble Double Q-Learning (REDQ), a sample-efficient model free algorithm, can be used in flight control applications. Three controllers were developed for: pitch, roll and combined biaxial attitude tracking tasks and tested on a high fidelity Cessna Citation 550 model. For each control task, three agents were trained offline: two using REDQ enhanced Soft Actor Critic (SAC) architectures and one using a standard SAC architecture for comparison. REDQ agents showed statistically significant improvements in sample efficiency during initial learning. Average accurate tracking convergence (error < 1◦) occurred within 5,500 training steps for pitch, 6,400 for roll and 11,500 for biaxial control. The gains in sample efficiency were shown to have drawbacks in learning stability and robustness when deviated too far from nominal conditions. ...
Sample efficiency is a critical metric in intelligent control systems as it directly influences the feasibility and effectiveness of learning-based approaches. This paper presents the study of how Randomized Ensemble Double Q-Learning (REDQ), a sample-efficient model free algorithm, can be used in flight control applications. Three controllers were developed for: pitch, roll and combined biaxial attitude tracking tasks and tested on a high fidelity Cessna Citation 550 model. For each control task, three agents were trained offline: two using REDQ enhanced Soft Actor Critic (SAC) architectures and one using a standard SAC architecture for comparison. REDQ agents showed statistically significant improvements in sample efficiency during initial learning. Average accurate tracking convergence (error < 1◦) occurred within 5,500 training steps for pitch, 6,400 for roll and 11,500 for biaxial control. The gains in sample efficiency were shown to have drawbacks in learning stability and robustness when deviated too far from nominal conditions.
Optimizing Charging Schedules for Electrified Aircraft at RTHA Airport
Balancing Cost and Time for Electric Aviation
Synthetic Data for Smarter RUL Prediction
Deep Generative Models in Turbofan Analysis
Integrated Vehicle Routing and Dock-Door Scheduling for Outbound Air Cargo Transport Using an Adaptive Large Neighbourhood Search Framework
An Air France KLM Martinair Cargo Case Study
directly including handling qualities and robust stability requirements in the optimization process. This strategy is employed to develop a Rate Command and Attitude Hold (RCAH) demand system aimed at satisfying longitudinal handling qualities. First, the stability of the
open-loop model and its compliance with the handling qualities guidelines are evaluated. Then, the control law is designed. In this step, a detailed description of the design specifications and how to specify them in the context of H∞ control is given. Subsequently, the controller parameters are optimized to satisfy the design specifications and a closed-loop analysis is performed. Finally, a simulator flight testing campaign is conducted to experimentally validate the designed control law. It is shown that the aircraft equipped with the RCAH system achieves better handling quality ratings (HQRs) and more favorable pilot feedback, providing a substantial improvement over the bare airframe. ...
directly including handling qualities and robust stability requirements in the optimization process. This strategy is employed to develop a Rate Command and Attitude Hold (RCAH) demand system aimed at satisfying longitudinal handling qualities. First, the stability of the
open-loop model and its compliance with the handling qualities guidelines are evaluated. Then, the control law is designed. In this step, a detailed description of the design specifications and how to specify them in the context of H∞ control is given. Subsequently, the controller parameters are optimized to satisfy the design specifications and a closed-loop analysis is performed. Finally, a simulator flight testing campaign is conducted to experimentally validate the designed control law. It is shown that the aircraft equipped with the RCAH system achieves better handling quality ratings (HQRs) and more favorable pilot feedback, providing a substantial improvement over the bare airframe.
Task Load Estimation for ATC Ground Control
A Dynamic Density-based Analysis