This study showcases an experimental deployment of deep reinforcement learning (DRL) for active flow control (AFC) of vortex-induced vibrations (VIV) in a circular cylinder at a high Reynolds number (R e = 3000) using rotary actuation. Departing from prior work that relied on low-Reynolds-number numerical simulations, this research demonstrates real-time control in a challenging experimental setting, successfully addressing practical constraints such as actuator delay. When the learning algorithm is provided with state feedback alone (displacement and velocity of the oscillating cylinder), the DRL agent learns a low-frequency rotary control strategy that achieves up to 80% vibration suppression, which leverages the traditional lock-on phenomenon. While this level of suppression is significant, it remains below the performance achieved using high-frequency rotary actuation. The reduction in performance is attributed to actuation delays and can be mitigated by augmenting the learning algorithm with past control actions. This enables the agent to learn a high-frequency rotary control strategy that effectively modifies vortex shedding and achieves over 95% vibration attenuation. These results demonstrate the adaptability of DRL for AFC in real-world experiments and its ability to overcome instrumental limitations such as actuation lag.

The aim of this study is to discover new active-flow-control (AFC) techniques for separation mitigation in a two-dimensional NACA 0012 airfoil at a Reynolds number of 3000. To find these AFC strategies, a framework consisting of a deep-reinforcement-learning (DRL) agent has been used to determine the action strategies to apply to the flow. The actions involve blowing and suction through jets at the airfoil surface. The flow is simulated with the numerical code Alya, which is a low-dissipation finite-element code, on a high-performance computing system. Various control strategies obtained through DRL led to 43.9% drag reduction, while others yielded an increase in aerodynamic efficiency of 58.6%. In comparison, periodic-control strategies demonstrated lower energy efficiency while failing to achieve the same level of aerodynamic improvements as the DRL-based approach. These gains have been attained through the implementation of a dynamic, closed-loop, time-dependent, active control mechanism over the airfoil.

This study presents novel drag reduction active-flow-control (AFC) strategies for a three-dimensional cylinder immersed in a flow at a Reynolds number based on freestream velocity and cylinder diameter of ReD=3900. The cylinder in this subcritical flow regime has been extensively studied in the literature and is considered a classic case of turbulent flow arising from a bluff body. The strategies presented are explored through the use of deep reinforcement learning. The cylinder is equipped with 10 independent zero-net-mass-flux jet pairs, distributed on the top and bottom surfaces, which define the AFC setup. The method is based on the coupling between a computational-fluid-dynamics solver and a multi-agent reinforcement-learning (MARL) framework using the proximal-policy-optimization algorithm. This work introduces a multi-stage training approach to expand the exploration space and enhance drag reduction stabilization. By accelerating training through the exploitation of local invariants with MARL, a drag reduction of approximately 9% is achieved. The cooperative closed-loop strategy developed by the agents is sophisticated, as it utilizes a wide bandwidth of mass-flow-rate frequencies, which classical control methods are unable to match. Notably, the mass cost efficiency is demonstrated to be two orders of magnitude lower than that of classical control methods reported in the literature. These developments represent a significant advancement in active flow control in turbulent regimes, critical for industrial applications.

The olive oil industry is an important source of agricultural residues throughout its value chain, ranging from intermediate process slurries to relatively dry content pruning residues. Among them, crude olive pomace (COP) is of particular interest since it is abundant, low cost and can be a promising source for bioenergy. Nevertheless, because COP is phytotoxic and has a high moisture content and low energy density, it represents a challenge to conventional processes that usually require a dry and homogenous material. The main novelty of this study is the use of a transition metal catalyst and a central composite design (CCD) approach to optimize the conversion of COP through hydrothermal liquefaction (HTL) into valuable products. Results show that catalytic HTL is capable of converting up to half of the COP into bio-oil. Higher process temperatures resulted in lower bio-oil yields but larger higher heating value (HHV) and lower N content. The bio-oils produced at higher temperatures also show lower concentration of phenols and regarding biochar, a low inorganic content. Without any further upgrading, COP bio-oils produced by HTL are rich in valuable compounds such as oleic acid, phenolic compounds and ketones that can be used in the polymer industry or as chemical intermediates. The highest bio-oil yield was 51.96 wt% at 330 ºC for 30 min and 7.5 wt% catalyst with a HHV of 22.0 MJ/kg. At those operational conditions, the biochar yield was 16.49 wt% with a HHV of 8.9 MJ/kg. The major minerals found in the biochars (CaO, SiO₂ and P₂O₅) suggests that biochar could be well-suited for use in soil applications or as materials for adsorption, especially the non-catalytic ones. Furthermore, the experimental results acquired from HTL of COP were used to develop a global kinetic model. Using an explicit Runge-Kutta method, the kinetic parameters were calculated. After comparing the global kinetic model with a linear system of ordinary differential equations (ODEs) based on the CCD models, results indicate that this approach is more effective in predicting the yields of HTL products.

Active flow control strategies for three-dimensional bluff bodies are challenging to design, yet critical for industrial applications. Here we explore the potential of discovering novel drag-reduction strategies using deep reinforcement learning. We introduce a high-dimensional active flow control setup on a three-dimensional cylinder at Reynolds numbers (Re _D) from 100 to 400, spanning the transition to three-dimensional wake instabilities. The setup involves multiple zero-net-mass-flux jets and couples a computational fluid dynamics solver with a numerical multi-agent reinforcement learning framework based on the proximal policy optimization algorithm. Our results demonstrate up to 16% drag reduction at Re _D = 400, outperforming classical periodic control strategies. A proper orthogonal decomposition analysis reveals that the control leads to a stabilized wake structure with an elongated recirculation bubble. These findings represent the first demonstration of training on three-dimensional cylinders and pave the way toward active flow control of complex turbulent flows.

Purpose: Wall-modeled large eddy simulation (LES) is a practical tool for solving wall-bounded flows with less computational cost by avoiding the explicit resolution of the near-wall region. However, its use is limited in flows that have high non-equilibrium effects like separation or transition. This study aims to present a novel methodology of using high-fidelity data and machine learning (ML) techniques to capture these non-equilibrium effects. Design/methodology/approach: A precursor to this methodology has already been tested in Radhakrishnan et al. (2021) for equilibrium flows using LES of channel flow data. In the current methodology, the high-fidelity data chosen for training includes direct numerical simulation of a double diffuser that has strong non-equilibrium flow regions, and LES of a channel flow. The ultimate purpose of the model is to distinguish between equilibrium and non-equilibrium regions, and to provide the appropriate wall shear stress. The ML system used for this study is gradient-boosted regression trees. Findings: The authors show that the model can be trained to make accurate predictions for both equilibrium and non-equilibrium boundary layers. In example, the authors find that the model is very effective for corner flows and flows that involve relaminarization, while performing rather ineffectively at recirculation regions. Originality/value: Data from relaminarization regions help the model to better understand such phenomenon and to provide an appropriate boundary condition based on that. This motivates the authors to continue the research in this direction by adding more non-equilibrium phenomena to the training data to capture recirculation as well.

This paper presents a deep reinforcement learning (DRL) framework for active flow control (AFC) to reduce drag in aerodynamic bodies. Tested on a 3D cylinder at Re = 100, the DRL approach achieved a 9.32% drag reduction and a 78.4% decrease in lift oscillations by learning advanced actuation strategies. The methodology integrates a CFD solver with a DRL model using an in-memory database for efficient communication between the two instances, making it scalable to more complex flows and higher Reynolds numbers.

The increase in emissions associated with aviation requires deeper research into novel sensing and flow-control strategies to obtain improved aerodynamic performances. In this context, data-driven methods are suitable for exploring new approaches to control the flow and develop more efficient strategies. Deep artificial neural networks (ANNs) used together with reinforcement learning, i.e., deep reinforcement learning (DRL), are receiving more attention due to their capabilities of controlling complex problems in multiple areas. In particular, these techniques have been recently used to solve problems related to flow control. In this work, an ANN trained through a DRL agent, coupled with the numerical solver Alya, is used to perform active flow control. The Tensorforce library was used to apply DRL to the simulated flow. Two-dimensional simulations of the flow around a cylinder were conducted and an active control based on two jets located on the walls of the cylinder was considered. By gathering information from the flow surrounding the cylinder, the ANN agent is able to learn through proximal policy optimization (PPO) effective control strategies for the jets, leading to a significant drag reduction. Furthermore, the agent needs to account for the coupled effects of the friction- and pressure-drag components, as well as the interaction between the two boundary layers on both sides of the cylinder and the wake. In the present work, a Reynolds number range beyond those previously considered was studied and compared with results obtained using classical flow-control methods. Significantly different forms of nature in the control strategies were identified by the DRL as the Reynolds number (Formula presented.) increased. On the one hand, for (Formula presented.), the classical control strategy based on an opposition control relative to the wake oscillation was obtained. On the other hand, for (Formula presented.), the new strategy consisted of energization of the boundary layers and the separation area, which modulated the flow separation and reduced the drag in a fashion similar to that of the drag crisis, through a high-frequency actuation. A cross-application of agents was performed for a flow at (Formula presented.), obtaining similar results in terms of the drag reduction with the agents trained at (Formula presented.) and 2000. The fact that two different strategies yielded the same performance made us question whether this Reynolds number regime ((Formula presented.)) belongs to a transition towards a nature-different flow, which would only admits a high-frequency actuation strategy to obtain the drag reduction. At the same time, this finding allows for the application of ANNs trained at lower Reynolds numbers, but are comparable in nature, saving computational resources.

Simulations of turbulent fluid flow around long cylindrical structures are computationally expensive because of the vast range of length scales, requiring simplifications such as dimensional reduction. Current dimensionality reduction techniques such as strip-theory and depth-averaged methods do not take into account the natural flow dissipation mechanism inherent in the small-scale three-dimensional (3-D) vortical structures. We propose a novel flow decomposition based on a local spanwise average of the flow, yielding the spanwise-averaged Navier–Stokes (SANS) equations. The SANS equations include closure terms accounting for the 3-D effects otherwise not considered in 2-D formulations. A supervised machine-learning (ML) model based on a deep convolutional neural network provides closure to the SANS system. A-priori results show up to 92% correlation between target and predicted closure terms; more than an order of magnitude better than the eddy viscosity model correlation. The trained ML model is also assessed for different Reynolds regimes and body shapes to the training case where, despite some discrepancies in the shear-layer region, high correlation values are still observed. The new SANS equations and ML closure model are also used for a-posteriori prediction. While we find evidence of known stability issues with long time ML predictions for dynamical systems, the closed SANS simulations are still capable of predicting wake metrics and induced forces with errors from 1-10%. This results in approximately an order of magnitude improvement over standard 2-D simulations while reducing the computational cost of 3-D simulations by 99.5%.

With the recent advances in machine learning, data-driven strategies could augment wall modeling in large eddy simulation (LES). In this work, a wall model based on gradient boosted decision trees is presented. The model is trained to learn the boundary layer of a turbulent channel flow so that it can be used to make predictions for significantly different flows where the equilibrium assumptions are valid. The methodology of building the model is presented in detail. The experiment conducted to choose the data for training is described. The trained model is tested a posteriori on a turbulent channel flow and the flow over a wall-mounted hump. The results from the tests are compared with that of an algebraic equilibrium wall model, and the performance is evaluated. The results show that the model has succeeded in learning the boundary layer, proving the effectiveness of our methodology of data-driven model development, which is extendable to complex flows.

Turbulent flow evolution and energy cascades are significantly different in two-dimensional (2-D) and three-dimensional (3-D) flows. Studies have investigated these differences in obstacle-free turbulent flows, but solid boundaries have an important impact on the cross-over from 3-D to 2-D turbulence dynamics. In this work, we investigate the span effect on the turbulence nature of flow past a circular cylinder at . It is found that even for highly anisotropic geometries, 3-D small-scale structures detach from the walls. Additionally, the natural large-scale rotation of the Kármán vortices rapidly two-dimensionalise those structures if the span is 50Â % of the diameter or less. We show this is linked to the span being shorter than the Mode B instability wavelength. The conflicting 3-D small-scale structures and 2-D Kármán vortices result in 2-D and 3-D turbulence dynamics which can coexist at certain locations of the wake depending on the domain geometric anisotropy.

The wake behind a bluff body constitutes an intrinsically three-dimensional flow and it is known that two-dimensional simulations yield to an unphysical prediction of the body forces because of the nature of the two-dimensional Navier-Stokes equations. However, three-dimensional simulations are too computationally expensive for cases such as marine risers, which have very large aspect ratios and are exposed to a high Reynolds number flow. A quantitative and qualitative study has been performed to investigate the fundamental differences on the wake of two-dimensional and three-dimensional fixed spanwise periodic cylinders for a Reynolds number of 10⁴. A very fine unifrom grid (503M points) has been used for the near and mid wake range, and it is shown that the wake presents very different vortical structures when the spanwise dimensionality is omitted. In this case, forces such as lift and drag are overpredicted. The kinetic energy spectra of the flow is also investigated to further discuss the physics inherent of each case together and it is found that the contribution of the spanwise velocity on the large wavenumbers is significantly smaller than the other velocity components.