Hostname: page-component-6898cfcb55-zsp5v Total loading time: 0 Render date: 2026-11-11T19:28:28.491Z Has data issue: false hasContentIssue false

Stabilization of a multi-frequency open cavity flow with gradient-enriched machine learning control

Published online by Cambridge University Press:  17 January 2023

Guy Y. Cornejo Maceda
Affiliation:
School of Mechanical Engineering and Automation, Harbin Institute of Technology (Shenzhen), University Town, Xili, Shenzhen 518055, PR ChinaLaboratoire Interdisciplinaire des Sciences du Numérique, Université Paris-Saclay, CNRS, 91400 Orsay, France
Eliott Varon
Affiliation:
Laboratoire Interdisciplinaire des Sciences du Numérique, Université Paris-Saclay, CNRS, 91400 Orsay, France
François Lusseyran
Affiliation:
Laboratoire Interdisciplinaire des Sciences du Numérique, Université Paris-Saclay, CNRS, 91400 Orsay, France
Bernd R. Noack*
Affiliation:
School of Mechanical Engineering and Automation, Harbin Institute of Technology (Shenzhen), University Town, Xili, Shenzhen 518055, PR ChinaHermann-Föttinger-Institut, Technische Universität Berlin, Müller-Breslau-Straße 8, D-10623 Berlin, Germany
*
†Email address for correspondence: bernd.noack@hit.edu.cn

Abstract

We stabilize an open cavity flow experiment to 1 % of its original fluctuation level. For the first time, a multi-modal feedback control is automatically learned for this configuration. The key enabler is automatic in situ optimization of control laws with machine learning augmented by a gradient descent algorithm, named gradient-enriched machine learning control (Cornejo Maceda et al., J. Fluid Mech., vol. 917, 2021, A42, gMLC). The physical interpretation of the feedback mechanism is assisted by a novel cluster-based control law visualization for the flow dynamics and corresponding actuation commands. Starting points of the control experiment are two unforced open cavity benchmark configurations: a narrow-bandwidth regime with a single dominant frequency and a mode-switching regime where two frequencies compete. The flow is forced by a dielectric barrier discharge actuator located at the leading edge and is monitored by a downstream hot-wire sensor over the trailing edge. The feedback law is optimized with respect to the monitored fluctuation level. As reference, the self-oscillations of the mixing layer are mitigated with steady actuation. Then, a feedback controller is optimized with gMLC. As expected, feedback control outperforms steady actuation by achieving a better amplitude reduction with approximately 1 % of the actuation energy required for similarly effective steady forcing. Intriguingly, optimized laws learned for one regime perform well for the other untested regime as well. The proposed control strategy can be expected to be applicable for many other shear flow experiments.

Information

Type
JFM Papers
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2023. Published by Cambridge University Press.
Figure 0

Table 1.Table of acronyms.

Figure 1

Figure 1.Diagram of the cavity with the position of the DBD actuator (in red) and the velocity sensor (in green). The magnified region depicts the velocity profiles of the incoming velocity ($U(y)$ in blue) and the ionic wind produced by the DBD actuator ($U_p(y)$ in red).

Figure 2

Figure 2.The actuation is performed with a DBD actuator placed upstream (a) and the current state of the flow is given by a hot-wire probe downstream (b).

Figure 3

Figure 3.Time series (top) and spectral content (bottom) of the velocity measured downstream for the two unforced regimes. The main frequencies of the flow are depicted in red: $f_b$, $f^-$, $f_a$, $f^+$ and $f_a$ harmonics. The vertical axis of the spectral plots are in $\log _{10}$ scale. The cost function (see § 3.2) detects the maximum peak in the green-shaded window $St \in [0.5,1.75]$. (a) Narrow-bandwidth regime and (b) mode-switching regime.

Figure 4

Table 2.Cavity flow parameters and experimental conditions for the two studied regimes. The temperature $T$ and kinematic viscosity $\nu$ values are averaged over the learning session.

Figure 5

Figure 4.Spectrograms of the downstream velocity for the two studied regimes. The colour code corresponds to the power level in $\log _{10}$scale. The ticks of the colour bar are the exponent values. (a) Narrow-bandwidth regime and (b) mode-switching regime.

Figure 6

Figure 5.Strouhal number ($St^{L}$) – dimensionless cavity length ($L/\theta _0$) map, $\theta _0$ being the momentum boundary layer thickness and $L$ the cavity length. Black lines represent the locus of (2.3) for locked-on modes $n=1,2,3$. Black dashed lines represent the locus of (2.3) without the corrective term $\gamma _n$: $St^{L}_{n}=n/2$. The left green band corresponds to the operating point for the narrow-bandwidth regime ($L/\theta _0=85.83$). The right green band corresponds to the operating point for the mode-switching regime ($L/\theta _0=102.90$). The red dots symbolize the three main oscillation modes of the mixing layer. For more details see Appendix B).

Figure 7

Table 3.Characteristics of the regimes dynamics. Values of the measured frequencies $f_b$, $f_a$ and $f^+$ and their corresponding Strouhal numbers $St_n^L$. The corrective term $\gamma _n$ is then computed from (2.3).

Figure 8

Figure 6.Schematic of the gMLC algorithm. On the left are depicted the three phases: MCS, exploration and exploitation. Each one of the phases requires several experiment evaluations. On the right is depicted a representation of the control law space and the gMLC learning process. The individuals generated during the MCS are depicted in black. The individuals resulting from genetic operations are depicted in blue and genetic operations by dashed blue arrows. The yellow region represents the subspace built from the best individuals. The individuals resulting from downhill simplex are depicted in yellow, and the red arrows symbolize the simplex sub-steps (only one sub-step is depicted). The reconstruction phase is not displayed for clarity.

Figure 9

Figure 7.Control law investigation methodology for the cavity control. A feature vector $\boldsymbol a$ is built from a direct measurement of the flow $u$. A feature vector of dimension three is depicted for simplicity. The elements of the feature vector are grouped in clusters. For clarity, only three clusters and their centroids (1,2,3) are displayed. The proximity map is defined by $\gamma _1$ and $\gamma _2$ the two flow features extracted with classical multidimensional scaling. For the transition matrix, darker squares symbolize higher transition probabilities. In the control network model, the actuation magnitudes are represented by rectangles; yellow denote the actuation range, red (blue) for a positive (negative) actuation with respect to the mean value.

Figure 10

Figure 8.Response of the cavity flow to increasing levels of steady actuations. Only 12 actuation levels among the 23 tested are depicted for clarity. The vertical axes are in $\log _{10}$ scale, and the ticks correspond to the exponent values. The spectra have been successively shifted upwards of 4 orders of magnitude to help the comparison. The difference of actuation intensity between two spectra is $\Delta V=0.6$ kV. The spectrum of the unforced flow is plotted in red and in transparency for comparison with the other levels. (a) Narrow-bandwidth regime and (b) mode-switching regime.

Figure 11

Table 4.Gradient-enriched MLC parameters to control the open cavity.

Figure 12

Figure 9.Diagram of the machine learning control process. The evaluation of one individual constitutes the fast evaluation loop, operating at $250$ Hz. The slow learning loop updates the control laws following the gMLC algorithm; it operates at $\sim O(10^{-2}\ {\rm Hz})$.

Figure 13

Figure 10.Distribution of the costs for the 1000 evaluated individuals during the gMLC optimization process for the narrow-bandwidth regime. Each dot represents the cost $J$ of one individual. The colour of the dots symbolizes how the individuals are generated: black dots for randomly generated individuals (MCS phase), blue dots for individuals generated by a genetic operator (exploration phase) and yellow dots for the individuals arising from the subplex method (exploitation phase). The individuals from the MCS and exploration phases are sorted following their costs. The red line follows the evolution of the best cost. The vertical axis is in log scale.

Figure 14

Figure 11.Characteristics of the best control law $K^{\textrm {I}}$ controlling the narrow-bandwidth regime. (a) Time series of the velocity measured downstream and voltage level at the terminals of the DBD actuator. (b) Power spectra of the velocity measured downstream. Black is for the unforced flow, red for the flow controlled with $K^{\textrm {I}}$ and blue for the flow controlled with the recorded actuation command $A^{\textrm {I}}(t)$ employed as an open-loop control. The spectra for the unforced flow (black) and the closed-loop controlled flow (red) are averaged over 20 realizations. The horizontal dashed lines denote the maximum of the spectra in the observation window (green background). The vertical axis is in $\log _{10}$ scale.

Figure 15

Figure 12.Actuation command $b$ vs $a_1$ for the case: $K^{\textrm {I}}$ controlling the narrow-bandwidth regime.

Figure 16

Table 5.Gains for the affine reconstruction of $K^{\textrm {I}}$ controlling the narrow-bandwidth regime.

Figure 17

Figure 13.Investigation of the law $K^{\textrm {I}}$ controlling the narrow-bandwidth regime. Clusters are painted in different colours. The centroids are marked with numbers from 1 to 10. Panel (c) represents the control network model. The actuation amplitudes are denoted with bars, red (blue) for positive (negative) amplitude with respect to the mean actuation. The yellow boxes underneath indicate 25 % of the maximum amplitude. The black arrows serve as the most probable transition from one cluster to the other ($p>0.40$). The grey arrows are for less probable transitions ($0.40 \geq p \geq 0.05$). Lower probability transitions and self-transitions are omitted for clarity. The red (blue) background denotes the supposed regions of positive (negative) amplitude. The dotted black lines are the supposed limits that separate the regions. (a) Proximity map of the feature vector $\boldsymbol a$, (b) transition probability matrix and (c) control network.

Figure 18

Figure 14.Distribution of the costs for the 1000 evaluated individuals during the gMLC optimization process for the mode-switching regime. Each dot represents the cost $J$ of one individual. The colour of the dots symbolize how the individuals have been generated: black dots for randomly generated individuals (MCS phase), blue dots for individuals generated from a genetic operator (exploration phase) and yellow dots for the individuals arising from the subplex method (exploitation phase). The individuals from the MCS and exploration phases are sorted following their costs. The red line follows the evolution of the best cost. The vertical axis is in $\log _{10}$ scale.

Figure 19

Figure 15.Characteristics of the best control law $K^{\textrm {II}}$ controlling the mode-switching regime. (a) Time series of the velocity measured downstream and voltage level at the terminals of the DBD actuator. A short window is enlarged to display the behaviour close to $A_{min}$ (the proportions are not kept). (b) Power spectra of the velocity measured downstream. Black is for the unforced flow, red for the flow controlled with $K^{\textrm {II}}$ and blue for the flow controlled with the recorded actuation command $A^{\textrm {II}}(t)$ employed as an open-loop control. The spectra for the unforced flow (black) and the closed-loop controlled flow (red) are averaged over 20 realizations. The horizontal dashed lines denote the maximum of the spectra in the observation window (green background). The vertical axis is in $\log _{10}$ scale.

Figure 20

Figure 16.Spectrogram of the velocity for the mode-switching regime controlled with $K^{\textrm {II}}$.

Figure 21

Figure 17.Visualization of the control law $K^{\textrm {II}}$ controlling the mode-switching regime. The control network is depicted like in figure 13. The actuation amplitudes are denoted with bars, red (blue) for positive (negative) amplitude with respect to the mean actuation. The yellow boxes indicate 10 % of the maximum amplitude. The black arrows serve as the most probable transition from one cluster to the other ($p>0.15$). The grey arrows are for less probable transitions ($0.15 \geq p \geq 0.10$). Lower probability transitions and self-transitions are omitted for clarity. The red (blue) background denotes the supposed regions of positive (negative) amplitude. The dotted black line is the supposed limit that separates the regions.

Figure 22

Figure 18.Spectral response of the flow controlled by $K^{\textrm {I}}$ and $K^{\textrm {II}}$ for the narrow-bandwidth regime (top) and the mode-switching regime (bottom). Black spectra correspond to the unforced dynamics of each regime; red spectra correspond to the flow controlled by law learned in the given regime, i.e. $K^{\textrm {I}}$ ($K^{\textrm {II}}$) for the narrow-bandwidth (mode-switching) regime. Green corresponds to the flow controlled by the law learned in the other regime and blue to the open-loop equivalent of the latter one. The horizontal dashed lines denote the maximum of each spectrum in the observation window (shaded green section). The vertical axes are in $\log _{10}$ scale. (a) Power spectra for the narrow-bandwidth regime and (b) power spectra for the mode-switching regime.

Figure 23

Figure 19.Visualization of the control law $K^{\textrm {II}}$ controlling the narrow-bandwidth regime. The control network is depicted as in figure 13. The actuation amplitudes are denoted with bars, red (blue) for positive (negative) amplitude with respect to the mean actuation. The yellow boxes indicate 25 % of the maximum amplitude. The black arrows serve as the most probable transition from one cluster to the other ($p>0.50$). The grey arrows are for less probable transitions ($0.50 \geq p \geq 0.5$). Lower probability transitions and self-transitions are omitted for clarity. The red (blue) background denotes the supposed regions of positive (negative) amplitude. The dotted black lines are the supposed limits that separate the regions.

Figure 24

Table 6.Gains for the affine reconstruction of $K^{\textrm {I}}$ controlling the mode-switching regime.

Figure 25

Figure 20.Actuation command $b$ vs $a_1$ for the case: $K^{\textrm {I}}$ controlling the mode-switching regime.

Figure 26

Figure 21.Visualization of the control law $K^{\textrm {I}}$ controlling the mode-switching regime. The control network is depicted as in figure 13. The actuation amplitudes are denoted with bars, red (blue) for positive (negative) amplitude with respect to the mean actuation. The yellow boxes indicate 25 % of the maximum amplitude. The black arrows serve as the most probable transition from one cluster to the other ($p>0.15$). The grey arrows are for less probable transitions ($0.15 \geq p \geq 0.9$). Lower probability transitions and self-transitions are omitted for clarity. The red (blue) background denotes the supposed regions of positive (negative) amplitude. The dotted black lines are the supposed limits that separate the regions.

Figure 27

Figure 22.Summary of the performance for the laws learned ($K^{\textrm {I}}$, $K^{\textrm {II}}$) in this study. On the left, the performance of the laws during the optimization process, and on the right, the performance during the offline re-evaluations. The re-evaluation results are averaged over 20 realizations. The results associated with the learning on the narrow-bandwidth regime and the mode-switching regime are marked by the superscripts $\textrm {I}$ and $\textrm {II}$, respectively. The downward arrows symbolize cost reduction. The feedback symbols indicate whether (✓) or not ($\times$) feedback is a necessary feature for the control. Here $\widetilde \sigma$ designates the normalized standard deviation of the downstream velocity.

Figure 28

Figure 23.Strouhal numbers for the main oscillation modes are displayed as functions of the dimensionless cavity length $L/\theta _0$. Self-sustained oscillations frequencies (black boxes), side-band peaks (grey boxes) and low frequencies (white boxes). Rectangle dimensions represent uncertainties. The shaded area (yellow) is drawn a posteriori to separate self-sustained oscillation frequencies from most side-band peaks. It is delimited by $St^{L} = St^{L}_{*} \pm 1/3$,with $St^{L}_{*} = 0.014 ( L/\theta _0-10 )$ the centreline Strouhal number. Hatched regions highlight side-band frequencies departing from the general scheme. Note that in this graph, $U_0$ corresponds to $U_\infty$ of the present paper. Figure and legend reproduced from Basley et al. (2013, figure 3), with the permission of AIP Publishing.

Figure 29

Figure 24.Distribution of the costs during the MLC optimization process. Each dot represents the cost $J$ of one individual. The colour of the dots represents how the individuals have been generated. Black dots for the individuals randomly generated by MCS (individuals $i=1,\ldots,100$), blue dots for the individuals generated with genetic operator (individuals $i=101,\ldots,1000$). For each generation the individuals have been sorted according to their cost. The red line shows the evolution of the best cost for the MLC optimization process. The green line corresponds to the gMLC optimization process. The vertical axis is in $\log _{10}$ scale.

Figure 30

Table 7.Summary of the 19 control laws composing $K^{\textrm {I}}$ described in (C1). For each control law, we present the mathematical expression $b$, its weight in $K^{\textrm {I}}$ and cost $J$. The three best-performing control laws $\#15$, $\#18$ and $\#19$ are highlighted in bold.

Figure 31

Table 8.Summary of the 11 control laws composing $K^{\textrm {II}}$ described in (C5). For each control law, we present the mathematical expression $b$, its weight in $K^{\textrm {II}}$ and cost $J$. The three best control laws $\#4$, $\#8$ and $\#11$ are highlighted in bold.

Figure 32

Figure 25.Spectra of the actuation command and the velocity measured by the hot-wire sensor downstream. (a) Narrow-bandwidth regime controlled by $K^{\textrm {I}}$. (b) Mode-switching regime controlled by $K^{\textrm {II}}$. (c) Narrow-bandwidth regime controlled by $K^{\textrm {II}}$. (d) Mode-switching regime controlled by $K^{\textrm {I}}$.

Figure 33

Figure 26.Spectra of additional hot-wire probes at different spanwise positions in the controlled mode-switching regime. (a) Hot-wire sensor positions. Only hot-wire HW1 is employed for the feedback control. Hot-wires HW2 and HW3 simultaneously measure the velocity at different spanwise locations. The height of hot-wires HW2 and HW3 is at $y=2$ mm, i.e. lower than hot-wire HW1 ($y=6$ mm), (b) Velocity spectrum measured by the first hot-wire (HW1) during the control of the mode-switching regime. The unforced and control spectra are averaged over 200 and 20 realizations, respectively, (c) Velocity spectrum measured by the second hot-wire (HW2) during the control of the mode-switching regime. The unforced and control spectra are averaged over 200 and 20 realizations, respectively and (d) Velocity spectrum measured by the third hot-wire (HW3) during the control of the mode-switching regime. The unforced and control spectra are averaged over 20 realizations.