1 Introduction
Nearly half of all fish species live a part of their life in a group (Pitcher Reference Pitcher, Greenberg and Haraway1998). This affords several advantages, including enhanced ability to escape from predators (Partridge Reference Partridge1982), searching for food (Pitcher, Magurran & Winfield Reference Pitcher, Magurran and Winfield1982) and mating (Griffiths & Magurran Reference Griffiths and Magurran1998). Although it is difficult to disentangle the sensory cues underlying fish communication in groups, signals encoded in the flow have been proposed as determinants for the emergence of coordinated movements and stable formations (Weihs Reference Weihs1973).
Surprising results continue to challenge our intuition about the ‘hows’ and ‘whys’ of swimming in coordination. For example, while drafting results in drag reduction for the trailing body in a pair of rigid structures in a flow, so-called ‘inverted drafting’ has been observed for flexible structures (Ristroph & Zhang Reference Ristroph and Zhang2008), wherein the leader receives the hydrodynamic advantage at the expense of the follower. As another example, a dead animal trailing a bluff body can generate thrust through passive interaction with the wake of the bluff body (Liao Reference Liao2007), thereby questioning the explanation of schooling based on lateral line sensing. Finally, it was recently discovered that the classical Weihs’ diamond pattern (Weihs Reference Weihs1973) may be hydrodynamically inferior to a phalanx at high swimming speeds (Ashraf et al. Reference Ashraf, Bradshaw, Ha, Halloy, Godoy-Diana and Thiria2017).
Beyond swimming fish, there is a need for principled approaches to infer cause-and-effect relationships from raw time series of multiple bodies oscillating in an encompassing fluid. Clusters of tall civil structures reacting to impacting vortices advected by the wind (Lam, Li & So Reference Lam, Li and So2003), arrays of active materials for underwater sensing and energy harvesting (Abdulsadda & Tan Reference Abdulsadda and Tan2012; Hobeck & Inman Reference Hobeck and Inman2012), nanomats of carbon nanotubes (Pozrikidis Reference Pozrikidis2010), arrays of cilia for fluid mixing and transport (Ding et al. Reference Ding, Nawroth, McFall-Ngai and Kanso2014) and antennulary setal hairs of copepods for mechanoreceptive sensing (Kiørboe et al. Reference Kiørboe, Andersen, Langlois and Jakobsen2010) present fluid–structure interactions that are yet to be fully understood.
Here, we posit an information-theoretic approach to infer causality in fluid–structure interactions. The foundations of information theory date back to the seminal work of Shannon (Reference Shannon1948), who introduced the concept of entropy to describe uncertainty of random variables. Grounded in information theory, nearly two decades ago, Schreiber put forward the concept of transfer entropy to isolate the driving and responding elements in coupled dynamical systems from their time series (Schreiber Reference Schreiber2000). Briefly, transfer entropy measures the reduction of uncertainty in predicting the future state of a system (responding element) due to additional knowledge about the present state of the other system (driving element). In contrast to correlation-based approaches, inferences based on transfer entropy do not rely on a linear relationship between the coupled systems and are robust with respect to variations in interaction delays, making it suitable to unravel causality in fluid–structure interactions.
Since its inception, transfer entropy has found application in several domains (Bossomaier et al. Reference Bossomaier, Barnett, Harr and Lizier2016), from the identification of functional circuits in the brain (Vicente et al. Reference Vicente, Wibral, Lindner and Pipa2011) to the analysis of financial markets (Marschinski & Kantz Reference Marschinski and Kantz2002), along with emerging studies on diffusion of policies in the United States (Anderson et al. Reference Anderson, Jimenez, Bae, Silver, Macinko and Porfiri2016; Grabow et al. Reference Grabow, Macinko, Silver and Porfiri2016; Porfiri & Ruiz-Marín Reference Porfiri and Ruiz-Marín2018), cardiovascular and cerebrovascular regulation (Faes et al. Reference Faes, Porta, Rossato, Adami, Tonon, Corica and Nollo2013), climate networks (Hlinka et al. Reference Hlinka, Hartman, Vejmelka, Runge, Marwan, Kurths and Paluš2013) and collective behaviour of animals (Hu, Nie & Fu Reference Hu, Nie and Fu2015; Orange & Abaid Reference Orange and Abaid2015; Butail, Mwaffo & Porfiri Reference Butail, Mwaffo and Porfiri2016; Tomaru et al. Reference Tomaru, Murakami, Niizato, Nishiyama, Sonoda, Moriyama and Gunji2016; Nakayama et al. Reference Nakayama, Ruiz-Marín, Camacho and Porfiri2017).
For example, Orange & Abaid (Reference Orange and Abaid2015) have demonstrated the possibility of reconstructing leader–follower interactions in pairs of bats flying in the wild from raw time series of the curvatures of their trajectories, reconstructed from three-dimensional (3D) tracking. Experimental results reported therein seem to support the intuition that bats occupying the frontal position in the pair tend to influence the behaviour of those in the rear position. Interestingly, a methodological comparison between transfer entropy and traditional cross-correlation to identify leaders in pairs of swimming fish has been presented in Butail et al. (Reference Butail, Mwaffo and Porfiri2016), offering compelling evidence in favour of an information-theoretic approach to study causal relationships in animal behaviour.
Despite its promise, the possibility of employing transfer entropy to study causality in fluid–structure interactions has never been attempted. In contrast to the state of knowledge that relies on physical modelling of fluid flows and structural dynamics (Dowell & Hall Reference Dowell and Hall2001), transfer entropy may constitute a powerful, model-free approach to elucidate interactions from time series. The feasibility of an information-theoretic approach to the study of causal relationships in fluid–structure interactions is grounded in prior work on geophysical fluid flows, where entropy-related notions have been proposed to assess the predictability of large-scale turbulence and quantify information content in ensemble predictions, from underlying physical models (Kleeman Reference Kleeman2002, Reference Kleeman2011; Majda, Kleeman & Cai Reference Majda, Kleeman and Cai2002).
Toward demonstrating the validity of transfer entropy to detect causality in fluid–structure interactions in a model-free context, we focus on the archetype of tandem pitching airfoils. We consider two airfoils aligned in a uniform flow, wherein the pitch angle of one airfoil is actively controlled while the other passively rotates. The active control alternates the pitch angle based upon an underlying two-state ergodic Markov process, which generates an information-rich, aperiodic and stationary signal. We monitor the pitch angle of the airfoils to compute transfer entropy.
We formulate three hypotheses: (1) transfer entropy detects causality independent of which airfoil is actuated; (2) transfer entropy predicts that the influence decays with the distance between the airfoils; and (3) transfer entropy infers that the influence of the upstream airfoil on the downstream one is greater than the influence of the downstream airfoil on the upstream one. Hypothesis (1) evaluates whether the approach is robust in detecting causality with respect to the relative positioning of the airfoils, that is, directionality of the cause-and-effect relationship. Hypotheses (2) and (3) address the quantification of the degree of influence, that is, the relative magnitude of the cause-and-effect relationship, with respect to variations in the configuration.
This paper is organized as follows. A synoptic primer on transfer entropy is provided in § 2. Our experimental scheme and theoretical approach are introduced in § 3 and § 4, respectively. Results of transfer entropy analysis and assessment of its numerical stability are detailed in § 5. Conclusions from our major findings are presented in § 6.
2 Theoretical background
In information theory, the uncertainty of a discrete random variable,
$X$
, can be measured through the notion of entropy, originally defined by Shannon (Reference Shannon1948) as
where
$\text{Pr}\{\cdot \}$
denotes probability,
$x$
is a realization of
$X$
, and the set
$\unicode[STIX]{x1D6FA}^{X}$
is the sample space that contains all possible realizations of
$X$
. The right-hand side of (2.1) corresponds to the expectation of the logarithm of the probability mass function, such that one may naturally define the joint and conditional entropies of two random variables,
$X$
and
$Y$
, as (Cover & Thomas Reference Cover and Thomas2006)
where
$y$
is a realization of
$Y$
and
$\unicode[STIX]{x1D6FA}^{Y}$
is the sample space of
$Y$
.
Given two stationary discrete stochastic processes,
$X=\left\{X_{t}\right\}_{t\in \mathbb{Z}^{+}}$
and
$Y=\left\{Y_{t}\right\}_{t\in \mathbb{Z}^{+}}$
, in its basic incarnation, transfer entropy from
$X$
to
$Y$
is computed as (Schreiber Reference Schreiber2000)
$$\begin{eqnarray}\displaystyle \text{TE}_{X\rightarrow Y} & = & \displaystyle H(Y_{t}\mid Y_{t-1})-H(Y_{t}\mid Y_{t-1},X_{t-1})\nonumber\\ \displaystyle & = & \displaystyle \mathop{\sum }_{y_{t},y_{t-1},x_{t-1}}\text{Pr}\{Y_{t}=y_{t},Y_{t-1}=y_{t-1},X_{t-1}=x_{t-1}\}\nonumber\\ \displaystyle & & \displaystyle \times \,\log _{2}\frac{\text{Pr}\{Y_{t}=y_{t}\mid Y_{t-1}=y_{t-1},X_{t-1}=x_{t-1}\}}{\text{Pr}\{Y_{t}=y_{t}\mid Y_{t-1}=y_{t-1}\}},\end{eqnarray}$$
where
$y_{t},y_{t-1}\in \unicode[STIX]{x1D6FA}^{Y}$
and
$x_{t-1}\in \unicode[STIX]{x1D6FA}^{X}$
. Transfer entropy in (2.4) quantifies the reduction in the uncertainty of the prediction of the future state of
$Y$
from its present, taking into account additional knowledge about the present of
$X$
. In alignment with Wiener’s principle of causality (Wiener Reference Wiener1956), such a reduction might be attributed to a cause-and-effect relationship between
$X$
and
$Y$
. If
$X$
has no influence on
$Y$
, the present of
$X$
does not encode information to predict
$Y$
; as such, transfer entropy should be zero. In contrast, if
$X$
influences
$Y$
, a non-zero transfer entropy should be detected, implying that predicting the future of
$Y$
is improved given knowledge of the present of
$X$
.
A generalization of (2.4) to account for delayed interactions between the stochastic processes has been recently established by Wibral et al. (Reference Wibral, Pampu, Priesemann, Siebenhhner, Seiwert, Lindner, Lizier and Vicente2013). Given a delay
$\unicode[STIX]{x1D6FF}\in \mathbb{Z}^{+}$
, transfer entropy from
$X$
to
$Y$
is defined as
$$\begin{eqnarray}\displaystyle \text{TE}_{X\rightarrow Y}(\unicode[STIX]{x1D6FF}) & = & \displaystyle \mathop{\sum }_{y_{t},y_{t-1},x_{t-\unicode[STIX]{x1D6FF}}}\text{Pr}\{Y_{t}=y_{t},Y_{t-1}=y_{t-1},X_{t-\unicode[STIX]{x1D6FF}}=x_{t-\unicode[STIX]{x1D6FF}}\}\nonumber\\ \displaystyle & & \displaystyle \times \log _{2}\frac{\text{Pr}\{Y_{t}=y_{t}\mid Y_{t-1}=y_{t-1},X_{t-\unicode[STIX]{x1D6FF}}=x_{t-\unicode[STIX]{x1D6FF}}\}}{\text{Pr}\{Y_{t}=y_{t}\mid Y_{t-1}=y_{t-1}\}}.\end{eqnarray}$$
In this sense, transfer entropy quantifies the improvement in predicting the future of
$Y$
from its present, due to additional knowledge about
$X$
,
$\unicode[STIX]{x1D6FF}$
time steps in the past. In our work, we focus on this definition to account for the finite speed of information transfer afforded by the encompassing fluid medium.
Through the information-theoretic construct of transfer entropy, we can infer cause-and-effect relationships in a principled manner that does not require an underlying mathematical model and inherently accommodates time-varying delays, stochasticity in measurements and nonlinear coupling. One of the key challenges for the application of transfer entropy on experimental data lies in the accurate estimation of the probability mass function from raw time series of finite length. The brute-force solution to estimate the probability mass function is to bin the datasets and count the occurrences of given triplets
$(y_{t},y_{t-1},x_{t-\unicode[STIX]{x1D6FF}})$
in the two time series (Zhang & Grabchak Reference Zhang and Grabchak2013). This approach is simple to implement but it restrains the sample space based on the length of the time series, such that enough realizations of the stochastic processes are needed for estimating each bin of the distribution. The naive solution of increasing the acquisition frequency of the experiment to increase the length of time series might be pursued, but excessively fast acquisitions could magnify the effect of measurement noise (Paluš & Vejmelka Reference Paluš and Vejmelka2007), thereby reducing the predicting power of transfer entropy.
To mitigate potential confounds associated with binning the time series and to deal with time series of moderate length, one may take on a symbolic approach to the computation of transfer entropy (Staniek & Lehnertz Reference Staniek and Lehnertz2008). Symbolic representations are utilized in economics, medical science and genetics (Conaway Reference Conaway1989; López et al.
Reference López, Matilla-García, Mur and Ruiz-Marín2010; Ruiz-Marín et al.
Reference Ruiz-Marín, Matilla-García, Cordoba, Susillo-González, Romo-Astorga, González-Pérez, Ruiz and Gayán2010), where the relative change of the data rather than their precise magnitudes is important. In a symbolic approach to the computation of transfer entropy, we aggregate
$m$
consecutive steps of a time series into an
$m$
-history,
$\{x_{i}\}_{i=t}^{t+m-1}$
. Then, we order the
$m$
elements in increasing order and determine the permutation of the distinct indices
$t_{1},t_{2},\ldots ,t_{m}$
ranging from 0 to
$m-1$
, such that
$x_{t+t_{1}}\leqslant x_{t+t_{2}}\leqslant \cdots \leqslant x_{t+t_{m}}$
, and
$t_{s}<t_{s+1}$
$(s=1,2,\ldots ,m-1)$
if
$x_{t+t_{s}}=x_{t+t_{s+1}}$
. The tuple
$(t_{1},t_{2},\ldots ,t_{m})$
is called a symbol and there are at most
$m!$
symbols that can be generated from
$m$
-histories. For example, in a binary representation of the time series
$\{x_{t}\}_{t=1}^{N}$
of length
$N$
, we could associate the symbol 1 if
$x_{t}\leqslant x_{t+1}$
and
$-1$
when
$x_{t}>x_{t+1}$
. Therefore, computing transfer entropy for binary symbols reduces to the estimation of only
$2^{3}=8$
values for the probability of all the possible triplets. Further technical details on the implementation of symbolic transfer entropy can be found in Porfiri & Ruiz-Marín (Reference Porfiri and Ruiz-Marín2017) for the study of animal behaviour.
3 Experiments
Two identical 3D-printed NACA 0012 airfoils with chord lengths
$c=5~\text{cm}$
and spans of 7 cm are situated in tandem in the centre of an open-channel water flume (Engineering Laboratory Design, Inc.) with test section
$15~\text{cm}\times 15~\text{cm}\times 240~\text{cm}$
(see figure 1). Each airfoil weighs
$10.9~\text{g}$
and has an effective density of
$0.80~\text{g}~\text{cm}^{-3}$
. As a result of the finite resolution of 3D printing, the trailing edges of the airfoils have a thickness of
$0.7~\text{mm}$
. The flow is conditioned by two honeycomb flow straighteners prior to entering the test section. The free stream is set to
$V=3.0~\text{cm}~\text{s}^{-1}$
, which is verified using a Dantec Dynamics laser Doppler velocimetry system. At room temperature, this corresponds to a Reynolds number of
$\mathit{Re}=Vc/\unicode[STIX]{x1D708}=1500$
, where
$\unicode[STIX]{x1D708}$
is the kinematic viscosity.
Schematic of the experimental set-up.

Each airfoil pivots about its 12 % chord location via an aluminium rod that passes out of the tunnel and into an aluminium block with two press-fit stainless-steel ball bearings. A stainless-steel retainer ring maintains the vertical positioning. The blocks are adjusted to accommodate separation distances between the airfoils (
$L$
). Each airfoil can be either actively controlled by a servo-motor (Futaba S3004), or passively rotate with low friction. In active control, the motor is triggered by an Arduino Uno through the Arduino support package in MATLAB R2017a. With a time step
$\unicode[STIX]{x0394}t_{act}$
, a random binary number is generated with equal probabilities, which determines the pitch angle of the airfoil (
$-15^{\circ }$
or
$15^{\circ }$
with respect to the free stream) during the following time step. The pitch angle of each airfoil is recorded over 300 s by a Nikon D7000 camera at 30 frames per second, at a resolution of
$1280\times 720$
pixels, with a maximum field of view of
$37~\text{cm}\times 21~\text{cm}$
. To facilitate tracking, fiducial marks (green tape) are placed at 5 % and 50 % chord of each airfoil.
As a preliminary step towards the systematic analysis of fluid-induced coupling of the airfoils, we verify the accuracy of transfer entropy predictions on synthetic interactions. Specifically, we consider two control conditions, in which both the airfoils are actively controlled. In both conditions, we set
$L/c=0.5$
and
$\unicode[STIX]{x0394}t_{act}=0.5~\text{s}$
. In the first control condition (‘Independently Active’), the actuation of the airfoils is independent of each other, and in the other one, the downstream airfoil is actuated in response to the upstream one with a prescribed time lag (‘Coordinately Active’). For Coordinately Active, the actuation of the downstream airfoil follows the upstream airfoil with a time lag
$\unicode[STIX]{x0394}T$
with probability
$(1-p)$
, and with probability
$p$
it takes the opposite angle. We consider three different lags
$\unicode[STIX]{x0394}T=0.67$
, 1.28 and 1.90 s, with
$p=0.1$
, 0.19 and 0.29, respectively, such that the probabilities scale linearly with the time lags and weaker interactions are associated with longer time lags. Ten repetitions are conducted for Independently Active and for each time lag in Coordinately Active, totalling 40 trials. Through transfer entropy analysis, we expect to demonstrate that the airfoils do not influence each other in Independently Active. For Coordinately Active, we expect to identify that: the upstream airfoil influences the downstream airfoil, the degree of influence decreases with increasing delay, and the synthetic lag aligns with the time delay at which transfer entropy predicts the strongest interaction.
To demonstrate the application of transfer entropy in the study of fluid-induced coupling, we release the constraint that both the airfoils are actively controlled. Five separation distances,
$L/c=\{0.2,0.5,1,2,5\}$
, and two experimental conditions are studied. In the first condition, the upstream airfoil is active and the downstream airfoil is passive (‘Upstream Active’), and, in the second, the roles of the airfoils are reversed (‘Downstream Active’). For Upstream and Downstream Active, we consider three values of the time step in between actuation events,
$\unicode[STIX]{x0394}t_{act}=\{0.5,1,2\}~\text{s}$
. Ten repetitions are executed for each actuation condition, separation distance and time between actuation events, totalling 300 trials.
In control and experimental conditions, the time series of the pitch angles are extracted from the videos by a custom image analysis program. In each frame, the fiducial marks on the airfoils are identified from the green component of the image. The centroid of the two marks is then used to determine the pitch angles of the airfoils, which are collected for approximately five minutes, that corresponds to
$N\approx 9000$
time instants given the frame rate of 30 frames per second. We use
$t$
to label the frame, and the physical time at
$t$
is
$T(t)$
, which we non-dimensionalize by a characteristic convective time scale
$T_{0}=c/V=1.67~\text{s}$
. Alternatively, one may non-dimensionalize with respect to the separation distance. This choice would be consistent with a convection-based explanation of the interaction, which would be tenable for condition Upstream Active but not for Downstream Active.
Fluid velocity field (
$\boldsymbol{u}$
) from the PIV measurements for (a) Upstream Active and (b) Downstream Active at
$L/c=0.5$
and
$\unicode[STIX]{x0394}t_{act}/T_{0}=0.3$
. In (a), the upstream airfoil has completed a clockwise flap, and the downstream airfoil is rotating clockwise. In (b), the downstream airfoil has completed an anticlockwise flap, and the upstream airfoil is rotating clockwise. Grey areas represent shadowed regions where data could not be collected. Solid (dashed) arrows indicate active (passive) rotation. Segments of the time series of the pitch angles of both airfoils are shown in (c) and (d), for Upstream Active and Downstream Active, respectively, at
$L/c=0.5$
. In (c) and (d) time is non-dimensionalized by
$T_{0}$
.

Before delving into the computation of transfer entropy and the results of our systematic analysis, it is of value to provide an overview of the underpinning fluid dynamics and concurrent foils’ motion. An illustration of the flow fields in the Upstream and Downstream Active conditions measured using a Dantec Dynamics time-resolved planar particle image velocimetry (PIV) system is presented in figure 2. The flow is seeded with polyamide particles with a diameter of
$50~\unicode[STIX]{x03BC}\text{m}$
and a density of
$1.0~\text{g}~\text{cm}^{-3}$
. The PIV system consists of a
$100~\text{mJ}~\text{pulse}^{-1}$
Nd:YAG dual-pulse laser with a wavelength of 532 nm, a Phantom high-speed camera and a timer box.
In both conditions, there is a primary flow from left to right in the free-stream direction, which is perturbed by the oscillations of the airfoils. In Upstream Active, the signature of a vortex, previously shed from the upstream airfoil, is observed at the mid-chord location of the downstream airfoil, causing a clockwise rotation. The time series of the pitch angles hint at a complex relationship between the oscillations of the two airfoils, which is unlikely to be identified by a correlation analysis due to the varying delays and nonlinear coupling between the time series. In Downstream Active, it is tenable that the motion of the downstream airfoil interacts with the wake of the upstream airfoil, causing a change in the pitch angle (Strykowski & Sreenivasan Reference Strykowski and Sreenivasan1990; Ozono Reference Ozono1999). Compared to Upstream Active, the interaction evidenced from the time series seems weaker. Through transfer entropy, we seek to unveil the complex relationship between the airfoils, shedding light on the direction, extent and time scale of the interaction.
4 Analysis
To mitigate the effect of measurement noise associated with the uncertainty in tracking the airfoils from the images and undesired mechanical vibration on the computation of transfer entropy, we downsample the time series of the pitch data with a resolution of
$f$
. Given the frame rate of 30 frames per second, two adjacent data points in the downsampled time series correspond to two frames that are
$f/30$
seconds apart. Then, we convert
$m$
consecutive airfoil pitch angles to a symbol. For example, for
$m=2$
, we encode each pair of consecutive pitch angles in a binary symbol, which is equal to
$1$
when the pitch angle increases and
$-1$
when the pitch angle decreases.
The time series of symbols are denoted
$\{u_{t}\}_{t=1}^{\lfloor N/f\rfloor }$
and
$\{d_{t}\}_{t=1}^{\lfloor N/f\rfloor }$
, for the upstream and downstream airfoils, respectively. On these sequences, we apply (2.5) to compute transfer entropy between the airfoils. Given the length of the time series, we limit our analysis to symbolic data generated with
$m=2$
or
$m=3$
consecutive frames and we systematically vary the resolution from 1 to 15.
Plots of (a)
$\text{TE}_{U\rightarrow D}(\unicode[STIX]{x1D6FF})$
and
$\text{TE}_{D\rightarrow U}(\unicode[STIX]{x1D6FF})$
and (b)
$|\text{TE}_{net}(\unicode[STIX]{x1D6FF})|$
as functions of
$T(\unicode[STIX]{x1D6FF})/T_{0}$
. Values refer to the trial in Upstream Active illustrated in figure 2(c) for
$m=2$
and
$f=10$
. The black dashed vertical line indicates the interaction delay
$\unicode[STIX]{x1D6FF}_{c}$
.

Following Wibral et al. (Reference Wibral, Pampu, Priesemann, Siebenhhner, Seiwert, Lindner, Lizier and Vicente2013), we expect that information flow between the two airfoils will be maximized in correspondence with the physical delay of their interaction. For each trial, we compute the delay that maximizes the magnitude of the net information transfer between the airfoils (see figure 3). Specifically, we evaluate
$\text{TE}_{net}(\unicode[STIX]{x1D6FF})=\text{TE}_{U\rightarrow D}(\unicode[STIX]{x1D6FF})-\text{TE}_{D\rightarrow U}(\unicode[STIX]{x1D6FF})$
for time delay up to
$T(\unicode[STIX]{x1D6FF})/T_{0}=2.4$
, search for the value of
$\unicode[STIX]{x1D6FF}_{c}$
that maximizes
$|\text{TE}_{net}(\unicode[STIX]{x1D6FF})|$
, and extract
$\text{TE}_{U\rightarrow D}(\unicode[STIX]{x1D6FF}_{c})$
and
$\text{TE}_{D\rightarrow U}(\unicode[STIX]{x1D6FF}_{c})$
. We refer to these two values as
$\text{TE}_{U\rightarrow D}$
and
$\text{TE}_{D\rightarrow U}$
, whose relative magnitudes are indicative of the cause-and-effect relationship.
5 Results and discussion
This section summarizes the key findings of our experimental campaign. First, we present results on the control trials and then we turn to experimental conditions. To ease the discussion of experimental findings, we initially focus on a time step between actuation events
$\unicode[STIX]{x0394}t_{act}=0.5~\text{s}$
. Based on pilot testing, the treatment of both control and experimental data is based on binary symbols with a resolution
$f=10$
, resulting in approximately 900 symbols per time series. Upon gaining insight into the application of transfer entropy to study the physics of the problem, we move to a thorough robustness analysis, in which we systematically examine the influence of the resolution, number of symbols and time between actuation events.
5.1 Control conditions
Transfer entropies
$\text{TE}_{U\rightarrow D}$
and
$\text{TE}_{D\rightarrow U}$
for control conditions, in which both the airfoils are simultaneously actuated. Computations are performed with
$m=2$
and
$f=10$
. Error bars represent standard errors, and an asterisk identifies significant difference between
$\text{TE}_{U\rightarrow D}$
and
$\text{TE}_{D\rightarrow U}$
from paired
$t$
-tests (adjusted
$p<0.05$
).

Figure 4 presents the values of
$\text{TE}_{U\rightarrow D}$
and
$\text{TE}_{D\rightarrow U}$
for control conditions. Predictably, for Independently Active, no significant difference between
$\text{TE}_{U\rightarrow D}$
and
$\text{TE}_{D\rightarrow U}$
is observed (
$p=0.49$
in paired
$t$
-tests). On the other hand, when the downstream airfoil motion is controlled by the upstream airfoil in Coordinately Active, we find that
$\text{TE}_{U\rightarrow D}>\text{TE}_{D\rightarrow U}$
for all
$\unicode[STIX]{x0394}T$
(adjusted
$p<0.01$
with Bonferroni correction (Abdi Reference Abdi and Salkind2007) in paired
$t$
-tests). (Throughout the statistical analysis, we adjust all the
$p$
-values by Bonferroni correction to correct for multiple comparisons, thereby limiting the possibility of false positives, that is, claiming the presence of a significant finding in spite of its absence.) As a result, transfer entropy is accurate in identifying the existence and direction of cause-and-effect relationships that underlie the synthetic time series.
Not only is transfer entropy successful in determining that the upstream airfoil influences the downstream airfoil in Coordinately Active, but also it successfully infers that the degree of the influence decreases with increasing delay. In fact, linear regression indicates that
$\text{TE}_{U\rightarrow D}$
is negatively dependent on
$\unicode[STIX]{x0394}T/T_{0}$
(
$\text{TE}_{U\rightarrow D}=-0.0367\unicode[STIX]{x0394}T/T_{0}+0.121$
;
$p<0.01$
for
$t$
-statistics on slope). No dependence of
$\text{TE}_{D\rightarrow U}$
on
$\unicode[STIX]{x0394}T/T_{0}$
is revealed due to the modest values of the recorded entropy, with
$p=0.33$
for
$t$
-statistics on slope.
Non-dimensional interaction time delays predicted by transfer entropy in Coordinately Active. Computations are performed with
$m=2$
and
$f=10$
. The dashed straight line is the bisectrix and error bars represent standard errors.

Finally, figure 5 confirms that transfer entropy accurately anticipates the lag of the interaction in Coordinately Active, whereby the predicted interaction time delay
$T(\unicode[STIX]{x1D6FF}_{c})$
closely follows the prescribed time lag
$\unicode[STIX]{x0394}T$
.
5.2 Experimental conditions
Transfer entropies
$\text{TE}_{U\rightarrow D}$
and
$\text{TE}_{D\rightarrow U}$
for the five separation distances and the two experimental conditions. Error bars represent standard errors, and an asterisk identifies significant difference between
$\text{TE}_{U\rightarrow D}$
and
$\text{TE}_{D\rightarrow U}$
from paired
$t$
-tests (adjusted
$p<0.05$
). Data refer to a time step between actuation events
$\unicode[STIX]{x0394}t_{act}=0.5~\text{s}$
, and computations are performed with
$m=2$
and
$f=10$
.

Figure 6 illustrates aggregated data from the two experimental conditions. In agreement with our first hypothesis, we find that transfer entropy is successful in detecting the causal relationship underlying the observed pitching dynamics for both the conditions in which one airfoil is actuated. Specifically, we find that
$\text{TE}_{U\rightarrow D}>\text{TE}_{D\rightarrow U}$
for Upstream Active (adjusted
$p<0.01$
in paired
$t$
-tests for all separation distances except for
$L/c=5$
, when
$p>0.99$
) and
$\text{TE}_{U\rightarrow D}<\text{TE}_{D\rightarrow U}$
for Downstream Active (adjusted
$p<0.05$
in paired
$t$
-tests for
$L/c=0.2$
and
$L/c=0.5$
;
$p=0.055$
for
$L/c=1$
;
$p=0.057$
for
$L/c=2$
; and
$p=0.66$
for
$L/c=5$
). At
$L/c=5$
, the minute values of transfer entropy hinder a statistical comparison, suggesting a modest interaction between the airfoils that explains the large
$p$
-value. Should both the airfoils be free to rotate, without actuation, the values of transfer entropies would be remarkably reduced, hampering the detection of a causal relationship between their motions – see additional experiments in the supplementary material.
To test our second hypothesis on the decay of the influence as a function of the separation distance, we study the dependence of the information transfer on
$L/c$
in both actuation conditions. We fit a linear regression on the values of the dominant transfer entropy (
$\text{TE}_{U\rightarrow D}$
for Upstream Active and
$\text{TE}_{D\rightarrow U}$
for Downstream Active) as a function of
$L/c$
. The analysis confirms that transfer entropy is negatively dependent on
$L/c$
(Upstream Active:
$\text{TE}_{U\rightarrow D}=-0.0303L/c+0.134$
,
$p<0.01$
for
$t$
-statistics on slope; and Downstream Active:
$\text{TE}_{D\rightarrow U}=-0.00728L/c+0.0420$
,
$p<0.01$
for
$t$
-statistics on slope).
To test our third hypothesis that the fluid flow favours information transfer in the downstream direction, we compare
$\text{TE}_{U\rightarrow D}$
in Upstream Active and
$\text{TE}_{D\rightarrow U}$
in Downstream Active for all values of
$L/c$
. Two-sample
$t$
-tests are performed at each
$L/c$
between the two conditions. We find that
$\text{TE}_{U\rightarrow D}$
in Upstream Active is higher than
$\text{TE}_{D\rightarrow U}$
in Downstream Active at
$L/c=0.2$
, 0.5 and 1 (adjusted
$p<0.01$
in two-sample
$t$
-tests). No difference is detected between
$\text{TE}_{U\rightarrow D}$
in Upstream Active and
$\text{TE}_{D\rightarrow U}$
in Downstream Active at
$L/c>1$
(adjusted
$p>0.99$
at
$L/c=2$
and 5 in two-sample
$t$
-tests).
Non-dimensional time delay at which the magnitude of the net transfer entropy is maximized as a function of the separation length for Upstream Active and Downstream Active, superimposed with linear regression fits. Error bars represent standard errors. Data refer to a time step between actuation events
$\unicode[STIX]{x0394}t_{act}=0.5~\text{s}$
, and computations are performed with
$m=2$
and
$f=10$
.

In the open channel employed in the experiments, three physical pathways are likely to contribute to the hydrodynamic interaction between the airfoils: vortex advection, surface waves and acoustics. Vortices generated by the upstream airfoil advect downstream at approximately the free-stream speed and impact the downstream airfoil, causing unsteady pressure loading after a time lapse of approximately
$T_{0}L/c$
. In addition to the formation of a trailing-edge vortex upon airfoil actuation, surface waves are generated in the open channel, offering a bidirectional communication pathway between the airfoils. Surface waves should propagate at
$V_{s}\approx 1~\text{m}~\text{s}^{-1}$
(
$V_{s}=\sqrt{gh}$
, where
$g$
is the gravitational acceleration and
$h$
is the channel depth (Lamb Reference Lamb1945)), which would lead to a fast interaction with a time scale of
$0.03T_{0}L/c$
. Acoustics could also contribute to the bidirectional interaction, at an even faster time scale, comparable with the speed of sound in water.
To delve into the relative role of these pathways, in figure 7, we examine the dependence of the delay
$\unicode[STIX]{x1D6FF}_{c}$
as a function of
$L/c$
; we exclude
$L/c=5$
due to the modest information transfer that challenges the inference of
$\unicode[STIX]{x1D6FF}_{c}$
. In Upstream Active, we find a marked dependence of the delay on the separation distance (
$T(\unicode[STIX]{x1D6FF}_{c})/T_{0}=0.268L/c+0.353$
,
$p<0.01$
for
$t$
-statistic on the slope), suggesting that the hydrodynamic interaction is supported by a combination of vortex advection and surface waves. In Downstream Active, no dependence between
$\unicode[STIX]{x1D6FF}_{c}$
and
$L/c$
is found, consistent with the premise that vortex advection is not a feasible pathway for this condition. In addition to hydrodynamic pathways, there is potential for structural coupling due to mechanical vibration of the experimental facility. To exclude this possibility, we performed an experiment in which there was no water in the channel and found no detectable oscillation in the passive airfoil – see the additional trial in the supplementary material available at https://doi.org/10.1017/jfm.2018.369.
5.3 Robustness analysis
Here, we attempt to demonstrate the robustness of transfer entropy predictions across a range of potential variations in the set-up for the computation and actuation parameters. The statistical analysis precisely mirrors the framework proposed in § 5.2 with a consistent significance level of 0.05. For ease of presentation, details on the statistical analysis for this robustness study are included in the supplementary material.
First, we analyse the same dataset for
$\unicode[STIX]{x0394}t_{act}=0.5~\text{s}$
considered earlier, but for varying choices of the resolution
$f$
. Again, we consider binary symbols in the computation of transfer entropy. Through a parametric analysis, we find that predictions on causality are consistent within the range
$9\leqslant f\leqslant 12$
. In this range, transfer entropy computations lead to consistent predictions on the directionality, strength and time delay of the interaction between the two airfoils, thereby confirming the three hypotheses on which this study rests.
Effect of downsampling on
$\text{TE}_{U\rightarrow D}$
and
$\text{TE}_{D\rightarrow U}$
for the two experimental conditions with
$\unicode[STIX]{x0394}t_{act}=0.5~\text{s}$
, at five separation distances using binary symbols (
$m=2$
). Time series of pitch angles are downsampled at a resolution
$f$
of (a) 9, (b) 11 and (c) 12. Error bars represent standard errors, and an asterisk identifies significant difference between
$\text{TE}_{U\rightarrow D}$
and
$\text{TE}_{D\rightarrow U}$
from paired
$t$
-tests (adjusted
$p<0.05$
). From comparisons, we find that
$\text{TE}_{U\rightarrow D}>\text{TE}_{D\rightarrow U}$
for all but two Upstream Active combination and
$\text{TE}_{U\rightarrow D}<\text{TE}_{D\rightarrow U}$
for most of the combinations considered in Downstream Active.

Effect of downsampling on non-dimensional interaction time delay predicted through transfer entropy for Upstream Active and Downstream Active with
$\unicode[STIX]{x0394}t_{act}=0.5~\text{s}$
, using binary symbols (
$m=2$
). Time series of pitch angles are downsampled at a resolution
$f$
of (a) 9, (b) 11 and (c) 12. The predicted values are superimposed with linear regression fits (red dashed line and blue dot-dashed line). Error bars represent standard errors.

To support the claim on the consistency of directionality, we present values of
$\text{TE}_{U\rightarrow D}$
and
$\text{TE}_{D\rightarrow U}$
for both experimental conditions for
$f=9$
, 11 and 12 in figure 8. With respect to the strength of the interaction, we find that
$\text{TE}_{U\rightarrow D}$
for Upstream Active and
$\text{TE}_{D\rightarrow U}$
for Downstream Active are negatively dependent on
$L/c$
(except for
$\text{TE}_{D\rightarrow U}$
for Downstream Active at
$f=12$
). Comparison between
$\text{TE}_{U\rightarrow D}$
in Upstream Active and
$\text{TE}_{D\rightarrow U}$
in Downstream Active confirms that information transferred is favoured by the fluid flow, whereby
$\text{TE}_{U\rightarrow D}$
in Upstream Active is significantly higher than
$\text{TE}_{D\rightarrow U}$
in Downstream Active for
$f=9,~L/c\leqslant 2$
;
$f=11,~L/c\leqslant 1$
; and
$f=12,~L/c\leqslant 1$
. Finally, the dependence of the delay
$T(\unicode[STIX]{x1D6FF}_{c})$
on
$L/c$
for
$f=9$
, 11 and 12 is examined through linear regression fits in figure 9. In Upstream Active, we confirm a marked dependence of the delay on the separation distance for all the tested values of
$f$
, while in Downstream Active, no significant dependence of
$T(\unicode[STIX]{x1D6FF}_{c})$
on
$L/c$
can be established except for
$f=9$
.
Next, we examine the effect of increasing the number of symbols in the representation of the time series, by studying the case
$m=3$
. By comparing the relative value of three consecutive angles, we obtain six distinct symbols. For example, one symbol refers to the case in which the angle consistently decreases from the first to the third frame and another one indicates the case in which the first angle is higher than the other two, but the third is larger than the second one. Encoding the symbols in the time series for upstream and downstream pitch angles, respectively, we compute transfer entropy via (2.5).
Similar to the analysis for binary symbols, we systematically downsample the time series of pitch angles at resolutions up to
$f=15$
and find stable predictions within the range
$5\leqslant f\leqslant 8$
. Overall, the parametric study demonstrates that, by using a symbolic representation of the time series of the pitch angle with six symbols rather than two, we attain equivalent conclusions, thereby offering further evidence for the reliability of our information-theoretic approach to study causality in fluid–structure interactions. The smaller resolutions (
$5\leqslant f\leqslant 8$
) needed for treating the case
$m=3$
compared to
$m=2$
(
$9\leqslant f\leqslant 12$
) could be attributed to two factors. First, increasing the number of symbols to six implies a drastic growth in the number of probabilities to be evaluated (216 for
$m=3$
versus 8 for
$m=2$
), calling for more data points to be employed to accurately estimate transfer entropy. Second, considering three adjacent frames helps mitigating the effect of measurement noise, thereby affording the treatment of faster acquisitions.
Effect of increasing the number of symbols to six (
$m=3$
) on
$\text{TE}_{U\rightarrow D}$
and
$\text{TE}_{D\rightarrow U}$
for the two experimental conditions with
$\unicode[STIX]{x0394}t_{act}=0.5~\text{s}$
, at five separation distances. Time series of pitch angles are downsampled at a resolution
$f$
of (a) 5, (b) 6, (c) 7 and (d) 8. Error bars represent standard errors, and an asterisk identifies significant difference between
$\text{TE}_{U\rightarrow D}$
and
$\text{TE}_{D\rightarrow U}$
from paired
$t$
-tests (adjusted
$p<0.05$
). From comparisons, we find that
$\text{TE}_{U\rightarrow D}>\text{TE}_{D\rightarrow U}$
for all but two Upstream Active combination and
$\text{TE}_{U\rightarrow D}<\text{TE}_{D\rightarrow U}$
for most of the combinations considered in Downstream Active.

Effect of increasing the number of symbols to six (
$m=3$
) on non-dimensional interaction time delay predicted through transfer entropy for Upstream Active and Downstream Active with
$\unicode[STIX]{x0394}t_{act}=0.5~\text{s}$
. Time series of pitch angles are downsampled at a resolution
$f$
of (a) 5, (b) 6, (c) 7 and (d) 8. The predicted values are superimposed with linear regression fits (red dashed line and blue dot-dashed line). Error bars represent standard errors.

In favour of the consistency in the prediction of the directionality of the causal relationship, we present the values of
$\text{TE}_{U\rightarrow D}$
and
$\text{TE}_{D\rightarrow U}$
for both experimental conditions in figure 10. Supporting the robustness of predicting the strength of the interaction, we find that
$\text{TE}_{U\rightarrow D}$
in Upstream Active and
$\text{TE}_{D\rightarrow U}$
in Downstream Active conditions are negatively dependent on
$L/c$
. Comparison between
$\text{TE}_{U\rightarrow D}$
in Upstream Active and
$\text{TE}_{D\rightarrow U}$
in Downstream Active supports the propagation of information through the fluid flow, albeit to a lesser extent than the case of binary symbols. Specifically, we find that values of
$\text{TE}_{U\rightarrow D}$
in Upstream Active are significantly higher than
$\text{TE}_{D\rightarrow U}$
in Downstream Active for
$f=6,~L/c\leqslant 0.5$
;
$f=7,~L/c=0.5$
; and
$f=8,~L/c\leqslant 0.5$
. The dependence of the delay
$T(\unicode[STIX]{x1D6FF}_{c})$
on
$L/c$
for
$5\leqslant f\leqslant 8$
is studied through linear regression fits in figure 11. For Upstream Active, we confirm a marked positive dependence of the delay on the separation distance for all
$f$
tested, and for condition Downstream Active, no significant dependence of
$T(\unicode[STIX]{x1D6FF}_{c})$
on
$L/c$
can be established for
$f=6$
and 7.
To demonstrate the robustness of transfer entropy predictions against variations of experimental parameters, we analyse independent trials with a larger time interval between actuation events, namely,
$\unicode[STIX]{x0394}t_{act}/T_{0}=0.6$
and
$1.2$
. We implement the analysis using binary symbols (
$m=2$
) and resolution
$f=10$
, based on the numerical set-up in §§ 5.1 and 5.2. The consistency of our predictions for different values of
$\unicode[STIX]{x0394}t_{act}$
offer compelling evidence in favour of our information-theoretic approach to study cause-and-effect relationships underlying fluid–structure interactions.
Effect of increasing the time interval between actuation events on transfer entropy and non-dimensional interaction delay for Upstream Active and Downstream Active: (a,b)
$\text{TE}_{U\rightarrow D}$
and
$\text{TE}_{D\rightarrow U}$
, and (c,d) non-dimensional interaction time delay for Upstream Active (a,c) and Downstream Active (b,d) computed from time-series data of airfoils actuated with
$\unicode[STIX]{x0394}t_{act}/T_{0}=0.6$
and 1.2,
$m=2$
and
$f=10$
. Error bars represent standard errors. Asterisk in (a,b) identifies significant difference between
$\text{TE}_{U\rightarrow D}$
and
$\text{TE}_{D\rightarrow U}$
from paired
$t$
-tests (adjusted
$p<0.05$
). For
$\unicode[STIX]{x0394}t_{act}/T_{0}=0.6$
and
$\unicode[STIX]{x0394}t_{act}/T_{0}=1.2$
, we find that
$\text{TE}_{U\rightarrow D}>\text{TE}_{D\rightarrow U}$
for Upstream Active for almost all combinations, and
$\text{TE}_{U\rightarrow D}<\text{TE}_{D\rightarrow U}$
for Downstream Active for
$\unicode[STIX]{x0394}t_{act}/T_{0}=0.6$
,
$L/c=0.2$
and 1. Time delays in (c,d) are superimposed with linear regression fits, with colour coding shown in the legend.

Results of the computation of transfer entropy and the interaction delay are synoptically presented in figure 12. Findings presented therein offer evidence in favour of the possibility to correctly determine causal relationships from experimental data with longer time intervals between actuation events. From the regression analysis, we find that
$\text{TE}_{U\rightarrow D}$
for Upstream Active and
$\text{TE}_{D\rightarrow U}$
for Downstream Active are negatively dependent on
$L/c$
, although we lose significance in the dependence of Downstream Active on
$\unicode[STIX]{x0394}t_{act}/T_{0}=1.2$
. The reason for the reduced statistical power at increased
$\unicode[STIX]{x0394}t_{act}/T_{0}$
may be sought in the smaller number of meaningful events that are now available for inferring causality from the time series. For
$\unicode[STIX]{x0394}t_{act}/T_{0}=1.2$
, on average, each time series will contain 25 % of the actuation events of the time series for
$\unicode[STIX]{x0394}t_{act}/T_{0}=0.3$
. In favour of the possibility to evidence information transfer through fluid flow, we find that values of
$\text{TE}_{U\rightarrow D}$
in Upstream Active are significantly higher than
$\text{TE}_{D\rightarrow U}$
in Downstream Active for both
$\unicode[STIX]{x0394}t_{act}/T_{0}=0.6$
and
$1.2$
(except for
$\unicode[STIX]{x0394}t_{act}/T_{0}=0.6$
,
$L/c=5$
, and
$\unicode[STIX]{x0394}t_{act}/T_{0}=1.2$
,
$L/c\geqslant 1$
). Finally, from the study of the dependence of the delay
$T(\unicode[STIX]{x1D6FF}_{c})$
on
$L/c$
, we observe a marked positive correlation between the delay and the separation distance in Upstream Active, while a dependence of
$T(\unicode[STIX]{x1D6FF}_{c})$
on
$L/c$
cannot be established in Downstream Active.
6 Conclusion
In this study, we have posited a model-free approach to infer causality in a fluid–structure interaction problem from raw experimental data. Our approach is grounded in the information-theoretic concept of transfer entropy, which offers a powerful lens to explore information transfer in dynamical systems. Given two stochastic processes, transfer entropy measures the extent to which predicting the future of one of the processes is enhanced from the knowledge of the other one. In this sense, this information-theoretic concept encapsulates salient dynamic information that could help in the quantification of a true causal link.
Toward a compelling demonstration of a transfer entropy approach to the study of fluid–structure interactions, we have focused on the archetypical problem of two tandem airfoils in a uniform flow. In a series of hypothesis-driven experiments, we have systematically varied the geometric configuration and actuation condition of the tandem airfoils, along with the computational set-up for evaluating transfer entropy. We demonstrated the possibility of predicting the directionality, extent and time scale of interactions from raw time series. Through an extensive robustness study, we determined the consistency of transfer entropy predictions with respect to the downsampling resolution of the time series, the number of symbols used for encoding the pitching dynamics of the airfoils, and the frequency of actuation of the airfoils.
In general, the idea of identifying causality from transfer entropy requires some caution (Lizier & Prokopenko Reference Lizier and Prokopenko2010). ‘Predictive information transfer’, underlying Wiener’s causality principle and inferred from transfer entropy, may differ from ‘causal information flow’, which demands a direct manipulation of the experiment to assess whether a source variable will drive a destination variable. Through our controllable experimental framework, we demonstrate a profound relationship between predictive information transfer and causal information flow in hydrodynamic interactions between pitching airfoils. As the source and destination variables change in the experiment, our results reveal a concurrent, robust change in the landscape of transfer entropy.
Encouraged by these findings, future work aims at inferring causal structures underlying fish schooling. We will seek to quantify the extent of hydrodynamic interactions among fish in a school using time series of fish tail beat angles in transfer entropy analysis. We believe that the proposed model-free approach holds promise in revealing the role of hydrodynamics during the transition between a diamond and a phalanx school pattern.
In addition, we will aim to demonstrate the utility of transfer entropy for direct assessment of causality between a fluid flow and a solid structure. Transfer entropy computation using a direct measurement of a fluid feature, such as a velocity time trace, and motion of a structure may help assess the directionality and magnitude of the interaction. The introduction of transfer entropy in the study of fluid–structure interaction problems may benefit research in the broader context of fluid mechanics, such as the investigation of air flow–vocal folds interactions (Mittal, Erath & Plesniak Reference Mittal, Erath and Plesniak2013) and blade–vortex interactions (Rockwell Reference Rockwell1998), where data-driven approaches have rarely been explored.
Acknowledgements
This work was supported by the National Science Foundation under grant numbers CBET-1332204 and CMMI-1433670 and by New York University Summer Research programme. The authors would like to thank A. Gementzopoulos for his help during the experiments and Dr S. Nakayama for useful feedback about the statistical design.
Supplementary materials
Supplementary materials are available at https://doi.org/10.1017/jfm.2018.369.












