1. Introduction
The object of study in the Gibbs formulation of statistical mechanics is an ensemble of systems, and the Gibbs entropy is a functional of the ensemble probability density function. Equilibrium is defined as the state where the probability density function is a time-independent solution of Liouville's equation. The development of this approach has been very successful, but its extension to nonequilibrium presents contentious problems.Footnote 1
To implement the Boltzmann approach (Lebowitz Reference Lebowitz1993; Bricmont Reference Bricmont1995; Goldstein Reference Goldstein, Bricmont, Dürr, Galvotti, Ghirardi, Petruccione and Zanghi2001) the phase space is divided into a set of macrostates. The Boltzmann entropy at a particular point in phase space is a measure of the volume of the macrostate in which the phase point is situated. The system is understood to be in equilibrium when the phase point is in a particular region of phase space. The entropy and equilibrium are thus properties of a single system.
The purpose of this article is to attempt to produce a synthesis of the Gibbs and Boltzmann approaches, which validates the Gibbs approach, as currently used in ‘equilibrium’ statistical mechanics and solid state physics, while at the same time endorsing the Boltzmann picture of the time evolution of entropy, including ‘the approach to equilibrium’. In order to do this we need to resolve in some way three questions, to which the current versions of the Gibbs and Boltzmann approaches offer apparently irreconcilable answers: (a) What is meant by equilibrium? (b) What is statistical mechanical entropy? and (c) What is the object of study? The attempt to produce conciliatory answers to a and b will occupy most of this article. However, we shall at the outset deal with c. As indicated above, ensembles are an intrinsic feature of the Gibbs approach (see, e.g., Prigogine Reference Prigogine1994, 8). However we follow the Neo-Boltzmannian view of Lebowitz (Reference Lebowitz1993, 38) that we “neither have nor do we need ensembles.” The object of study in statistical mechanics is a single system and all talk of ensembles can be understood as just a way of giving a relative frequency flavor to the probabilities of events occurring in that system.
We now describe briefly the dynamics and thermodynamics of the system together with the statistical approach of Gibbs. The Boltzmann approach is described in greater detail in Section 2.
At the microscopic (dynamic) level, the system (taken to consist of N microsystems) is supposed to have a one-to-one autonomous dynamics
$\boldsymbol{x}\rightarrow \phi _{t}\boldsymbol{x}$, on its phase space
$\Gamma _{N}$. The system is reversible, meaning that there exists a self-inverse operator
$\mathstrut{{\mbox{\boldmath$\cal J$}}} $ on
$\boldsymbol{x}\in \Gamma _{N}$, such that
$\phi _{t}\boldsymbol{x}=\boldsymbol{x}^{\prime }\rightarrow \phi _{t}\mathstrut{{\mbox{\boldmath$\cal J$}}} \boldsymbol{x}^{\prime }=\mathstrut{{\mbox{\boldmath$\cal J$}}} \boldsymbol{x}$. Then
$\phi _{-t}=( \phi _{t}) ^{-1}=\mathstrut{{\mbox{\boldmath$\cal J$}}} \phi _{t}\mathstrut{{\mbox{\boldmath$\cal J$}}} $. On the subsets of
$\Gamma _{N}$ there is a sigma-additive measure
$\mathsf{m}$, such that (a)
$\mathsf{m}( \Gamma _{N}) $ is finite, (b)
$\mathsf{m}$ is absolutely continuous with respect to the Lebesque measure on
$\Gamma _{N}$, and (c)
$\mathsf{m}$ is preserved by
$\{ \phi _{t}\} $; that is
$\mathsf{m}( \phi _{t}\gamma ) =\mathsf{m}( \gamma ) $,
$\forall \:\: t$ and measurable
$\gamma \subset \Gamma _{N}$. This means that there will be no convergence to an attractor (which could in the dynamic sense be taken as an equilibrium state).
At the phenomenological (thermodynamic) level, equilibrium is a state in which there is no perceptible change in macroscopic properties. It is such that a system (a) either is or is not in equilibrium (a binary property), (b) never evolves out of equilibrium, and (c) when not in equilibrium evolves toward it.
At the statistical level (in the Gibbs approach), the phase point
$\boldsymbol{x}\in \Gamma _{N}$ is distributed according to a probability density function
$\rho ( \boldsymbol{x};\: t) $ invariant under
$\{ \phi _{t}\} $, meaning that it is a solution of Liouville's equation. At equilibrium the Gibbs entropy is the functional

of a time-independent probability density function. Problems arise when an attempt is made to extend the use of (1) to nonequilibrium situations, which are now perceived as being those where
$\rho $ is time dependent.
2. The Macroscopic Level–Boltzmann Approach
Here we must introduce a set
$\Xi $ of macroscopic variables at the observational level that give more detail than the thermodynamic variables, and a set of macrostates
$\{ \mu \} $ defined so that: (i) every
$\boldsymbol{x}\in \Gamma _{N}$ is in exactly one macrostate denoted by
$\mu _{\boldsymbol{x}}$, (ii) each macrostate corresponds to a unique set of values for
$\Xi $, (iii)
$\mu _{\boldsymbol{x}}$ is invariant under all permutations of the microsystems, and (iv) the phase points
$\boldsymbol{x}$ and
$\mathstrut{{\mbox{\boldmath$\cal J$}}} \boldsymbol{x}$ are in macrostates of the same size.Footnote 2 The Boltzmann entropy, which is a function on the macrostates, and consequently also a function on the phase points in
$\Gamma _{N}$, is
This is, of course, an extensive variable, and the quantity of interest is the dimensionless entropy per microsystem
$s_{\mathrm{B}\,}\mathrel{\mathop:}= S_{\mathrm{B}\,}/ ( Nk_{\mathrm{B}\,}) $, which for the sake of brevity we shall refer to as the Boltzmann entropy. Along a trajectory
$s_{\mathrm{B}\,}$ will not be a monotonically increasing function of time. Rather we should like it to exhibit thermodynamic-like behavior, defined in an informal (preliminary) way as follows:
Definition (TL1): The evolution of the system will be thermodynamic-like if
$s_{\mathrm{B}\,}$ spends most of the time close to its maximum value, from which it exhibits frequent small fluctuations and rarer large fluctuations.
This leads to two problems which we discuss in Sections 2.1 and 2.2.
2.1. How Do We Define Equilibrium?
Is it possible to designate a part of
$\Gamma _{N}$ as the equilibrium state? On the grounds of the system's reversibility and recurrence we can, of course, discount the possibility that such a region is one which, once entered by the evolving phase point, will not be exited. As was well understood by both Maxwell and Boltzmann, equilibrium must be a state which admits the possibility of fluctuations out of equilibrium. Lebowitz (Reference Lebowitz1993, 34) and Goldstein (Reference Goldstein, Bricmont, Dürr, Galvotti, Ghirardi, Petruccione and Zanghi2001, 8) refer to a particular macrostate as the equilibrium macrostate, and the remark by Bricmont (Reference Bricmont1995, 179), that “by far the largest volumes [of phase space] correspond to the equilibrium values of the macroscopic variables (and this is how ‘equilibrium’ should be defined)” is in a similar vein. So is there a single equilibrium macrostate? If so it must be that in which the phase point spends more time than in any other macrostate and, if the system were ergodic, it would be the largest macrostate
$\mu _{\mathrm{Max}\,}$ (see Sec. 2.2), with largest Boltzmann entropy. There is one immediate problem associated with this. Suppose we consider the set of entropy levels
$\{ s_{\mathrm{B}\,}( \mu ) \} $,
$\forall \:\mu \subset \Gamma _{N}$. Then, as has been shown by Lavis (Reference Lavis2005) for the baker's gas, associated with these levels there may be degeneracies
$\omega ( \mu ) $, such that, for some
$\mu $ with
$\mathsf{m}( \mu ) < \,\mathsf{m}( \mu _{\mathrm{Max}\,}) $,
$\mathsf{m}( \mu ) \omega ( \mu ) > \,\mathsf{m}( \mu _{\mathrm{Max}\,}) $. The effect of this is that the entropy will be likely, in the course of evolution, to spend more time in a level less than the maximum (see Lavis Reference Lavis2005, Figs. 4 and 5).
Another example, which has been used to discuss the evolution of Boltzmann's entropy (see Bricmont Reference Bricmont1995, App. 1) and which we shall use as an illustrative example in this article, is the Kac ring model (Kac Reference Kac1959, 99).Footnote 3 Macrostates in this model can be indexed
$k=0,\: 1,\:\ldots \: ,\:( 1/ 2) N$, where
$\mu _{k}$ is the macrostate with
$( 1/ 2) N+k$ up spins and
$( 1/ 2) N-k$ down spins, giving
Then, of course,
$\mu _{\mathrm{Max}\,}=\mu _{0}$ with
$\mathsf{m}( \mu _{k}) $ monotonically decreasing with increasing
$\vert k\vert $. But although the maximum macrostate is unique,
$\omega ( \mu _{k}) =2$,
$\forall \: k\neq 0$ and the entropy level corresponding to the largest volume of
$\Gamma _{N}$ is given, for
$N> 2$, by the macrostate pair
$\mu _{\pm 1}$. It may be supposed that this question of degeneracy is an artifact of relevance only for small
$N$. It is certainly the case, both for the baker's gas and Kac ring, that, if
$\mu ^{\prime }$ is a macrostate which maximizes
$\mathsf{m}( \mu ^{\prime }) \omega ( \mu ^{\prime }) $, although
$\mathsf{m}( \mu ^{\prime }) \omega ( \mu ^{\prime }) \nrightarrow \,\mathsf{m}( \mu _{\mathrm{Max}\,}) $,
$s_{\mathrm{B}\,}( \mu ^{\prime }) \rightarrow s_{\mathrm{B}\,}( \mu _{\mathrm{Max}\,}) $, as
$N\rightarrow \infty $. So, maybe the union of
$\mu _{\mathrm{Max}\,}$ and all the equally sized macrostates with measure
$\mathsf{m}( \mu ^{\prime }) $ can be used as the equilibrium state. To test this possibility take the Kac ring and consider the partial sum
where
$\mathstrut{\cal B} ( N,\: k) $ is the union of all
$\mu _{j}$ with
$j\in [ -k,\: k] $. Then it is not difficult to show that, for fixed
$k$,
The proportion of
$\Gamma _{N}$ contained within the band of macrostates
$\mathstrut{\cal B} ( N,\: k) $ decreases with
$N$.Footnote 4 If we want the equilibrium region to satisfy the property described in the quotation given above from Bricmont (Reference Bricmont1995), then this cannot be done by designating a band of a fixed number of macrostates in this way. To ensure that as
$N$ becomes large “by far the largest volumes [of phase space] correspond to the equilibrium values of the macroscopic variables” we need to choose a value of
$k$ increasing with
$N$. Thus for example to create an ‘equilibrium band of macrostates’ containing 99.999% of
$\Gamma _{N}$ we must choose
$k=22$, for
$N=100$;
$k=70$, for
$N=1,000$; and
$k=221$ for
$N=10,000$. An entropy profile for this last case is shown in Figure 1. The putative equilibrium state, representing 99.999% of
$\Gamma _{10,000}$ is given by the region bounded by the horizontal lines in the figure. If the system were ergodic (like the baker's gas) we would expect the system to spend almost all of the 10,000 time steps in this region, whereas in this particular simulation only 4,658 steps satisfied this condition. This is to be expected as the Kac ring is not ergodic but has an ergodic decomposition into cycles of which this figure represents half a cycle.Footnote 5 The proportion of ‘equilibrium states’ will differ between cycles. So the problems with defining an equilibrium region are:
(i) Just choosing the largest macrostate as the equilibrium region does not guarantee that this region becomes an increasing proportion of phase space as
$N$ increases. In fact the reverse is the case for the Kac ring.(ii) Any choice of a collection of macrostates to represent equilibrium is:
(a) Arbitrary: leading to an arbitrary division between fluctuations within and out of equilibrium, as is shown in the profile in Figure 1.
(b) Difficult: as we have shown in the Kac ring. Except for ergodic systems there is no clear way to make a choice which guarantees that the system will spend most of its time in equilibrium. The choice of a region consisting of 99.999% of phase space still yields an evolution where only about 47% of the points on the trajectory lie within it.
Half a cycle of the plot of
$s_{\mathrm{B}\,}$ against time, for a Kac ring of 10,000 spins. There are
$m=509$ spin-flippers, distributed randomly around the ring, and the evolution is initiated in the low-entropy state
$k=4,993$. The upper and lower horizontal lines correspond, respectively, to
$s_{\mathrm{B}\,}( \mu _{\mathrm{Max}\,}) =0\mathrm{.}\,69266408$ and
$s_{\mathrm{B}\,}( \mu _{221}) =0\mathrm{.}\,69168704$.

But why define equilibrium in this binary way? We suggest that the quality which we are trying to capture is a matter of degree, rather than the two-valued property of either being in equilibrium or not in equilibrium. We, therefore, make the following proposal:
Definition (C): All references to a system being, or not being, in equilibrium should be replaced by references to the commonness of the state of the system, with this property being measured by (some possibly-scaled form of) the Boltzmann entropy.
2.2. We Need Thermodynamic-Like Behavior to Be Typical
By this we mean that most initial states of the system should lead to thermodynamic-like behavior. Before discussing the dynamic properties needed for this, we shall refer briefly to the more limited notion of typicality employed by the Neo-Boltzmannians and contained in the assertion (Lebowitz Reference Lebowitz1999, S348) “that
$S_{\mathrm{B}\,}$ will typically be increasing in a way which explains and describes qualitatively the evolution towards equilibrium of macroscopic systems.” The conditions for this to be the case were first discussed by Ehrenfest and Ehrenfest-Afanassjewa (Reference Ehrenfest and Ehrenfest-Afanassjewa1992, 32–34).
Consider a macrostate
$\mu $ divided into four parts
$\mu ^{( --) }$,
$\mu ^{( -+) }$,
$\mu ^{( +-) }$,
$\mu ^{( ++) }$, where
$\mu ^{( -+) }$ consists of those points in
$\mu $ which have evolved from a smaller macrostate and which evolve into a larger macrostate, with the other parts defined in a similar way.Footnote 6 On grounds of symmetry, if
$\boldsymbol{x}$ and
$\mathstrut{{\mbox{\boldmath$\cal J$}}} \boldsymbol{x}$ are both in
$\mu $, then
$\mathsf{m}( \mu ^{( -+) }) =\mathsf{m}( \mu ^{( +-) }) $; otherwise the macrostates will be in reversal pairs with plus and minus signs interchanged. In order for forward evolution to a larger macrostate to be typical it must be the case that the overwhelmingly largest part of
$\mu $ is
$\mu ^{( ++) }$. This was asserted without proof by Ehrenfest and Ehrenfest-Afanassjewa (Reference Ehrenfest and Ehrenfest-Afanassjewa1992). More recent arguments have been advanced from the point of view that a macrostate is more likely to be surrounded by larger macrostates or that it is easier to ‘aim at’ a larger, rather than a smaller, neighboring macrostate. Even accepting this argument, it can at the most explain how, if the state of a system is assigned randomly to a point in a macrostate, then the subsequent first transition is to a larger macrostate. As was pointed out by Lavis (Reference Lavis2005), it gives no explanation for the entropy direction at the next transition, since the part of the macrostate occupied after the first transition will be determined by the dynamics. In any case, I wish to argue that this is a too narrowly defined version of typicality, which should be applied to thermodynamic-like behavior over the whole evolution.
I have already argued in Section 2.1 that commonness or ‘equilibriumness’ is a matter of degree, and it is clear that thermodynamic-like behavior is also a matter of degree, for which we need to propose a measure. A difference between these properties is that commonness is something which can be assessed at an instant of time, whereas thermodynamic-like behavior is a temporally global property assessed over the whole trajectory.
Let
$\mathstrut{\cal L} _{\boldsymbol{x}}$ be a trajectory in
$\Gamma _{N}$ identified (uniquely) by the property that it passes through the point
$\boldsymbol{x}$ and let
$\mathsf{T}_{\boldsymbol{x}}( \gamma ) $ be the proportion of time which the phase point evolving along
$\mathstrut{\cal L} _{\boldsymbol{x}}$ spends in the some
$\gamma \subset \Gamma _{N}$.Footnote 7 Definition TL1 is an informal qualitative definition of thermodynamic-like behavior, for which we need the entropy profile of
$s_{\mathrm{B}\,}$, not only to be quite close to
$( s_{\mathrm{B}\,}) _{\mathrm{Max}\,}\mathrel{\mathop:}= s_{\mathrm{B}\,}( \mu _{\mathrm{Max}\,}) $ for most of its evolution but also for fluctuations around this value to be fairly small. We, therefore, propose the following definition:
Definition (TL2): The degree to which the evolution of the system is thermodynamic-like along
$\mathstrut{\cal L} _{\boldsymbol{x}}$ is measured by the extent to which
and
are small, where
is the time average of
$s_{\mathrm{B}\,}$ along
$\mathstrut{\cal L} _{\boldsymbol{x}}$ and
$\Psi _{\boldsymbol{x}}[ s_{\mathrm{B}\,}] $ is the standard deviation with respect to the time distribution.
Of course, it could be regarded as unsatisfactory that two parameters are used as a measure of the degree of a property and it is a matter of judgment which is more important. For the Kac ring of 10,000 spins with the entropy profile shown in Figure 1,
and, as a comparison, for the same ring with the flippers placed at every tenth site
It is clear (and unsurprising) that the random distribution of spin flippers leads to more thermodynamic-like behavior.
To explore the consequences of TL2 we distinguish between four aspects of a system:
(i) The number of microsystems
$N$ and their degrees of freedom, together giving the phase space
$\Gamma _{N}$, with points representing microstates.(ii) The measure
$\mathsf{m}$ on
$\Gamma _{N}$.(iii) The mode of division of
$\Gamma _{N}$ into the set
$\{ \mu \} $ of macrostates.(iv) The
$\mathsf{m}$-measure preserving dynamics of the system.
Having chosen i and ii, the choices for iii and then iv are not unique. In the case of the baker's gas (Lavis Reference Lavis2005),
$\Gamma _{N}$ is a
$2N$-dimensional unit hypercube with volume measure. Macrostates are specified by partitioning each square face of the hypercube. With such a setup it would now be possible to choose all manner of discrete-time dynamics.Footnote 8
Whether a system is ergodic will be determined by i, ii, and iv and, if it is,
is both the proportion of
$\Gamma _{N}$ in
$\gamma $ and of the time spent in
$\gamma $, f.a.a.
$\mathstrut{\cal L} _{\boldsymbol{x}}\in \Gamma _{N}$. This will be the case for the baker's gas but not the Kac ring. For any specification of i–iii we denote the results of computing
$\langle s_{\mathrm{B}\,}\rangle _{\boldsymbol{x}}$,
$\Delta _{\boldsymbol{x}}[ s_{\mathrm{B}\,}] $, and
$\Psi _{\boldsymbol{x}}[ s_{\mathrm{B}\,}] $ using (11) by
$\langle s_{\mathrm{B}\,}\rangle $,
$\Delta [ s_{\mathrm{B}\,}] $, and
$\Psi [ s_{\mathrm{B}\,}] $; that is to say, we omit the unnecessary trajectory-identifying subscript
$\boldsymbol{x}$. If we were able to devise a model with i–iii the same as the
$N=10,000$ Kac ring, but with an ergodic dynamics, we would have
and it is not difficult to show that
$\Delta [ s_{\mathrm{B}\,}] $ and
$\Psi [ s_{\mathrm{B}\,}] $ are monotonically decreasing functions of
$N$. Ergodicity leads to more thermodynamic-like behavior, which becomes increasingly thermodynamic-like with increasing
$N$.Footnote 9 This behavior is also typical, since it occurs f.a.a.
$\mathstrut{\cal L} _{\boldsymbol{x}}\in \Gamma _{N}$.
Of course, the results (12) are not simply dependent on the putative ergodic dynamics of the system, but also on the way that the macrostates have been defined. If the time average of
$s_{\mathrm{B}\,}( \boldsymbol{x}) $ is to be close to
$( s_{\mathrm{B}\,}) _{\mathrm{Max}\,}$ and if the fluctuations in
$s_{\mathrm{B}\,}( \boldsymbol{x}) $ are to be small, then most of
$\Gamma _{N}$ must lie in macrostates with
$s_{\mathrm{B}\,}( \mu ) $ close to
$( s_{\mathrm{B}\,}) _{\mathrm{Max}\,}$. In the case of the Kac ring, with
$N=10,000$, 99.98% of
$\Gamma _{10000}$ lies in macrostates with
$s_{\mathrm{B}\,}( \mu ) > 0.999( s_{\mathrm{B}\,}) _{\mathrm{Max}\,}$. However, of course, the Kac ring, although not ergodic, gives every appearance, at least in the instances investigated (see Fig. 1), of behaving in a thermodynamic-like manner. Although ergodicity, with a suitable macrostate structure, is sufficient for thermodynamic-like behavior, it is clearly not necessary.
Consider the case where
$\Gamma _{N}$ can be ergodically decomposed; meaning that
where
$\Gamma _{\alpha }$ is invariant and indecomposable under
$\{ \phi _{t}\} $. Then the time spent in
$\gamma \subset \Gamma _{N}$ is
and we, henceforth, identify a time average along a trajectory in
$\Gamma _{\alpha }$ using
$\langle \cdots \rangle _{\alpha }$ with
$\alpha $ also replacing the subscript
$\boldsymbol{x}$ in (6) and (7). In the case of the Kac ring the index
$\alpha $ labels the cycles which form the ergodic decomposition of
$\Gamma _{N}$. For a particular cycle, such as that shown in Figure 1,
$\mathsf{T}_{\alpha }( \mu ) $ is obtained simply by counting the number of times the phase point visits each macrostate in a complete cycle. The data are then used to compute the results given in (9). A plot of
$\mathsf{T}_{\alpha }( \mu _{k}) $ against the microstate index
$k$ is shown in Figure 2 with a comparison made with
$\tau ( \mu _{k}) $, the corresponding curve for a system with ergodic dynamics. This gives a graphic illustration of the suggestion that ergodic systems, with a suitable choice of macrostates, are likely to be more thermodynamic-like in their behavior than nonergodic systems. It might also be speculated that
$\varepsilon $–ergodic systems (Vranas Reference Vranas1998) show increasingly thermodynamic-like behavior with decreasing
$\varepsilon $.
Plot of
$\mathsf{T}_{\alpha }( \mu _{k}) $ for the cycle
$\alpha $ of the Kac ring shown in Figure 1 together with the corresponding curve of
$\tau ( \mu _{k}) $ for a system with ergodic dynamics.

Another advantage of an ergodic system is that, f.a.a.
$\mathstrut{\cal L} _{\mathbf{x}}\in \Gamma _{N}$, the level of thermodynamic-like behavior will be the same. This contrasts with an ergodic decomposition characterized by (13), where it is possible for differing levels of thermodynamic-like behavior to be exhibited within different members of the decomposition. To be precise, take small positive
$\varepsilon _{\Delta }$ and
$\varepsilon _{\Psi }$ and regard behavior along a trajectory as thermodynamic-like if and only if both
$\Delta _{\alpha }[ s_{\mathrm{B}\,}] < \varepsilon _{\Delta }$ and
$\Psi _{\alpha }[ s_{\mathrm{B}\,}] < \varepsilon _{\Psi }$. Let
$\Gamma ^{( \mathrm{T}\,) }_{N}$ be the union of all
$\Gamma _{\alpha }$ in which the behavior is thermodynamic-like with
$\Gamma ^{( \mathrm{A}\,) }_{N}=\Gamma _{N}\backslash \Gamma ^{( \mathrm{T}\,) }_{N}$.
In the discussion of the Boltzmann approach, reference to probabilities has so far been avoided. To complete the discussion in this section and to relate the arguments to the Gibbs approach we shall need (see Lavis Reference Lavis2005) to introduce two sets of probabilities for a system with the ergodic decomposition (13). The first of these is
$\mathsf{p}_{\alpha }\mathrel{\mathop:}= \mathrm{Pr}\,( \boldsymbol{x}\in \Lambda _{\alpha }) ,\quad\forall \:\Gamma _{\alpha }$. Then thermodynamic-like behavior will be typical for the system if
Thus we have two levels of degree, the first represented by the choices of
$\varepsilon _{\Delta }$ and
$\varepsilon _{\Psi }$ and the second concerning the extent to which (15) is satisfied.
3. Reconciling Gibbs and Boltzmann
As we saw in Section 1, the Gibbs approach depends on defining a probability density function
$\rho ( \boldsymbol{x}) $ on
$\Gamma _{N}$, for a system ‘at equilibrium’. Thus we must address more directly the question of probabilities. Assuming the ergodic decomposition (13), we take the time-average definition of von Plato (Reference von Plato, Fenstad, Frolov and Hilpinen1989), for which
where
$\mathsf{T}_{\alpha }( \gamma ) $ is given by (14). Thus the probability density function for
$\Gamma _{\alpha }$ is
from which we have
If we assume that all points of
$\Gamma _{N}$ are equally likely, then on Bayesian/Laplacean grounds, and consonant with the approach of Bricmont (Reference Bricmont, Bricmont, Dürr, Galvotti, Ghirardi, Petruccione and Zanghi2001), we should choose
giving, from (18),
$\rho ( \boldsymbol{x}) =1/ \mathsf{m}( \Gamma _{N}) $, which is the microcanonical distribution and for which, from (1),
It also follows, from (2), (8), (11), and (19) that
Lavis (Reference Lavis2005) has proposed a general scheme for relating a phase function
$f$, defined on
$\boldsymbol{x}\in \Gamma _{N}$ to a macro-function
$\mathstrut{\cal F} $ defined on the macrostates
$\{ \mu \} $ and then to a thermodynamic function
$F$. The first step is to course grain
$f( \boldsymbol{x}) $ over the macrostates to produce
$\mathstrut{\cal F} ( \mu ) $.Footnote 10 The second step is to define the thermodynamic variable
$F$ along the trajectory
$\mathstrut{\cal L} _{\boldsymbol{x}}$ as
$\langle \mathstrut{\cal F} \rangle _{\boldsymbol{x}}$. In the case of the Boltzmann entropy, which is both a phase function and a macro-function, the first step in this procedure is unnecessary since it already, by definition, course grained over the macrostates. Then we proceed to identify the dimensionless thermodynamic entropy per microsystem with
$\langle s_{\mathrm{B}\,}\rangle _{\boldsymbol{x}}$. In the case of a system with an ergodic decomposition this definition would yield a different thermodynamic entropy
$s_{\alpha }$ for each member of the decomposition, with, from (6),
In the case where the behavior is thermodynamic-like in
$\Gamma _{\alpha }$,
$s_{\alpha }$ differs from
$( s_{\mathrm{B}\,}) _{\mathrm{Max}\,}$ by at most some small
$\varepsilon _{\Delta }$ and, if (15) holds, this will be the case for measurements along most trajectories. In the case of the Kac ring with
$N=10,000$ and the trajectory investigated for Figures 1 and 2 the actual difference is given in (9), a value which is likely to decrease with increasing
$N$.
It is often said that in “equilibrium [the Gibbs entropy] agrees with Boltzmann and Clausius entropies (up to terms that are negligible when the number of particles is large) and everything is fine” (Bricmont Reference Bricmont1995, 188). Interpreted within the present context this means that the good approximation
$s_{\mathrm{B}\,}( \mu _{\mathrm{Max}\,}) $, for the entropy per microsystem of a system for which thermodynamic-like behavior is typical, can be replace by
$s_{\mathrm{G}\,}=s_{\mathrm{B}\,}( \Gamma _{N}) $. The advantage of this substitution is obvious, since the first expression is dependent on the division into macrostates and second is not. However, a little care is needed in justifying this substitution. It is not valid because, as asserted in the quotation from Bricmont (Reference Bricmont, Bricmont, Dürr, Galvotti, Ghirardi, Petruccione and Zanghi2001, 3),
$\mu _{\mathrm{Max}\,}$ occupies an increasing proportion of
$\Gamma _{N}$ as
$N$ increases. Indeed, we have shown for the Kac ring that the reverse is the case. That proportion becomes vanishingly small as
$N$ increases. However, the required substitution can still be made, since for that model
Although it may seem that the incorrect intuition on the part of Bricmont (Reference Bricmont, Bricmont, Dürr, Galvotti, Ghirardi, Petruccione and Zanghi2001) concerning the growth in the relative size of the largest macrostate, leading as it does to the correct conclusion with respect to entropy, is easily modified and of no importance, we have shown in Section 2.1 that it has profound consequences for the attempt to define equilibrium in the Boltzmann approach.
It should be emphasized that the Gibbs entropy (20) is no longer taken as that of some (we would argue) nonexistent equilibrium state, but as an approximation to the true thermodynamic entropy which is the time average over macrostates of the Boltzmann entropy. The use of a time-independent probability density function for the Gibbs entropy is not because the system is at equilibrium but because the underlying dynamics is autonomous.Footnote 11 The thermodynamic entropy approximated by the Gibbs entropy (20) remains constant if the phase space remains unchanged but changes discontinuously if a change in external constraints leads to a change in
$\Gamma _{N}$. An example of this, for a perfect gas in a box when a partition is removed, is considered by Lavis (Reference Lavis2005), who shows that the Boltzmann entropy follows closely the step change in the Gibbs entropy.
4. Conclusion
In our program for reconciling the Boltzmann and Gibbs approaches to statistical mechanics we have made use both of ergodicity and ergodic decomposition, and there is deep (and justified) suspicion of the use of ergodic arguments, particularly among philosophers of physics. Earman and Rédei (Reference Earman and Rédei1996, 75) argue that “ergodic theory in its traditional form is unlikely to play more than a cameo role in whatever the final explanation of the success of equilibrium statistical mechanics turns out to be.” In its ‘traditional form’ the ergodic argument goes something like this: (a) Measurement processes on thermodynamic systems take a long time compared to the time for microscopic processes in the system and thus can be effectively regarded as infinite time averages. (b) In an ergodic system the infinite time average can be shown, for all but a set of measure zero, to be equal to the macrostate average with respect to an invariant normalized measure which is unique.Footnote 12 The traditional objections to this argument are also well known: (i) Measurements may be regarded as time averages, but they are not infinite time averages. If they were one could not, by measurement, investigate a system not in equilibrium. In fact, traditional ergodic theory does not distinguish between systems in equilibrium and not in equilibrium. (ii) Ergodic results are all to within sets of measure zero and one cannot equate such sets with events with zero probability of occurrence. (iii) Rather few systems have been shown to be ergodic. So one must look for a reason for the success of equilibrium statistical mechanics for nonergodic systems and when it is found it will make the ergodicity of ergodic systems irrelevant as well.
This use of ergodicity differs substantially from that described above, and it thus escapes wholly or partly the strictures applied to it. In respect of the question of equilibrium/nonequilibrium I argue that the reason this does not arise in ergodic arguments is that equilibrium does not exist. The phase point of the system, in its passage along a trajectory, passes through common (high entropy) and uncommon (low entropy) macrostates and that is all. So we cannot be charged with ‘blurring out’ the period when the system was not in equilibrium. The charge against ergodic arguments related to sets of measure zero is applicable only if one wants to argue that the procedure always works; that is that non-thermodynamic-like behavior never occurs. But we have, in this respect, taken a Boltzmann view. We need thermodynamic-like behavior to be typical, and I have proposed conditions for this to be the case. But I admit the possibility of atypical behavior occurring with small but not-vanishing probability. While the class of systems admitting a finite or denumerable ergodic decomposition is likely to be much larger than that of the purely ergodic systems, there remains the difficult question of determining general conditions under which the temporal behavior along a trajectory, measured in terms of visiting times in macrostates, approximates, in most members of the ergodic decomposition, to thermodynamic-like behavior.









