1. Introduction
According to Bayesianism, scientific inference is governed by the rule of conditionalization, which says that upon learning a piece of evidence e one should update one’s credence in a hypothesis h by replacing one’s initial probability for h C(h) with its posterior probability C(h/e). According to explanationism—another popular theory of scientific inference—the central principle governing scientific inference is inference to the best explanation (IBE). In its probabilistic version, IBE says that upon learning e one should assign substantially greater degrees of confidence to those hypotheses that best explain e, that is, those hypotheses that optimally combine explanatory virtues (simplicity, precision, fruitfulness, etc.).
At least on the surface, these two accounts of scientific inference look different. Since they are both plausible in their own right, it would be desirable to show that they are mutually compatible, that is, that the explanatory virtues that bear on hypothesis confirmation according to explanationism should also influence the credence assignments of rational Bayesian agents. This article contributes to this project by offering a compatibilist account of the explanatory virtue of unification. Considerations of explanatory unification figure prominently in many central episodes of scientific history: for instance, Copernicanism’s ability to unify various celestial phenomena treated as independent by Ptolemaism played a major role in the acceptance of the heliocentric model by the scientific community. And the principle that when choosing between competing explanatory hypotheses, we should, ceteris paribus, pick those hypotheses that explain the data in a unifying way rather than those that do not is arguably one of the few substantive inferential rules common to all domains of scientific inquiry (Janssen Reference Janssen2002). Thus the task of finding a place for considerations of explanatory unification within the Bayesian framework is a particularly important aspect of the compatibilist project.
Following Janssen (Reference Janssen2002), I take the defining feature of explanatory unification to be this: a hypothesis explains a range of phenomena in a unifying way when it traces them back to a ‘common origin’, that is, a common explanatory basis.Footnote 1 To illustrate, suppose that Jones has both pleuritis and a malar rash.Footnote 2 One unifying explanation of these data is that Jones has lupus, a common cause of both symptoms. By contrast, the hypothesis that Jones’s pleuritis was caused by the flu while his rash was caused by some other, independent disease (Bloom’s syndrome, say) also provides an explanation of both symptoms, but not one that unifies them: instead, the hypothesis is merely the conjunction of two separate explanations, one for each symptom. In this example, the common origin posited by the unifying hypothesis is a common cause. In other cases, the postulated common origin may instead be some mechanism, law, or theoretical principle that we may hesitate to call a ‘cause’ but nevertheless constitutes a common explanatory basis for the data. For instance, Darwinism unifies various phenomena such as atrophied organs, fossils, and homologies by explaining each of them as a consequence of the same biological mechanism, namely, that of evolution by natural selection.
A distinctive feature of unifying explanations is that they reveal the co-occurrence of their explananda to be no coincidence and thereby contribute to our sense of the world as an understandable and coherent place. In that respect, such explanations are especially ‘lovely’, which explains why unification figures prominently on the explanationist’s list of considerations that bear on hypothesis confirmation. Yet it is worth pointing out explicitly that no reasonable explanationist would regard unifying explanations as always more plausible than nonunifying ones. Other explanatory considerations also come into play when evaluating the credibility of an explanatory hypothesis, so that a nonunifying explanation may well be overall more credible than a unifying one. For instance, in a circumstance in which the proposition that Jones has the flu explains his pleuritis better than the lupus hypothesis (perhaps because patients like Jones rarely get pleuritis when they have lupus but typically do when they have the flu), IBE’s verdict may well be that the nonunifying explanation of Jones’s symptoms should receive greater credence.
Henderson (Reference Henderson2014) helpfully distinguishes two strategies to coordinate considerations of explanatory unification with Bayesianism, each one corresponding to a specific compatibilist stance one may adopt on the relationships between explanationism and Bayesianism generally. According to what she calls ‘constraint-based compatibilism’ (692–95), explanatory considerations should be regarded as an indispensable external supplement to the raw Bayesian machinery: epistemic agents must take into account considerations of explanatory power when assigning their priors and/or likelihoods to hypotheses, so that explanatory virtues come into play in Bayesian updating as external constraints on ‘correct’ credences.Footnote 3 Regarding unification, the most explicit proposal along these lines is Lipton’s (Reference Lipton2004, 115) suggestion that “considerations of unification, simplicity and their ilk” constrain rational priors on hypotheses, so that simpler and more unifying hypotheses should receive higher prior probability. Yet Lipton does not flesh out this suggestion in any detail, and at any rate his proposal faces difficulties that reflect more general issues with constraint-based compatibilism (see Henderson Reference Henderson2014, 696–98). In particular, Lipton does not explain why Bayesianism needs to be supplemented with considerations of unification in the first place, leading one to suspect that the proposal amounts to a mere ad hoc accommodation of explanatory unification within the Bayesian framework rather than a real integration of the two.
A more attractive compatibilist strategy would be to try to show that an inferential privilege for unifying explanations need not be superimposed on the Bayesian machinery from the outside but falls out of Bayesian inference by itself, so that a Bayesian agent will naturally come to regard hypotheses that unify the data as, ceteris paribus, more plausible. If this ‘emergent compatibilist’ (Henderson Reference Henderson2014, 698) strategy could be made to work, it would yield a genuine integration of considerations of explanatory unification within the Bayesian framework rather than the mere accommodation supplied by constraint-based approaches, thereby providing a very satisfying picture of the relationships between explanationism about unification and Bayesianism. It is this strategy that I will follow here.
This article can be regarded as an extension of Myrvold’s (Reference Myrvold2003, Reference Myrvold2017) account, whose central notion is that of ‘mutual information unification’ or ‘MI-unification’ for short. (As Myrvold explicitly notes, explanatory unification and MI-unification are not the same thing—a point to which I will come back at the end of this article. But the two notions bear interesting relations to each other, as we will see.) Myrvold defines the mutual information of a set of propositions {p 1, …, pn} (for an agent at time t) asFootnote 4

where C is the agent’s initial credence function conditional on her background knowledge at t; I measures the extent to which the members of the set are evidentially relevant to one another, that is, the extent to which they probabilistically strengthen or ‘cohere with’ one another. (Note that I is the logarithmic version of Shogenji’s [Reference Shogenji1999] popular measure of the coherence of a set of propositions.) A hypothesis is MI-unifying in Myrvold’s sense when it “render[s] what, on prior grounds, appear to be independent phenomena informationally relevant to each other” (Myrvold Reference Myrvold2003, 400). And on Bayesianism, Myrvold shows, the ability of a hypothesis to MI-unify the data contributes to the incremental support bestowed on the hypothesis by those data—a result that makes it possible to rationalize various paradigmatic instances of inference to the most unifying explanation in Bayesian terms. Yet in a wide range of cases in which a hypothesis provides a unified explanation of the data, the hypothesis does not MI-unify the evidence any more than a nonunifying explanation does. I will show that in such cases, the notion of mutual information can still help us reconcile the explanationist claim about the confirmatory role of explanatory unification with Bayesianism. As I will explain, the key to such a reconciliation lies in the fact that explanatory unification contributes to a hypothesis’s Bayesian prior by affecting its ‘explanatory coherence’, that is, the extent to which the hypothesis offers mutually cohesive explanations of various phenomena.
2. MI-Unification
Let me start with a brief summary of Myrvold’s account of MI-unification. As mentioned, a hypothesis is MI-unifying when it renders various phenomena evidentially relevant to one another. More precisely, Myrvold defines the degree to which a hypothesis h MI-unifies a set of pieces of evidence {e 1, …, en} as follows:Footnote 5

This quantity is positive when the ei’s provide more evidence for one another on h than unconditionally, and negative otherwise. Thus MIU effectively measures the amount by which h increases or decreases the mutual informational relevance of the evidence set. Note also that for two hypotheses h 1 and h 2,
That is, h 1 MI-unifies the evidence more than h 2 does just in case the mutual information of the evidence is higher given h 1 than given h 2. Myrvold (Reference Myrvold2003) shows that the relative incremental support that two hypotheses h 1 and h 2 receive from an evidence set—a standard measure of which is the log likelihood ratio of the hypotheses—can be decomposed as follows:Footnote 6

For future purposes it will be useful to focus on the comparative absolute support that h 1 and h 2 receive from the data, as measured in their log posterior ratio. Equation (4) entails thatFootnote 7

Thus the relative credibility of h 1 and h 2 given the data is the sum of three kinds of terms. The first is the log likelihood ratio of h 1 and h 2 on each ei, which measures the extent to which h 1 makes each ei considered on its own more probable than h 2 does. The second is the log prior ratio of h 1 and h 2, that is, the extent to which h 1 is more initially plausible than h 2. The third and final term is the extent to which h 1 MI-unifies the data compared to h 2. This means that a greater degree of MI-unification increases the relative credibility of the relevant hypothesis.
These results are good news for the compatibilist. To see why, consider a simple example, which I borrow from McGrew (Reference McGrew2003, 563–64).Footnote 8 In 1979, two quasar images were discovered to have the exact same spectral characteristics. It was suggested that these two images were produced by a single quasar whose radiation was bent by a gravitational lens—a massive gravitational object situated between Earth and the quasar.Footnote 9 The advantage of this hypothesis is that by tracing back the two images to a common origin, it virtually guarantees the match between their spectral characteristics—a match that would be an extraordinary coincidence if the images came from two different quasars. This also means that the ‘one quasar’ hypothesis MI-unifies the spectra in question, while the ‘two quasars’ hypothesis does not. Let s 1 and s 2 be propositions describing the spectral characteristics of the first and second quasar images, respectively; ht is the ‘two quasars’ hypothesis, that is, the proposal that each image is the result of radiation emitted by a separate quasar, while ho is the ‘one quasar’ hypothesis, according to which there is a single quasar in the vicinity of the two images that emits radiation bent by gravitational lensing. On ht, the spectral characteristics of one image provide virtually no information about the spectral characteristics of the other image, so that
and hence
. By contrast, on ho, s 1 is virtually guaranteed to hold iff s 2 holds, so that
. On the other hand, ho makes no specific prediction about the precise spectral characteristics we should observe each image to have, so that
and
are both very low. Consequently,
is much lower than
and hence also much lower than
. Thus
is very high. By (3), it follows that
. This means that if the hypotheses under consideration are otherwise on a par with respect to the first two kinds of terms in (5), a Bayesian agent will assign more posterior credence to ho than ht. For instance, imagine a Bayesian agent who regards ht and ho as equally a priori plausible and as assigning the same probabilities to s 1 and s 2 considered on their own, so that
,
, and
. Then (5) entails that the agent should assign greater credence to ho than ht given s 1 and s 2, thereby providing a natural Bayesian reconstruction of this paradigmatic example of inference to the most unifying explanation.
Let me point out a wrinkle here. Arguably ho does not really fall under the scope of this article, since it does not really explain either s 1 or s 2. One may reasonably think that an explanation of an item of evidence should, at a minimum, raise the probability of its occurrence. But ho remains entirely unspecific about the precise features of the common source it postulates and hence does not make any specific prediction about the spectral characteristics of either image. So as McGrew (Reference McGrew2003, 563) points out, it does nothing to raise the probability of either s 1 or s 2 (
and
). (Similar remarks apply to the equally unspecific ht.) It would perhaps be more appropriate to say that what ho explains is not s 1 or s 2 in themselves, but the striking correlation between the two.
It may therefore be worth illustrating the results above by considering a case in which the competing hypotheses do clearly provide some explanation of each datum in the evidence set. Thus suppose that we precisify the ‘bare-bones’ hypothesis ho by adding to it a hypothesis about the specific characteristics of the postulated quasar and gravitational lens that are responsible for the specific spectra of the two images (the composition of the gas cloud surrounding the black hole, the mass of the lens, etc.) in a way that provides at least some explanation of the specific spectral characteristics of the two images. Call the resulting hypothesis Ho. Hypothesis Ho, we may suppose, raises the probabilities of both s 1 and s 2. Yet if Ho is to be at all a realistic hypothesis that an actual astrophysicist may be in a position to entertain, it will still assign to each of these data a probability less than 1. (To get a probability of 1 for both s 1 and s 2, one would have to describe the postulated quasar in an excruciating amount of detail.) But Ho still virtually guarantees the match between s 1 and s 2, so that I(s 1, s 2; Ho) remains higher than 0. Now contrast Ho with a similar precisification of ht that not only posits the existence of two quasars but also makes certain precise assumptions about the physical characteristics of the two quasars—call it Ht. On Ht, s 1 and s 2 are still mutually evidentially irrelevant since they have different and unrelated origins, so that
. Hence Ho still MI-unifies the data more than Ht. Thus, ceteris paribus, a Bayesian agent will regard the more unifying explanation of the data Ho as better supported than the nonunifying explanation Ht.
Yet not all instances of the inferential advantage claimed by explanationists for unifying explanations can be accounted for by way of MI-unification: a unifying explanation need not MI-unify the data any more than a competing nonunifying explanation does. To illustrate, return to Lange’s (Reference Lange2004) medical diagnosis example introduced at the outset of the article.Footnote 10 Suppose we are comparing two alternative explanations of Jones’s pleuritis (p) and malar rash (m): the hypothesis hl that Jones has lupus, a common cause of both pleuritis and malar rashes, and the hypothesis hfb that Jones happens to have two unrelated diseases, the flu—which causes pleuritis but not malar rashes—and Bloom’s syndrome—which causes malar rashes but not pleuritis. (Then hfb is nothing more than the conjunction of two separate, unrelated explanations of the symptoms: the hypothesis hf that Jones has the flu and the hypothesis hb that Jones has Bloom’s syndrome.) Although hl provides a unified explanation of the symptoms while hfb does not, both hypotheses are on a par with respect to MI-unification. On hfb, both symptoms are mutually evidentially irrelevant, because on the assumption that p and m were produced by unrelated diseases, neither one provides evidence for the other:
But the same is true on hl:
The reason is that since p and m provide evidence for each other only because they are both signs of lupus, once the presence of lupus is held fixed, the occurrence of one symptom provides no additional information regarding the other. And (6) and (7) entail that
and hence also that
. Thus the explanationist claim that the explanatory unification afforded by hl contributes to its plausibility (so that, ceteris paribus, hl should be preferred to hfb) cannot be coordinated with Bayesianism by appealing to considerations of MI-unification. The challenge for the compatibilist, then, is to find some other way to rationalize this claim in Bayesian terms. The main purpose of the account offered in the next section is primarily intended to address this challenge. As we will see, in cases in which the unifying explanation does not MI-unify the data more than a nonunifying explanation, the explanationist claim that explanatory unification contributes to a hypothesis’s credibility can be explained in Bayesian terms via the fact that Bayesianism favors hypotheses that offer mutually informationally relevant explanations of the data. So on Bayesian updating there are two ways in which considerations of explanatory unification can affect the credibility of a hypothesis: by increasing the mutual information of the explananda or by offering mutually informationally relevant accounts of these explananda. The upshot is a general mutual information account of explanatory unification.
3. A General Mutual Information Account of Explanatory Unification
As a first step, it will be useful to remind ourselves of a point already made in the introduction: from an explanationist point of view, other explanatory considerations besides unification come into play when evaluating the credibility of a hypothesis in light of the data. In particular, one needs to consider not only whether the hypothesis unifies the phenomena but also how well it explains each individual item of evidence considered in itself. For instance, when evaluating whether hl or hfb is the better explanation of Jones’s symptoms, we should also take into account how well each hypothesis explains each symptom considered on its own. If Jones’s malar rash is better explained by Bloom’s syndrome than by lupus, and likewise his pleuritis is better explained by the flu than by lupus, IBE’s verdict may well be that hfb is more credible than hl in light of the symptoms. To reconcile explanationism about unification and Bayesianism in cases such as Lange’s medical example, it will therefore be useful to examine which factors come into play in determining how well a hypothesis explains a piece of evidence considered on its own and how to understand these factors in Bayesian terms.
To do so, let us briefly consider an example of competing explanations of a single item of evidence due to Okasha (Reference Okasha2000, 702–3). While examining a distressed 5-year-old child, a doctor decides that the best explanation for his distress (d) is that he tore a ligament, the alternative explanation being that he pulled a muscle. The doctor is asked to explain her reasoning. Her answer is that “preadolescent children very rarely pull muscles, but often tear ligaments” and that “the symptoms, though compatible with either diagnosis, are exactly what we would expect if the child has torn a ligament, though not if he has pulled a muscle” (Okasha Reference Okasha2000, 703). Here two explanatory virtues come into play in evaluating the quality of each competing explanation of d. The first is the extent to which the explanation coheres with the doctor’s background beliefs about the patient, reflected in her initial credence in the explanation. The second is the extent to which d is to be expected in light of the explanation—that is, how well the explanation fits the symptom, which is reflected in the likelihood of the explanation on d. Indeed, from a compatibilist perspective, these two factors ultimately and entirely determine the quality of the relevant explanations, as they also fix which explanation has a higher probability in light of the data.Footnote 11 Hence, from a compatibilist point of view, how well a hypothesis explains an individual piece of evidence e considered on its own is determined by the likelihood of the explanation of e that h provides and the prior probability of this explanation. In the case of a hypothesis h that explains multiple items of evidence e 1, … , en at once, how well h explains a given ei on its own is determined by the prior probability and likelihood on ei of the explanation that h provides for ei.
At this point we need to bring into the foreground an intuitive distinction that will be crucial in what follows. When dealing with a hypothesis that explains multiple items of evidence e 1, … , en, we should take care to distinguish between the hypothesis itself and the explanation that the hypothesis provides for some piece of evidence ei considered on its own. Those two need not be the same thing: specifically, a hypothesis may contain an explanation of ei while also containing additional content that comes into play in explaining other items of evidence but is itself explanatorily irrelevant to ei. By way of illustration, consider hfb. This hypothesis, remember, offers separate explanations of each of Jones’s symptoms: the hypothesis hf that p is due to the flu (which causes pleuritis but not malar rashes) and the hypothesis hb that m is due to Bloom’s syndrome (which causes malar rashes but not pleuritis). Thus, the explanation that hfb provides of p is hf: the additional content hb is explanatorily irrelevant to the pleuritis. And the explanation that it provides of m is simply hb, as the additional hypothesis hf is explanatorily irrelevant to the rash. We can also apply the distinction to the competing hypothesis hl. But here it is a distinction without a difference: hl provides the same explanation for each symptom considered in isolation, namely, that it was caused by lupus. So the entire content of the hypothesis is explanatorily relevant to each symptom, and the explanation that the hypothesis provides for each such symptom is equivalent to the hypothesis itself.
With these considerations in mind, it becomes easy to provide a reconciliation of explanationism about unification and Bayesianism that includes those cases in which the more unifying explanation does not MI-unify the data more. Let me show this by first examining Lange’s medical diagnosis example in more detail and considering a situation in which both hypotheses offer equally good explanations of each symptom considered on its own. That is, let us suppose that the flu and lupus hypotheses equally well explain Jones’s pleuritis considered by itself and that likewise the Bloom’s syndrome and lupus hypotheses equally well explain Jones’s rash considered on its own. Specifically, let us assume that the flu and the lupus hypotheses assign the same probability to p and are equally initially plausible, so that
And likewise, let us assume that the Bloom’s syndrome and lupus hypotheses assign the same probability to m and are equally initially plausible, so that
In such a situation an explanationist would contend that we should ascribe more credence to the more unifying hypothesis hl than to hfb, since the two hypotheses are otherwise explanatorily on a par. The good news is that Bayesianism agrees with this verdict, as can be seen by looking in turn at the likelihoods and priors of both hypotheses.
With respect to their likelihoods on p & m, both hypotheses are on a par. One way to see this is to note first that since Bloom’s syndrome is causally irrelevant to pleuritis, learning that Jones has Bloom’s syndrome in addition to the flu should not change one’s estimate of the probability that Jones has pleuritis. Likewise, since the flu is causally irrelevant to malar rash, learning that Jones has the flu in addition to Bloom’s syndrome should not change one’s estimate of the probability of m. Hence
Thus by (8) and (10), hl and hfb assign the same probability to each symptom considered in isolation. And since neither hypothesis MI-unifies the symptoms more than the other, (4) entails that they have equal likelihoods on p & m. So as far as likelihood is concerned, there is no advantage for the unifying hypothesis hl.
But in the present situation hl has a higher prior probability than hfb, and for reasons that directly reflect the fact that, by contrast to hfb, it supplies a common origin for Jones’s symptoms. To see this, note that because the flu and Bloom’s syndrome are by hypothesis causally independent, they should also be statistically independent of each other. As a result, hf and hb are mutually evidentially irrelevant, so that
And given (9) and (11), this entails that
. Hence although both hypotheses provide equally good explanations of each symptom considered in isolation of the other, the more unifying hypothesis hl is more credible than hfb in light of the data, because it is more plausible to begin with. Moreover, the prior disadvantage of hfb compared to hl can be analyzed in a way that is very illuminating for our purposes. Note that (14) is just a way to express the fact that the explanations of each symptom provided by hfb are mutually evidentially irrelevant to one another, so that
By contrast, because hl traces back the symptoms to the same source, the explanations that it provides for each symptom are one and the same and hence mutually evidentially relevant. Specifically, the mutual information of these explanations is the mutual information of the set {hl, hl}:

which is positive as long as the agent is not already certain of hl. Now it is easy to verify that the priors of hfb and hl can be rewritten on a logarithmic scale as the sum of the prior probabilities of the explanations they offer for each symptom considered on its own and the mutual information of these explanations:
Given that each of the first two terms on the right-hand side of (17) equals the corresponding term on the right-hand side of (18), (17) and (18) show that the prior advantage of hl is a direct consequence of the fact that by contrast to hfb, it offers mutually cohesive explanations of each individual symptom considered in isolation. This suggests that in addition to MI-unification, considerations of explanatory unification can also affect the credibility of a hypothesis by affecting the mutual informational relevance of the explanations that the hypothesis provides for each item of evidence considered on its own.
Let me now turn these considerations into a general account.Footnote 12 First, we need some formal notation to keep track of the distinction between a hypothesis and the explanation that the hypothesis provides for a piece of evidence. When a hypothesis h explains multiple items of evidence e 1, … , en, I will use
to denote the explanation that h provides for ei considered on its own:
, then, contains all and only those parts of h that are explanatorily relevant to e i. Specifying what ‘explanatory relevance’ precisely amounts to is a task for a theory of explanation; for my purposes it is enough to note that in many cases we have clear intuitions on whether some proposition or fact is explanatorily relevant to an explanandum. For instance, in the case of hfb, it is intuitively obvious that
and
. And in the case of hl, it is clear that
and
are both identical to hl itself, reflecting the fact that the hypothesis provides the same explanation for both symptoms.Footnote 13 In this example the explanations provided by the competing hypotheses are either entirely different propositions (in the case of hfb) or propositions identical to one another and to the hypothesis itself (in the case of hl). There are of course intermediate situations in which a hypothesis provides partially overlapping explanations of various pieces of evidence—explanations that share some but not all of their content. For example, consider two ideal gases enclosed in separate containers; let g 1 describe the pressure of the first gas and g 2 describe the pressure of the second gas. And consider the hypothesis
, where B is Boyle’s law, vt 1 describes the volume and temperature of the first gas, and vt 2 describes the volume and temperature of the second gas. While B is explanatorily relevant to both g 1 and g 2, vt 1 is explanatorily relevant to g 1 only, while vt 2 is explanatorily relevant to g 2 only. So
is B & vt 1, and
is B & vt 2. Hypotheses
and
partially overlap in that they both contain B.
For simplicity, we will assume that when h explains an evidence set {e 1, …, en}, h can be entirely rewritten as the conjunction of the explanations that it provides for each ei considered in isolation, so that
This is to assume h contains no ‘explanatorily idle’ content, so that every part of h is explanatorily relevant to at least one ei. This assumption could be relaxed without changing anything central to the account proposed in this section, but it substantially simplifies some of the equations to be presented below.
Let us now consider the relative credibility of two competing explanations h 1 and h 2 of an evidence set {e 1 … en}, as expressed in the log ratio of their posterior probabilities. From Bayes’ theorem, it follows that

If we consider the two terms on the right-hand side of (20), we will find that each is determined not only by the likelihood and/or prior of the
’s and
’s (i.e., the factors that determine how well each hypothesis explains each item of evidence considered in isolation), but also by an additional mutual information term that represents the impact of considerations of explanatory unification.
Consider the log likelihood ratio of h 1 and h 2 first. We will assume that when a hypothesis h explains an evidence set (whether in a unifying or nonunifying way), then for each ei in the set
That is,
screens off the additional content (if any) of h from ei. We have already seen that this assumption is satisfied in the case of hfb (see [12] and [13] above). And since
and
are each identical to hl, (21) is trivially satisfied in the case of hl. (Similar considerations apply in the other examples discussed in this article.) From (4) and (21), we get

This says that the log likelihood ratio of the two hypotheses is the sum of two kinds of terms: the log likelihood ratio of
and
for each ei and the extent to which h 1 MI-unifies the collective evidence compared to h 2. In other words, the likelihood of h 1 on the data as a whole compared to that of h 2 is determined by the degrees to which the individual explanations provided by h 1 and h 2 make the relevant explanandum expectable and the extent to which the explananda are mutually informationally relevant on each hypothesis. Since a hypothesis that traces its various explananda back to a common origin may thereby render them mutually informationally relevant (as in the case of Ho vs. Ht), this is a first way in which from a Bayesian point of view considerations of explanatory unification can favor a unifying hypothesis.
Let us turn now to the log prior ratio of h 1 and h 2. For our purposes, it is illuminating to note that it can be parsed as follows:Footnote 14

Equation (23) tells us that the log prior ratio of h 1 and h 2 is the sum of two kinds of terms. The first is the log prior ratio of
and
for each ei, which measures the relative initial plausibility of the explanations of ei provided by h 1 and h 2 respectively. The second term is the extent to which the explanations provided by h 1 are more or less mutually informationally relevant than the explanations provided by h 2, that is, the extent to which the former probabilistically strengthen or ‘cohere with’ one another compared to the latter. Let us call the quantity
the explanatory coherence of h. (This label is appropriate in light of the fact that I is simply the logarithmic version of Shogenji’s [Reference Shogenji1999] standard measure of the coherence of a set of propositions.) The second term in (23), then, measures the extent to which h 1 is explanatorily coherent compared to h 2.
The key point for our purposes is that whether a hypothesis is explanatorily coherent is intimately tied to whether it offers a unified explanation of the data: when h 1 traces back the various ei’s to a common origin while h 2 does not, we can expect that h 1 will be more explanatorily coherent than h 2. The reason is that when a hypothesis h offers a unified explanation of the evidence, each of the explanations of the individual phenomena provided by h will appeal to the same explanatory fact—the ‘common origin’ of the phenomena in question. As a result, if the agent is not already certain of the truth of these various explanations, each of them will provide positive evidence for the truth of the others, and the explanatory coherence of h will be positive. For instance, the fact that hl traces back each symptom to the same source is reflected in the fact that its explanatory coherence is positive (see [16] above). By contrast, if h explains the phenomena in a nonunifying way, h will consist merely in the conjunction of separate explanations for each phenomenon. Because these explanations appeal to independent explanatory factors, they will be mutually evidentially neutral, so that the explanatory coherence of the hypothesis will be null, as in the case of hfb (see [15]).
While in this example hl has positive explanatory coherence because it supplies a common cause of its explananda, it should be clear that a hypothesis will also receive a positive degree of explanatory coherence as long as it provides some common explanatory basis for the phenomena, including one we may hesitate to call a ‘cause’. Consider, for example, the aforementioned hypothesis hg, which traces back the pressures of two gases g 1 and g 2 to a ‘common origin’ in a broad sense of the phrase, namely, the fact that both gases conform to Boyle’s law B. Remember that
is B & vt 1 and
is B & vt 2, where vt 1 describes the volume and temperature of the first gas and vt 2 describes the volume and temperature of the second gas. Let us make the natural assumption that B, vt 1, and vt 2 are all evidentially independent of one another and also that B is evidentially independent of vt 1 & vt 2. Then the explanatory coherence of hg is
and hence it is positive as long as
.
To summarize, the upshot of (23) is that from a Bayesian point of view, considerations of explanatory unification affect the credibility of a hypothesis not only by way of MI-unification but also in the form of a prior bias in favor of hypotheses that offer mutually cohesive explanations of the data. The prior probability of the hypothesis is determined not only by the extent to which each of the individual explanations it offers is initially plausible but also by the extent to which these explanations cohere with one another. And when these explanations all trace back their relevant explanandum to a single factor, they will thereby be mutually relevant to one another.
As a final step, note that by plugging our formula for the log likelihood ratio (22) and our formula for the log prior ratio (23) into (20), we obtain the following pleasing way of parsing the relative credibility of h 1 and h 2:

Equation (25) tells us that the relative credibility of h 1 and h 2 in light of the data is the sum of three kinds of terms. The first is the log likelihood and log prior ratios of
and
for each ei. This first term effectively measures the relative quality of the explanations that h 1 and h 2 provide for each item of evidence taken by itself. The next two terms correspond to two ways in which considerations of explanatory unification can affect the relative credibility of the two hypotheses: by creating mutual informational relevance between the explananda or by increasing the mutual informational relevance of the various explanations that the hypothesis provides.Footnote 15 And while an explanatory unifying hypothesis may not MI-unify the evidence more than a nonunifying one, we can nevertheless expect the explanatory coherence of the unifying hypothesis to be higher. Thus (25) provides a general Bayesian vindication of the explanationist contention that considerations of explanatory unification contribute to the plausibility of a hypothesis.
Let me close this section with two additional remarks on this account. The first remark is that MI-unification and explanatory coherence are only two of many factors that enter into the prior and/or posterior credibility of a hypothesis. So the account of course does not entail that a unifying explanation should always be assigned more credence than a nonunifying one. But this is perfectly consistent with explanationism. To illustrate, let us return to the medical diagnosis example. As an inspection of (23) reveals, for hfb to be at least as initially plausible as hl, either hf or hb must be more initially plausible than hl. Hence the prior bias for hl encoded in (23) reveals itself in the fact that hfb will be initially no less plausible than hl only if for at least one of Jones’s symptoms, the explanation of that symptom that hfb provides is more initially plausible than and hence in a certain respect explanatorily superior to the competing explanation provided by hl. Now, even if hl is more initially plausible than hfb, its posterior probability may well be lower than that of hfb if the latter assigns a much higher probability to the data than hl does. But as an inspection of (22) reveals, in any such case either the flu hypothesis must make Jones’s pleuritis more likely than the lupus hypothesis does or the Bloom’s syndrome hypothesis must make the malar rash more likely than the lupus hypothesis itself. Again, this is a situation in which for at least one of the two symptoms, hfb provides an explanation of this symptom that has an important explanatory advantage over the explanation provided by hl. In all such circumstances, the claim that hfb may be overall more plausible than hl is one that an explanationist can perfectly agree with. From an explanationist point of view, what happens is that the explanatory advantage bestowed on hl by its unifying power is counterbalanced by other explanatory considerations that count in favor of hfb.
Second, insofar as the account proposed here gives a role to considerations of explanatory unification in influencing Bayesian priors (by way of explanatory coherence), it provides a partial vindication of Lipton’s (Reference Lipton2004, 115) contention that when assigning prior credences to hypotheses, a Bayesian agent should privilege those that offer unified explanations of the data. But whereas Lipton’s proposal remains rather sketchy, the present account allows us to envision precisely which form this privilege should take: in assigning prior credence to a conjunction of explanations, a Bayesian agent should take into account not only the prior probability of each explanation but also the degree to which they cohere or ‘agree’ with one another. And while Lipton’s constraint on priors is superimposed from the outside, the prior preference for unifying explanations encoded in (23) emerges naturally from the Bayesian machinery considered by itself.
4. Mutual Information, Common Origin, and Brute Coincidences
In closing, let me address an objection one may raise against the account offered in the previous section.Footnote 16 To bring the objection out it is useful to first look at a complaint registered by Lange (Reference Lange2004) against the notion of MI-unification. Consider Einstein’s quantum light hypothesis hq, which says that light is quantized (as a matter of physical law). Einstein showed that on hq various apparently unrelated phenomena involving light should in fact be expected to occur together.Footnote 17 Hence hq MI-unifies the relevant phenomena. But now consider an alternative hypothesis h q′ according to which by sheer coincidence light happens to behave as if it were quantized. As Lange points out, this hypothesis MI-unifies the phenomena in question just as well, since it makes their co-occurrence as likely as hq does. This example shows that the notion of MI-unification is insensitive to the distinction between hypotheses that render the data mutually informationally relevant by positing a common origin and hypotheses that create mutual informational relevance between the data by positing a brute coincidence. Yet, Lange claims, the distinction has confirmatory significance: a hypothesis such as hq should “receive more support from the phenomena” (Reference Lange2004, 212) than a hypothesis such as h q′, in virtue of the fact that the former but not the latter unifies the phenomena in a genuinely explanatory way. (Call this Lange’s thesis.) Lange’s complaint, then, is that the notion of MI-unification cannot help us reconcile this thesis with Bayesianism.
Now, as Myrvold (Reference Myrvold2017, 98–101) notes, if read as a claim about incremental support, Lange’s thesis seems simply incompatible with Bayesianism. As equation (4) in section 2 makes clear, for Bayesianism incremental support is determined entirely by the likelihood of the hypothesis on each individual datum and the extent to which it MI-unifies these data. There is simply no space for an extra incremental boost to a hypothesis’s credibility due to the fact that it posits a common origin of the phenomena rather than a brute coincidence. Yet one might wonder whether the general mutual information account of unification presented in section 3 could help provide a Bayesian justification of Lange’s thesis read as a claim about absolute support, by revealing that genuinely explanatory unification increases a hypothesis’s prior probability more than unification by brute coincidence does. Indeed, a proponent of Lange’s thesis would likely insist that only if the answer to this question is positive can the account be deemed to genuinely reconcile Bayesianism and explanationism.
But the answer is negative. This can easily be seen by returning to our earlier example involving the explanation of two gas pressures g 1 and g 2 in terms of a hypothesis hg (which conjoins two propositions vt 1 and vt 2 describing the volumes and temperatures of the two gases with the hypothesis B that as a matter of law all gases conform to Boyle’s formula). On the account proposed in section 3, considerations of explanatory unification contribute to hg’s prior plausibility by making the hypothesis positively explanatorily coherent. More specifically, the equation in footnote 14 entails that hg’s log prior is the sum of the log priors of the explanations of each individual datum that hg offers and of its explanatory coherence:
And as we have seen,
is positive and equal to
, reflecting the fact that by tracing both phenomena to a common explanatory basis (namely, Boyle’s law), the two explanations vt 1 & B and vt 2 & B probabilistically strengthen one another.
But now consider an alternative hypothesis h g′ conjoining two subhypotheses vt 1 & B′ and vt 2 & B′, where B′ is the proposition that by sheer coincidences gases happen to behave in the way described by Boyle’s formula. Although h g′ ‘unifies’ g 1 and g 2 in a nonexplanatory way (i.e., by tracing both back to a single brute coincidence rather to some common explanatory basis), the account of section 3 entails that this form of unification nevertheless positively contributes to the hypothesis’s prior plausibility. Specifically, the log prior of h g′ can be decomposed as the sum of the log priors of its two subhypotheses and the mutual information of these subhypotheses:

And assuming as before that vt 1 and vt 2 are evidentially irrelevant to one another, and also that B′ is evidentially independent of vt 1, vt 2, and their conjunction, we have
which is positive as long as
. True, it would be improper to call this quantity the ‘explanatory coherence’ of h g′, since neither vt 1 & B′ nor vt 2 & B′ can be deemed to really explain g 1 and g 2. Nevertheless, because these two hypotheses ‘account for’ these phenomena in terms of the same brute coincidence and hence cohere with each other, considerations of mutual information contribute to h g′’s prior plausibility just as much as they do in the case of hg. In fact, their contribution is even greater in the case of h g′. The reason is that B′ is considerably less plausible than B and should thus be assigned lower credence than B, so that
.Footnote 18 So considerations of mutual information cannot help us capture in Bayesian terms the contention that hg should be regarded as more a priori plausible than h g′ on the ground that only the former unifies the data in a genuinely explanatory way, as the contribution to H g′’s prior due to (nonexplanatory) informational coherence is no less than the contribution to hg’s prior due to explanatory coherence.Footnote 19
The upshot is that the account proposed in this article provides no way to justify Lange’s thesis in Bayesian terms, as it gives a role to considerations of explanatory unification in Bayesian updating only by way of the I terms and MIU terms in (25), none of which are sensitive to the distinction between unification by common origin and unification by brute coincidence. Indeed, the account strongly suggests that however we understand it exactly, the thesis is simply irreconcilable with Bayesianism. Thus the account allows explanationists to reconcile their claims about unification with Bayesianism only at the cost of rejecting Lange’s thesis and hence endorsing a more modest version of explanationism than some may like.
But in my view there are two considerations that make this a fair price to pay for the explanationist. First, note that the examples discussed in this section are rather artificial cases insofar as the ‘brute coincidence’ hypotheses they involve are particularly contrived and uninteresting. While in those cases the account proposed here yields a verdict that some explanationists may find unpalatable, this is more than counterbalanced by the fact that in more realistic and interesting cases in which considerations of explanatory unification are deployed in inference (such as the ones discussed in previous sections), the account yields a perfectly good Bayesian explanation of the confirmatory role of this explanatory virtue—a very desirable outcome in its own right.
Second, it should be noted that while considerations of mutual information in themselves do not favor genuinely explanatory over brute coincidence hypotheses, Bayesianism nevertheless yields the sensible verdict that hypotheses of the former kind should generally be assigned more credence than hypotheses of the latter kind (see Myrvold Reference Myrvold2017, 104). To illustrate, consider hg versus h g′ again. Because the brute coincidence that h g′ posits is wildly implausible, a Bayesian agent will naturally assign a considerably lower prior to h g′ than hg and hence also a much lower posterior given that both hypotheses are on a par with respect to likelihood. This is perfectly compatible with the fact that considerations of mutual information do not favor hg over hg′. There are of course other considerations that come into judging the prior plausibility of these hypotheses: namely, the priors of the subhypotheses of which they are composed, which are considerably higher in the case of hg. The point generalizes: because hypotheses that posit brute coincidences have in general much less initial plausibility than competing common origin hypotheses,Footnote 20 the Bayesian will agree with the explanationist that the latter should usually receive greater posterior credence than the former.
Overall, then, it seems to me that the consequence of my account discussed in this section is one that a reasonable explanationist can perfectly live with.
