Hostname: page-component-74656f9884-j7cmm Total loading time: 0 Render date: 2026-11-10T08:57:27.532Z Has data issue: false hasContentIssue false
  • English
  • Français

A Problem for Confirmation Measure Z

Published online by Cambridge University Press:  01 January 2022

Branden Fitelson
Rights & Permissions [Opens in a new window]

Abstract

In this article, I present a serious problem for confirmation measure Z.

Information

Type
Discussion
Information
Philosophy of Science , Volume 88 , Issue 4 , October 2021 , pp. 726 - 730
Copyright
Copyright 2021 by the Philosophy of Science Association. All rights reserved.

1. Confirmation Measure Z

Crupi, Tentori, and Gonzalez (Reference Crupi, Tentori and Gonzalez2007) provide a very interesting set of theoretical and empirical arguments in favor of the following (piecewise) Bayesian measure of the degree to which evidence E confirms hypothesis H, relative to background knowledge K:Footnote 1

Z(H,E|K)={Pr(H|E & K)−Pr(H|K)1−Pr(H|K)if Pr(H|E & K)≥Pr(H|K)Pr(H|E & K)−Pr(H|K)Pr(H|K)if Pr(H|E & K)<Pr(H|K)

I will not go into their arguments in favor of Z here. Instead, I will present what I take to be a serious problem with Z. This will require a brief digression into the notion of independent evidence.

2. Independent Evidence Regarding a Hypothesis

Fitelson (Reference Fitelson2001) offers the following Bayesian account of what it means for two pieces of evidence E 1 and E 2 to be confirmationally independent, regarding hypothesis H, according to a confirmation measure 𝔠.

Independence. E 1 and E 2 are confirmationally independent regarding H, according to 𝔠 (i.e., E 1, E 2 are 𝔠-independent regarding H) if and only if both 𝔠(H,E1|E2)=𝔠(H,E1) and 𝔠(H,E2|E1)=𝔠(H,E2).Footnote 2

Intuitively, E 1 and E 2 are confirmationally independent regarding H, according to 𝔠, just in case the degree to which E 1 (E 2) confirms H (according to 𝔠) does not depend on whether E 2 (E 1) is already known.

As Fitelson shows, this notion can be applied in various useful confirmation-theoretic ways (e.g., to provide a Bayesian account of the value of varied/diverse evidence). I will not delve into Independence here. Rather, I will simply apply it to reveal that measure Z has a serious shortcoming when it comes to the handling of certain sorts of independent evidence.

3. A Problem for Measure Z

Sometimes, we have conflicting evidence regarding a hypothesis. That is to say, sometimes, the following property holds for a triple E 1, E 2, and H.

Conflict. E 1 and E 2 constitute conflicting evidence regarding H if and only if E 1 confirms H, while E 2 disconfirms H. Formally, E 1 and E 2 constitute conflicting evidence regarding H if and only if Pr(H|E1)>Pr(H) and Pr(H|E2)<Pr(H).

Intuitively, it should be possible for some triple E 1, E 2, and H to satisfy both Independence and Conflict. That is to say, intuitively, there sometimes exists independent, conflicting evidence regarding some hypotheses. More precisely, we have the following eminently plausible existence claim.

Existence. There exist some triples E 1, E 2, and H that satisfy both Independence and Conflict.

Indeed, Existence strikes me as so plausible as to require little justification. Having said that, it is worth giving a simple example that illustrates the intuitive plausibility of Existence.Footnote 3 Here, I borrow the following example, which belongs to a class of examples used by Fitelson (Reference Fitelson2001) to provide an intuitive illustration of Independence (with individual degrees of strength that can be tweaked via some simple parameters, which I have set here).

The Urn Example. An urn has been selected at random from a collection of urns. Each urn contains some balls. In some of the urns (the H-urns) the proportion of white balls to nonwhite balls is 1/3, and in all the other urns (the ∼H-urns) the proportion of white balls to nonwhite balls is 2/3. The proportion of H-urns is 1/2. Balls are to be drawn randomly from the selected urn, with replacement.

Let H be the hypothesis that the proportion of white balls in the urn is 1/3 (i.e., that the sampled urn is an H-urn). Let W i state that the ball drawn on the i th draw (i≥1) is white. Intuitively, ∼W 1 and W 2 are confirmationally independent regarding H; that is, the triple 〈∼W 1, W 2, H〉 instantiates Independence.Footnote 4

Surprisingly, according to measure Z, Existence is false (a fortiori). That is, according to measure Z, it is conceptually impossible for any pair of evidence E 1, E 2 to be both independent regarding H and conflicting regarding H (for any hypothesis H).

Problem. According to measure Z, Existence is (analytically) false.

Proof. Suppose, for reductio, that there does exist some triple E 1, E 2, H that satisfies both Independence (according to measure Z) and Conflict. Then, we may reason as follows.

(1) Pr(H|E1)>Pr(H) Assumption (Conflict)
(2) Pr(H|E2)<Pr(H) Assumption (Conflict)
(3) Z(H,E1)=Z(H,E1|E2) Assumption (Z-Independence)
(4) Z(H,E2)=Z(H,E2|E1) Assumption (Z-Independence)
(5) Pr(H|E1)−Pr(H)1−Pr(H)=Pr(H|E1 & E2)−Pr(H|E2)1−Pr(H|E2) (1), (3), definition of Z
(6) Pr(H|E2)−Pr(H)Pr(H)=Pr(H|E1 & E2)−Pr(H|E1)Pr(H|E1) (2), (4), definition of Z

Now, let x=Pr(H|E1), y=Pr(H|E2), z = Pr(H), and u=Pr(H|E1 & E2). Then, (5) and (6) can be rewritten as the following pair of algebraic equations.

(5) x−z1−z=u−y1−y
(6) y−zz=u−xx

Algebraically (assuming only that x, y, z, and u are real numbers), (5) and (6) entail that either (7) x=z or (8) y=z. But, this contradicts our assumption that both (1) x>z and (2) y<z. QED

In closing, it is worth noting that it seems to be the piecewise nature of Z that causes Problem. For it can be shown that none of the non-piecewise-defined confirmation measures that have been discussed in the literature (see, e.g., Crupi et al. [Reference Crupi, Tentori and Gonzalez2007] and Crupi and Tentori [Reference Crupi and Tentori2014] for recent surveys) have this Problem (proof omitted). Finally, because Problem only rests on ordinal features, it will plague any measure that is ordinally equivalent to Z.Footnote 5

Footnotes

†

I would like to thank Vincenzo Crupi, Graham Oddie, and two anonymous referees of this journal for their helpful feedback on previous versions of this article.

1. Several authors discussed/endorsed measure Z before Crupi et al. (Reference Crupi, Tentori and Gonzalez2007). See, e.g., Rescher (Reference Rescher1958) and Shortliffe and Buchanan (Reference Shortliffe and Buchanan1975). However, Crupi et al. provide the most compelling and comprehensive theoretical and empirical arguments in its favor.

2. Here, 𝔠(H, E) is shorthand for 𝔠(H,E|⊤), where ⊤ is a tautology. This can be read simply as “the degree to which E confirms H (unconditionally), according to 𝔠.”

3. I thank an anonymous referee for urging me to include an illustrative intuitive example of Existence.

4. Fitelson (Reference Fitelson2001) would be committed to a claim far stronger than mere Existence here (note that Conflict is obviously true in this case). He would be committed to the stronger claim that ∼W 1 and W 2 should have equal and opposite degrees of confirmation, which exactly cancel each other out, so that the total degree to which the conjunction ∼W 1 & W 2 confirms H is zero. This is because he accepts the likelihood-ratio measure of degree of confirmation, which satisfies (not only Existence but) a strong independence-additivity requirement. Of course, we do not need to go along with Fitelson (Reference Fitelson2001) on that stronger/more specific claim. All we need this example to do is make Existence somewhat plausible (i.e., not a conceptual impossibility). As I point out below, among all the measures of confirmation that have been proposed and defended in the literature, Z is the only measure that entails the conceptual impossibility of Existence. Indeed, a plenitude of examples satisfying Existence are easily described for all other confirmation measures in the literature.

5. An anonymous referee points out that the following (formally similar) piecewise confirmation measure (on which see Mura [Reference Mura, Alai and Tarozzi2006, Reference Mura2008] and Crupi and Tentori [Reference Crupi and Tentori2014] for further discussion), which takes its theoretical inspiration from Törnebohm (Reference Törnebohm, Hintikka and Suppes1966), is not ordinally equivalent to Z:

Z⋆(H,E|K)={log[Pr(H|E & K)]−log[Pr(H|K)]−log[Pr(H|K)]if Pr(H|E & K)≥Pr(H|K)log[Pr∼H|E & K)]−log[Pr(∼H|K)]−log[Pr(∼H|K)]if Pr(H|E & K)<Pr(H|K)

I have been unable to determine whether Z⋆ also falsifies Existence (because Z⋆ involves logarithms, this question cannot be answered using standard algebraic techniques; Fitelson Reference Fitelson2008). This is an interesting open question.

References

Crupi, Vincenzo, and Tentori, Katya. 2014. “State of the Field: Measuring Information and Confirmation.” Studies in History and Philosophy of Science A 47:81–90.CrossRefGoogle Scholar
Crupi, Vincenzo, Tentori, Katya, and Gonzalez, Michel. 2007. “On Bayesian Measures of Evidential Support: Theoretical and Empirical Issues.” Philosophy of Science 74 (2): 229–52.CrossRefGoogle Scholar
Fitelson, Branden. 2001. “A Bayesian Account of Independent Evidence with Applications.” Philosophy of Science 68 (Proceedings): S123–S140.CrossRefGoogle Scholar
Fitelson, Branden. 2008. “A Decision Procedure for Probability Calculus with Applications.” Review of Symbolic Logic 1 (1): 111–25.CrossRefGoogle Scholar
Mura, Alberto. 2006. “Deductive Probability, Physical Probability, and Partial Entailment.” In Karl Popper Philosopher of Science, ed. Alai, Mario and Tarozzi, Gino, 181–202. Suveria Mannielli: Rubbettino.Google Scholar
Mura, Alberto. 2008. “Can Logical Probability Be Viewed as a Measure of Degrees of Partial Entailment.” Logic and Philosophy of Science 6:25–33.Google Scholar
Rescher, Nicholas. 1958. “A Theory of Evidence.” Philosophy of Science 25 (1): 83–94.CrossRefGoogle Scholar
Shortliffe, Edward H., and Buchanan, Bruce G. 1975. “A Model of Inexact Reasoning in Medicine.” Mathematical Biosciences 23 (3–4): 351–79.CrossRefGoogle Scholar
Törnebohm, Håkan. 1966. “Two Measures of Evidential Strength.” in Aspects of Inductive Logic, ed. Hintikka, Jaakko and Suppes, Patrick, 81–95. Studies in Logic and the Foundations of Mathematics 43. Amsterdam: North-Holland.CrossRefGoogle Scholar