Oaksford & Chater's (O&C's) book Bayesian Rationality (Oaksford & Chater Reference Oaksford and Chater2007, henceforth BR) is at heart a review of the authors' research program exploring probabilistic models of human deductive reasoning. However, the review is nested within a set of chapters that make clear the ambitious goal of this research program: not just to explain how people reason, but to provide us with a new functional notion of rationality. This work, together with that of Anderson (Reference Anderson1990) and Shepard (Reference Shepard1987; Reference Shepard, Solso and Massaro1995) was one of the early successes of rational analysis and Bayesian models of cognition (see also, Chater & Oaksford Reference Chater and Oaksford1999a). As such, BR illustrates the strengths of rational analysis, and helps to highlight the challenges that Bayesian models face.
One of the strengths of rational analysis is producing models that explain human behavior as an adaptive response to problems posed by the environment. Establishing how the notion of rationality appealed to by these explanations relates to traditional normative analyses in psychology and economics is one of the themes of the early chapters of the book, building on previous discussion by Anderson (Reference Anderson1990). Loosely speaking, the thesis is that rationality can be a methodological assumption that guides us to explanations of behavior: Rather than deciding that people solve a problem poorly, we should consider the possibility that they are solving another problem well, and try to determine what that problem might be. This analysis can be more satisfying than traditional uses of normative models, in that it produces a systematic picture of the assumptions guiding human inferences rather than a list of deviations. This approach is perhaps best exemplified in BR by the Wason selection task, in which the traditional normative account is a combination of falsificationism and deductive logic, and the alternative construes the problem as one of confirmation and induction.
Rational accounts of cognition have virtues that go beyond mere systematicity. One of the most important is the explicit treatment of the assumptions of learners that results from explaining behavior as an adaptive response to computational problems. Computational models of cognition typically focus on the processes that govern behavior. Their content and parameters concern the properties of hypothetical cognitive mechanisms – similarity, strength of association, and learning rates. The content and parameters of rational models are expressed in a different language, being about the problems learners solve and the assumptions they make. As a consequence, these models are more abstract, but more explicit about their commitments, providing a transparent account of what learners should find easy or hard to learn (their “inductive biases”) and what factors should influence behavior (such as the rarity of properties in the Wason task). Developing models formulated in these terms can be valuable, because many questions in cognitive science are posed at the same level of abstraction, concerning the constraints that guide human learning.
The treatment of human reasoning presented in BR illustrates another strength of Bayesian models: the capacity to combine symbolic representations with statistical inference. As O&C discuss, logic and probability have often been viewed as distinct. Researchers in philosophy and artificial intelligence have touted the expressive power of deductive logic, whereas probability theory is typically applied to simpler representations such as sequences of coin flips. The models developed in the book begin to combine the expressive power of logic with the inferential capacity of probability, following a trend towards probabilistic logics that is now a hot topic in artificial intelligence (e.g., Friedman et al. Reference Friedman, Getoor, Koller, Pfeffer and Dean1999; Milch et al. Reference Milch, Marthi, Russell, Dietterich, Getoor and Murphy2004). More generally, the idea of combining structured representations with statistical inference brings together two traditions in cognitive science, where symbolic models employ structured representations and connectionism demonstrates power of statistical learning. As discussed in the book, the potential of the resulting synthesis is great, with structured statistical models being useful when both representation and learning are key, such as inferring the existence of causal relationships (e.g., Griffiths & Tenenbaum Reference Griffiths and Tenenbaum2005) and learning and using language (e.g., Chater & Manning Reference Chater and Manning2006).
While the examples presented in BR illustrate the strengths of rational analysis and Bayesian models of cognition, they also highlight some of the challenges that this approach faces. One significant challenge is connecting rational models to more conventional psychological explanations – identifying mechanisms that can support the sophisticated probabilistic inferences required by structured statistical models. Another challenge is understanding where the knowledge that guides these inferences comes from – the source of the priors and hypothesis spaces for Bayesian inference. And finally, the parallels between induction and scientific reasoning drawn in the book raise another compelling question. Following Reichenbach (Reference Reichenbach1938), philosophers of science distinguish between discovery – developing genuinely new hypotheses – and justification – explaining why one hypothesis should be preferred to another. Bayesian inference, at least in the form presented in most Bayesian models, is a logic of justification, with all possible hypotheses being evaluated. So, how might Bayesian models account for discovery, something that would seem to require going beyond the hypotheses available?
These are significant challenges, but they might be overcome by drawing on work in other disciplines that use Bayesian models. Probabilistic inference is not just hard for people, it is difficult for computers too. The resulting work on approximate inference in computer science and statistics provides a potential source of psychological mechanisms (e.g., Sanborn et al. Reference Sanborn, Griffiths and Navarro2006; Shi et al. Reference Shi, Feldman, Griffiths, Love, McRae and Sloutsky2008). Hierarchical Bayesian models, originally developed in statistics to capture both individual and population effects, provide a way for learners to start out with vague priors and to refine their beliefs over time to develop more informative expectations (Tenenbaum et al. Reference Tenenbaum, Griffiths and Kemp2006). Finally, nonparametric Bayesian models use stochastic processes to define priors over infinite, structured hypothesis spaces, allowing new observations to be explained through new hypotheses (e.g., Sanborn et al. Reference Sanborn, Griffiths and Navarro2006; Griffiths & Ghahramani Reference Griffiths, Ghahramani, Weiss, Scholkopf and Plaut2006), and perhaps paving the way towards a deeper understanding of discovery. Set in this broader context, BR is a significant step towards a genuinely interdisciplinary science of induction, connecting human minds with algorithms from computer science and the abstract principles of statistics.
ACKNOWLEDGMENTS
I would like to thank J. Austerweil, F. Eberhardt, C. Lucas, F. Reali, J. Vuong, J. Williams, and other members of the Computational Cognitive Science Lab at Berkeley for helpful discussions of the book.