Oaksford & Chater (O&C) argue in Bayesian Rationality (Oaksford & Chater Reference Oaksford and Chater2007, henceforth BR) that a rational analysis is an essential step toward understanding process models from a functional perspective and that “[d]oing this requires developing an account of the optimal behaviour” (p. 268). We argue that relative uses of rational principles of inductive inference can be used to explain function without knowing the optimal response function, and propose that multiple forms of functional analysis are required to understand the cognitive system from a functional perspective.
Rational principles of inductive inference such as Bayesian and simplicity principles are perhaps most frequently used as criteria in relative statements of the form “P is a better response than Q for problem X” For instance, the use of rational principles as model selection criteria (Kearns et al. Reference Kearns, Mansour, Ng and Ron1997; Pitt et al. Reference Pitt, Myung and Zhang2002). In contrast, step four of Anderson's (Reference Anderson1991a) rational analysis excludes anything but statements of the form “P is the optimal response to task X.” Because rational principles can be used to compare the behavior of process models without knowing the optimal response, rational analysis is an instance of a broader class of methodologies adopting rational principles to understand function (e.g., Gigerenzer et al. Reference Gigerenzer and Todd1999). Given this, does knowledge of the optimal response offer any intrinsic advantage when explaining why a process is successful; and what price do we pay by demanding knowledge of the optimal response function?
Knowledge of the optimal solution is one way of establishing that a particular process or organism is successful; but explaining why the process is successful is not implied by this finding. For example, knowing the optimality conditions of the naïve Bayes classifier does not by itself tell us why it is successful. One explanation for why naïve Bayes is successful might be that the independence assumption results in fewer parameters. In certain contexts which violate this independence assumption, the assumption nevertheless causes a reduction in the variance component of error relative to a learning algorithm that assumes that the features are dependent (Domingos & Pazzani Reference Domingos and Pazzani1997). This causal explanation for why naïve Bayes is successful does not require knowledge of the optimal response. It can be established using relative uses of rational principles when the optimal response is incalculable. Furthermore, for realistic contexts of sparse exposure the optimality conditions for naïve Bayes, despite its simplicity, are not fully known (Kuncheva Reference Kuncheva2006). Although typically unavailable, knowing the optimality conditions for an algorithm would undoubtedly provide a good starting point to understand its function; but optimality conditions are neither a required starting point, nor do they by themselves offer a causal explanation for why the algorithm is functional.
Functional explanations arising from Bayesian rational analyses also aim to tell us why a pattern of behavior is rationally justified given that the environment has a certain probabilistic structure. The optimal response function provides a reference point against which to measure behavior without committing to how that behavior is achieved. Because relative uses of rational principles are order relations over theories, or models, of problem solving, they cannot be used in this way. However, abstracting from the process level limits what causal explanation one can offer for why the organism does what it does. One can say that it is successful, but whether or not such a finding provides a satisfactory causal explanation for why it is successful is not so clear (Danks Reference Danks, Chater and Oaksford2008).
Problems arising from the intractability of reliably identifying the optimal response can also make it less desirable. O&C contemplate the possibility that when a rational analysis is intractable, cognitive science may also be intractable (BR, p. 283). Alternatively, this makes complementary forms of functional analysis all the more necessary. The distinction between relative and absolute uses of rational principles mirrors the distinction between, and relative difficulty of, verification and search problems in complexity theory. For example, for an instance of the traveling salesperson problem, the comparative statement “Tour P is shorter than tour Q” is trivial to verify, but the absolute statement “Tour P is the shortest tour” will often be intractable to establish. Many problems take this form and are NP complete (Nondeterministic Polynomial time), including the computation of optimal Bayesian responses and approximations in many settings (e.g., Cooper Reference Cooper1990).
Functional analyses based on rational principles of induction rest on several idealizations: (a) Although different rational principles of induction point to a coherent theoretical picture of what makes a good inference, their practical implementations are often inconsistent, and point to different conclusions (Kearns 1997); (b) functional models will not capture all forms of uncertainty impacting on the problem, some of which may change the character of a functional response (Bookstaber & Langsam Reference Bookstaber and Langsam1985); (c) functional models always consider local goals, which only partially inherit the properties of the global goal being examined; (d) rational principles of inductive inference are approximate models of function, which do not consider functional pressures arising from, for example, processing (Brighton & Gigerenzer Reference Brighton, Gigerenzer, Chater and Oaksford2008; Todd & Gigerenzer Reference Todd and Gigerenzer2003). These are unavoidable realities of modeling, and apply to both relative and absolute uses of rational principles of induction.
An explanation requiring an optimal response function must also consider that: (e) for problems of inductive inference, the optimal response is often analytically intractable to determine with exact methods, and will not be unique; (f) behavioral responses are typically approximately optimal, revealing a tendency rather than a correspondence; (g) successfully optimizing a local goal does not necessarily take us toward the global optimal when other dependencies are known to be only approximately fulfilled (Lipsey & Lancaster Reference Lipsey and Lancaster1956). These additional factors lead to increased flexibility in what behaviors we choose to label optimal. Our point is that these further assumptions are a choice rather than a necessity, and are only required to support certain forms of explanation. We agree with (O&C) on the importance of understanding the ecological function of cognitive processes. We also agree that rational analysis represents a powerful move in this direction. But functional analysis can also proceed without seeking to establish optimality with respect to the organism.