Traditional theories hold that human beings make decisions consciously and intentionally. In contemporary cognitive science, this traditional perspective has been challenged by research pointing to an important role for unconscious influences in decision making. Newell & Shanks (N&S) provide a methodological critique of some of the major bodies of literature on unconscious cognition. As they argue, when awareness probes are more reliable, relevant, immediate, and sensitive, greater evidence of conscious awareness is sometimes revealed. Thus, at least some findings used to argue for unconscious influences on decision making may result from shortcomings of commonly used measures of conscious awareness.
This point also applies to some areas of research on implicit and automatic cognition not addressed by N&S. Uhlmann et al. (Reference Uhlmann, Pizarro and Bloom2008) raised similar concerns about methodological limitations potentially shrouding evidence of awareness of the automatic associations measured by tasks like the Implicit Association Test (IAT; Greenwald et al. Reference Greenwald, McGhee and Schwartz1998). Early studies finding negligible correlations between self-reported attitudes and IAT scores led to the conclusion that the latter measured attitudes of which the person was not consciously aware. However, subsequent studies reveal robust implicit-explicit correlations after correcting for random measurement error (Cunningham et al. Reference Cunningham, Preacher and Banaji2001; Cunningham et al. Reference Cunningham, Nezlek and Banaji2004) and when more relevant self-report measures are used (e.g., asking the person to report their automatic gut feelings rather than their explicit attitudes; Ranganath et al. Reference Ranganath, Smith and Nosek2008; Smith & Nosek Reference Smith and Nosek2011). Moreover, correlations between self-report and implicit measures are higher in domains that are less socially sensitive (e.g., consumer as opposed to racial attitudes; Nosek Reference Nosek2005), for participants unmotivated to conceal their true attitudes (Banse et al. Reference Banse, Seise and Zerbes2001; Dunton & Fazio Reference Dunton and Fazio1997; Fazio et al. Reference Fazio, Jackson, Dunton and Williams1995; Payne Reference Payne2001; Payne et al. Reference Payne, Cheng, Govorun and Stewart2005), and when respondents are encouraged to be honest in their self-reports (Olson et al. Reference Olson, Fazio and Hermann2007). This suggests that people are at least partly aware of their automatic associations, but that insufficiently reliable, sensitive, and relevant measures often obscure this fact (Uhlmann et al. Reference Uhlmann, Pizarro and Bloom2008).
This reflects not just methodological limitations of the measures involved, but also the broader problem with operationalizing unconsciousness as a null effect (as is done in most research on unconscious cognition). When post hoc debriefings do not uncover evidence of awareness, or a correlation between a self-report measure and implicit measure fails to emerge, such null effects are used to conclude a lack of conscious awareness. This would be less problematic if we knew a priori that the measure of awareness were perfectly valid. However, how does one really know whether an awareness measure is reliable, relevant, sensitive, or immediate enough? Such measures are most self-evidently valid when they uncover some evidence of conscious awareness. But when they do not, should we then conclude the null (i.e., a lack of conscious awareness), or worry that the measures involved are not good enough? Equating unconsciousness with the null also leaves the findings vulnerable to criticism. A skeptic can always argue (in some cases post hoc) that the awareness measure was insufficiently relevant, reliable, immediate, or sensitive.
Importantly, there is considerable evidence of unconscious influences on decision making that is not dependent on null effects. For instance, research on the effects of “reasons analyses” shows that asking people to provide reasons for their attitudes leads them to report different attitudes, suggesting that they do not actually know what the real reasons for their attitudes are (Wilson & LaFleur Reference Wilson and LaFleur1995; Wilson et al. Reference Wilson, Dunn, Bybee, Hyman and Rotondo1984; Reference Wilson, Dunn, Kraft, Lisle and Berkowitz1989). N&S argue that reasons analyses may lead participants to incorporate additional information they had not considered before and therefore change their attitudes, but they offer no evidence that this actually occurs. Moreover, it is unclear why consciously incorporating previously unconsidered information would reduce attitude-behavior consistency and post-choice satisfaction if the influence of the new information (and resulting attitude change) is genuine. Thus, the effects of reasons analyses are more consistent with a lack of full introspective access into the true influences on one's attitudes.
In addition, the effects of unobtrusively presented primes (e.g., words related to competition) on relevant judgments and actions (e.g., competitive behavior) have been replicated in scores of studies (for reviews, see Bargh Reference Bargh2006; Bargh et al. Reference Bargh, Schwader, Hailey, Dyer and Boothby2012; DeCoster & Claypool Reference DeCoster and Claypool2004; Wheeler & DeMarree Reference Wheeler and DeMarree2009). Indicating that such influences occur primarily when participants are unable to consciously resist them, priming effects have been shown to attenuate or even reverse when study participants suspect they are being influenced (Lombardi et al. Reference Lombardi, Higgins and Bargh1987; Newman & Uleman Reference Newman and Uleman1990) or their awareness of the primes is experimentally increased (Erb et al. Reference Erb, Bioy and Hilton2002; Newman & Uleman Reference Newman and Uleman1990; Strack et al. Reference Strack, Schwarz, Bless, Kübler and Wänke1993). If increased awareness reduces priming effects, then assimilation to primes is almost certainly unconscious. The case that people are unaware of the influences of primes on their judgments and behaviors does not rest solely on null effects.
As highlighted by N&S, the criteria currently used to demonstrate unconscious cognition are worth critiquing and debating. However, it is worth discussing not only the criteria for concluding an influence on decision making is unconscious, but also for concluding it is conscious. When strong evidence of unconscious cognition is unavailable, researchers should not assume conscious awareness by default. Rather, awareness should be demonstrated empirically. A liberal criterion is a statistically significant relationship between an awareness probe and the phenomenon of interest. A conservative criterion is that an effect only emerges among participants who report being consciously aware of it. Regardless of what criteria the field ultimately settles on, it is critical that the burden of proof for concluding consciousness and unconsciousness be equally difficult to meet.
Traditional theories hold that human beings make decisions consciously and intentionally. In contemporary cognitive science, this traditional perspective has been challenged by research pointing to an important role for unconscious influences in decision making. Newell & Shanks (N&S) provide a methodological critique of some of the major bodies of literature on unconscious cognition. As they argue, when awareness probes are more reliable, relevant, immediate, and sensitive, greater evidence of conscious awareness is sometimes revealed. Thus, at least some findings used to argue for unconscious influences on decision making may result from shortcomings of commonly used measures of conscious awareness.
This point also applies to some areas of research on implicit and automatic cognition not addressed by N&S. Uhlmann et al. (Reference Uhlmann, Pizarro and Bloom2008) raised similar concerns about methodological limitations potentially shrouding evidence of awareness of the automatic associations measured by tasks like the Implicit Association Test (IAT; Greenwald et al. Reference Greenwald, McGhee and Schwartz1998). Early studies finding negligible correlations between self-reported attitudes and IAT scores led to the conclusion that the latter measured attitudes of which the person was not consciously aware. However, subsequent studies reveal robust implicit-explicit correlations after correcting for random measurement error (Cunningham et al. Reference Cunningham, Preacher and Banaji2001; Cunningham et al. Reference Cunningham, Nezlek and Banaji2004) and when more relevant self-report measures are used (e.g., asking the person to report their automatic gut feelings rather than their explicit attitudes; Ranganath et al. Reference Ranganath, Smith and Nosek2008; Smith & Nosek Reference Smith and Nosek2011). Moreover, correlations between self-report and implicit measures are higher in domains that are less socially sensitive (e.g., consumer as opposed to racial attitudes; Nosek Reference Nosek2005), for participants unmotivated to conceal their true attitudes (Banse et al. Reference Banse, Seise and Zerbes2001; Dunton & Fazio Reference Dunton and Fazio1997; Fazio et al. Reference Fazio, Jackson, Dunton and Williams1995; Payne Reference Payne2001; Payne et al. Reference Payne, Cheng, Govorun and Stewart2005), and when respondents are encouraged to be honest in their self-reports (Olson et al. Reference Olson, Fazio and Hermann2007). This suggests that people are at least partly aware of their automatic associations, but that insufficiently reliable, sensitive, and relevant measures often obscure this fact (Uhlmann et al. Reference Uhlmann, Pizarro and Bloom2008).
This reflects not just methodological limitations of the measures involved, but also the broader problem with operationalizing unconsciousness as a null effect (as is done in most research on unconscious cognition). When post hoc debriefings do not uncover evidence of awareness, or a correlation between a self-report measure and implicit measure fails to emerge, such null effects are used to conclude a lack of conscious awareness. This would be less problematic if we knew a priori that the measure of awareness were perfectly valid. However, how does one really know whether an awareness measure is reliable, relevant, sensitive, or immediate enough? Such measures are most self-evidently valid when they uncover some evidence of conscious awareness. But when they do not, should we then conclude the null (i.e., a lack of conscious awareness), or worry that the measures involved are not good enough? Equating unconsciousness with the null also leaves the findings vulnerable to criticism. A skeptic can always argue (in some cases post hoc) that the awareness measure was insufficiently relevant, reliable, immediate, or sensitive.
Importantly, there is considerable evidence of unconscious influences on decision making that is not dependent on null effects. For instance, research on the effects of “reasons analyses” shows that asking people to provide reasons for their attitudes leads them to report different attitudes, suggesting that they do not actually know what the real reasons for their attitudes are (Wilson & LaFleur Reference Wilson and LaFleur1995; Wilson et al. Reference Wilson, Dunn, Bybee, Hyman and Rotondo1984; Reference Wilson, Dunn, Kraft, Lisle and Berkowitz1989). N&S argue that reasons analyses may lead participants to incorporate additional information they had not considered before and therefore change their attitudes, but they offer no evidence that this actually occurs. Moreover, it is unclear why consciously incorporating previously unconsidered information would reduce attitude-behavior consistency and post-choice satisfaction if the influence of the new information (and resulting attitude change) is genuine. Thus, the effects of reasons analyses are more consistent with a lack of full introspective access into the true influences on one's attitudes.
In addition, the effects of unobtrusively presented primes (e.g., words related to competition) on relevant judgments and actions (e.g., competitive behavior) have been replicated in scores of studies (for reviews, see Bargh Reference Bargh2006; Bargh et al. Reference Bargh, Schwader, Hailey, Dyer and Boothby2012; DeCoster & Claypool Reference DeCoster and Claypool2004; Wheeler & DeMarree Reference Wheeler and DeMarree2009). Indicating that such influences occur primarily when participants are unable to consciously resist them, priming effects have been shown to attenuate or even reverse when study participants suspect they are being influenced (Lombardi et al. Reference Lombardi, Higgins and Bargh1987; Newman & Uleman Reference Newman and Uleman1990) or their awareness of the primes is experimentally increased (Erb et al. Reference Erb, Bioy and Hilton2002; Newman & Uleman Reference Newman and Uleman1990; Strack et al. Reference Strack, Schwarz, Bless, Kübler and Wänke1993). If increased awareness reduces priming effects, then assimilation to primes is almost certainly unconscious. The case that people are unaware of the influences of primes on their judgments and behaviors does not rest solely on null effects.
As highlighted by N&S, the criteria currently used to demonstrate unconscious cognition are worth critiquing and debating. However, it is worth discussing not only the criteria for concluding an influence on decision making is unconscious, but also for concluding it is conscious. When strong evidence of unconscious cognition is unavailable, researchers should not assume conscious awareness by default. Rather, awareness should be demonstrated empirically. A liberal criterion is a statistically significant relationship between an awareness probe and the phenomenon of interest. A conservative criterion is that an effect only emerges among participants who report being consciously aware of it. Regardless of what criteria the field ultimately settles on, it is critical that the burden of proof for concluding consciousness and unconsciousness be equally difficult to meet.