Everyone complains of his memory, and no one complains of his judgment.
François de la RochefoucauldFootnote 1
Introduction: Inattention to Thinking Errors in Medicine
While the medical ethics literature has well explored the harm to patients, families, and the integrity of the profession in failing to disclose medical errors once they occur,Footnote 2,3 less often addressed are the moral and professional obligations to take all available steps to prevent errors and harm in the first instance. We think about how to fairly and responsibly handle mistakes after the fact, but do we think as extensively about the origins of these errors, particularly when they may result from potentially correctable flaws in physician thinking and judgment? As an expanding body of scholarship further elucidates the causes of medical error, including the considerable extent to which medical errors, particularly in diagnostics, may be attributable to cognitive sources,Footnote 4 insufficient progress in systematically evaluating and implementing suggested strategies for improving critical reasoning is of mounting concern.Footnote 5 We maintain that self-reflective refinement of critical thinking should not be construed as optional but rather should be considered an integral part of medical education, a codified tenet of professionalism, and by extension, a moral and professional duty.Footnote 6
Given what’s at stake, it seems implausible that there could be ground yet to cover on the vital road of preventing grave medical errors and resultant harm to patients. Regrettably, such may be the case. While much of the scholarship arguing for attention to cognitive errors in diagnostics has underscored the gravity of the charge by invoking the 1999 Institute of Medicine (IOM) report on medical errors,Footnote 7 there remains sparse evidence of change in the more than a decade since.Footnote 8 Notwithstanding that several years have elapsed since Jerome Groopman drew widespread attention to cognitive errors in medicine in his 2007 bestseller, How Doctors Think, his appeals to systematically incorporate concerted thinking about thinking in medicine remain largely unheeded.Footnote 9 Sadly, this lack of progress seems not to be a case of no stone unturned. Instead, plausible avenues for change have been substantially overlooked, many emanating from a pivotal line of scholarship applying tools and insights from cognitive psychology toward understanding and improving critical thinking in medicine.Footnote 10,11 For some years now, these scholarly examinations have concluded with pleas for specific changes to education and practice to improve clinical reasoning and reduce thinking errors, particularly in diagnostics.Footnote 12,13 As the years pass, and an impressive body of literature accumulates, the continued lack of progress in systematically assessing and applying recommended strategies for addressing cognitively sourced diagnostic errors both threatens patient health and challenges ethical ideals.
Curiously, although a robust patient safety movement has successfully addressed other forms of medical error in recent years, attention to diagnostic errors has lagged. In a 2010 article in Health Affairs, physician Robert Wachter noted that although medication error was mentioned 70 times in the aforementioned 1999 IOM report, To Err Is Human: Building a Safer Health System,Footnote 14 diagnostic errors were mentioned only twice, particularly puzzling given the higher incidence and greater harm attributable to diagnostic error.Footnote 15 As Wachter notes, the issue of “diagnostic errors has been strangely absent from the flurry of patient safety activity over the last decade. This absence is particularly noteworthy given the frequency of these errors.”Footnote 16 A 2009 JAMA commentary by David Newman-Toker and Peter Pronovost similarly bemoaned the patient safety movement’s narrow focus “on translating evidence into practice, mitigating hazards from therapies, and improving culture and communication. Diagnostic errors have received relatively little attention . . . [though they remain] an important source of preventable harm.”Footnote 17
Diagnostic errors may be preventable, in large part, because they so often derive from systems and cognitive sources. A seminal 2005 analysis of diagnostic errors by Mark Graber and colleagues, published in the Archives of Internal Medicine, found that “system-related factors contributed to the diagnostic error in 65% of the cases and cognitive factors in 74% . . . [uncovering] dominant problems that should be targeted for additional research” toward early error reduction.Footnote 18 The lag or lack of attention is even more puzzling given the toll—financial and human—attributable to diagnostic error. A 2013 study retrospectively analyzing 350,706 paid claims from the National Practitioner Data Bank over a 25-year period found that diagnostic errors were the leading claim type (accounting for 28.6% of claims), led the various claim types in terms of costs (accounting for 35.2% of total payments), and were the foremost cause of claims-related death and disability.Footnote 19 The study authors conclude, “Among malpractice claims, diagnostic errors appear to be the most common, most costly and most dangerous of medical mistakes. . . . Healthcare stakeholders should consider diagnostic safety a critical health policy issue.”Footnote 20
Beyond arguments predicated on patient safety (which should be sufficiently compelling) and aggregate monetary costs (which should be sufficiently motivating),Footnote 21 delaying or failing to engage in efforts that carry the potential to reduce a leading cause of error-related morbidity and mortality seems ethically problematic as well. This latter objection provides the impetus for the present examination. As a foundation for this analysis, we begin with a very brief overview of the theoretical underpinnings of this work and the application of tools and insights from cognitive sciences toward understanding medical decisionmaking and mitigating error. We then outline the ethical ramifications of sustained inattention to this issue and argue for an ethical mandate for applying the very latest about what is known about critical thinking, judgment, and reasoning toward addressing errors and improving medical decisions and care. Our examination concludes with brief attention to three lasting hurdles, offered with an eye toward facilitating action and overdue progress in addressing preventable thinking errors in medicine.
Cognitive Science and Thinking Errors in Medicine
In his 2011 bestseller, Thinking Fast and Slow, psychologist and 2002 Nobel Prize winner in economics Daniel Kahneman delves deeply into the prevailing dual-process approach to thinking and reasoning.Footnote 22 Building on groundbreaking work in cognitive heuristics and biases conducted with his longtime colleague, Amos Tversky, four decades earlier,Footnote 23 Kahneman explains, for a lay audience, the appeal and science behind this dual-process explanation of fast and slow thinking, also conceptualized as system 1 and system 2, or intuitive and analytic, thinking.Footnote 24,25 Although the model is considerably more nuanced than its binary schema might suggest, in simplest terms, slow or system 2 thinking (solving a complex math problem or trying to navigate a turn across heavy traffic) is deliberative, systematic, and resource heavy, whereas fast or system 1 thinking (identifying colors or facial expressions or performing simple math) is frugal and automatic, marked by rapid application of heuristics to complete patterns and achieve associative coherence.Footnote 26
Over the last decade, scholars have applied these theories and tools, particularly the dual-process model and insights on prevalent biases and heuristics in human problem solving, to the important work of understanding medical decisionmaking and, by extension, medical errors.Footnote 27,28,29 Following up on an earlier paper examining an array of heuristics and biases in conjunction with diagnostic errors in emergency department physicians,Footnote 30 in 2008 physician Pat Croskerry, a leading scholar in the field, wrote with his colleague Geoff Norman, in the American Journal of Medicine, of the hazards to diagnostic thinking arising from a common bias toward overconfidence.Footnote 31 The authors conclude that this widespread bias substantially contributes to thinking errors in medicine, and they advise that it “should be possible to improve clinical reasoning through specific training and thus reduce the prevalence of biases such as overconfidence.”Footnote 32
In 2009 Croskerry mapped out a comprehensive “universal model of diagnostic reasoning” that charted system 1 and 2 processing, in reference to diagnostic thinking, further integrating into the model cognitive and metacognitive constructs, including biases and heuristics, pattern recognition, monitoring, and calibration of accuracy.Footnote 33 While acknowledging the need for further substantiating research, Croskerry reinforces that “clinicians in training and those already in practice need a comprehensive approach to clinical decision making that facilitates their understanding of this complex process and allows them to gain insight and understanding into their own decision making.”Footnote 34 More recent work in modeling medical decisions further supports the application of the dual-process theory, and cognitive and metacognitive constructs, toward understanding and improving decisionmaking.Footnote 35,36
With attention still limited, in spite of a growing publication record in leading medical journals, in June 2013, Croskerry authored a perspective piece in the New England Journal of Medicine urging a shift in the medical community, namely, as expressed by the article’s title, “From Mindless to Mindful Practice—Cognitive Bias and Clinical Decision Making.”Footnote 37 Predicating his argument on the dual modes of intuitive and analytic thinking, Croskerry describes two case examples of diagnostic failures and prescriptively encourages training in critical thinking, including concerted efforts to think about how we think (in psychological parlance, metacognitionFootnote 38), toward fostering “judicious interventions by the analytic mode when needed— specifically, in its capacity to override the intuitive mode” and further toward the development of “effective cognitive debiasing strategies in medicine.”Footnote 39
With respect to plausible avenues for corrective action, in addition to debiasing strategies,Footnote 40,41 recommendations for addressing thinking errors in medicine include the following: training in cognitive aspects of decisionmaking and critical thinking skills throughout the stages of medical education;Footnote 42,43 training in and vital fiats to include metacognitive constructs—among them, reflective thinking, monitoring, and control functions—for assessing and continually refining one’s own thinking;Footnote 44,45,46,47,48 and, at the systems level, recommendations for structural changes to augment feedback so as to facilitate error analysis,Footnote 49,50,51 alongside procedural changes at key decision points, ranging from complex computerized decision supports to simple checklists.Footnote 52,53,54,55
Yet, even with scholars effectively pounding the table with alarming statistics about the harm attributable to thinking errors in diagnostics, attention to this line of inquiry has lagged. Without a commitment to researching, evaluating, and thereafter implementing promising strategies on the part of those who set agendas, curricula, budgets, and research priorities, the path to meaningful change remains considerably obstructed. Frustratingly, for individual physicians and educators motivated by these cognitive science findings to improve diagnostic thinking, progress is impeded by the lack of rigorous research as to how diagnostic decisionmaking transpires, and as to which of the suggested strategies might best counteract the relevant heuristics or flaws. As Robert Wachter concludes, we continue to lack solid evidence as to whether “proposed solutions to diagnostic error work, partly because they have been so little studied.”Footnote 56
Inaction as Ethically Problematic
In a 2009 address to the American Academy of Arts and Sciences, reprinted in 2010, Jerome Groopman said, “I believe the time has come to incorporate cognitive science into the education of medical students and physicians. We need to know how we think and why we often, too often, think incorrectly.”Footnote 57 In addition to patent risks to patient safety, we believe that lackluster attention to critical thinking skills and thinking errors in medicine increasingly carries ethical implications as well.
With respect to understanding the ethical ramifications of continued inaction, at the outset, we must acknowledge not only a shared responsibility to disclose errors after the fact but also a further obligation to reflect on these errors and take any and all available steps to prevent such errors in the future. From a principles point of view,Footnote 58 a situation in which plausible avenues for remedying mistakes remain untested, as grave and preventable harm to patients knowingly continues, evokes arrant concerns of nonmaleficence. Whether this frame of inaction in the face of viable remedies is an accurate depiction of the present (or an imminent) state of affairs may be up for debate. At the very least, it will be increasingly difficult for defenders of the status quo to claim that every step is being taken to avoid thinking errors in medicine, particularly in diagnostics, should the recommendations of a decade-long line of scholarship continue to be largely ignored. Naturally, as obligations to patients extend considerably beyond mere avoidance of harm, also entangled here are concerns arising from ethical mandates of beneficence, and how this inattention likewise compromises good patient care.
Further intertwined are ethical arguments arising from medical professionalism and duties to colleagues, the community, and the honor of the profession. Dating back to the classical version of the Hippocratic Oath, the medical profession has upheld commitments beyond good patient care and “keeping patients safe from harm,” to include the avoidance of injustice, the promotion of trust in the doctor-patient relationship, and the espousal of duties to the community and the profession.Footnote 59 In this case, patent moral obligations to patients are joined by duties to the art and craft of medicine, to current and future generations of physicians, to the profession, and to society. Neglecting to fully explore viable avenues for remedying a leading source of medical error seemingly runs contrary to the central tenets of long-established professional codes.
In enumerating the ethical pitfalls of continuing on the current path, it is important to consider issues of justice and fairness as well. Along with the patent unfairness of missing opportunities to prevent errors and grave associated harm, there may further be justice issues in the distribution of error and associated harms. Although supporting data on this front is scant, it seems quite possible that the burdens of medical error (and likely limitations on avenues of recourse for addressing errors after the fact) may disproportionately fall to vulnerable groups. The distribution of cognitive-based errors, particularly those rooted in the employment of rapid heuristics, biases, and assumptions, may thus serve to create new or to exacerbate existing disparities in care. Given that physicians have espoused duties to combating injustice, this duty surely must extend to remedying even inadvertent iatrogenic injustices.
The late physician and ethicist Ed Pellegrino, in discussing the limits of the Hippocratic Oath, emphasized the social responsibility of the physician, advancing that “medicine, which touches on the most human problems of both the individual and society, cannot serve man without attending to both his personal and communal needs.”Footnote 60 Lamenting the prevailing narrow focus, in a speech delivered a decade earlier, Pellegrino began, “Historically and conceptually we have been accustomed to think of medical ethics in terms of the obligations of individual physicians to individual patients. We have largely neglected the obligations of the profession as a moral community . . . some of the issues that vex us most are resolvable only through the use of our collective moral power.”Footnote 61 Underscoring the force of this expanded view, Pellegrino concludes, “Every one of the things that disturb the conscientious physician—in his colleagues or in today’s social milieu—can be effectively opposed if we are faithful to the central aim of medicine: the care and cure of the sick. . . . There is enormous moral power in this position but we have not used it.”Footnote 62 When appeals go out in 2013Footnote 63 for attention to systematic errors, that look an awful lot like those of decades past,Footnote 64,65 this continued privation may be seen to compromise the “social ethics”Footnote 66 of medicine as well.
Although the possible ethical pitfalls stemming from inaction may be rather plain, considerably less clear are the whys behind this apparent lapse. It remains unknown whether there exists a pervasive underestimation of the extent to which diagnostic errors are attributable to thinking errors, or whether the problem is appreciated, but plausible avenues for amelioration (cognitive and metacognitive training) have been dismissed as soft or optional or outside the scope of professional responsibility. Similarly, it is unclear whether there is simply a lack of awareness among stakeholders of this rich body of scholarship and the strategies for improving thinking (unlikely given widespread publication in medical journals over the last decade); whether the methodological complexities of assessing decisionmaking and proposed interventions have stymied progress; or whether the work of introspection, of acknowledging the possibility of error in one’s own thinking, is thought too bland or cumbersome especially given the comparative ease of employing the latest technology.Footnote 67 Whether the entangling of malpractice claimsFootnote 68 with thinking errors in diagnostics may pose complex conflicts of interest that may also serve to impede attention, is likewise thoroughly unknown.
Far more transparent, however, is the ethical upshot of continued avoidance, the extent to which sustained inertia runs contrary to principles of beneficence and nonmaleficence, and to themes of fairness and justice. Whatever the reason for the lag, the present situation seems untenable, and inconsistent with prevailing notions of ethics and medical professionalism. The idea that individuals may continue to be harmed, and lives lost, because avenues for fixing fundamental thinking errors are, for whatever reason, not prioritized, to the extent that they are even considered at all, seems fundamentally unjust.
Taking liberties with the transitive property, if a leading cause of error-related morbidity and mortality is diagnostic error,Footnote 69 and if diagnostic errors are, in large part, attributable to cognitive errors,Footnote 70 then some significant fraction of error-induced death and disability is likely attributable to thinking errors in medicine. If these constituent facts were not widely disseminated, the ethical calculus might be different. But as they are, as the relevant research has appeared in leading medical journals for years, continued inattention is increasingly problematic, with the consequences of inaction compounded, in large part, because we now have plausible remedies.
Remaining Hurdles
In moving this issue from weary lamentation to action, it seems important to briefly address three enduring tensions that may be impeding forward progress.
The first involves a tension between deductive and inductive scholarly approaches to translating insights from cognitive psychology and behavioral economics into established interventions for improving thinking in medicine. Given the aforementioned shortage of empirical studies,Footnote 71 much of the relevant literature has necessarily approached the issue from a deductive standpoint, reasoning from theory how medical decisionmaking optimally should function.Footnote 72,73,74 Although such theoretical work is invaluable, a lasting impediment to action may be the paucity of inductive approaches, efforts to understand how medical thinking operates from experience up rather than from theory down. As medical diagnostics is a distinctly inductive process, the need for empirical research is even more acute. Furthermore, without this solid grounding in real-world reasoning, the risk of narrow interpretations grows, as deductions from theory remain unopposed by lessons from practice.
Meanwhile, the need for further research, toward understanding how diagnostic decisions unfold, and how to address enduring sources of error and improve critical reasoning, steadily grows. Newman-Toker and Pronovost attributed the lag in this research to the “complexity of diagnostic problems and relative infancy of methods to study misdiagnosis, combined with limited funding for research in diagnostic safety.”Footnote 75 Although these lines of inquiry are fraught with challenges, including the inherent complexities of assessing thinking, lasting change may require an elusive meet-in-the-middle approach, akin to Rawls’s reflective equilibrium,Footnote 76 a bridging of inductive and deductive reasoning, scientific theory and human art.
A second tension suffusing this work involves concerns of process and outcome in conceptualization, measurement, and evaluation. Critical thinking, active listening, diagnostic reasoning, and medical assessment are complex processes. Yet we most often draw conclusions about the quality of these dynamic processes by the static accuracy of the answers. Reminiscent of the childhood mathematics-class mandate to “show your work,” sound processes may, at times, lead to incorrect answers, and correct answers may betray faulty reasoning. In examining this endemic privileging of outcomes over process, short answer over story, in a discussion of certifying competencies in medicine, Fins and colleagues warn of the “parcelation of history from histology and narrative from nosology” and express concern for the consequent impact of this reductionist approach to professionalism and the practice of medicine.Footnote 77 Although this argument is more complex than can be conveyed in this space, the disconnect of understanding process solely by way of outcome, particularly when addressing phenomena as qualitative as thinking and reasoning, presents an enduring challenge to this work, one in need of ongoing consideration.
Finally, a lasting and complex tension in this scholarship involves consideration of the locus of change as residing with the individual as opposed to the larger system. Dan Ariely makes the point, in his bestseller, that we are not just irrational but “predictably irrational”—we misjudge, we employ biases and heuristics, we fill in patterns, and we are tripped up by cognitive illusions, not just sporadically but in similar and highly predictable ways.Footnote 78 Thus, to treat the locus of this issue as if it is one person’s failings, largely misses the point and, more so, the opportunity to understand how thinking errors are predisposed at the systems level. In discussing the correlates of good intuitive judgments, Kahneman advised, “Don’t look inside, don’t look at the person, look at the environment.”Footnote 79
In contemplating the environment of diagnostic decisionmaking, we might consider, for example, opportunities for calibration. A central metacognitive construct, calibration involves assessing the degree to which confidence judgments of perceived accuracy correlate with objective information on accuracy;Footnote 80 this operation requires, as one might imagine, actual information on accuracy. Without opportunities for feedback, confidence remains uncalibrated, and the same mistaken assessment might be made time and again, as a pattern is recognized as similar to a prior instance, without an appreciation that the prior judgment, now repeated anew, was wrong. Autopsies allow for feedback and calibration, as do any systems that enable subsequent data on proven diagnoses.Footnote 81,Footnote 82 In a 2009 Archives of Internal Medicine study analyzing 583 physician-reported diagnostic errors, Gordon Schiff et al. lament the decline in autopsies and the lost opportunity for feedback, noting, “we are more often literally and figuratively burying our mistakes. Highlighting diagnostic error cases can help remind leaders of health care institutions of their responsibility to foster conditions that will better address and minimize the occurrence and consequences of errors that might otherwise have remained hidden.”Footnote 83
Yet even though structural and individual components of decisionmaking may be abstracted as residing in tension, naturally they remain irrevocably intertwined. As we contemplate augmenting system-wide opportunities for feedback, we must also prioritize individual training in critical thinking, so that the available information may be used to calibrate confidence, gauge certainty and uncertainty, and assess what is known and, as importantly, what is not. As we extol the science of medicine, we must remain mindful of the art, uncertainty, and imperfection of medical thinking, and the consequent need to systematically revisit and refine our judgments. As the great American philosopher and pragmatist John Dewey might advise, we must allow ourselves to be comfortable with uncertainty, ambiguity, and the ubiquity of contingencies; we must avoid premature moral closure and, by extension, premature diagnostic closure.Footnote 84,Footnote 85 Thus, in the same breath that we emphasize sound structures and systems, we must be careful not to downplay the centrality of personal responsibility, and the vital importance of acknowledging and addressing the possibility of flaws in our judgments. “Whatever the system of care,” writes Fins, “the quality of its delivery hinges upon individuals, what he or she intuits and knows. . . . Each of us plays a part of a larger process, of course, but each of us needs to make our own singular contributions.”Footnote 86 This inherent tension between individual and system will not be solved with a privileging of one over the other; rather, we need systemic reforms in tandem with personal responsibility.
Finally, as we look to translate personal and professional responsibility into action, we must acknowledge the extent to which clear paths to progress, for those inclined to take corrective action, remain frustratingly hampered. Although we have viable avenues that might counter these cognitive constraints on medical decisions, the continued scarcity of rigorous research elucidating how decisions are made, and evaluating which of the proposed strategies might best address persistent thinking errors, has left unacceptably vague how best to proceed.Footnote 87 For individual physicians eager to take curative action, there may yet be interim options. Developing a deeper appreciation and understanding of the cognitive facets of medical judgment and decisionmaking, and exploring metacognitive approaches to improving critical thinking in medicine outlined by CroskerryFootnote 88 and Groopman,Footnote 89 among others, may be a reasonable place to start. With that baseline familiarity, other steps might include participation in quality-assurance programs, earning continuing medical education (CME) credits in areas related to medical error, and participating in Joint Commission (JCAHO)–mandated hospital programs related to medical errors. Furthermore, to the extent that concerned readers may be in a position to influence the medical education curriculum, shape the research agenda, or persuade leadership of the import of this issue, these system-directed efforts may hold the key to breaking the impasse and dispelling the inertia. Harnessing the untapped, collective power of the medical profession as a moral community, as Ed Pellegrino suggested decades ago,Footnote 90 may be just the remedy for our shared ills, and just what is needed to compel change.
Concluding with Optimism (Itself a Cognitive Bias)
To conclude with a glimmer of hope, though the picture has remained fairly bleak, early indications suggest that attention to diagnostic error may be on the rise.Footnote 91,92 A recent 2013 systematic review, published in Annals of Internal Medicine, assembled the studies to date of patient safety initiatives targeting diagnostic error, identifying 109 studies over 46 years (1966–2012).Footnote 93 Although studies of interventions aimed at reducing cognitive sources of error were included in the review, overall most of the studies identified were small, and only 14 were randomized trials, leading the authors to advocate for more rigorous research going forward.Footnote 94 We echo these calls and urge attention to thinking errors in diagnostic reasoning—and throughout medical decisionmaking—predicated on critical arguments of patient safety as well as on a moral and professional rationale. The time has indeed come for the systematic incorporation of tools, constructs, and insights from cognitive sciences, in particular metacognition, into medical decisionmaking and, more broadly, into bioethics.Footnote 95 Croskerry titled one of his early articles in Academic Emergency Medicine “The Cognitive Imperative: Thinking about How We Think.”Footnote 96 More than a decade later, with scant evidence of change, we believe that steadfast attention to cognitive and metacognitive solutions for thinking errors in medicine has evolved to become an ethical imperative as well. Whether such assertions are effective in spurring renewed attention and compelling overdue progress remains to be seen.