Hostname: page-component-7b7567c8c-mnklg Total loading time: 0 Render date: 2026-11-12T22:31:11.251Z Has data issue: false hasContentIssue false
  • English
  • Français

Performance of simplified surgical site infection (SSI) surveillance case definitions for resource limited settings: Comparison to SSI cases reported to the National Healthcare Safety Network, 2013–2017

Published online by Cambridge University Press:  13 March 2020

Matthew D. WestercampOpen the ORCID record for Matthew D. Westercamp[Opens in a new window],
Margaret A. Dudeck,
Kathy Allen-Bridson,
Rebecca Konnor,
Jonathan R. Edwards,
Benjamin J. Park and
Rachel M. Smith
Matthew D. Westercamp*
Affiliation:
Division of Healthcare Quality Promotion, National Center for Emerging and Zoonotic Diseases, US Centers for Disease Control and Prevention (CDC), Atlanta, Georgia
Margaret A. Dudeck
Affiliation:
Division of Healthcare Quality Promotion, National Center for Emerging and Zoonotic Diseases, US Centers for Disease Control and Prevention (CDC), Atlanta, Georgia
Kathy Allen-Bridson
Affiliation:
Division of Healthcare Quality Promotion, National Center for Emerging and Zoonotic Diseases, US Centers for Disease Control and Prevention (CDC), Atlanta, Georgia
Rebecca Konnor
Affiliation:
Division of Healthcare Quality Promotion, National Center for Emerging and Zoonotic Diseases, US Centers for Disease Control and Prevention (CDC), Atlanta, Georgia
Jonathan R. Edwards
Affiliation:
Division of Healthcare Quality Promotion, National Center for Emerging and Zoonotic Diseases, US Centers for Disease Control and Prevention (CDC), Atlanta, Georgia
Benjamin J. Park
Affiliation:
Division of Healthcare Quality Promotion, National Center for Emerging and Zoonotic Diseases, US Centers for Disease Control and Prevention (CDC), Atlanta, Georgia
Rachel M. Smith
Affiliation:
Division of Healthcare Quality Promotion, National Center for Emerging and Zoonotic Diseases, US Centers for Disease Control and Prevention (CDC), Atlanta, Georgia
*
Author for correspondence: Matthew D. Westercamp, Email: mwestercamp@cdc.gov
Rights & Permissions [Opens in a new window]

Abstract

Surgical site infections (SSIs) are among the most common healthcare-associated infections in low- and middle-income countries. To encourage establishment of actionable and standardized SSI surveillance in these countries, we propose simplified surveillance case definitions. Here, we use NHSN reports to explore concordance of these simplified definitions to NHSN as ‘reference standard.’

Information

Type
Concise Communication
Information
Infection Control & Hospital Epidemiology , Volume 41 , Issue 5 , May 2020, pp. 611 - 613
Copyright
© 2020 by The Society for Healthcare Epidemiology of America. All rights reserved

Surgical site infections (SSIs) are among the most common healthcare-associated infections (HAIs) in low- and middle-income countries (LMICs) with an incidence >3 times higher than rates in developed nations.Reference Allegranzi, Bagheri Nejad and Combescure1 SSIs result in longer patient hospital stays and greater healthcare costs.Reference Poulsen, Bremmelgaard, Sorensen, Raahave and Petersen2 Because many SSIs are preventable, this increased burden is avoidable in many LMIC settings.

The CDC National Healthcare Safety Network (NHSN) SSI surveillance methodology and case definitions have been designed to support quality improvement efforts within US hospitals and fulfill US regulatory requirements. Although NHSN case definitions have become a de facto gold standard for use internationally, limited resources and differing regulatory contexts limit the appropriateness of NHSN methods and case definitions outside the United States. Where limited technical, structural, and material resources hamper even basic HAI surveillance, NHSN methodology requires substantial simplification and modification for missing definition requirements for feasible implementation. The resulting differences limit comparability between systems and can promote inappropriate comparison to published NHSN metrics.

To encourage the establishment of simple, actionable, and standardized SSI surveillance in LMIC settings, we developed an SSI surveillance strategy using simplified SSI surveillance case definitions. To better understand the usefulness of these definitions, we took advantage of available NHSN reports to provide a novel exploration of concordance of our proposed simplified definitions to NHSN as a ‘reference standard.’

Methods

We defined 2 simplified, non–laboratory-based case definitions. Cases were defined as postoperative patients with (1) wound purulence or painful, spreading inflammation (redness, swelling, warmth) surrounding the surgical site with evidence of fever in the 30 days following surgery (ie, symptom based); or (2) wound purulence or purposeful reopening of the surgical wound in the 30 days following surgery (ie, operation based).

Both definitions limit complexity by excluding depth of infection and restricting inputs to observable, objective criteria. Definitions were based on those proposed by the WHO,3 the UK National Prevalence Survey Study (NPS),Reference Ayliffe, Casewell and Cookson4 the UK Surgical Infection Study Group (SISG),Reference Peel and Taylor5 and in consultation with experienced surgeons providing service in LMIC for review and comment.Reference Bruce, Russell, Mollison and Krukowski6

Proposed definitions were compared to data reported to the NHSN Patient Safety Component Procedure-Associated Module for the years 2013–2017, restricted to in-plan facilities.7 Elements of interest included the event criteria reported for each case, the type of surgical procedure performed, depth of infection, physician diagnosis, and laboratory findings. Only data from reported NHSN cases were available.

We described concordance for the entire dataset (all surgical procedures) and separately for cesarean birth because this procedure is a commonly performed surgical procedures and is a focus of surveillance in many LMICs. Percent agreement (PA) was defined as the proportion of SSI cases reported to NHSN captured by each simplified definition.

Findings

Between 2013 and 2017, the NHSN database contained 215,729 SSI case reports available for analysis. Of these 215,729 SSI case reports, 155,020 met the symptom-based case definition (PA, 72%) and 172,497 met the operation-based case definition (PA, 80%). Restricting the results to the 9,897 infections after cesarean birth, the symptom-based case definition identified 6,688 cases (PA, 68%) and the operation-based case definition identified 6,731 cases (PA, 68%). The PAs of each definition element and the impact of adding physician diagnosis, pathogen isolation, and wound dehiscence are provided in Table 1.

Table 1.

Percent Agreement for Symptom-Based and Operation-Based Definitions by Definition Elements for All SSI Infections and Restricted to Infections After Cesarean Birth—National Healthcare Safety Network, 2013–2017

Note. SSI, surgical site infection; PA, percentage agreement; NA, not available.

a The percent agreement of infection detection of listed element only.

b Symptom-based definition: wound purulence or painful, spreading inflammation (redness, swelling, warmth) surrounding the surgical site with evidence of fever in the 30 d following surgery.

c The percent agreement of infection detection of the listed element plus definition elements listed previously.

d Wound purulence or purposeful reopening of the surgical wound in the 30 d following surgery.

e The percent agreement of infection detection of listed element plus the full symptom-based case definition.

Of the 60,709 NHSN-reported infections that did not meet the symptom-based definition, 22,825 (38%) were diagnosed by a physician, 45,662 (75%) had an organism identified on culture, and 3,544 (6%) had radiologic evidence of infection. Of the 45,351 infections that did not meet the operation-based definition, 15,849 (35%) were diagnosed by a physician, 32,852 (72%) had an organism identified on culture, and 4,993 (11%) had radiologic evidence of infection. Restricting the results to the 3,209 postcesarean infections that failed to meet the symptom-based definition, 1,813 (57%) were diagnosed by a physician, 2,118 (66%) had an organism identified by culture, and 37 (1%) had radiologic evidence of infection. Of 3,233 postcesarean infections missed by the operation-based infection, 1,692 (52%) were diagnosed by a physician, 1,714 (53%) had a positive culture, and 117 (4%) had radiographic evidence of infection.

The symptom-based definition was able to identify 104,180 (79%) of the 131,874 severe infections (deep or organ space), and the operation-based definition identified 107,191 (81%) of these severe infections. Limiting to infections after cesarean birth, 89% of severe infections were captured by the symptom-based definition, and 65% were captured by the operation-based infection. The proportion of infections identified by depth of infection is provided in Table 2.

Table 2.

Proportion of Infections Identified by Depth of Infection for All Surgical Site Infections and Infections After Cesarean Birth Only by Simplified Symptom-Based and Operation-Based Case Definitions, National Healthcare Safety Network, 2013–2017

a Infection involves only skin and subcutaneous tissue of the incision.

b Infection involves deep soft tissues of the incision (for example, fascial and muscle layers).

c Infection involves any part of the body deeper than the fascial/muscle layers, that is opened or manipulated during the operative procedure.

Discussion

In resource-limited settings such as LMICs, sustainable surveillance implementation generally requires increased dedicated resources and/or methods to reduce resource burden. Because increased resources are often challenging, we present an early validation of simplified SSI surveillance case definitions to reduce system complexity or burden and support more universally feasible SSI and HAI surveillance.

Using a large set of SSIs reported to the NHSN, we tested the ability of 2 simplified surveillance case definitions to identify reported infections. For all infections, purulence alone identified 69% of SSIs, with pain and/or redness and/or swelling identifying an additional 3% and “wound reopened” identifying an additional 10%. For cesarean births, purulence identified 60% of SSIs, pain and/or redness and/or swelling identified an additional 8%, and “wound reopened” identified an additional 7%. Generally, our simplified definitions had improved agreement with NHSN in more severe infections. A notable exception was the relatively poor agreement observed for the operational-based definition in organ-space infections (Table 2).

Our findings provide evidence for the limits of SSI/HAI surveillance that does not consider microbiologic findings. As many as 75% of infections not captured would have been identified if microbiologic data were considered. Although we acknowledge the critical importance of microbiology in guiding clinical treatment and appropriate antibiotic use, many facilities in LMICs lack access to quality microbiology, which highlights the need for feasible HAI surveillance strategies that provide immediately actionable results without microbiologic infrastructure. With appreciation of the inherent limitations, the simplified definitions proposed, if used systematically and appropriately, can allow appreciation of a consistent and meaningful proportion of infections to help guide and monitor IPC activities.

Several important limitations should be appreciated in consideration of our findings. Reliance on infections reported to the NHSN allows no appreciation of possible over- or under-identification of infections. Additionally, nuances in NHSN reporting may have affected our assessment in ways that could not be well controlled. Specifically, the NHSN does not capture a fever-symptom for superficial infections, which likely limited the agreement of our symptom-based definition and NHSN-reported superficial infections. Finally, the impact of excluding physician diagnosis is highly physician and context dependent and is difficult to generalize.

The NHSN is the most widely used HAI tracking system in the United States, and the value provided to stakeholders is substantial. However, relying on NHSN definitions and methods in non-US limited-resource settings may decrease system efficiency in those settings and limit the value of surveillance results. In settings where gaps in evidence-based infection prevention and control are recognized, direct action to address those practices should be prioritized. However, where evidence and surveillance are required to guide or justify prevention, HAI surveillance must balance system requirements to the benefit the information will provide. Here, we have presented 2 definitions that offer reasonable agreement with the NHSN despite considerable simplification. Along with efforts to build microbiology capacity, further development and validation of HAI surveillance definitions and methods specifically addressing performance and feasibility in limited-resource settings should be prioritized.

Acknowledgments

We thank Dr Joe Sharma, Dr Todd Lucas, and Dr Joseph Solomkin for their reviews and valuable insights into developing these simplified SSI case definitions. We offer special thanks to the dedicated professionals that make the CDC’s National Healthcare Safety Network possible. The findings and conclusions in this report are those of the author(s) and do not necessarily represent the official position of the Centers for Disease Control and Prevention.

Financial support

No financial support was provided relevant to this article.

Conflicts of interest

All authors report no conflicts of interest relevant to this article.

References

Allegranzi, B, Bagheri Nejad, S Fau, Combescure, C, et al. Burden of endemic health-care-associated infection in developing countries: systematic review and meta-analysis. Lancet 2011;377:186–188.CrossRefGoogle ScholarPubMed
Poulsen, KB, Bremmelgaard, A, Sorensen, AI, Raahave, D, Petersen, JV. Estimated costs of postoperative wound infections. A case-control study of marginal hospital and social security costs. Epidemiol Infect 1994;113:283–295.CrossRefGoogle ScholarPubMed
World Health Organization. Prevention of hospital-acquired infections: a practical guide. In: Department of Communicable Disease—Surveillance and Response. Second ed. Geneva, Switzerland: WHO; 2002.Google Scholar
Ayliffe, GA, Casewell, MW, Cookson, BD, et al. National prevalence survey of hospital acquired infections: definitions. A preliminary report of the Steering Group of the Second National Prevalence Survey. J Hosp Infect 1993;24:69–76.Google Scholar
Peel, AL, Taylor, EW. Proposed definitions for the audit of postoperative infection: a discussion paper. Surgical Infection Study Group. Ann R Coll Surg Engl 1991;73:385–388.Google ScholarPubMed
Bruce, J, Russell, EM, Mollison, J, Krukowski, ZH. The quality of measurement of surgical wound infection as the basis for monitoring: a systematic review. J Hosp Infect 2001;49:99–108.CrossRefGoogle ScholarPubMed
National Healthcare Safety Network (NHSN) patient safety component manual, 2017. Centers for Disease Control and Prevention website. https://www.cdc.gov/nhsn/pdfs/validation/2017/pcsmanual_2017.pdf. Published 2017. Accessed February 10, 2020.Google Scholar
Figure 0

Table 1.Percent Agreement for Symptom-Based and Operation-Based Definitions by Definition Elements for All SSI Infections and Restricted to Infections After Cesarean Birth—National Healthcare Safety Network, 2013–2017

Figure 1

Table 2.Proportion of Infections Identified by Depth of Infection for All Surgical Site Infections and Infections After Cesarean Birth Only by Simplified Symptom-Based and Operation-Based Case Definitions, National Healthcare Safety Network, 2013–2017