Hostname: page-component-7b7567c8c-wxvwp Total loading time: 0 Render date: 2026-11-13T19:05:58.030Z Has data issue: false hasContentIssue false
  • English
  • Français

Development and implementation of the Antimicrobial Stewardship Intervention Scoring Tool at a single pediatric institution

Published online by Cambridge University Press:  16 September 2024

Ann L. WirtzOpen the ORCID record for Ann L. Wirtz[Opens in a new window],
Alaina N. BurnsOpen the ORCID record for Alaina N. Burns[Opens in a new window],
Elizabeth MonseesOpen the ORCID record for Elizabeth Monsees[Opens in a new window],
Brian R. LeeOpen the ORCID record for Brian R. Lee[Opens in a new window] and
Joshua C. HerigonOpen the ORCID record for Joshua C. Herigon[Opens in a new window]
Ann L. Wirtz*
Affiliation:
Department of Pharmacy, Children’s Mercy Kansas City, University of Missouri, Kansas, MO, USA
Alaina N. Burns
Affiliation:
Department of Pharmacy, Children’s Mercy Kansas City, University of Missouri, Kansas, MO, USA
Elizabeth Monsees
Affiliation:
Performance Excellence, Children’s Mercy Kansas City, University of Missouri, Kansas, MO, USAUniversity of Missouri-Kansas City School of Medicine, Children’s Mercy Kansas City, University of Missouri, Kansas, MO, USA
Brian R. Lee
Affiliation:
University of Missouri-Kansas City School of Medicine, Children’s Mercy Kansas City, University of Missouri, Kansas, MO, USADivision of Pediatric Infectious Diseases, Children’s Mercy Kansas City, University of Missouri, Kansas, MO, USA
Joshua C. Herigon
Affiliation:
University of Missouri-Kansas City School of Medicine, Children’s Mercy Kansas City, University of Missouri, Kansas, MO, USADivision of Pediatric Infectious Diseases, Children’s Mercy Kansas City, University of Missouri, Kansas, MO, USA
*
Corresponding author: Ann L. Wirtz; Email: alwirtz@cmh.edu
Rights & Permissions [Opens in a new window]

Abstract

Objective:

The primary objective was to grade the potential impact of antimicrobial stewardship program (ASP) interventions on patient safety at a single center using a newly developed scoring tool, the Antimicrobial Stewardship Impact Scoring Tool (ASIST).

Design:

Retrospective descriptive study.

Setting:

A 367-bed free-standing, pediatric academic medical center.

Methods:

The ASP team developed the ASIST which scored each intervention on an impact level (low, moderate, high) based on patient harm avoidance and degree of antibiotic optimization. Intervention frequency and characteristics were collected between May 1, 2022 and October 31, 2023. Intervention rates per impact level were calculated monthly.

Results:

The ASP team made 1024 interventions further classified as low (45.1%), moderate (47%), and high impact (7.9%). The interventions for general pediatrics (53.9%) and those to modify formulation (62.2%), dose/frequency (58.1%), and duration (57.5%) were frequently low impact. Hematology/oncology (12.5%), sub-specialty (11.7%), and surgical services (11.3%) had the greatest rate of high-impact interventions. Interventions to broaden antibiotics (40.8%) and those associated with antibiotics used to treat bacteremia (20.6%) were frequently classified as high-impact.

Conclusion:

The ASIST is an effective tool to link ASP interventions to prevention of antimicrobial-associated patient harm. For our ASP team, it provided meaningful data to present to hospital leadership and identified opportunities to prevent future harm and reduce ASP team workload.

Information

Type
Original Article
Information
Infection Control & Hospital Epidemiology , Volume 45 , Issue 11 , November 2024, pp. 1341 - 1346
Check for updates
Copyright
© The Author(s), 2024. Published by Cambridge University Press on behalf of The Society for Healthcare Epidemiology of America

Background

Antimicrobials are one of the most frequent medications resulting in adverse drug reactions (ADR), and use of antimicrobials, both appropriately and inappropriately, has been associated with an increased risk of patient harm. Reference Bauer, Kullar, Gilchrist and File1–Reference Butler, Brown and Durkin4 In a single-center retrospective study of hospitalized pediatric patients receiving antimicrobials, 21% experienced an ADR, and each additional day of antimicrobials was associated with a 7% increased risk. Reference Same, Hsu and Cosgrove5 Antimicrobial stewardship programs (ASPs) are closely tied to patient safety as the overall goal is to “to optimize clinical outcomes while minimizing unintended consequences of antimicrobial use.” Reference Tamma, Holmes and Ashley6 ASP interventions in the inpatient setting have decreased inappropriate antimicrobial use, Clostridioides difficile infection rates, and other variables. Reference Searns, Williams and MacBrayne7–Reference Hurtado, Varela, Juarez, Nguyen and Nhean10

A key component of ASPs has been ongoing monitoring of various metrics. 11–13 In the “The Core Elements of Hospital Antibiotic Stewardship Programs, 2019,” the Centers for Disease Control and Prevention (CDC) recommends following process metrics (eg, antibiotic utilization) and outcomes (eg, antibiotic resistance rates). 11 While effective at displaying program progress, these metrics do not adequately depict the direct impact of the ASP on patient safety, which is an important metric for both hospital leadership who are charged with resource allocation and frontline teams who are responsible for implementing change. There is a need for an objective, quantifiable measure to assess antimicrobial-associated patient harm avoided due to ASP intervention. This study describes the development of a novel metric—the Antimicrobial Stewardship Impact Scoring Tool (ASIST)—which associates each inpatient ASP prospective audit and feedback (PAF) intervention with a level (high, moderate, low impact) of patient harm prevention and antimicrobial optimization. The primary objective was to grade the potential impact of ASP PAF interventions on patient safety at a single center using the ASIST.

Methods

Study setting

Children’s Mercy Kansas City (CMKC) is a 367-bed free-standing, pediatric academic medical center that provides comprehensive primary and tertiary care for a 5-state, 100-county region. During the study period, the ASP team consisted of two infectious diseases (ID) clinical pharmacy specialists, five ID physicians, one advanced practice provider (APP), one nurse with infection prevention and clinical safety experience, and one data analyst. A hospital wide PAF ASP was initiated on March 3, 2008 targeting inpatients receiving antibiotics without an active ID consult. An ID pharmacist, physician, or the APP performed a daily review of inpatients receiving antibiotics for two consecutive calendar days. During the weekdays, when an ID pharmacist was responsible for PAF review, an ID physician assisted in identifying and providing interventions. The ASP team provided interventions to the primary medical team when indicated and utilized standardized intervention categories: ID consult, narrow antibiotics, broaden antibiotics, modify formulation (ex. intravenous (IV) to oral (PO) transition), optimize duration, modify dose/frequency, consolidate antibiotics, and stop antibiotics. The ASP team also collected whether interventions were accepted or rejected within 24 hours of intervention. This information was documented by the ASP team member performing the review in an ASP intervention form within the electronic health record (EHR). The ASP team tracked various program metrics (days of therapy (DOT) per 1,000 patient days, intervention characteristics, etc) monthly and reported regularly to various leadership groups within the institution.

Impact score design and implementation

In September 2021, the ASP team began developing the ASIST to quantify patient harm avoidance and degree of antibiotic optimization with PAF interventions. The ASP team created a multidisciplinary subgroup including ID/ASP pharmacists, an ID/ASP physician, and a nurse to develop the ASIST. We modeled the ASIST loosely after the American Society of Healthcare Risk Management Patient Safety Event Classification which includes three safety event classes depending on whether the error reaches the patient (Serious Safety Event, Safety Event, Pre-Patient Event) and the level of harm occurring. Reference Hoppes and Mitchell14 Similarly, the group defined three levels of impact: low, moderate, and high for the ASIST. With low-impact interventions, antimicrobial-associated patient harm was unlikely to occur, but opportunities existed for minor antibiotic optimization. Moderate interventions had substantial room for antibiotic optimization but still were thought to have low risk for antimicrobial-associated patient harm. High-impact interventions carried substantial risk of antimicrobial-associated patient harm due to high probability of a severe adverse effect or due to poor outcomes from an inappropriate regimen as documented in evidence-based guidelines or high-quality literature. A severe adverse effect included situations that could contribute to patient death or temporary/permanent harm such as organ dysfunction, prolonged hospitalization, or medical/surgical intervention. Reference Hoppes and Mitchell14 Using these principles and examples of interventions made during daily ASP PAF rounds, definitions for each level of impact were created for all the standardized ASP intervention categories (Table 1). For the “stop antibiotics” intervention category, the ASP team classified specific antibiotics as narrow- or broad-spectrum utilizing a previously described rank system created by the Duke Antimicrobial Stewardship Outreach Network. 15 (Supplemental Table 1) Examples of interventions within each impact category is found in the supplemental information (Supplemental Table 2).

Table 1.

Antimicrobial Stewardship Impact Scoring Tool (ASIST)

Note. IV, intravenous; PO, oral; PIV, peripheral intravenous line; CVL, central venous line.

In November 2021, the ASP team began piloting the ASIST during daily PAF rounds. ASP team members were trained on the tool, and each intervention was independently scored by the ID pharmacist or APP and ID physician conducting ASP PAF that day. Discrepancies and interventions which did not cleanly fall into a distinct category were identified and reviewed monthly by the ASP subgroup to inform modifications. The ASP subgroup met monthly to evaluate these instances and modified the tool as necessary. The tool was finalized in April 2022.

The impact level for each intervention was recorded in the EHR within our existing ASP intervention documentation. High-impact interventions were discussed at the ASP multidisciplinary huddle to identify any systematic interventions to implement to prevent possible antimicrobial-associated patient harm. Numbers of low-, moderate-, and high-impact interventions were included in ASP data sharing with various hospital committees.

Study design and end points

The institutional review board reviewed and approved this study. The primary objective was to grade the potential impact of ASP PAF interventions on patient safety at a single center using the ASIST. Data were extracted from the EHR between May 1, 2022 and October 31, 2023 on a monthly basis. The absolute number and frequency of all ASP PAF interventions as well as those classified as high, moderate, or low impact were collected for each month. Details such as patient age, patient sex, primary medical service, antibiotic indication, intervention category, and intervention acceptance were obtained from ASP documentation in the EHR.

Results

Between May 1, 2022 and October 31, 2023, the ASP team made 1024 interventions with an average of 57 interventions provided each month (range: 36–84). The proportion of all interventions classified as low-, moderate-, or high-impact differed by month (Figure 1). On average, five high-impact interventions were provided each month (range 2–10).

Figure 1.

Monthly frequency of low-, moderate-, and high-impact antimicrobial stewardship interventions.

The vast majority of all ASP interventions were classified as low (45.1%) or moderate impact (47%) (Table 2). Intervention categories with the largest proportion of low-impact interventions included modify formulation (62.2%), modify dose/frequency (58.1%), and optimize duration (57.5%). The general pediatrics service had the greatest proportion of low-impact interventions (53.9%). The intervention categories of consolidate antibiotics (61.1%), stop antibiotics (56.9%), and ID consult (55.4%) were frequently classified as moderate impact. A smaller proportion of interventions (7.9%) were classified as high-impact. While the general pediatrics, PICU, and NICU services had the greatest absolute number of high-impact interventions, the greatest rate was observed with the hematology/oncology (12.5%), sub-specialty (11.7%), and surgical services (11.3%). Interventions to broaden antibiotics (40.8%) and those associated with antibiotics used to treat bacteremia (20.6%) were frequently classified as high-impact. The antibiotics with the highest rates of high-impact interventions included aminoglycosides (12.5%), vancomycin (10.3%), and fluoroquinolones (9.7%). Primary care teams accepted 91.4% of high-impact interventions.

Table 2.

Characteristics of antimicrobial stewardship program interventions by impact level

a Proportions reflect the percentage of overall interventions with a denominator of 1024 total interventions

b Proportions are the percentage of low-, moderate-, and high-impact interventions composing the total number of interventions in each row

c Multiple antibiotics could be associated with a single intervention

Discussion

This report describes the successful development and implementation of a novel scoring tool to associate each ASP intervention with a level (low-, moderate-, high-impact) of patient harm prevention and antimicrobial optimization. While the majority of the ASP interventions were considered low- or moderate-impact, high-impact interventions occurred consistently. Traditional metrics fail to capture ASP impact on patient safety; a measure such as the ASIST is needed to better describe impact and inform program agenda. Enumerating high-impact interventions quantifies the prevention of significant harm by the ASP and can help to prevent future antimicrobial-related safety events. At the same time, low-impact interventions may identify opportunities for automation, protocol development, and prioritization of program resources.

Traditional ASP measures have focused on four primary areas: antimicrobial utilization, program process, clinical or microbiological outcomes, and financial impact. Reference Brotherton16 These metrics focus on cost and consumption of antimicrobials and fail to capture instances where ASP interventions impacted patient safety, especially in the pediatric setting. Reference File, Srinivasan and Bartlett17 In the literature, various ASPs have developed subjective systems to recognize “great catches” where the ASP intervention changed the trajectory of patient care. Reference Searns, Williams and MacBrayne7 The ASIST was designed as an objective measure to be utilized by our ASP team members and eventually expanded across multiple healthcare settings. The tool allows ASPs to capture not only the quantity of interventions but also the qualitative aspect. Our ASP team identifies that the ASIST is easy to use and adds limited time to daily ASP documentation. As the ASIST was loosely modeled after the American Society of Healthcare Risk Management Patient Safety Event Classification, its terminology is something familiar to hospital leadership. Similar to event reporting systems, as a program we have used the ASIST to identify trends and put forth interventions to prevent future harm from antimicrobials. Reference Hoppes and Mitchell14 We share the distribution of high-, moderate-, and low-impact interventions with hospital leadership allowing us to have further conversations about the value of ASP involvement in patient safety.

High-impact interventions occurred almost weekly. These were almost always followed by the primary medical team, further justifying the need for ASP PAF reviews. For example, high-impact interventions occurred frequently with vancomycin, aminoglycosides, and fluoroquinolones which have high rates of ADRs. Reference Campbell, Chen and Edelstein18,Reference Baggio and Ananda-Rajah19 A large proportion of ASP interventions for hematology/oncology, sub-specialty, and surgical services were considered high-impact. This is likely because these patients are often more complex, have higher risk for error or ADRs, or utilize broad-spectrum antimicrobials more frequently making treatment more challenging. Reference Boton, Patel, Kendall, Hershey and Jarzebowski20–Reference Majumdar, Shah, Park, Narayanan, Kaye and Bhatt23 The increased risk of high-impact interventions for these services highlights the impact the ASP may have in complex patients. Additionally, ASP team members made many high-impact interventions related to broadening antimicrobials. Upon review, many of these interventions were related to inappropriate use of third generation cephalosporins to treat Enterobacterales at moderate to high risk for clinically significant AmpC production, which was a deviation from national guideline recommendations. Reference Tamma, Aitken and Bonomo24 Therefore, we worked with our microbiology laboratory to suppress third generation cephalosporin susceptibilities on specific isolate types (eg, blood cultures) for these organisms and provided education to specific units on appropriate treatment.

In contrast, low-impact interventions occurred consistently and in certain months accounted for majority of the ASP interventions. With increasing demand for ASPs, recent publications highlight the need to shift the responsibility of appropriate antimicrobial use away from the ASP and to the frontline clinician thus limiting the need for ASP oversight. Reference Jenkins and Tamma25 Low-impact interventions may provide opportunity to do so. At our institution, updating antimicrobial order sentences to include preset durations for specific indications (eg, 5 days for pneumonia) or implementing automatic IV to PO transitions for certain antimicrobials may reduce number of low-impact interventions. As a program, we could leverage primary team pharmacist involvement to make low-impact interventions, team pharmacist participation in ASPs has been successful in expanding stewardship reach. Reference Dubrovskaya, Scipione and Siegfried26,Reference Wirtz, Burns and Lee27

A limitation of this study is that the ASIST was developed by and utilized only at our institution. It is unknown whether the tool would be applicable to other ASPs at other centers and whether similar results would be obtained. However, a multi-center collaborative is currently underway to gain consensus on the scoring tool. While we aimed for the tool to be as objective as possible, the tool was not formally validated. Our program has multiple ASP team members, and it is possible that there would be differences in coding of interventions.

ASPs are a vital component to prevent antimicrobial-associated patient harm and new metrics are needed to better depict the association of ASPs and patient safety. Reference Tamma, Holmes and Ashley6 We report the successful implementation of a novel tool, the ASIST, to score ASP interventions on the degree of antimicrobial optimization and impact on harm prevention. The ASIST tool was helpful as a method to report ASP safety data to hospital leadership. As a program, we continue to review high-impact interventions to identify processes to implement to prevent future harm as well as review trends in low-impact interventions to potentially reduce ASP team workload. Future directions include approval and expansion of the ASIST outside of our organization.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/ice.2024.114.

Acknowledgements

The authors would like to thank the members of the Children’s Mercy Antimicrobial Stewardship Program for their assistance in developing and utilizing the ASIST.

Financial support

None reported.

Competing interests

ALW has received grant funding through the Association for Professionals in Infection Control and Epidemiology to expand the ASIST to external institutions. All other authors have no conflicts of interest.

References

Bauer, KA, Kullar, R, Gilchrist, M, File, TM. Antibiotics and adverse events: the role of antimicrobial stewardship programs in ‘doing no harm’. Curr Opin Infect Dis 2019;32:553–558.CrossRefGoogle ScholarPubMed
Shehab, N, Patel, PR, Srinivasan, A, Budnitz, DS. Emergency department visits for antibiotic-associated adverse events. Clin Infect Dis 2008;47:735–743.CrossRefGoogle ScholarPubMed
Tamma, PD, Avdic, E, Li, DX, Dzintars, K, Cosgrove, SE. Association of adverse events with antibiotic use in hospitalized patients. JAMA Intern Med 2017;177:1308–1315.CrossRefGoogle ScholarPubMed
Butler, AM, Brown, DS, Durkin, MJ, et al. Association of inappropriate outpatient pediatric antibiotic prescriptions with adverse drug events and health care expenditures. JAMA Netw Open 2022;5:e2214153.CrossRefGoogle ScholarPubMed
Same, RG, Hsu, AJ, Cosgrove, SE, et al. Antibiotic-associated adverse events in hospitalized children. J Pediatric Infect Dis Soc 2021;10:622–628.CrossRefGoogle ScholarPubMed
Tamma, P, Holmes, A, Ashley, ED. Antimicrobial stewardship: another focus for patient safety?. Curr Opin Infect Dis 2014;27:348–355.CrossRefGoogle ScholarPubMed
Searns, JB, Williams, MC, MacBrayne, CE, et al. Handshake antimicrobial stewardship as a model to recognize and prevent diagnostic errors. Diagnosis (Berl) 2020; 8:347–352.CrossRefGoogle Scholar
Patel, S, Vazquez, JA, Chase, A, Ebong, E. 89. A collaborative & novel antimicrobial stewardship initiative – mandatory approval of peripherally inserted central venous catheters. Open Forum Infect Dis 2020;7:S60–S61.CrossRefGoogle Scholar
Tamma, PD, Miller, MA, Dullabh, P, et al. Association of a safety program for improving antibiotic use with antibiotic use and hospital-onset Clostridioides difficile infection rates among US hospitals. JAMA Netw Open 2021;4:e210235.CrossRefGoogle ScholarPubMed
Hurtado, D, Varela, M, Juarez, A, Nguyen, Y-N, Nhean, S. Impact of antimicrobial stewardship program intervention acceptance on hospital length of stay. Hosp Pharm 2023;58:491–495.CrossRefGoogle ScholarPubMed
The core elements of hospital antibiotic stewardship programs: 2019. Center for Disease Control and Prevention website. https://www.cdc.gov/antibiotic-use/healthcare/pdfs/hospital-core-elements-H.pdf. Published 2019. Accessed February 20, 2024.Google Scholar
The Joint Commission. New and revised requirements addressing antibiotic stewardship for the hospital and critical access hospital programs: 2023. https://www.jointcommission.org/-/media/tjc/documents/standards/r3-reports/r3_antibioticstewardship_july2022_final.pdf. Published 2023. Accessed February 20, 2024.Google Scholar
Centers for Medicare and Medicaid Services. Infection prevention and control and antibiotic stewardship program interpretive guidance update. https://www.cms.gov/files/document/qso-22-20-hospitals.pdf. Published 2022. Accessed February 20, 2024.Google Scholar
Hoppes, M, Mitchell, J. Serious safety events: a focus on harm classification: deviation in care as link. Getting to zero white paper series - edition No. 2. American Society for Healthcare Risk Management (ASHRM). https://www.ashrm.org/sites/default/files/ashrm/SSE-2_getting_to_zero-9-30-14.pdf. Published 2014. Accessed February 19, 2024.Google Scholar
Duke Antimicrobial Stewardship Outreach Network. Developing patient safety outcome measures and measurement tools for antibiotic stewardship programs metrics guide. https://dason.medicine.duke.edu/sites/default/files/media-file/dason-cdcfinalanalysistool-r11-21.pdf. Published 2017. Accessed February 19, 2024.Google Scholar
Brotherton, AL. Metrics of antimicrobial stewardship programs. Med Clin North Am 2018;102:965–976.CrossRefGoogle ScholarPubMed
File, TM Jr, Srinivasan, A, Bartlett, JG. Antimicrobial stewardship: importance for patient and public health. Clin Infect Dis 2014;15:S93–6.CrossRefGoogle Scholar
Campbell, RE, Chen, CH, Edelstein, CL. Overview of antibiotic-induced nephrotoxicity. Kidney Int Rep 2023;8:2211–2225.CrossRefGoogle ScholarPubMed
Baggio, D, Ananda-Rajah, MR. Fluoroquinolone antibiotics and adverse events. Aust Prescr 2021;44:161–164.CrossRefGoogle ScholarPubMed
Boton, NH, Patel, PK, Kendall, RE, Hershey, C, Jarzebowski, M. Errors in perioperative antimicrobial use for hospitalized surgical patients. Antimicrob Steward Healthc Epidemiol 2022;2:e162.CrossRefGoogle ScholarPubMed
Papan, C, Reifenrath, K, Last, K, et al. Antimicrobial use in pediatric oncology and hematology in Germany and Austria, 2020/2021: a cross-sectional, multi-center point-prevalence study with a multi-step qualitative adjudication process. Lancet Reg Health Eur 2023;28:100599.CrossRefGoogle ScholarPubMed
Amaro-Hosey, K, Danés, I, Vendrell, L, et al. Adverse reactions to drugs of special interest in a pediatric oncohematology service. Front Pharmacol 2021;12:670945.CrossRefGoogle Scholar
Majumdar, A, Shah, MR, Park, JJ, Narayanan, N, Kaye, KS, Bhatt, PJ. Challenges and opportunities in antimicrobial stewardship among hematopoietic stem cell transplant and oncology patients. Antibiotics 2023;12:592.CrossRefGoogle ScholarPubMed
Tamma, PD, Aitken, SL, Bonomo, RA, et al. Infectious Diseases Society of America 2023 guidance on the treatment of antimicrobial resistant gram-negative infections, Clin Infect Dis 2023;ciad428.CrossRefGoogle Scholar
Jenkins, TC, Tamma, PD. Thinking beyond the “core” antibiotic stewardship interventions: Shifting the onus for appropriate antibiotic use from stewardship teams to prescribing clinicians. Clin Infect Dis 2021;72:1457–1462.CrossRefGoogle ScholarPubMed
Dubrovskaya, Y, Scipione, MR, Siegfried, J, et al. Multilayer model of pharmacy participation in the antimicrobial stewardship program at a large academic medical center. Hosp Pharm 2017;52:628–634.CrossRefGoogle Scholar
Wirtz, AL, Burns, AN, Lee, BR, et al. Effectiveness and safety of mandatory antimicrobial indications and durations and a pharmacist-driven 48-hour time-out in a pediatric hospital. Am J Health Syst Pharm 2020;77:614–621.CrossRefGoogle Scholar
Figure 0

Table 1.Antimicrobial Stewardship Impact Scoring Tool (ASIST)

Figure 1

Figure 1.Monthly frequency of low-, moderate-, and high-impact antimicrobial stewardship interventions.

Figure 2

Table 2.Characteristics of antimicrobial stewardship program interventions by impact level

Supplementary material: File

Wirtz et al. supplementary material 1

Wirtz et al. supplementary material
Download Wirtz et al. supplementary material 1(File)
File 23.4 KB
Supplementary material: File

Wirtz et al. supplementary material 2

Wirtz et al. supplementary material
Download Wirtz et al. supplementary material 2(File)
File 22.1 KB