Antibiotic resistance is a significant problem in health care. Multidrug-resistant organisms (MDROs) are increasingly prevalent and are associated with significant morbidity, mortality, and costs. 1 The United States Centers for Disease Control and Prevention recognizes antibiotic usage as the most important factor driving resistance. 1 Antibiotic exposure is known to contribute to resistance; it is estimated that the odds of developing a MDRO among patients who received antibiotic therapy is 1.8–5.1 times that of patients who did not receive antibiotics.Reference Tornieporth, Roberts, John, Hafner and Riley 2 – Reference Couderc, Jolivet and Thiébaut 4 Antibiotics are among the most common drugs prescribed in medicine; nearly 50% of all hospitalized patients and 75% of critically ill patients receive an antibiotic during a hospital stay. 1 Furthermore, up to 50% of those antibiotics prescribed are considered inappropriate.Reference Dellit, Owens and McGowan 5 Significant opportunities exist to optimize and reduce antibiotic usage. The impact of reducing overall antibiotic usage on antibiotic resistance is not known and would be difficult to assess using traditional study designs. Therefore, we applied mathematical modeling to estimate the effect of reducing antibiotic usage on antibiotic resistance.
In this study, we used agent-based modeling to explore the potential impact of antibiotic stewardship (ie, specifically reduced overall antibiotic usage) on acquisition rates of MDROs and the proportion of patients who acquired a MDRO during their hospital stay. Increased understanding of the potential effect of reducing unnecessary antibiotic usage is useful in promoting and implementing antimicrobial stewardship programs in healthcare settings.
MATERIALS AND METHODS
Agent-based modeling facilitates the explicit simulation of healthcare worker (HCW)–patient interactions that serve as the mechanism for MDRO transmission, and it allows for distinct representation of individual characteristics (ie, heterogeneity).Reference Macal and North 6 We modified an existing agent-based model of MDRO transmission developed using NetLogo version 5.0.5 software 7 that was used in a previous study.Reference Barnes, Morgan, Harris, Carling and Thom 8 (A description of the model pseudocode is provided as an online supplement.) We modeled the intensive care unit (ICU), where MDROs are prevalent and antibiotic usage is high. In this model, we assumed that transmission among patients occurred via the contaminated hands of HCWs. We modeled nurses, physicians, and other HCWs separately, each with distinct, literature-based rates of hand-hygiene compliance on entry and exit to patient rooms.Reference Barnes, Morgan, Harris, Carling and Thom 8 Clinically relevant MDROs were considered in the model; methicillin-resistant Staphylococcus aureus (MRSA) or vancomycin-resistant enterococci (VRE) were modeled as high-prevalence pathogens, while carbapenem-resistent Enterobacteriaceae (CRE), multidrug-resistant Acinetobacter baumannii (MDR-AB), and multidrug-resistant Pseudomonas aeruginosa (MDR-PA) were modeled as low-prevalence pathogens (definitions for MDR-AB and MDR-PA previously reported in the literature were considered).Reference Magiorakos, Srinivasan and Carey 9 MDROs were considered as either high- or low-prevalence based on prevalence rates found predominately in the US literature. Colonization status and transmission with respect to each class of MDROs were modeled independently.
A conceptual diagram of the agent-based model is presented in Figure 1. A proportion of patients admitted to the ICU were colonized with each respective MDRO, modeled using an admission prevalence parameter. An independent proportion of all newly admitted patients was selected at random to receive antibiotics during their stay (ie, antibiotic usage). We assumed that the duration of antibiotic treatment was longer than the length of stay; therefore, we did not model the initiation and termination of antibiotic usage. During each patient’s hospital stay, there were HCW–patient interactions to provide care, and transmission of each MDRO depended on colonization of the patient and contamination of the HCW. We modeled transmission probability asymmetrically; that is, we assumed that a colonized patient was more likely to transmit an MDRO to a HCW than a HCW to a patient. In this model, if a HCW failed to comply with hand hygiene on room exit and again on entry to the subsequent patient’s room—or if the hand hygiene attempt was unsuccessful at removing the contamination—there was risk of transmission to the subsequent patient. The HCW’s hands remained contaminated until a successful hand-hygiene event was completed; therefore, multiple subsequent patients could have been at risk. Patients were discharged at the end of their predetermined length of stay and were immediately replaced with a new patient.
Conceptual flow diagram for agent-based model of multidrug-resistant organism (MDRO) transmission. Patients are admitted to the intensive care unit with a parameterized probability of MDRO colonization and receiving antibiotics. Patients receiving antibiotics are more likely to acquire and transmit a MDRO (microbiome effect) and can also acquire a MDRO via genetic mutation. Healthcare workers periodically visit patients during their stay and can colonize patients if they transiently acquire an MDRO from a colonized patient and transmit it to a susceptible patient prior to successfully cleaning their hands.

As stated, a portion of the patients received antibiotics; we modeled the effect of this antibiotic exposure in 2 ways. First, the administration of antibiotics can lead to disruptions in the human microbiome, which may result in the overgrowth of MDROs that are already present at low levels or can leave patients susceptible to acquisition of new MRDOs. In turn, these patients are in turn more likely to shed and transmit these organisms to other patients via the contamination of HCW hands. For this scenario, we introduced a parameter, denoted the microbiome effect, which increased the transmission probability for relevant visits between patients who received antibiotics and their HCWs. Specifically, we increased the transmission probability from contaminated HCWs to susceptible patients who received antibiotics, and we increased the transmission probability from colonized patients who received antibiotics to susceptible visiting HCWs. We set the baseline microbiome effect at 1.0 (ie, no increase in transmission probability for visits involving patients who received antibiotics). Then, we varied the antibiotic usage and microbiome effect parameters from their respective baseline levels to explore the effect of decreasing overall antibiotic usage on transmission of MDROs in the ICU. Our goal was to identify the level at which the microbiome effect causes transmission to become statistically significantly higher, as well as the level at which an overall reduction in antibiotic usage causes a statistically significant decrease in transmission.
We also modeled the effect of antibiotic usage in a second manner. In some cases, the presence of antibiotics can lead to the development of antibiotic resistance via genetic mutation. Thus, we introduced another parameter, denoted the mutation effect, which designated a small proportion of patients who received antibiotics to develop a MDRO via this mechanism. The actual proportion of patients who received antibiotics and developed a resistant phenotype via mutation is unknown. We set the mutation effect conservatively at 1%, and we varied this parameter via sensitivity analysis to evaluate the effect of this assumption on our results, given the uncertainty surrounding the actual likelihood of the occurrence of a mutation event (see online supplement).
The model inputs for the simulation experiments are summarized in Table 1. Many nonexperimental parameters were configured using data from the research literature or observation data from a large, academic medical center.Reference Climo, Sepkowitz and Zuccotti 10 – Reference Candeloro, Kelly, Bohdanowicz, Martin and Bombassaro 28 In the absence of other information, the remaining nonexperimental parameter values were selected to model a general hospital ICU. These nonexperimental parameters were generally held constant for all simulation experiments, with the exception of sensitivity analysis performed for the mutation effect and the hand hygiene of nurses. The key experimental parameters were the antibiotic usage and microbiome effect. At baseline, we assumed an antibiotic usage of 75%, that is, 75% of the patients in our model received antibiotics,Reference Lawrence, Puzniak, Shadel, Gillespie, Kollef and Mundy 26 – Reference Lilly, Zuckerman, Badawi and Riker 29 and no microbiome effect (ie, equal to 1).
Agent-Based Model Input Parameters

NOTE. HCW, healthcare worker.
a The probability of transmission given an interaction between a susceptible agent and a colonized agent.
b For sensitivity analysis of the hand hygiene compliance of nurses and the mutation rate, please see the online supplement.
RESULTS
We simulated the transmission of the high- and low-prevalence MDROs for 1 year using the model inputs specified in Table 1. We performed 200 replications each for 33 parameter-based scenarios and compared the effects of antibiotic usage and the microbiome effect on prevalence-specific acquisition rates (acquisitions per 1,000 patient days) and the proportion of patients who acquired each class of MDRO during their stay. We first explored this effect using a baseline frequency of antibiotic usage of 75% and then explored the effect on transmission by reducing absolute antibiotic usage by 10% and 25%, respectively.
In Figure 2, we summarize the prevalence-specific acquisition rates (dependent outcome) as a function of the microbiome effect and antibiotic usage. When considering a microbiome effect of 2.0 (ie, that patients who received antibiotics were twice as likely to acquire or transmit a MDRO), reducing antibiotic usage by 10% (ie, from 75% to 65%) reduced acquisition rates of high-prevalence MDROs by 11.2% from 8.56 to 7.60 acquisitions per 1,000 patient days (P<.001). Reducing antibiotic usage by 25% (i.e., from 75% to 50%) reduced acquisition rates by 28.3% from 8.56 to 6.14 acquisitions per 1,000 patient days (P<.001). For low-prevalence MDROs, absolute reductions in antibiotic usage by 10% and 25% reduced acquisition rates by 14.3% (P<.001) and 29.8% (P<.001), respectively.
Prevalence-specific multidrug-resistant organism (MDRO) acquisition rates as a function of microbiome effect and antibiotic usage levels. Acquisition rates for high- and low-prevalence MDROs grow exponentially with increasing microbiome effect, and statistically significant benefits of decreased antibiotic usage are observed at microbiome effect levels of ~1.2 and higher.

For the high-prevalence MDROs, when considering a microbiome effect of 1.1 (ie, a 10% increase in transmission probability between patients receiving antibiotics and HCWs) and higher, acquisition rates were statistically significantly higher than at baseline (ie, microbiome effect of 1.0) for all experimental levels of antibiotic usage. Statistically significant differences for low-prevalence MDROs were not consistently observed until a microbiome effect of 1.3 was used for all experimental levels of antibiotic usage. Using the same testing approach, we found that reducing the proportion of patients who received antibiotics from 75% to 65% significantly lowered acquisition rates at a microbiome effect of 1.5 for the high-prevalence MDROs and 1.7 for the low-prevalence MDROs, respectively. Reducing the proportion of patients who received antibiotics from 75% to 50% provided a consistent benefit at microbiome effects of 1.2 and 1.4 for high- and low-prevalence MDROs, respectively.
Figure 3 summarizes the proportion of patients who acquired an MDRO during their stay (dependent outcome). We observed similar trends with respect to the microbiome effect as for acquisition rates. In addition, among patients not receiving antibiotics, acquisition rates increased with the microbiome effect for both high- and low-prevalence MDROs.
Proportion of patients who acquire each class of multidrug-resistant organism (MDRO) during their stay as a function of the microbiome effect and whether they are receiving antibiotics. Increasing the microbiome effects not only increases transmission for patients who are receiving antibiotics but also increases colonization pressure for all patients. Differences between the 2 groups of patients at a microbiome effect of 1.0 (no effect) are due to genetic mutation effects.

DISCUSSION
Antibiotic usage, and in particular unnecessary usage of antibiotics, is a major driver of antibiotic resistance. A primary goal of antimicrobial stewardship programs, therefore, is to reduce the incidence of resistant organisms by reducing antibiotic usage. 30 , Reference File, Srinivasan and Bartlett 31 We found measurable and significant benefits to be gained by reducing antibiotic usage in an ICU setting. Studies reporting on the outcomes of antimicrobial stewardship interventions suggest that a reduction in overall antibiotic usage by approximately 33% is feasible.Reference Dellit, Owens and McGowan 5 , Reference Nilholm, Holmstrand and Ahl 32 , Reference Malani, Richards, Kapila, Otto, Czerwinski and Singal 33 Even a moderate absolute reduction of 10% in overall antibiotic usage has the potential to reduce acquisition rates of MDROs by 11.2%, and a 25% absolute reduction in antibiotic usage can reduce MDRO acquisition rates by 28.3%.
Mathematical modeling, such as the methods used in this paper, is an important tool to evaluate the impact of antibiotic reduction because large-scale clinical studies to evaluate the impact of reduced overall antibiotic usage on the spread of resistant organisms are complex and/or unavailable. Mathematical modeling of this problem to date has been limited; a time series analysis study by Willman et alReference Willmann, Marschal, Hölzl, Schröppel, Autenrieth and Peter 34 only evaluated the potential effect of a specific antibiotic (meropenem) on resistance rates of a specific organism (multidrug-resistant Pseudomonas aeruginosa).Reference Willmann, Marschal, Hölzl, Schröppel, Autenrieth and Peter 34 In 2016, Pelat et alReference Pelat, Kardaś-Słoma and Birgand 35 developed a stochastic, compartmental model of extended-spectrum β-lactamase–producing Enterobacteriaceae transmission in an ICU and explored the impact of reducing antibiotic prevalence at admission with or without reducing antibiotherapy duration. These researchers found that the reduction in antibiotic prevalence at admission by 50% reduced acquisition rates by as much as 33%, which is consistent with our results. Our study also focused on the effect of an overall reduction in antibiotic usage on transmission of multiple MDROs, but we utilized an agent-based model to simulate the potential effects of the intervention—including both microbiome and mutation effects—instead of a projection based on forecast estimates or compartmental modeling.
There are challenges in using traditional study methods and outcomes to examine the impact of antimicrobial stewardship. First, the use of the antibiogram does not capture changes in resistance patterns over time in a hospital unit, as it usually includes only the first isolate from each patient.Reference Dickstein, Geffen, Leibovici and Paul 36 Second, reliance on clinical cultures to assess changes in resistance patterns is challenging due to the infrequency of positive clinical cultures; therefore, few studies include development of antimicrobial resistance based on surveillance cultures as a primary outcome.Reference McGregor and Furuno 37 , Reference Schechner, Temkin, Harbarth, Carmeli and Schwaber 38 The use of transmission dynamic modeling allows for the estimation of the impact of antimicrobial stewardship via experimentation with relevant parameters.
In this model, we considered 2 effects of antibiotic usage: the microbiome effect and the mutation effect. A few studies have examined the microbiome of individuals after antibiotic exposure.Reference Malhotra-Kumar, Lammens, Coenen, Van Herck and Goossens 39 , Reference Hay, Thomas and Montgomery 40 In one study, Malhotra et alReference Malhotra-Kumar, Lammens, Coenen, Van Herck and Goossens 39 examined the impact of macrolide versus placebo use on macrolide-resistant streptococci from pharyngeal swabs of healthy volunteers and found that exposure to azithromycin increased the proportion of streptococci that were macrolide resistant by 53.4%. However, the antibiotic effect on risk of transmission from one person to the next (ie, the microbiome effect) is not known. In our model, we examined microbiome effect over a spectrum and noted that benefits are statistically significant even at conservative estimates, particularly for high-prevalence MDROs (ie, ranging from 1.2 to 1.5, depending on the level of antibiotic usage). The benefits of antibiotic reduction were even larger at higher levels.
Furthermore, overall reduction of antibiotic usage lowers colonization pressure for the entire unit, including for patients who are not receiving antibiotics. In this scenario, fewer patients receive antibiotics and are therefore less likely to transmit (if they are colonized) or acquire a MDRO (either via a contaminated HCW or genetic mutation). As a result, other susceptible patients in the unit are at a decreased risk of acquisition because HCWs are not exposed as often to colonized patients.
The benefits observed in this model are proportionally similar for both high- and low-prevalence MDROs with similar relative risk reductions. For typical high-prevalence MDROs, such as MRSA or VRE, a significant reduction in antibiotic usage can lead to a reduction of multiple acquisitions per 1000 patient days. For low-prevalence MDROs, a reduction in antibiotic usage can have the same relative effect, although not as large of an absolute risk reduction (ie, in terms of acquisitions per 1,000 patient days). Such a reduction could be a key intervention to preventing further emergence and spread of these MDROs and to maintaining low prevalence.Reference Cotter, Stanton, Ross and Hill 41 Notably, prevalence varies geographically, and the assumptions made regarding low- and high-prevalence MDROs may not hold true in specific areas. For example, multidrug-resistant gram-negative bacteria are more common in regions such as India and Greece and may be considered high-prevalence pathogens in these locations.
This study has some limitations. First, we grouped the effects of all antibiotics together with respect to antibiotic usage and the microbiome effect. In reality, different antibiotics (or classes of antibiotics) may have differential effects on the transmission probabilities for various MDROs, but this level of detail is not currently supported by available data.Reference Cotter, Stanton, Ross and Hill 41 In addition, we only considered a single category of antibiotic usage, which ignores differences in outcomes for patients who receive suboptimal dosing.Reference Drusano, Louie, Deziel and Gumbo 42 This simplification limited the number of parameter assumptions required for the model and facilitated more direct experimentation regarding the primary interventional parameter (ie, antibiotic usage). Next, the results generated via simulation are sensitive to the input parameters and would likely change under different assumptions. For example, admission prevalence as well as compliance rates for hand hygiene and glove and gown usage are likely to vary by hospital; they are strong determinants for MDRO transmission in the model. In addition, antibiotic prescribing practices are also likely to vary. However, modifying these parameters tends to scale transmission proportionally and does not have a significant impact on the proportional effect of reducing antibiotic usage. For example, increasing the mutation rate from 1% to 5% of patients receiving antibiotics increased overall transmission; however, the percentage decrease in acquisition rates due to a reduction in antibiotic usage remained strongly significant. Additional details on the sensitivity analysis of hand hygiene and mutation effect parameters are available in an online supplement, which supports our results in the face of the variability and uncertainty associated with these parameters. In this study, we focused on setting the model parameters to evidence-based values, either informed by the literature or by calibrating those using observational data. Individual facilities could adapt the model parameters as needed to form more reasonable estimates of local prevalence and transmission levels, as well as the effect of reducing antibiotic usage on acquisition rates and other secondary outcomes.
In a critical-care setting—where nearly 75% of patients receive antibiotics and up to 50% of antibiotic courses may be considered inappropriate—even a moderate reduction in antibiotic usage is expected to cause a clinically significant reduction of MDRO transmission. In prior studies, antimicrobial stewardship programs have been shown to reduce overall antibiotic usage by nearly 33%, which in our model would result in at least a 25% decrease in MDRO acquisition. These reductions are statistically significant and proportionally similar for both high- and low-prevalence MDROs, and they can potentially decrease MDRO acquisition among patients who are receiving antibiotics as well as among patients who are not receiving antibiotics.
Acknowledgments
The authors would like to thank Gwen Robinson for her assistance with the preparation and submission of this manuscript.
Financial support: A.D.H. is supported by a grant from the National Institutes of Health (NIH; grant no. 5K24AI079040-05). K.A.T. is supported by an NIH Career Development Grant (grant no. 1K23AI08250-01A1). D.J.M. is supported by a grant from the Veterans Affairs Health Services Research and Development Department (grant no. CRE 12-307).
Potential conflicts of interest: All authors report no conflicts of interest relevant to this article.
SUPPLEMENTARY MATERIAL
To view supplementary material for this article, please visit https://doi.org/10.1017/ice.2017.34




