1361. Taken in Isolation: How Improved Infection Control Makes Measuring Improvements in Infection Control More Difficult
Session: Poster Abstract Session: HAI: Epidemiologic Methods
Friday, October 28, 2016
Room: Poster Hall
Background: The power of a study is a function of the number of events. This idea is implicit in the multi-center trials in hospital epidemiology, and the use of large-scale administrative data – both vastly increase this number. Yet as infection control practices improve, the ratio of true “signal” to stochastic “noise” becomes less favorable, even for reasonably large studies. We explore this phenomenon, and its implications for research as well as healthcare policy.

Methods: We use a mathematical model of vancomycin-resistant enterococci (VRE) in an ICU to simulate two interventions with a known effect – a chlorhexidine gluconate (CHG) bathing protocol (1), and a decrease in hand hygiene adherence. In both cases, a stochastically simulated time series is obtained, and then two methods – a mathematical model and an interrupted time series – are used to attempt to estimate the value of the known, simulated effect.

Results: For both cases we show that as the number of events decreases, the effect becomes more difficult to detect. While unsurprising, this result provides a more intuitive illustration than power calculations. We conclude by showing a way to evaluate a hospital’s performance that addresses this problem, using a model to show an individual hospital’s infection rates in the context of stochastic uncertainty.

Conclusion: As infection control practice improves, it will become more difficult to detect new improvements, making the evaluation of new interventions harder. Conversely, increases in cases will become easier to detect. While this may be addressable in intervention studies by increasing the number of patients recruited or the number of sites, this may be cost prohibitive. Worryingly, in many circumstances such as in evaluations of healthcare quality, individual hospitals are judged in isolation, and as infection control improves, the results of these economically important evaluations will become dominated by the effect of random chance. New metrics, evaluation guidelines, etc. must be adjusted to take the role of randomness into account.

1. Dicks, K.V., et al. (2016). A Multicenter Pragmatic Interrupted Time Series Analysis of Chlorhexidine Gluconate Bathing in Community Hospital Intensive Care Units. ICHE, 1–7.

Eric Lofgren, MSPH, PhD, School for Global Animal Health, Washington State University, Pullman, WA

Disclosures:

E. Lofgren, None

Findings in the abstracts are embargoed until 12:01 a.m. CDT, Wednesday Oct. 26th with the exception of research findings presented at the IDWeek press conferences.