2107. Decision trees vs. Neural Networks for Supervised Machine Learning Based Prediction of Healthcare-Associated Urinary Tract Infections.
Session: Poster Abstract Session: Healthcare Epidemiology: Device-associated HAIs
Saturday, October 6, 2018
Room: S Poster Hall

Background: Supervised machine learning (SML) based methods could facilitate early prediction of healthcare-related adverse events. The role of SML in stratifying patient-risk of infectious events during hospitalization and their performance using limited subsets of standardized and widely available predictors is less known. Using a large cohort of adult inpatients, we use SML techniques to predict a diagnosis of urinary tract infection (UTI) during hospitalization.

Methods: We used previously validated data from adults (≥18 years old) hospitalized between 2009 and 2016 in a healthcare system as part of a federally funded study. The outcome was a UTI detected > 2 days after admission. Predictors measured clinical complexity, history of healthcare associated complications and specific risk factors for UTI. Predictors were restricted to those standardized and readily obtainable across facilities (e.g. ICD codes). Two SML methods, neural networks (NN) and decision trees (DT) were used. The NN used two hidden layers and a sigmoid output function. The DT used binary recursive portioning and Gini coefficient to measure node impurity.  60% of available hospitalizations was the training set, and 40% used as test set for validation. Cross validation was used to refine the model. Oversampling was used to adjust for the rare outcome. The area under the curve (AUC) for the test set measured model performance.

Results: From a total of 897,344 hospitalizations there were 16,069 UTIs identified from the data set during the study period. Applying NN and DT to the raw dataset, AUC’s of 0.55 and 0.69 were achieved respectively with the test set. Model performance for DNN and DT improved with oversampling to 0.77 and 0.78, outperforming traditional logistic regression (Figure 1). The optimal DT is presented (Figure 2).

Conclusion: Reasonable prediction performance for an infectious event during hospitalization was achieved using a limited set of routinely available and standardized variables. While both SML methods had comparable performance, the DT was more interpretable. Further work will extend these methods to other infectious events, use more specific EHR data and link these predictions to interventions in real-time.

 

 

 

 

 

 

 

 

 

 

Philip Zachariah, MD, MS1, Elioth Mirsha Sanabria Buenaventura, MSc2, Jianfang Liu, PhD3, Bevin Cohen, PhD3, David Yao, PhD2 and Elaine Larson, RN PhD3, (1)Vagelos College of Physicians and Surgeons, Columbia University, New York, NY, (2)Fu School of Engineering, Columbia University, New York, NY, (3)School of Nursing, Columbia University, New York, NY

Disclosures:

P. Zachariah, None

E. Mirsha Sanabria Buenaventura, None

J. Liu, None

B. Cohen, None

D. Yao, None

E. Larson, None

Findings in the abstracts are embargoed until 12:01 a.m. PDT, Wednesday Oct. 3rd with the exception of research findings presented at the IDWeek press conferences.