Program Schedule

873
Using natural language processing on electronic medical notes to detect the presence of an indwelling urinary catheter

Session: Poster Abstract Session: Device-Associated HAIs
Friday, October 10, 2014
Room: The Pennsylvania Convention Center: IDExpo Hall BC
Posters
  • NLP Indwelling Catheter_ID Week Poster_final_5Oct2014_v2.pdf (486.3 kB)
  • Background: We set out to develop a natural language processing (NLP) algorithm to extract concepts related to indwelling urinary catheters from electronic medical notes.

    Methods: A concept lexicon was developed based on domain knowledge, prior expertise and review of medical notes. Concepts were classified as evidence of either catheter presence or catheter absence. A reference standard set of 1595 randomly selected documents from inpatient admissions were annotated by human reviewers to identify all positively and negatively asserted concepts. An NLP algorithm was tuned using 100 documents from the set. Novel lexicon semantics including evidence of catheter absence and inherently negated terms were used.  Electronic medical record note titles with the highest hit rate for concepts were identified. The NLP algorithm was then tested on a set of 1495 documents to determine agreement between NLP and human reference standard, sensitivity and positive predictive value (PPV).

    Results: The overall cohort included 5,589 unique patients with 77,938 hospital days from two VA hospitals over a one-year period.  The lexicon contained 590 concepts for catheter presence (eg. Foley catheter was placed) and 18 for evidence of absence (eg. Patient has bathroom privileges).  Iterative review of NLP outputs on the training set included false positive analyses and fine-tuning of the algorithm. Overall, nurse’s notes were the most frequent inpatient note titles; these also yielded the highest number of concepts with respect to urinary catheters.  The overall agreement between the NLP and reference standard was 71%. With 348 instances of ‘evidence of catheter presence’ the system found 246 for a sensitivity of 87%. With 84 false positive concepts associated with catheter presence, the PPV was 59%. For ‘evidence of catheter absence’, the agreement was 72% (450 instances), sensitivity was 77% and PPV was 68%.

    Conclusion: We have shown that it is possible to identify the presence of an indwelling urinary catheter from the free text of electronic medical notes. Further refinement and scaling-up of NLP algorithms to large document sets is ongoing. This is the first key step in developing protocols to assist humans in large-scale review of patient charts for CAUTI.

    Adi Gundlapalli, MD, PhD, MS1, Guy Divita2,3, Tyler Forbush3, Andrew Redd, PhD3, Marjorie Carter, MSPH3, Ashley J. Gendrett, BS, MPH4, Kalpana Gupta, MD, MPH5, Ying Suo, MS2, B.S. Begum Durgahee, MS3, Sarah Krein, PhD, RN6, Michael Rubin, MD, PhD2, Anne Sales, PhD, RN7, Matthew Samore, MD8 and Barbara W. Trautner, MD, PhD, FIDSA9, (1)University of Utah School of Medicine and Salt Lake City VA Health Care System, Salt Lake City, UT, (2)Internal Medicine, University of Utah School of Medicine, Salt Lake City, UT, (3)Ideas Center, VA Salt Lake City HCS, Salt Lake City, UT, (4)Houston Center for Innovations in Quality, Effectiveness, and Safety (iQuESt), Michael E. Debakey Veterans Affairs Medical Center, Houston, TX, (5)Department of Medicine/Boston University School of Medicine, Boston, MA, (6)Department of Internal Medicine, Division of General Medicine, University of Michigan Medical School, Ann Arbor, MI, (7)Division of Nursing Business and Health Systems, University of Michigan, School of Nursing, Ann Arbor, MI, (8)University of Utah School of Medicine, Division of Epidemiology, Salt Lake City, UT, (9)Section of Infectious Diseases, Departments of Medicine and Surgery, Baylor College of Medicine, Houston, TX

    Disclosures:

    A. Gundlapalli, None

    G. Divita, None

    T. Forbush, None

    A. Redd, None

    M. Carter, None

    A. J. Gendrett, None

    K. Gupta, None

    Y. Suo, None

    B. S. B. Durgahee, None

    S. Krein, Blue Cross and Blue Shield of Michigan Foundation: Grant Investigator, Research grant and Research support
    Department of Veterans Affairs: Employee and Investigator, Research support and Salary

    M. Rubin, None

    A. Sales, None

    M. Samore, None

    B. W. Trautner, None

    Findings in the abstracts are embargoed until 12:01 a.m. EDT, Oct. 8th with the exception of research findings presented at the IDWeek press conferences.

    Sponsoring Societies:

    © 2014, idweek.org. All Rights Reserved.

    Follow IDWeek