Program Schedule

HIV Quality Report Cards:  Impact of Case-mix adjustment and Statistical Methods

Session: Oral Abstract Session: HIV Testing and Cascade of Care
Thursday, October 9, 2014: 9:00 AM
Room: The Pennsylvania Convention Center: 107-AB
Background: There will be increasing pressure to publically report and rank the performance of health care systems on HIV quality measures.  To inform discussion of public reporting in HIV care, we evaluated the impact of adjusting for patient characteristics (i.e. 'case-mix') when profiling and ranking individual HIV care systems on the viral control quality measure.

Methods: We used data from the Veterans Health Administration (VHA) HIV Clinical Case Registry and administrative databases to estimate case-mix adjusted viral control for local care systems in 2009.  Patient-level viral control was defined as last HIV viral load measurement in year ≤ 400 copies/ml, among patients on potent antiretroviral therapy at least six months with at least two visits in year that were at least sixty days apart.  Systems caring for > 25 eligible patients were included (patient N=12,368, system N=91).  We compared system rankings created using two case-mix adjustment methods; the observed to expected estimator previsously used by the New York Cardiac Surgery Outcomes reporting system, and the risk-standardized ratio currently used by the Centers for Medicare and Medicaid Services (CMS) Hospital Compare program.

Results: Overall, 10,913 patients (88.2%) achieved viral control.  Prior to case-mix adjustment, system-level viral control ranged from 51% to 100%.  Seventeen (19%) systems were labeled as low outliers (performance significantly below the overall mean) and 11 (12%) as high outliers.  Adjustment for case-mix (patient demographics, comorbidity, CD4 nadir, time on therapy, and income from VHA administrative databases) reduced the number of outliers by approximately one third, but results differed substantially by method.  The adjustment model had moderate discrimination (c statistic = 0.66), suggesting potential for unadjusted risk when using administrative data to measure case-mix.

Conclusion: Case-mix adjustment strongly affects rankings of care systems on the viral control measure of HIV care quality.  Given the sensitivity of rankings to selection of case-mix adjustment methods – and potential for unadjusted risk when using variables limited to current administrative databases – the HIV care community should explore optimal methods for case-mix adjustment before moving forward with public reporting.

Michael Ohl, MD, MSPH1, Michihiko Goto, MD1, Kelly Richardson, PhD2, Marin Schweizer, PhD3, Mary Vaughand-Sarrazin, PhD2 and Eli Perencevich, MD, MS, FIDSA, FSHEA4,5, (1)Division of Infectious Diseases, Department of Internal Medicine, University of Iowa Carver College of Medicine, Iowa City, IA, (2)Iowa City VAMC, Iowa City, IA, (3)Internal Medicine, University of Iowa Carver College of Medicine, Iowa City, IA, (4)Center for Comprehensive Access and Delivery Research and Evaluation (CADRE), Iowa City VA Health Care System, Iowa City, IA, (5)Iowa City VA Health Care System, Iowa City, IA


M. Ohl, None

M. Goto, None

K. Richardson, None

M. Schweizer, None

M. Vaughand-Sarrazin, None

E. Perencevich, None

Findings in the abstracts are embargoed until 12:01 a.m. EDT, Oct. 8th with the exception of research findings presented at the IDWeek press conferences.

Sponsoring Societies:

© 2014, All Rights Reserved.

Follow IDWeek