1279: Development of ACR Longitudinal Digital Quality Measures for Systemic Lupus Erythematosus: A Literature Review and Modified Delphi Consensus Study

Christie Bartels¹, April Jorge², Candace Feldman³, Claire Barber⁴, April Barnado⁵, Bonnie Bermas⁶, Ali Duarte-Garcia⁷, Shivani Garg⁸, Leah Haseley⁹, Shraddha Jatwani¹⁰, Tracy Johansson¹¹, Alex Limanni¹², Wendy Rodgers¹³, Brad Rovin¹⁴, Yesenia Santiago-Casas¹⁵, Lisa Suter¹⁶, Jennifer Ude¹¹, JoAnn Zell¹⁷ and Jinoos Yazdany¹⁸, ¹University of Wisconsin School of Medicine and Public Health, Madison, WI, ²Massachusetts General Hospital, Boston, MA, ³Brigham and Women's Hospital, Boston, MA, ⁴University of Calgary, Calgary, AB, Canada, ⁵Vanderbilt University Medical Center, Nashville, TN, ⁶UT Southwestern, Dallas, TX, ⁷Mayo Clinic, Rochester, MN, ⁸University of Madison, School of Medicine and Public Health, Madison, WI, ⁹University of Washington, Harborview Medical Center, Seattle, WA, ¹⁰Albert Einstein Medical Center, Ambler, PA, ¹¹American College of Rheumatology, Atlanta, GA, ¹²Self, Dallas, TX, ¹³Lupus Foundation of America, Torrance, CA, ¹⁴The Ohio State University, Columbus, OH, ¹⁵Integral Rheumatology and Immunology Specialists, Plantation, FL, ¹⁶Yale School of Medicine, New Haven, CT, ¹⁷University of Colorado Anschutz Medical Campus, Denver, CO, ¹⁸UCSF, San Francisco, CA

Background/Purpose: Significant morbidity and mortality urge efforts to improve quality of care for people with systemic lupus erythematosus (SLE). Yet, none of the 25 American College of Rheumatology (ACR) quality measures is specific to SLE. As part of a collaboration between the Centers for Disease Control and Prevention and ACR, we used literature review and consensus methods to develop digital quality measures, defined by their reliance on electronic health data, in this case from the ACR RISE registry, to improve longitudinal SLE care and outcomes.

Methods: An ACR work group of 10 SLE experts reviewed literature, synthesized and ranked measure constructs, and constructed evidence-based quality measure statements for review by a 17-member multidisciplinary Delphi panel (Figure 1). A priori we planned to advance 2-3 statements to test as digital quality measures. Literature review included all N. American and European guidelines 2000-2020 focused on SLE or lupus nephritis management. Guidelines meeting inclusion criteria were reviewed to distill candidate quality measure constructs in three domains: SLE treatment, monitoring, and phenotype. After discussion, the work group ranked importance and feasibility of constructs (9-point Likert, 9=definitely important). Constructs with high importance (≥60% ratings ≥7 and ≤1 rating ≤3, after excluding 1 extreme low and high rating) were adapted as IF/THEN quality measure statements with evidence summaries. Panelists assessed each statement during three consecutive virtual Delphi sessions and voted before and after each session on importance and feasibility of each measure using 4 and 9-point Likert scales, respectively; scores were normalized to a 100-point scale. Consensus was again determined using a similar Delphi scoring schema for final votes. In a final step, the Delphi panel ranked proposed measures for potential public health impact on SLE care and outcomes.

Results: Experts reviewed 10 guidelines to distill 57 quality measure constructs (18 phenotyping, 24 monitoring, 15 treatment). Fifteen highly rated constructs advanced to generate IF/THEN statements. Table 1 shows Delphi panel ratings of importance and feasibility ratings for the 15 candidate measures. Among these, 5 met high consensus for importance and feasibility: hydroxychloroquine use, limiting glucocorticoids, end-organ monitoring, serologies at diagnosis, and kidney end-organ laboratory evaluation at diagnosis. Finally, the top three recommended statements for SLE patients were: 1) hydroxychloroquine use, 2) limiting glucocorticoids (not ≥7.5mg/d for >6 months), and 3) monitoring kidney function and urine protein excretion every six months (Table 2).

Conclusion: After extensive vetting for public health impact, Delphi experts recommended three digital quality measures focused on hydroxychloroquine use, limiting glucocorticoids, and kidney monitoring. Next steps include testing candidate statements in the RISE registry for data availability and validity and working with RISE practices to optimize reliability and feasibility. Ultimately, these efforts aim to implement validated digital quality measures within US rheumatology practices to improve SLE outcomes.
Figure 1. Overview of Process to Develop SLE Digital Quality Measures




Disclosures: C. Bartels, Pfizer; A. Jorge, None; C. Feldman, AtlasBio, Pfizer Pharmaceuticals, BMS Foundation, Health Resources in Action, Illumina, Mestag Therapeutics, Elsevier; C. Barber, None; A. Barnado, None; B. Bermas, Bristol-Myers Squibb(BMS), Novartis; A. Duarte-Garcia, None; S. Garg, None; L. Haseley, None; S. Jatwani, None; T. Johansson, None; A. Limanni, None; W. Rodgers, None; B. Rovin, AstraZeneca, Aurinia, Biogen, Genetech, Janssen, Lupus Foundation of America, GlaxoSmithKlein(GSK); Y. Santiago-Casas, None; L. Suter, None; J. Ude, None; J. Zell, None; J. Yazdany, AstraZeneca, Gilead, Bristol-Myers Squibb(BMS), Aurinia, Astra Zeneca, Pfizer.