Comparative analysis of stakeholder experiences with an online approach to prioritizing patient-centered research topics

Objective: Little evidence exists about effective and scalable methods for meaningful stakeholder engagement in research. We explored patient/caregiver experiences with a high-tech online engagement approach for patient-centered research prioritization, compared their experiences with those of professional stakeholders, and identified factors associated with favorable participant experiences. Methods: We conducted 8 online modified-Delphi (OMD) panels. Panelists participated in 2 rating rounds with a statistical feedback/online discussion round in between. Panels focused on weight management/obesity, heart failure, and Kawasaki disease. We recruited a convenience sample of adults with any of the 3 conditions (or parents/guardians of Kawasaki disease patients), clinicians, and researchers. Measures included self-reported willingness to use OMD again, the panelists' study participation and online discussion experiences, the system's perceived ease of use, and active engagement metrics. Results: Out of 349 panelists, 292 (84%) completed the study. Of those, 46%were patients, 36%were clinicians, and 19%were researchers. In multivariate models, patients were not significantly more actively engaged (Odds ratio (OR) 1.69, 95%confidence interval (CI), 0.94-3.05) but had more favorable study participation (β=0.49; P≤.05) and online discussion (β=0.18; P ≤.05) experiences and were more willing to use OMD again (β =0.36; P ≤.05), compared to professional stakeholders. Positive perceptions of the OMD system's ease of use (β= 0.16; P ≤.05) and favorable study participation (β = 0.26; P ≤.05) and online discussion (β=0.57; P ≤.05) experiences were also associated with increased willingness to use OMD in the future. Active engagement was not associated with online experience indices or willingness to use OMD again. Conclusion: Online approaches to engaging large numbers of stakeholders are a promising and efficient adjunct to in-person meetings.