Methodological challenges in randomised trials of mHealth interventions: survey, expert workshop, and recommendations

Article type
Authors
Lopez Alcalde J1, Wieland L2, Yan Y3, Barth J3, Reza Khami M4, Shivalli S5, Locker C6, Kaur Rai H7, Macharia P8, Yun S9, Lang E10, Naggirinya A11, Campos-Asensio C12, Ahmadian L13, Witt C14
1Institute for Complementary and Integrative Medicine, University Hospital Zurich and University of Zurich, Zurich, Switzerland; Faculty of Medicine, Universidad Francisco de Vitoria (UFV), IRYCIS, CIBERESP, Madrid, Spain
2Institute for Complementary and Integrative Medicine, University Hospital Zurich and University of Zurich, Zurich, Switzerland; Center for Integrative Medicine, University of Maryland School of Medicine, Baltimore, MD, United States, Baltimore, MD, United States
3Institute for Complementary and Integrative Medicine, University Hospital Zurich and University of Zurich, Zurich, Switzerland
4Research Center for Caries Prevention, Dentistry Research Institute, Community Oral Health Department, School of Dentistry, Tehran University of Medical Sciences, Islamic Republic of Iran
5Department of Medical Statistics, Faculty of Epidemiology and Public Health, London School of Hygiene & Tropical Medicine, London, United Kingdom
6Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada
7Digital Health and Wellness Research Group, Department of Computer and Information Sciences, University of Strathclyde, United Kingdom
8Department of Research and Programmes, Kenyatta National Hospital, Nairobi, Kenya; Department of Epidemiology of Microbial Diseases, Yale School of Public Health, New Haven, USA
9Bio-Heart Cardiovascular Diseases Research Group, Bellvitge Biomedical Research Institute (IDIBELL), L'Hospitalet de Llobregat, Barcelona, Spain; Community Heart Failure Program, Cardiology Department, Bellvitge University Hospital, L’Hospitalet de Llobregat, Barcelona, Spain
10Hypnalgesics, LLC d/b/a Comfort Talk, Brookline, MA, US
11Infectious Diseases Institute, College of Health Sciences, Makerere University, Kampala, Uganda
12Biblioteca Médica, Hospital Universitario de Getafe, Madrid, Spain
13Medical Informatics Research Centre, Institute for Futures Studies in Health, Kerman University of Medical Sciences, Kerman, Islamic Republic of Iran
14Institute for Complementary and Integrative Medicine, University Hospital Zurich and University of Zurich, Zurich, Switzerland; Institute for Social Medicine, Epidemiology and Health Economics, Charité – Universitätsmedizin Berlin, Berlin, Germany
Abstract
"Background: Mobile health (mHealth) uses mobile technology, such as smartphones, to support and optimize healthcare. mHealth currently plays an essential role in healthcare. Randomised controlled clinical trials (RCTs) are vital for evaluating health interventions and ensuring that resources are used effectively to improve healthcare outcomes. However, mHealth RCTs may present specific methodological challenges.
Objectives: 1) Identify specific methodological challenges in RCTs of mHealth interventions; 2) Prioritise and discuss a selected group of challenges; and 3) Provide recommendations for overcoming prioritised challenges.
Methods: Three-phase NIH-funded project (Cochrane Complementary Medicine Field: Resource for Research (2R24AT001293)). O1) Online survey to collect methodological challenges specific to RCTs of mHealth interventions. O2) Online workshop with experts to prioritise and discuss challenges. O3) Development of recommendations via consensus.
Results: 80 authors of mHealth RCTs participated in the survey. The methodological aspects most frequently reported as more or much more challenging were those concerning mHealth intervention integrity (the degree to which the study intervention was implemented as intended), particularly managing low intervention adherence (86.0%) and defining adherence (49.4%). Other challenges identified were analysing passive data (e.g., data collected from smartphone sensors) (41.4%) and verifying the participants' identity during recruitment (41.2%). Eleven experts participated in the subsequent consensus workshop and developed seventeen recommendations for overcoming methodological challenges in mHealth RCTs, most concerning mHealth intervention integrity. One important recommendation is that adherence assessment in mHealth trials should diverge from the approaches commonly employed in drug efficacy trials. Specifically, when evaluating mHealth intervention adherence, it is crucial to account for factors such as internet access requirements and the interoperability of the mHealth app.
Conclusions: RCTs assessing mHealth interventions encounter distinct methodological challenges. This study has formulated recommendations to address the most salient methodological hurdles faced in mHealth RCTs, with a significant focus on the integrity of mHealth interventions.
Patient or healthcare consumer involvement: None."