Smartphone App–Based Survey Deployment Patterns and Longitudinal Response Rate: Randomized Controlled Trial (Preprint)

<sec> <title>BACKGROUND</title> Survey fatigue is a common challenge in longitudinal studies, particularly when using smartphone apps to collect survey data. Evidence-based strategies are needed to maintain longitudinal response rates. </sec> <sec> <title>OBJECTIVE</title> This study aims to evaluate the effect of a more frequent smartphone-administered survey deployment strategy with smaller survey batches on participant response rates over an extended period. </sec> <sec> <title>METHODS</title> We conducted a randomized controlled trial (NCT04752657) embedded in the electronic Framingham Heart Study cohorts between June 2021 and December 2023. Participants were randomly allocated to receive a full set of surveys every 4 weeks (control group) or half of the survey set biweekly, such that the full set is completed every 4 weeks (experimental group). Randomization was stratified by age (≤75 y vs &gt;75 y) and phone type (Android vs iPhone). Married couples were assigned to the same group using a blocked randomization approach. The primary outcome was the proportion of surveys returned per participant assessed longitudinally across four periods (baseline to wk 8, wk 8-16, wk 16-24, and wk 24-32), with 19, 17, 16, and 15 unique surveys deployed, respectively. We used mixed-effects regression models with random intercepts to compare the repeated outcome between groups. Stratified analyses by age and sex were performed. </sec> <sec> <title>RESULTS</title> Among 492 participants (mean age 74, SD 6.3 y; 58%, n=284 women, 84%, n=413 non-Hispanic White), there was evidence that the experimental group had higher response rates over time compared to the control group (&lt;i&gt;P&lt;/i&gt;=.003 for interaction between deployment pattern and time). Both groups showed similar proportions of surveys returned during the first period (75% vs 76%). The experimental group had higher response rates than the control group in subsequent periods (70% vs 67% in wk 8-16, 64% vs 59% in wk 16-24, and 58% vs 50% in wk 24-32). The proportion of participants not returning any surveys increased from 3% to 38% in the control group compared to 1% to 28% in the experimental group across the four time periods. Stratified analyses revealed that among younger participants (≤75 y), the experimental group showed 12% higher survey response rates compared to the control group in the final period, while the difference was minimal among older participants (&gt;75 years). The effect of the deployment pattern was similar for men and women. Three-way interaction analyses revealed no significant differences in the deployment pattern effect over time by age group (&lt;i&gt;P&lt;/i&gt;=.95) or sex (&lt;i&gt;P&lt;/i&gt;=.65). </sec> <sec> <title>CONCLUSIONS</title> Administering half of the surveys every 2 weeks, as compared to all surveys every 4 weeks, was associated with higher maintained longitudinal survey response rates. This strategy may help mitigate survey fatigue and improve data quality in digital health studies. </sec> <sec> <title>CLINICALTRIAL</title> ClinicalTrials.gov NCT04752657; https://clinicaltrials.gov/study/NCT04752657 </sec>