Tag: machine learning

Impact of Iterative Development and Beta-Testing on the Usability and Acceptability of a Novel Just-in-Time Adaptive Digital Physical Activity Intervention

Vandelanotte, C., Maher, C., Hodgetts, D., Imam, T., Rashid, M., To, Q. G., & Trost, S. (2025). Impact of Iterative Development and Beta-Testing on the Usability and Acceptability of a Novel Just-in-Time Adaptive Digital Physical Activity Intervention. Journal of Physical Activity and Health, 1(aop), 1-7.

[Open Access] https://journals.humankinetics.com/view/journals/jpah/22/10/article-p1315.xml

Abstract

The search for cost-effective population-based physical activity interventions continues. Therefore, we developed a novel just-in-time adaptive digital assistant supported by machine learning (ie, MoveMentor). Beta-testing is essential to evaluate both technical performance and user acceptance. The aim of this study was to assess app usability, acceptability, and technical performance through iterative rounds of beta-testing.

Insufficiently active people (age: 39.8 [10.2]; 86% female) participated in 2 rounds of beta-testing (round 1, n = 112; round 2, n = 41). Participants downloaded the digital assistant app onto their phone to use during the study period (round 1: 12 wk, round 2: 4 wk). Participants were asked complete at least 4 educational and 5 chat conversations, rate over 50 notifications, and complete an online follow-up survey at week 4 examining aspects of app usability and acceptability. Descriptive statistics and t tests were used to analyze outcomes.

Across both rounds, the app demonstrated good overall usability scores (System Usability Scale: 75.3 out of 100) but lower usefulness ratings. Round 2 participants showed increased engagement with features including action plans ( P  < .001), educational conversations ( P  < .001), and personalization features ( P  < .001), and they appreciated the educational conversations more ( P  < .05). Technical issues including data syncing problems and chat limitations persisted across both rounds. The notification system received mixed feedback, though customization options in round 2 reduced complaints (12.2%–7.3%).

The app demonstrated good acceptability and usability but low usefulness. The iterative beta-testing successfully identified areas for improvement and enabled meaningful enhancements to content and user engagement features. While some technical challenges persisted, the beta-testing provided clear direction for ongoing improvements.

Perceptions and expectations of an artificially intelligent physical activity digital assistant — A focus group study

Vandelanotte, C., Hodgetts, D., Peris, D. L. I. H. K., Karki, A., Maher, C., Imam, T., … & Trost, S. (2024). Perceptions and expectations of an artificially intelligent physical activity digital assistant—A focus group study. Applied Psychology: Health and Well‐Being, 16(4), 2362-2380.

[Open Access] https://iaap-journals.onlinelibrary.wiley.com/doi/full/10.1111/aphw.12594

Abstract

Artificially intelligent physical activity digital assistants that use the full spectrum of machine learning capabilities have not yet been developed and examined.

This study aimed to explore potential users’ perceptions and expectations of using such a digital assistant. Six 90-min online focus group meetings (n = 45 adults) were conducted. Meetings were recorded, transcribed and thematically analysed.

Participants embraced the idea of a ‘digital assistant’ providing physical activity support. Participants indicated they would like to receive notifications from the digital assistant, but did not agree on the number, timing, tone and content of notifications. Likewise, they indicated that the digital assistant’s personality and appearance should be customisable. Participants understood the need to provide information to the digital assistant to allow for personalisation, but varied greatly in the extent of information that they were willing to provide.

Privacy issues aside, participants embraced the idea of using artificial intelligence or machine learning in return for a more functional and personal digital assistant.

In sum, participants were ready for an artificially intelligent physical activity digital assistant but emphasised a need to personalise or customise nearly every feature of the application. This poses challenges in terms of cost and complexity of developing the application.