Tag: Large language model

MoveMentor—examining the effectiveness of a machine learning and app-based digital assistant to increase physical activity in adults: protocol for a randomised controlled trial

Vandelanotte, C., Trost, S., Hodgetts, D., Imam, T., Rashid, M. M., To, Q. G., & Maher, C. (2025). MoveMentor—examining the effectiveness of a machine learning and app-based digital assistant to increase physical activity in adults: protocol for a randomised controlled trial. Trials, 26(1), 233.

[Open Access] https://link.springer.com/article/10.1186/s13063-025-08926-3

Abstract
Physical inactivity is prevalent, leading to a high burden of disease and large healthcare costs. Thus, there is a need for affordable, effective and scalable interventions. However, interventions that are affordable and scalable are beset with modest effects and engagement. Interventions that integrate machine learning with real-time data to offer unprecedented levels of personalisation and customisation might offer solutions. The aim of this study is to conduct a randomised controlled trial to evaluate the effectiveness of a machine learning and app-based digital assistant to increase physical activity.

One hundred and ninety-eight participants will be recruited through Facebook advertisements and randomly allocated to an intervention or control group. Intervention participants will gain access to an app-based physical activity digital assistant that can learn and adapt in real-time to achieve high levels of personalisation and user engagement by virtue of applying a range of machine learning techniques (i.e. reinforcement learning, natural language processing and large language models). The digital assistant will interact with participants in 3 main ways:(1) educational conversations about physical activity; (2) just-in-time personalised in-app notifications (‘nudges’), cues to action encouraging physical activity and (3) chat-based questions and answers about physical activity. Additionally, the app includes adaptive goal setting and an action planning tool. The control group will gain access to the intervention after the last assessment. Outcomes will be measured at baseline, 3 and 6 months. The primary outcome
is device-measured (Axivity AX3) moderate-to-vigorous physical activity. Secondary outcomes include app engagement and retention, quality of life, depression, anxiety, stress, sitting time, sleep, workplace productivity, absenteeism,
presenteeism and habit strength.
The trial presents a unique opportunity to study the effectiveness of a new generation of digital interventions that use advanced machine learning methods to improve physical activity behaviour. By addressing the limitations of existing conversational agents, we aim to pave the way for more effective and adaptable interventions.


Trial registration Australian New Zealand Clinical Trial Registry ACTRN12624000255583p. Registered on 14 March

  1. https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=387332

Impact of Iterative Development and Beta-Testing on the Usability and Acceptability of a Novel Just-in-Time Adaptive Digital Physical Activity Intervention

Vandelanotte, C., Maher, C., Hodgetts, D., Imam, T., Rashid, M., To, Q. G., & Trost, S. (2025). Impact of Iterative Development and Beta-Testing on the Usability and Acceptability of a Novel Just-in-Time Adaptive Digital Physical Activity Intervention. Journal of Physical Activity and Health, 1(aop), 1-7.

[Open Access] https://journals.humankinetics.com/view/journals/jpah/22/10/article-p1315.xml

Abstract

The search for cost-effective population-based physical activity interventions continues. Therefore, we developed a novel just-in-time adaptive digital assistant supported by machine learning (ie, MoveMentor). Beta-testing is essential to evaluate both technical performance and user acceptance. The aim of this study was to assess app usability, acceptability, and technical performance through iterative rounds of beta-testing.

Insufficiently active people (age: 39.8 [10.2]; 86% female) participated in 2 rounds of beta-testing (round 1, n = 112; round 2, n = 41). Participants downloaded the digital assistant app onto their phone to use during the study period (round 1: 12 wk, round 2: 4 wk). Participants were asked complete at least 4 educational and 5 chat conversations, rate over 50 notifications, and complete an online follow-up survey at week 4 examining aspects of app usability and acceptability. Descriptive statistics and t tests were used to analyze outcomes.

Across both rounds, the app demonstrated good overall usability scores (System Usability Scale: 75.3 out of 100) but lower usefulness ratings. Round 2 participants showed increased engagement with features including action plans ( P  < .001), educational conversations ( P  < .001), and personalization features ( P  < .001), and they appreciated the educational conversations more ( P  < .05). Technical issues including data syncing problems and chat limitations persisted across both rounds. The notification system received mixed feedback, though customization options in round 2 reduced complaints (12.2%–7.3%).

The app demonstrated good acceptability and usability but low usefulness. The iterative beta-testing successfully identified areas for improvement and enabled meaningful enhancements to content and user engagement features. While some technical challenges persisted, the beta-testing provided clear direction for ongoing improvements.

Perceptions and expectations of an artificially intelligent physical activity digital assistant — A focus group study

Vandelanotte, C., Hodgetts, D., Peris, D. L. I. H. K., Karki, A., Maher, C., Imam, T., … & Trost, S. (2024). Perceptions and expectations of an artificially intelligent physical activity digital assistant—A focus group study. Applied Psychology: Health and Well‐Being, 16(4), 2362-2380.

[Open Access] https://iaap-journals.onlinelibrary.wiley.com/doi/full/10.1111/aphw.12594

Abstract

Artificially intelligent physical activity digital assistants that use the full spectrum of machine learning capabilities have not yet been developed and examined.

This study aimed to explore potential users’ perceptions and expectations of using such a digital assistant. Six 90-min online focus group meetings (n = 45 adults) were conducted. Meetings were recorded, transcribed and thematically analysed.

Participants embraced the idea of a ‘digital assistant’ providing physical activity support. Participants indicated they would like to receive notifications from the digital assistant, but did not agree on the number, timing, tone and content of notifications. Likewise, they indicated that the digital assistant’s personality and appearance should be customisable. Participants understood the need to provide information to the digital assistant to allow for personalisation, but varied greatly in the extent of information that they were willing to provide.

Privacy issues aside, participants embraced the idea of using artificial intelligence or machine learning in return for a more functional and personal digital assistant.

In sum, participants were ready for an artificially intelligent physical activity digital assistant but emphasised a need to personalise or customise nearly every feature of the application. This poses challenges in terms of cost and complexity of developing the application.