Standardized evaluation of the quality and persuasiveness of mobile health applications for diabetes management

Permission to use received from Rebecca Fowler View poster .

Results of a service evaluation using myHeart in a large London-based acute NHS Trust. We are pleased to report the outcomes from this recent service evaluation of myHeart and the potential benefit of using the myHeart app to supplement existing cardiac rehabilitation (CR). Cardiac rehabilitation is an essential evidence-based intervention that supports patient recovery following a cardiac event. It offers patients a structured education and exercise programme to aid recovery and support behavioural changes to help reduce the risk of future cardiac health complications. The myHeart app provides a structure educational and exercise intervention that mirrors current CR service delivery as well as supportive self-management tools. Overall, 721 patients were invited to participate in 1 of 4 groups (class-based CR, class-based CR with myHeart, home-based CR and home-based CR with myHeart). A total of 584 patients opted to use class-based CR and of these 43 chose to include myHeart to support them with this. There were 137 patients in the home-based group, with 54 choosing to include myHeart alongside their CR. This 12-week evaluation involved functional, physical and psychological assessments both before and after CR to explore potential changes. Patients were also asked to complete a rating of perceived exertion Borg RPE scale (Borg 6-20). Those in the home-based groups were contacted mid-way through the study. Results identified three key outcomes: 1. Blood pressure, cholesterol, LDL, BMI, HbA1c and exercise were all very similar across the groups with marginal differences across each measure. 2. Drop-out rates (DOR) of patients being invited to attend CR and attending CR were significantly lower in those groups with access to myHeart. * Class only: DOR = 58.2% Class + App; DOR = 25.6% * Home only: DOR = 73.5% Home + App; DOR = 42.6% 3. Those patients with access to myHeart and in the home-based group saw the greatest improvement in anxiety and depression scores. This real-world evaluation provides an encouraging insight into the potential impact of myHeart to supplement CR services, and is suggestive that, as an adjunct to support both class and home-based programmes, myHeart helps to reduce drop-out rates in CR and can assist in reinforcing continuous engagement with CR programmes.

Results have led to continued QISMET Accreditation for myDiabetes (QIS2015) and have revealed the app could play an important role in supporting structured patient education delivery for type 2 diabetes following initial diagnosis, and as an ongoing resource. Together with a large Health and Care Partnership, we led a multi-centre service evaluation to explore the impact of myDiabetes on education course attendance rates. T2DM is a serious and growing problem worldwide and affects more than 3 million people in the UK. Structured education is a large part of managing T2DM to promote a healthy lifestyle and improve blood sugar control. However, the uptake for education courses has been less than encouraging across the UK. By offering a digital alternative or adjunct to a class-based course those who are unable or prefer not to attend a class-based programme, are able to receive structured education. myDiabetes is an app to support patients and clinicians manage diabetes together, remotely and at scale. Overall, 83 T2DM patients were recruited by the healthcare team, of which 28 chose to use myDiabetes alone, 35 chose only usual care, and 20 chose to use both. Patient education usage was monitored over a 12-week period. During this evaluation we monitored changes in diabetes related clinical health outcomes where possible, including HbA1c, blood pressure and body mass index. Participants in all three sites were asked to complete the Problem Areas In Diabetes (PAID) questionnaire at the beginning and end of the evaluation to explore markers of improvement in diabetes related distress. Results showed the app was acceptable in this care setting with 31 of 42 patients using it alone or as an adjunct to usual care. A total of 586 education videos were watched, on average each patient watched 22.5 (SD 19.6) videos. There was a reduction in PAID scores across all arms, with the app only arm showing the greatest improvement. Patients using myDiabetes showed the greatest improvement in HbA1c (-7.5 vs –4.4 mmol/mol), Systolic Blood Pressure (-12.2 vs +3.3 mmHg) and PAID score (-6.8 vs –5.2). In this real world evaluation myDiabetes performed better than published education course completion rates and resulted in significant improvements in HbA1c and PAID score compared to classed-based programs. This supports the use of myDiabetes to support the delivery of structured based education for patients with type 2 diabetes.

NHS University College London Hospitals NHS Foundation Trust, part of North Central London ICB, is taking a significant step towards enhancing patient empowerment and optimising disease management. Asthma is a chronic condition that affects millions of people worldwide, often leading to severe health complications if not managed properly. Recognising the critical need for effective self-management tools, NHS University College London Hospitals NHS Foundation Trust has chosen the myAsthma app to provide patients with the resources they need to take control of their health. Dr Kay Roy PhD FRCP, Consultant Respiratory Physician University College London Hospitals NHS Foundation Trust, comments “We are thrilled to introduce myAsthma as a self-management tool to our community. It represents a significant step forward in empowering our patients with asthma to take control of their health. By providing them with personalised support, we believe this tool will greatly improve their quality of life. Additionally, the use of myAsthma in outpatient settings will help triage patients more effectively, ensuring they are seen in a timely manner and appropriately referred for the right investigations and services. Our team is excited to see the positive impact this will have on the asthma population across North Central London ICB." The myAsthma app, part of the my mhealth suite of digital health solutions, is designed to empower patients with comprehensive tools and information to manage their asthma more effectively. Key features include: • Personalised Action Plans: Tailored asthma management plans based on individual patient needs. • Inhaler technique training: Contributing to better health outcomes and reduced risk of exacerbations • Medication Tracking: Reminders and logs to ensure patients take their medication as prescribed. • Symptom tracking: Easy-to-use tools for tracking symptoms and triggers. • Educational Resources: Access to a wealth of information on asthma, helping patients understand their condition and how to manage it. As more NHS partners embrace the my mhealth platform, we're thrilled to witness its growing impact and the positive changes it is bringing to long-term condition care. For more information on this article or other my mhealth projects, please get in touch https://mymhealth.com/contact-us

The my mhealth data library is an extensive resource designed to support healthcare providers by offering a wealth of information and tools related to COPD and long-term health conditions.

Permission to use received from Rebecca Fowler View poster

Henry M.G. Glyde1Alison M. Blythin2 Tom M.A. Wilkinson3Ian T. Nabney4 James W. Dodd5 EPSRC Centre for Doctoral Training in Digital Health and Care, University of Bristol, Bristol, UK my mHealth Limited, Bournemouth , UK my mHealth and Clinical and Experimental Science, University of Southampton, Southampton, UK School of Engineering Mathematics and Technology, University of Bristol, Bristol, UK Academic Respiratory Unit, Translational Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK Abstract Background Acute exacerbations of COPD (AECOPD) are episodes of breathlessness, cough and sputum which are associated with the risk of hospitalisation, progressive lung function decline and death. They are often missed or diagnosed late . Accurate timely intervention can improve these poor outcomes. Digital tools can be used to capture symptoms and other clinical data in COPD. This study aims to apply machine learning to the largest available real-world digital dataset to identify AECOPD Prediction tool which could be used to support early intervention improve clinical outcomes. Objective To create and validate a machine learning predictive model that forecasts exacerbations of COPD 1-8 days in advance. The model is based on routine patient-entered data from myCOPD self-management app. Method Adaptations of the AdaBoost algorithm were employed as machine learning approaches. The dataset included 506 patients users between 2017-2021. 55,066 app records were available for stable COPD event labels and 1,263 records of AECOPD event labels. The data used for training the model included COPD assessment test (CAT) scores, symptom scores, smoking history, and previous exacerbation frequency. All exacerbation records used in the model were confined to the 1-8 days preceding a self-reported exacerbation event. Results TheEasyEnsemble Classifier resulted in a Sensitivity of 67.0% and a Specificity of 65% with a positive predictive value (PPV) of 5.0% and a negative predictive value (NPV) of 98.9%. An AdaBoost model with a cost-sensitive decision tree resulted in a a Sensitivity of 35.0% and a Specificity of 89.0% with a PPV of 7.08% and NPV of 98.3%. Conclusion This preliminary analysis demonstrates that machine learning approaches to real-world data from a widely deployed digital therapeutic has the potential to predict AECOPD and can be used to confidently exclude the risk of exacerbations of COPD within the next 8 days. Permission to use received from Henry Glyde. Read more on Heliyon website.

Charlotte Smith 1 Francesca D’angelo 2 University Hospital of Derby and Burton, Cardiac Rehabilitation Department, Burton Upon Trent, UK. University Hospital of Derby and Burton, Health and Wellbeing Department, Burton, UK To examine the effectiveness of physical activity outcomes using a web-based Cardiac Rehabilitation application compared with a conventional programme or a combination of both. University Hospitals of Derby and Burton NHS Foundation Trust poster presented at the BACPR Annual Conference October 5-6th 2023 Permission to use received from Charlotte Smith

Francesca D’angelo 1 Charlotte Smith 2 University Hospital of Derby and Burton, Health and Wellbeing Department, Burton, UK University Hospital of Derby and Burton, Cardiac Rehabilitation Department, Burton Upon Trent, UK. To examine the effectiveness of psychological outcomes using a web-based Cardiac Rehabilitation application compared with a conventional programme or a combination of both. University Hospitals of Derby and Burton NHS Foundation Trust poster presented at the BACPR Annual Conference October 5-6th 2023 Poster presented at the BACPR Annual Conference October 5-6th 2023 Permission to use received from Charlotte Smith