Authors’ Response to Peer Reviews of “Satisfaction With Health Care Services at the Pediatric Specialist Clinic of the National Referral Center in Malaysia: Cross-sectional Study of Caregivers’ Perspectives”

“Engagement” with digital behaviour change interventions (DBCIs) is considered important for their effectiveness. Evaluating engagement is therefore a priority; however, a shared understanding of how to usefully conceptualise engagement is lacking. This review aimed to synthesise literature on engagement to identify key conceptualisations and to develop an integrative conceptual framework involving potential direct and indirect influences on engagement and relationships between engagement and intervention effectiveness. Four electronic databases (Ovid MEDLINE, PsycINFO, ISI Web of Knowledge, ScienceDirect) were searched in November 2015. We identified 117 articles that met the inclusion criteria: studies employing experimental or non-experimental designs with adult participants explicitly or implicitly referring to engagement with DBCIs, digital games or technology. Data were synthesised using principles from critical interpretive synthesis. Engagement with DBCIs is conceptualised in terms of both experiential and behavioural aspects. A conceptual framework is proposed in which engagement with a DBCI is influenced by the DBCI itself (content and delivery), the context (the setting in which the DBCI is used and the population using it) and the behaviour that the DBCI is targeting. The context and “mechanisms of action” may moderate the influence of the DBCI on engagement. Engagement, in turn, moderates the influence of the DBCI on those mechanisms of action. In the research literature, engagement with DBCIs has been conceptualised in terms of both experience and behaviour and sits within a complex system involving the DBCI, the context of use, the mechanisms of action of the DBCI and the target behaviour. Electronic supplementary material The online version of this article (doi:10.1007/s13142-016-0453-1) contains supplementary material, which is available to authorized users.

Background Mobile health (mHealth) is often reputed to be cost-effective or cost-saving. Despite optimism, the strength of the evidence supporting this assertion has been limited. In this systematic review the body of evidence related to economic evaluations of mHealth interventions is assessed and summarized. Methods Seven electronic bibliographic databases, grey literature, and relevant references were searched. Eligibility criteria included original articles, comparison of costs and consequences of interventions (one categorized as a primary mHealth intervention or mHealth intervention as a component of other interventions), health and economic outcomes and published in English. Full economic evaluations were appraised using the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) checklist and The PRISMA guidelines were followed. Results Searches identified 5902 results, of which 318 were examined at full text, and 39 were included in this review. The 39 studies spanned 19 countries, most of which were conducted in upper and upper-middle income countries (34, 87.2%). Primary mHealth interventions (35, 89.7%), behavior change communication type interventions (e.g., improve attendance rates, medication adherence) (27, 69.2%), and short messaging system (SMS) as the mHealth function (e.g., used to send reminders, information, provide support, conduct surveys or collect data) (22, 56.4%) were most frequent; the most frequent disease or condition focuses were outpatient clinic attendance, cardiovascular disease, and diabetes. The average percent of CHEERS checklist items reported was 79.6% (range 47.62–100, STD 14.18) and the top quartile reported 91.3–100%. In 29 studies (74.3%), researchers reported that the mHealth intervention was cost-effective, economically beneficial, or cost saving at base case. Conclusions Findings highlight a growing body of economic evidence for mHealth interventions. Although all studies included a comparison of intervention effectiveness of a health-related outcome and reported economic data, many did not report all recommended economic outcome items and were lacking in comprehensive analysis. The identified economic evaluations varied by disease or condition focus, economic outcome measurements, perspectives, and were distributed unevenly geographically, limiting formal meta-analysis. Further research is needed in low and low-middle income countries and to understand the impact of different mHealth types. Following established economic reporting guidelines will improve this body of research.

Background The number of adolescents with chronic health conditions (CHCs) continues to increase. Medication nonadherence is a global challenge among adolescents across chronic conditions and is associated with poor health outcomes. While there has been growing interest in the use of mHealth technology to improve medication adherence among adolescents with CHCs, particularly text messaging and mobile phone apps, there has been no prior systematic review of their efficacy. Objective The purpose of this review was to systematically evaluate the most recent evidence for the efficacy of text messaging and mobile phone apps as interventions to promote medication adherence among adolescents with CHCs. Methods PubMed, Embase, CENTRAL, PsycINFO, Web of Science, Google Scholar, and additional databases were searched from 1995 until November 2015. An additional hand search of related themes in the Journal of Medical Internet Research was also conducted. The Preferred Reporting Results of Systematic Reviews and Meta-Analyses guidelines were followed. Two reviewers independently screened titles/abstracts, assessed full-text articles, extracted data from included articles, and assessed their quality using Grades of Recommendation, Assessment, Development, and Evaluation criteria. Included studies were described in original research articles that targeted adherence in adolescents with CHCs (12-24 years-old). Results Of the 1423 records examined, 15 met predefined criteria: text messaging (n=12) and mobile phone apps (n=3). Most studies were performed in the United States (11/15, 73%), were randomized-controlled trials (8/15, 53%), had a sample size <50 (11/15, 73%), and included adherence self-report and/or biomarkers (9/15, 60%). Only four studies were designed based on a theoretical framework. Approaches for text messaging and mobile phone app interventions varied across studies. Seven articles (7/15, 47%) reported significant improvement in adherence with moderate to large standardized mean differences. Most of the included studies were of low or moderate quality. Studies varied in sample size, methods of adherence assessment, and definition of adherence, which prohibited performing a meta-analysis. Conclusions The use of text messaging and mobile phone app interventions to improve medication adherence among adolescents with CHCs has shown promising feasibility and acceptability, and there is modest evidence to support the efficacy of these interventions. Further evaluation of short- and long-term efficacy and cost-effectiveness of these interventions is warranted given the early and evolving state of the science.