+1 Recommend
0 collections
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Measuring the Implementation of Behavioral Intervention Technologies: Recharacterization of Established Outcomes

      Read this article at

          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.


          Behavioral intervention technologies (BITs) are websites, software, mobile apps, and sensors designed to help users address or change behaviors, cognitions, and emotional states. BITs have the potential to transform health care delivery, and early research has produced promising findings of efficacy. BITs also favor new models of health care delivery and provide novel data sources for measurement. However, there are few examples of successful BIT implementation and a lack of consensus on as well as inadequate descriptions of BIT implementation measurement. The aim of this viewpoint paper is to provide an overview and characterization of implementation outcomes for the study of BIT use in routine practice settings. Eight outcomes for the evaluation of implementation have been previously described: acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost, penetration, and sustainability. In a proposed recharacterization of these outcomes with respect to BIT implementation, definitions are clarified, expansions to the level of analysis are identified, and unique measurement characteristics are discussed. Differences between BIT development and implementation, an increased focus on consumer-level outcomes, the expansion of providers who support BIT use, and the blending of BITs with traditional health care services are specifically discussed. BITs have the potential to transform health care delivery. Realizing this potential, however, will hinge on high-quality research that consistently and accurately measures how well such technologies have been integrated into health services. This overview and characterization of implementation outcomes support BIT research by identifying and proposing solutions for key theoretical and practical measurement challenges.

          Related collections

          Most cited references 51

          • Record: found
          • Abstract: found
          • Article: not found

          A compilation of strategies for implementing clinical innovations in health and mental health.

          Efforts to identify, develop, refine, and test strategies to disseminate and implement evidence-based treatments have been prioritized in order to improve the quality of health and mental health care delivery. However, this task is complicated by an implementation science literature characterized by inconsistent language use and inadequate descriptions of implementation strategies. This article brings more depth and clarity to implementation research and practice by presenting a consolidated compilation of discrete implementation strategies, based on a review of 205 sources published between 1995 and 2011. The resulting compilation includes 68 implementation strategies and definitions, which are grouped according to six key implementation processes: planning, educating, financing, restructuring, managing quality, and attending to the policy context. This consolidated compilation can serve as a reference to stakeholders who wish to implement clinical innovations in health and mental health care and can facilitate the development of multifaceted, multilevel implementation plans that are tailored to local contexts.
            • Record: found
            • Abstract: found
            • Article: found
            Is Open Access

            Mobile Applications for Diabetics: A Systematic Review and Expert-Based Usability Evaluation Considering the Special Requirements of Diabetes Patients Age 50 Years or Older

            Background A multitude of mhealth (mobile health) apps have been developed in recent years to support effective self-management of patients with diabetes mellitus type 1 or 2. Objective We carried out a systematic review of all currently available diabetes apps for the operating systems iOS and Android. We considered the number of newly released diabetes apps, range of functions, target user groups, languages, acquisition costs, user ratings, available interfaces, and the connection between acquisition costs and user ratings. Additionally, we examined whether the available applications serve the special needs of diabetes patients aged 50 or older by performing an expert-based usability evaluation. Methods We identified relevant keywords, comparative categories, and their specifications. Subsequently, we performed the app review based on the information given in the Google Play Store, the Apple App Store, and the apps themselves. In addition, we carried out an expert-based usability evaluation based on a representative 10% sample of diabetes apps. Results In total, we analyzed 656 apps finding that 355 (54.1%) offered just one function and 348 (53.0%) provided a documentation function. The dominating app language was English (85.4%, 560/656), patients represented the main user group (96.0%, 630/656), and the analysis of the costs revealed a trend toward free apps (53.7%, 352/656). The median price of paid apps was €1.90. The average user rating was 3.6 stars (maximum 5). Our analyses indicated no clear differences in the user rating between free and paid apps. Only 30 (4.6%) of the 656 available diabetes apps offered an interface to a measurement device. We evaluated 66 apps within the usability evaluation. On average, apps were rated best regarding the criterion “comprehensibility” (4.0 out of 5.0), while showing a lack of “fault tolerance” (2.8 out of 5.0). Of the 66 apps, 48 (72.7%) offered the ability to read the screen content aloud. The number of functions was significantly negative correlated with usability. The presence of documentation and analysis functions reduced the usability score significantly by 0.36 and 0.21 points. Conclusions A vast number of diabetes apps already exist, but the majority offer similar functionalities and combine only one to two functions in one app. Patients and physicians alike should be involved in the app development process to a greater extent. We expect that the data transmission of health parameters to physicians will gain more importance in future applications. The usability of diabetes apps for patients aged 50 or older was moderate to good. But this result applied mainly to apps offering a small range of functions. Multifunctional apps performed considerably worse in terms of usability. Moreover, the presence of a documentation or analysis function resulted in significantly lower usability scores. The operability of accessibility features for diabetes apps was quite limited, except for the feature “screen reader”.
              • Record: found
              • Abstract: found
              • Article: not found

              Efficacy of an Internet-based behavioral intervention for adults with insomnia.

              Insomnia is a major health problem with significant psychological, health, and economic consequences. However, availability of one of the most effective insomnia treatments, cognitive behavioral therapy, is significantly limited. The Internet may be a key conduit for delivering this intervention. To evaluate the efficacy of a structured behavioral Internet intervention for adults with insomnia. Forty-five adults were randomly assigned to an Internet intervention (n = 22) or wait-list control group (n = 23). Forty-four eligible participants (mean [SD] age, 44.86 [11.03] years; 34 women) who had a history of sleep difficulties longer than 10 years on average (mean [SD], 10.59 [8.89] years) were included in the analyses. The Internet intervention is based on well-established face-to-face cognitive behavioral therapy incorporating the primary components of sleep restriction, stimulus control, sleep hygiene, cognitive restructuring, and relapse prevention. The Insomnia Severity Index and daily sleep diary data were used to determine changes in insomnia severity and the main sleep variables, including wake after sleep onset and sleep efficiency. Intention-to-treat analyses showed that scores on the Insomnia Severity Index significantly improved from 15.73 (95% confidence interval [CI], 14.07 to 17.39) to 6.59 (95% CI, 4.73 to 8.45) for the Internet group but did not change for the control group (16.27 [95% CI, 14.61 to 17.94] to 15.50 [95% CI, 13.64 to 17.36]) (F(1,42) = 29.64; P < .001). The Internet group maintained their gains at the 6-month follow-up. Internet participants also achieved significant decreases in wake after sleep onset (55% [95% CI, 34% to 76%]) and increases in sleep efficiency (16% [95% CI, 9% to 22%]) compared with the nonsignificant control group changes of wake after sleep onset (8% [95% CI, -17% to 33%) and sleep efficiency (3%; 95% CI, -4% to 9%). Participants who received the Internet intervention for insomnia significantly improved their sleep, whereas the control group did not have a significant change. The Internet appears to have considerable potential in delivering a structured behavioral program for insomnia. Identifier: NCT00328250.

                Author and article information

                J Med Internet Res
                J. Med. Internet Res
                Journal of Medical Internet Research
                JMIR Publications (Toronto, Canada )
                January 2019
                25 January 2019
                : 21
                : 1
                [1 ] Veterans Affairs Connecticut Healthcare System West Haven, CT United States
                [2 ] Department of Psychiatry Yale University School of Medicine New Haven, CT United States
                [3 ] Department of Psychiatry and Behavioral Sciences University of Washington School of Medicine Seattle, WA United States
                [4 ] Department of Psychological Science University of California at Irvine Irvine, CA United States
                [5 ] Kaiser Permanente Washington Health Research Institute Seattle, WA United States
                Author notes
                Corresponding Author: Eric DA Hermes
                ©Eric DA Hermes, Aaron R Lyon, Stephen M Schueller, Joseph E Glass. Originally published in the Journal of Medical Internet Research (, 25.01.2019.

                This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on well as this copyright and license information must be included.



                Comment on this article