22
views
0
recommends
+1 Recommend
1 collections
    0
    shares

      To submit your manuscript to JMIR, please click here

      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Improving Uptake of a National Web-Based Psychoeducational Workshop for Informal Caregivers of Veterans: Mixed Methods Implementation Evaluation

      research-article

      Read this article at

      ScienceOpenPublisherPMC
      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Background

          Although web-based psychoeducational programs may be an efficient, accessible, and scalable option for improving participant well-being, they seldom are sustained beyond trial publication. Implementation evaluations may help optimize program uptake, but few are performed. When the US Department of Veterans Affairs (VA) launched the web-based psychoeducational workshop Building Better Caregivers (BBC) for informal caregivers of veterans nationwide in 2013, the workshop did not enroll as many caregivers as anticipated.

          Objective

          This study aims to identify the strengths and weaknesses of initial implementation, strategies likely to improve workshop uptake, whether the VA adopted these strategies, and whether workshop enrollment changed.

          Methods

          We used mixed methods and the Promoting Action on Research Implementation in Health Services (PARIHS) implementation evaluation framework. In stage 1, we conducted semistructured interviews with caregivers, local staff, and regional and national VA leaders and surveys with caregivers and staff. We collected and analyzed survey and interview data concurrently and integrated the results to identify implementation strengths and weaknesses, and strategies likely to improve workshop uptake. In stage 2, we reinterviewed national leaders to determine whether the VA adopted recommended strategies and used national data to determine whether workshop enrollment changed over time.

          Results

          A total of 54 caregivers (n=32, 59%), staff (n=13, 24%), and regional (n=5, 9%) and national (n=4, 7%) leaders were interviewed. We received survey responses from 72% (23/32) of caregivers and 77% (10/13) of local staff. In stage 1, survey and interview results were consistent across multiple PARIHS constructs. Although participants from low-enrollment centers reported fewer implementation strengths and more weaknesses, qualitative themes were consistent across high- and low-enrollment centers, and across caregiver, staff, and leadership respondent groups. Identified strengths included belief in a positive workshop impact and the use of some successful outreach approaches. Implementation weaknesses included missed opportunities to improve outreach and to better support local staff. From these, we identified and recommended new and enhanced implementation strategies—increased investment in outreach and marketing capabilities; tailoring outreach strategies to multiple stakeholder groups; use of campaigns that are personal, repeated, and detailed, and have diverse delivery options; recurrent training and mentoring for new staff; and comprehensive data management and reporting capabilities. In stage 2, we determined that the VA had adopted several of these strategies in 2016. In the 3 years before and after adoption, cumulative BBC enrollment increased from 2139 (2013-2015) to 4030 (2016-2018) caregivers.

          Conclusions

          This study expands the limited implementation science literature on best practices to use when implementing web-based psychoeducational programs. We found that robust outreach and marketing strategies and support for local staff were critical to the implementation success of the BBC workshop. Other health systems may want to deploy these strategies when implementing their web-based programs.

          Related collections

          Most cited references43

          • Record: found
          • Abstract: not found
          • Article: not found

          A General Inductive Approach for Analyzing Qualitative Evaluation Data

          D R Thomas (2006)
            Bookmark
            • Record: found
            • Abstract: found
            • Article: found
            Is Open Access

            PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice

            Background The Promoting Action on Research Implementation in Health Services, or PARIHS framework, was first published in 1998. Since this time, work has been ongoing to further develop, refine and test it. Widely used as an organising or conceptual framework to help both explain and predict why the implementation of evidence into practice is or is not successful, PARIHS was one of the first frameworks to make explicit the multi-dimensional and complex nature of implementation as well as highlighting the central importance of context. Several critiques of the framework have also pointed out its limitations and suggested areas for improvement. Discussion Building on the published critiques and a number of empirical studies, this paper introduces a revised version of the framework, called the integrated or i-PARIHS framework. The theoretical antecedents of the framework are described as well as outlining the revised and new elements, notably, the revision of how evidence is described; how the individual and teams are incorporated; and how context is further delineated. We describe how the framework can be operationalised and draw on case study data to demonstrate the preliminary testing of the face and content validity of the revised framework. Summary This paper is presented for deliberation and discussion within the implementation science community. Responding to a series of critiques and helpful feedback on the utility of the original PARIHS framework, we seek feedback on the proposed improvements to the framework. We believe that the i-PARIHS framework creates a more integrated approach to understand the theoretical complexity from which implementation science draws its propositions and working hypotheses; that the new framework is more coherent and comprehensive and at the same time maintains it intuitive appeal; and that the models of facilitation described enable its more effective operationalisation. Electronic supplementary material The online version of this article (doi:10.1186/s13012-016-0398-2) contains supplementary material, which is available to authorized users.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              The Effectiveness of Web-Based vs. Non-Web-Based Interventions: A Meta-Analysis of Behavioral Change Outcomes

              Background A primary focus of self-care interventions for chronic illness is the encouragement of an individual's behavior change necessitating knowledge sharing, education, and understanding of the condition. The use of the Internet to deliver Web-based interventions to patients is increasing rapidly. In a 7-year period (1996 to 2003), there was a 12-fold increase in MEDLINE citations for “Web-based therapies.” The use and effectiveness of Web-based interventions to encourage an individual's change in behavior compared to non-Web-based interventions have not been substantially reviewed. Objective This meta-analysis was undertaken to provide further information on patient/client knowledge and behavioral change outcomes after Web-based interventions as compared to outcomes seen after implementation of non-Web-based interventions. Methods The MEDLINE, CINAHL, Cochrane Library, EMBASE, ERIC, and PSYCHInfo databases were searched for relevant citations between the years 1996 and 2003. Identified articles were retrieved, reviewed, and assessed according to established criteria for quality and inclusion/exclusion in the study. Twenty-two articles were deemed appropriate for the study and selected for analysis. Effect sizes were calculated to ascertain a standardized difference between the intervention (Web-based) and control (non-Web-based) groups by applying the appropriate meta-analytic technique. Homogeneity analysis, forest plot review, and sensitivity analyses were performed to ascertain the comparability of the studies. Results Aggregation of participant data revealed a total of 11,754 participants (5,841 women and 5,729 men). The average age of participants was 41.5 years. In those studies reporting attrition rates, the average drop out rate was 21% for both the intervention and control groups. For the five Web-based studies that reported usage statistics, time spent/session/person ranged from 4.5 to 45 minutes. Session logons/person/week ranged from 2.6 logons/person over 32 weeks to 1008 logons/person over 36 weeks. The intervention designs included one-time Web-participant health outcome studies compared to non-Web participant health outcomes, self-paced interventions, and longitudinal, repeated measure intervention studies. Longitudinal studies ranged from 3 weeks to 78 weeks in duration. The effect sizes for the studied outcomes ranged from -.01 to .75. Broad variability in the focus of the studied outcomes precluded the calculation of an overall effect size for the compared outcome variables in the Web-based compared to the non-Web-based interventions. Homogeneity statistic estimation also revealed widely differing study parameters (Qw16 = 49.993, P ≤ .001). There was no significant difference between study length and effect size. Sixteen of the 17 studied effect outcomes revealed improved knowledge and/or improved behavioral outcomes for participants using the Web-based interventions. Five studies provided group information to compare the validity of Web-based vs. non-Web-based instruments using one-time cross-sectional studies. These studies revealed effect sizes ranging from -.25 to +.29. Homogeneity statistic estimation again revealed widely differing study parameters (Qw4 = 18.238, P ≤ .001). Conclusions The effect size comparisons in the use of Web-based interventions compared to non-Web-based interventions showed an improvement in outcomes for individuals using Web-based interventions to achieve the specified knowledge and/or behavior change for the studied outcome variables. These outcomes included increased exercise time, increased knowledge of nutritional status, increased knowledge of asthma treatment, increased participation in healthcare, slower health decline, improved body shape perception, and 18-month weight loss maintenance.
                Bookmark

                Author and article information

                Contributors
                Journal
                J Med Internet Res
                J Med Internet Res
                JMIR
                Journal of Medical Internet Research
                JMIR Publications (Toronto, Canada )
                1439-4456
                1438-8871
                January 2021
                7 January 2021
                : 23
                : 1
                : e16495
                Affiliations
                [1 ] Division of General Internal Medicine Department of Medicine University of California San Francisco San Francisco, CA United States
                [2 ] Center for Innovation to Implementation VA Palo Alto Health Care System Palo Alto, CA United States
                [3 ] Department of Behavioral and Community Health University of Maryland Baltimore, MD United States
                [4 ] Department of Communication Studies San Francisco State University San Francisco, CA United States
                [5 ] Department of Psychiatry and Behavioral Sciences Stanford University Palo Alto, CA United States
                [6 ] VA Caregivers Support Program Department of Veterans Affairs Washington, DC United States
                [7 ] Division of Primary Care and Population Health Stanford University Palo Alto, CA United States
                Author notes
                Corresponding Author: Veronica Yank veronica.yank@ 123456ucsf.edu
                Author information
                https://orcid.org/0000-0002-8420-3897
                https://orcid.org/0000-0001-8192-9812
                https://orcid.org/0000-0003-3859-8493
                https://orcid.org/0000-0001-6948-833X
                https://orcid.org/0000-0003-0884-4120
                https://orcid.org/0000-0003-4114-912X
                https://orcid.org/0000-0002-0291-6544
                https://orcid.org/0000-0003-4946-1919
                https://orcid.org/0000-0001-5838-5335
                Article
                v23i1e16495
                10.2196/16495
                7819783
                33410759
                ec182a30-434e-4813-a110-4c357939c649
                ©Veronica Yank, Randall C Gale, Andrea Nevedal, Leonore Okwara, Christopher J Koenig, Ranak B Trivedi, Nancy J Dupke, Margaret Kabat, Steven M Asch. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 07.01.2021.

                This is an open-access article distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.

                History
                : 3 October 2019
                : 23 March 2020
                : 13 July 2020
                : 18 November 2020
                Categories
                Original Paper
                Original Paper

                Medicine
                web-based workshop,implementation science,behavioral intervention technology,informal caregiver,family caregiver,veteran,psychoeducation,self-management,outreach,marketing

                Comments

                Comment on this article