Current practice and barriers and facilitators to outcome measurement in aphasia rehabilitation: a cross-sectional study using the theoretical domains framework

Background To be able to design effective strategies to improve healthcare professionals’ implementation behaviors, a valid and reliable questionnaire is needed to assess potential implementation determinants. The present study describes the development of the Determinants of Implementation Behavior Questionnaire (DIBQ) and investigates the reliability and validity of this Theoretical Domains Framework (TDF)-based questionnaire. Methods The DIBQ was developed to measure the potential behavioral determinants of the 12-domain version of the TDF (Michie et al., 2005). We identified existing questionnaires including items assessing constructs within TDF domains and developed new items where needed. Confirmatory factor analysis was used to examine whether the predefined structure of the TDF-based questionnaire was supported by the data. Cronbach’s alpha was calculated to assess internal consistency reliability of the questionnaire, and domains’ discriminant validity was investigated. Results We developed an initial questionnaire containing 100 items assessing 12 domains. Results obtained from confirmatory factor analysis and Cronbach’s alpha resulted in the final questionnaire consisting of 93 items assessing 18 domains, explaining 63.3% of the variance, and internal consistency reliability values ranging from .68 to .93. Domains demonstrated good discriminant validity, although the domains ‘Knowledge’ and ‘Skills’ and the domains ‘Skills’ and ‘Social/professional role and identity’ were highly correlated. Conclusions We have developed a valid and reliable questionnaire that can be used to assess potential determinants of healthcare professional implementation behavior following the theoretical domains of the TDF. The DIBQ can be used by researchers and practitioners who are interested in identifying determinants of implementation behaviors in order to be able to develop effective strategies to improve healthcare professionals’ implementation behaviors. Furthermore, the findings provide a novel validation of the TDF and indicate that the domain ‘Environmental context and resources’ might be divided into several environment-related domains.

Health-related quality of life (HRQL) is a key outcome in stroke clinical trials. Stroke-specific HRQL scales (eg, SS-QOL, SIS) have generally been developed with samples of stroke survivors that exclude people with aphasia. We adapted the SS-QOL for use with people with aphasia to produce the Stroke and Aphasia Quality of Life Scale (SAQOL). We report results from the psychometric evaluation of the initial 53-item SAQOL and the item-reduced SAQOL-39. We studied 95 people with long-term aphasia to evaluate the acceptability, reliability, and validity of the SAQOL and SAQOL-39 using standard psychometric methods. A total of 83 of 95 (87%) were able to complete the SAQOL by self-report; their results are reported here. Results supported the reliability and validity of the overall score on the 53-item SAQOL, but there was little support for hypothesized subdomains. Using factor analysis, we derived a shorter version (SAQOL-39) that identified 4 subdomains (physical, psychosocial, communication, and energy). The SAQOL-39 demonstrated good acceptability, internal consistency (Cronbach's alpha=0.74 to 0.94), test-retest reliability (intraclass correlation coefficient=0.89 to 0.98), and construct validity (corrected domain-total correlations, r=0.38 to 0.58; convergent, r=0.55 to 0.67; discriminant, r=0.02 to 0.27 validity). The SAQOL-39 is an acceptable, reliable, and valid measure of HRQL in people with long-term aphasia. Further testing is needed to evaluate the responsiveness of the SAQOL-39 and to investigate its usefulness in evaluative research and routine clinical practice.

Background Allied Health Professionals today are required, more than ever before, to demonstrate their impact. However, despite at least 20 years of expectation, many services fail to deliver routine outcome measurement in practice. This systematic review investigates what helps and hinders routine outcome measurement of allied health professionals practice. Methods A systematic review protocol was developed comprising: a defined search strategy for PsycINFO, MEDLINE and CINHAL databases and inclusion criteria and systematic procedures for data extraction and quality appraisal. Studies were included if they were published in English and investigated facilitators and/or barriers to routine outcome measurement by allied health professionals. No restrictions were placed on publication type, design, country, or year of publication. Reference lists of included publications were searched to identify additional papers. Descriptive methods were used to synthesise the findings. Results 960 papers were retrieved; 15 met the inclusion criteria. Professional groups represented were Physiotherapy, Occupational Therapy, and Speech and Language Therapy. The included literature varied in quality and design. Facilitators and barriers to routine outcome measurement exist at individual, managerial and organisational levels. Key factors affecting professionals’ use of routine outcome measurement include: professionals’ level of knowledge and confidence about using outcome measures, and the degree of organisational and peer-support professionals received with a view to promoting their work in practice. Conclusions Whilst the importance of routinely measuring outcomes within the allied health professions is well recognised, it has largely failed to be delivered in practice. Factors that influence clinicians’ ability and desire to undertake routine outcome measurement are bi-directional: they can act as either facilitators or barriers. Routine outcome measurement may only be deliverable if appropriate action is taken at individual therapist, team, and organisational levels of an organisation.