Development of a measurement system for complex oral information transfer in medical consultations

Abstract

Background

Information exchange between physician and patient is crucial to achieve patient involvement, shared decision making and treatment adherence. No reliable method exists for measuring how much information physicians provide in a complex, unscripted medical conversation, nor how much of this information patients recall. This study aims to fill this gap by developing a measurement system designed to compare complex orally provided information to patient recall.

Methods

The development of the complex information transfer measurement system required nine methodological steps. Core activities were data collection, definition of information units and the first draft of a codebook, refinement through independent coding and consensus, and reliability testing. Videotapes of physician-patient consultations based on a standardized scenario and post-consultation interviews with patients constituted the data. The codebook was developed from verbatim transcriptions of the videotapes. Inter-rater reliability was calculated using a random selection of 10% of the statements in the transcriptions.

Results

Thirtyfour transcriptions of visits and interviews were collected. We developed a set of rules for defining a single unit of information, defined detailed criteria for exclusion and inclusion of relevant units of information, and outlined systematic counting procedures. In the refinement phase, we established a system for comparing the information provided by the physician with what the patient recalled. While linguistic and conceptual issues arose during the process, coders still achieved good inter-rater reliability, with intra-class correlation for patient recall: 0.723, and for doctors: 0.761. A full codebook is available as an appendix.

Conclusions

A measurement system specifically aimed at quantifying complex unscripted information exchange may be a useful addition to the tools for evaluating the results of health communication training and randomized controlled trials.

Electronic supplementary material

The online version of this article (10.1186/s12874-019-0788-7) contains supplementary material, which is available to authorized users.