A systematic review of professional reasoning literature in occupational therapy

In the process of undertaking a meta-synthesis of qualitative studies of free-standing midwife-led units, the authors of this paper encountered a number of methodologically and epistemologically unresolved issues. One of these related to the assessment of the quality of qualitative research. In an iterative approach to scoping this issue, we identified eight existing checklists and summary frameworks. Some of these publications were opinion based, and some involved a synthesis of pre-existing frameworks. None of them provide a clear map of the criteria used in all their reviewed papers, and of the commonalities and differences between them. We critically review these frameworks and conclude that, although they are epistemologically and theoretically dense, they are excessively detailed for most uses. In order to reach a workable solution to the problem of the quality assessment of qualitative research, the findings from these frameworks and checklists were mapped together. Using a technique we have termed a 'redundancy approach' to eliminate non-essential criteria, we developed our own summary framework. The final synthesis was achieved through reflexive debate and discussion. Aspects of this discussion are detailed here. The synthesis is clearly rooted in a subjectivist epistemology, which views knowledge as constructed and hermeneutic in intent, encompassing individual, cultural and structural representations of reality.

The objective of this study is to outline explicit criteria for assessing the contribution of qualitative empirical studies in health and medicine, leading to a hierarchy of evidence specific to qualitative methods. This paper arose from a series of critical appraisal exercises based on recent qualitative research studies in the health literature. We focused on the central methodological procedures of qualitative method (defining a research framework, sampling and data collection, data analysis, and drawing research conclusions) to devise a hierarchy of qualitative research designs, reflecting the reliability of study conclusions for decisions made in health practice and policy. We describe four levels of a qualitative hierarchy of evidence-for-practice. The least likely studies to produce good evidence-for-practice are single case studies, followed by descriptive studies that may provide helpful lists of quotations but do not offer detailed analysis. More weight is given to conceptual studies that analyze all data according to conceptual themes but may be limited by a lack of diversity in the sample. Generalizable studies using conceptual frameworks to derive an appropriately diversified sample with analysis accounting for all data are considered to provide the best evidence-for-practice. Explicit criteria and illustrative examples are described for each level. A hierarchy of evidence-for-practice specific to qualitative methods provides a useful guide for the critical appraisal of papers using these methods and for defining the strength of evidence as a basis for decision making and policy generation.