23
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Quality improvement into practice

      review-article
      1 , , 2
      The BMJ
      BMJ Publishing Group Ltd.

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          What you need to know Thinking of quality improvement (QI) as a principle-based approach to change provides greater clarity about (a) the contribution QI offers to staff and patients, (b) how to differentiate it from other approaches, (c) the benefits of using QI together with other change approaches QI is not a silver bullet for all changes required in healthcare: it has great potential to be used together with other change approaches, either concurrently (using audit to inform iterative tests of change) or consecutively (using QI to adapt published research to local context) As QI becomes established, opportunities for these collaborations will grow, to the benefit of patients. The benefits to front line clinicians of participating in quality improvement (QI) activity are promoted in many health systems. QI can represent a valuable opportunity for individuals to be involved in leading and delivering change, from improving individual patient care to transforming services across complex health and care systems.1 However, it is not clear that this promotion of QI has created greater understanding of QI or widespread adoption. QI largely remains an activity undertaken by experts and early adopters, often in isolation from their peers.2 There is a danger of a widening gap between this group and the majority of healthcare professionals. This article will make it easier for those new to QI to understand what it is, where it fits with other approaches to improving care (such as audit or research), when best to use a QI approach, making it easier to understand the relevance and usefulness of QI in delivering better outcomes for patients. How this article was made AB and FO are both specialist quality improvement practitioners and have developed their expertise working in QI roles for a variety of UK healthcare organisations. The analysis presented here arose from AB and FO’s observations of the challenges faced when introducing QI, with healthcare providers often unable to distinguish between QI and other change approaches, making it difficult to understand what QI can do for them. How is quality improvement defined? There are many definitions of QI (box 1). The BMJ’s Quality Improvement series uses the Academy of Medical Royal Colleges definition.6 Rather than viewing QI as a single method or set of tools, it can be more helpful to think of QI as based on a set of principles common to many of these definitions: a systematic continuous approach that aims to solve problems in healthcare, improve service provision, and ultimately provide better outcomes for patients. Box 1 Definitions of quality improvement Improvement in patient outcomes, system performance, and professional development that results from a combined, multidisciplinary approach in how change is delivered.3 The delivery of healthcare with improved outcomes and lower cost through continuous redesigning of work processes and systems.4 Using a systematic change method and strategies to improve patient experience and outcome.5 To make a difference to patients by improving safety, effectiveness, and experience of care by using understanding of our complex healthcare environment, applying a systematic approach, and designing, testing, and implementing changes using real time measurement for improvement.6 In this article we discuss QI as an approach to improving healthcare that follows the principles outlined in box 2; this may be a useful reference to consider how particular methods or tools could be used as part of a QI approach. Box 2 Principles of QI Primary intent—To bring about measurable improvement to a specific aspect of healthcare delivery, often with evidence or theory of what might work but requiring local iterative testing to find the best solution.7 Employing an iterative process of testing change ideas—Adopting a theory of change which emphasises a continuous process of planning and testing changes, studying and learning from comparing the results to a predicted outcome, and adapting hypotheses in response to results of previous tests.8 9 Consistent use of an agreed methodology—Many different QI methodologies are available; commonly cited methodologies include the Model for Improvement, Lean, Six Sigma, and Experience-based Co-design.4 Systematic review shows that the choice of tools or methodologies has little impact on the success of QI provided that the chosen methodology is followed consistently.10 Though there is no formal agreement on what constitutes a QI tool, it would include activities such as process mapping that can be used within a range of QI methodological approaches. NHS Scotland’s Quality Improvement Hub has a glossary of commonly used tools in QI.11 Empowerment of front line staff and service users—QI work should engage staff and patients by providing them with the opportunity and skills to contribute to improvement work. Recognition of this need often manifests in drives from senior leadership or management to build QI capability in healthcare organisations, but it also requires that frontline staff and service users feel able to make use of these skills and take ownership of improvement work.12 Using data to drive improvement—To drive decision making by measuring the impact of tests of change over time and understanding variation in processes and outcomes. Measurement for improvement typically prioritises this narrative approach over concerns around exactness and completeness of data.13 14 Scale-up and spread, with adaptation to context—As interventions tested using a QI approach are scaled up and the degree of belief in their efficacy increases, it is desirable that they spread outward and be adopted by others. Key to successful diffusion of improvement is the adaption of interventions to new environments, patient and staff groups, available resources, and even personal preferences of healthcare providers in surrounding areas, again using an iterative testing approach.15 16 What other approaches to improving healthcare are there? Taking considered action to change healthcare for the better is not new, but QI as a distinct approach to improving healthcare is a relatively recent development. There are many well established approaches to evaluating and making changes to healthcare services in use, and QI will only be adopted more widely if it offers a new perspective or an advantage over other approaches in certain situations. A non-systematic literature scan identified the following other approaches for making change in healthcare: research, clinical audit, service evaluation, and clinical transformation. We also identified innovation as an important catalyst for change, but we did not consider it an approach to evaluating and changing healthcare services so much as a catch-all term for describing the development and introduction of new ideas into the system. A summary of the different approaches and their definition is shown in box 3. Many have elements in common with QI, but there are important difference in both intent and application. To be useful to clinicians and managers, QI must find a role within healthcare that complements research, audit, service evaluation, and clinical transformation while retaining the core principles that differentiate it from these approaches. Box 3 Alternatives to QI Research—The attempt to derive generalisable new knowledge by addressing clearly defined questions with systematic and rigorous methods.17 Clinical audit—A way to find out if healthcare is being provided in line with standards and to let care providers and patients know where their service is doing well, and where there could be improvements.18 Service evaluation—A process of investigating the effectiveness or efficiency of a service with the purpose of generating information for local decision making about the service.19 Clinical transformation—An umbrella term for more radical approaches to change; a deliberate, planned process to make dramatic and irreversible changes to how care is delivered.20 Innovation—To develop and deliver new or improved health policies, systems, products and technologies, and services and delivery methods that improve people’s health. Health innovation responds to unmet needs by employing new ways of thinking and working.21 Why do we need to make this distinction for QI to succeed? Improvement in healthcare is 20% technical and 80% human.22 Essential to that 80% is clear communication, clarity of approach, and a common language. Without this shared understanding of QI as a distinct approach to change, QI work risks straying from the core principles outlined above, making it less likely to succeed. If practitioners cannot communicate clearly with their colleagues about the key principles and differences of a QI approach, there will be mismatched expectations about what QI is and how it is used, lowering the chance that QI work will be effective in improving outcomes for patients.23 There is also a risk that the language of QI is adopted to describe change efforts regardless of their fidelity to a QI approach, either due to a lack of understanding of QI or a lack of intention to carry it out consistently.9 Poor fidelity to the core principles of QI reduces its effectiveness and makes its desired outcome less likely, leading to wasted effort by participants and decreasing its credibility.2 8 24 This in turn further widens the gap between advocates of QI and those inclined to scepticism, and may lead to missed opportunities to use QI more widely, consequently leading to variation in the quality of patient care. Without articulating the differences between QI and other approaches, there is a risk of not being able to identify where a QI approach can best add value. Conversely, we might be tempted to see QI as a “silver bullet” for every healthcare challenge when a different approach may be more effective. In reality it is not clear that QI will be fit for purpose in tackling all of the wicked problems of healthcare delivery and we must be able to identify the right tool for the job in each situation.25 Finally, while different approaches will be better suited to different types of challenge, not having a clear understanding of how approaches differ and complement each other may mean missed opportunities for multi-pronged approaches to improving care. What is the relationship between QI and other approaches such as audit? Academic journals, healthcare providers, and “arms-length bodies” have made various attempts to distinguish between the different approaches to improving healthcare.19 26 27 28 However, most comparisons do not include QI or compare QI to only one or two of the other approaches.7 29 30 31 To make it easier for people to use QI approaches effectively and appropriately, we summarise the similarities, differences, and crossover between QI and other approaches to tackling healthcare challenges (fig 1). Fig 1 How quality improvement interacts with other approaches to improving healthcare QI and research Overview Research aims to generate new generalisable knowledge, while QI typically involves a combination of generating new knowledge or implementing existing knowledge within a specific setting.32 Unlike research, including pragmatic research designed to test effectiveness of interventions in real life, QI does not aim to provide generalisable knowledge. In common with QI, research requires a consistent methodology. This method is typically used, however, to prove or disprove a fixed hypothesis rather than the adaptive hypotheses developed through the iterative testing of ideas typical of QI. Both research and QI are interested in the environment where work is conducted, though with different intentions: research aims to eliminate or at least reduce the impact of many variables to create generalisable knowledge, whereas QI seeks to understand what works best in a given context. The rigour of data collection and analysis required for research is much higher; in QI a criterion of “good enough” is often applied. Relationship with QI Though the goal of clinical research is to develop new knowledge that will lead to changes in practice, much has been written on the lag time between publication of research evidence and system-wide adoption, leading to delays in patients benefitting from new treatments or interventions.33 QI offers a way to iteratively test the conditions required to adapt published research findings to the local context of individual healthcare providers, generating new knowledge in the process. Areas with little existing knowledge requiring further research may be identified during improvement activities, which in turn can form research questions for further study. QI and research also intersect in the field of improvement science, the academic study of QI methods which seeks to ensure QI is carried out as effectively as possible.34 Scenario: QI for translational research Newly published research shows that a particular physiotherapy intervention is more clinically effective when delivered in short, twice-daily bursts rather than longer, less frequent sessions. A team of hospital physiotherapists wish to implement the change but are unclear how they will manage the shift in workload and how they should introduce this potentially disruptive change to staff and to patients. Before continuing reading think about your own practice—How would you approach this situation, and how would you use the QI principles described in this article? Adopting a QI approach, the team realise that, although the change they want to make is already determined, the way in which it is introduced and adapted to their wards is for them to decide. They take time to explain the benefits of the change to colleagues and their current patients, and ask patients how they would best like to receive their extra physiotherapy sessions. The change is planned and tested for two weeks with one physiotherapist working with a small number of patients. Data are collected each day, including reasons why sessions were missed or refused. The team review the data each day and make iterative changes to the physiotherapist’s schedule, and to the times of day the sessions are offered to patients. Once an improvement is seen, this new way of working is scaled up to all of the patients on the ward. The findings of the work are fed into a service evaluation of physiotherapy provision across the hospital, which uses the findings of the QI work to make recommendations about how physiotherapy provision should be structured in the future. People feel more positive about the change because they know colleagues who have already made it work in practice. QI and clinical audit Overview Clinical audit is closely related to QI: it is often used with the intention of iteratively improving the standard of healthcare, albeit in relation to a pre-determined standard of best practice.35 When used iteratively, interspersed with improvement action, the clinical audit cycle adheres to many of the principles of QI. However, in practice clinical audit is often used by healthcare organisations as an assurance function, making it less likely to be carried out with a focus on empowering staff and service users to make changes to practice.36 Furthermore, academic reviews of audit programmes have shown audit to be an ineffective approach to improving quality due to a focus on data collection and analysis without a well developed approach to the action section of the audit cycle.37 Clinical audits, such as the National Clinical Audit Programme in the UK (NCAPOP), often focus on the management of specific clinical conditions. QI can focus on any part of service delivery and can take a more cross-cutting view which may identify issues and solutions that benefit multiple patient groups and pathways.30 Relationship with QI Audit is often the first step in a QI process and is used to identify improvement opportunities, particularly where compliance with known standards for high quality patient care needs to be improved. Audit can be used to establish a baseline and to analyse the impact of tests of change against the baseline. Also, once an improvement project is under way, audit may form part of rapid cycle evaluation, during the iterative testing phase, to understand the impact of the idea being tested. Regular clinical audit may be a useful assurance tool to help track whether improvements have been sustained over time. Scenario: Audit and QI A foundation year 2 (FY2) doctor is asked to complete an audit of a pre-surgical pathway by looking retrospectively through patient documentation. She concludes that adherence to best practice is mixed and recommends: “Remind the team of the importance of being thorough in this respect and re-audit in 6 months.” The results are presented at an audit meeting, but a re-audit a year later by a new FY2 doctor shows similar results. Before continuing reading think about your own practice—How would you approach this situation, and how would you use the QI principles described in this paper? Contrast the above with a team-led, rapid cycle audit in which everyone contributes to collecting and reviewing data from the previous week, discussed at a regular team meeting. Though surgical patients are often transient, their experience of care and ideas for improvement are captured during discharge conversations. The team identify and test several iterative changes to care processes. They document and test these changes between audits, leading to sustainable change. Some of the surgeons involved work across multiple hospitals, and spread some of the improvements, with the audit tool, as they go. QI and service evaluation Overview In practice, service evaluation is not subject to the same rigorous definition or governance as research or clinical audit, meaning that there are inconsistencies in the methodology for carrying it out. While the primary intent for QI is to make change that will drive improvement, the primary intent for evaluation is to assess the performance of current patient care.38 Service evaluation may be carried out proactively to assess a service against its stated aims or to review the quality of patient care, or may be commissioned in response to serious patient harm or red flags about service performance. The purpose of service evaluation is to help local decision makers determine whether a service is fit for purpose and, if necessary, identify areas for improvement. Relationship with QI Service evaluation may be used to initiate QI activity by identifying opportunities for change that would benefit from a QI approach. It may also evaluate the impact of changes made using QI, either during the work or after completion to assess sustainability of improvements made. Though likely planned as separate activities, service evaluation and QI may overlap and inform each other as they both develop. Service evaluation may also make a judgment about a service’s readiness for change and identify any barriers to, or prerequisites for, carrying out QI. QI and clinical transformation Overview Clinical transformation involves radical, dramatic, and irreversible change—the sort of change that cannot be achieved through continuous improvement alone. As with service evaluation, there is no consensus on what clinical transformation entails, and it may be best thought of as an umbrella term for the large scale reform or redesign of clinical services and the non-clinical services that support them.20 39 While it is possible to carry out transformation activity that uses elements of QI approach, such as effective engagement of the staff and patients involved, QI which rests on iterative test of change cannot have a transformational approach—that is, one-off, irreversible change. Relationship with QI There is opportunity to use QI to identify and test ideas before full scale clinical transformation is implemented. This has the benefit of engaging staff and patients in the clinical transformation process and increasing the degree of belief that clinical transformation will be effective or beneficial. Transformation activity, once completed, could be followed up with QI activity to drive continuous improvement of the new process or allow adaption of new ways of working. As interventions made using QI are scaled up and spread, the line between QI and transformation may seem to blur. The shift from QI to transformation occurs when the intention of the work shifts away from continuous testing and adaptation into the wholesale implementation of an agreed solution. Scenario: QI and clinical transformation An NHS trust’s human resources (HR) team is struggling to manage its junior doctor placements, rotas, and on-call duties, which is causing tension and has led to concern about medical cover and patient safety out of hours. A neighbouring trust has launched a smartphone app that supports clinicians and HR colleagues to manage these processes with the great success. This problem feels ripe for a transformation approach—to launch the app across the trust, confident that it will solve the trust’s problems. Before continuing reading think about your own organisation—What do you think will happen, and how would you use the QI principles described in this article for this situation? Outcome without QI Unfortunately, the HR team haven’t taken the time to understand the underlying problems with their current system, which revolve around poor communication and clarity from the HR team, based on not knowing who to contact and being unable to answer questions. HR assume that because the app has been a success elsewhere, it will work here as well. People get excited about the new app and the benefits it will bring, but no consideration is given to the processes and relationships that need to be in place to make it work. The app is launched with a high profile campaign and adoption is high, but the same issues continue. The HR team are confused as to why things didn’t work. Outcome with QI Although the app has worked elsewhere, rolling it out without adapting it to local context is a risk – one which application of QI principles can mitigate. HR pilot the app in a volunteer specialty after spending time speaking to clinicians to better understand their needs. They carry out several tests of change, ironing out issues with the process as they go, using issues logged and clinician feedback as a source of data. When they are confident the app works for them, they expand out to a directorate, a division, and finally the transformational step of an organisation-wide rollout can be taken. Education into practice Next time when faced with what looks like a quality improvement (QI) opportunity, consider asking: How do you know that QI is the best approach to this situation? What else might be appropriate? Have you considered how to ensure you implement QI according to the principles described above? Is there opportunity to use other approaches in tandem with QI for a more effective result? How patients were involved in the creation of this article This article was conceived and developed in response to conversations with clinicians and patients working together on co-produced quality improvement and research projects in a large UK hospital. The first iteration of the article was reviewed by an expert patient, and, in response to their feedback, we have sought to make clearer the link between understanding the issues raised and better patient care.

          Related collections

          Most cited references9

          • Record: found
          • Abstract: found
          • Article: found
          Is Open Access

          How to get started in quality improvement

          What you need to know Participation in quality improvement can help clinicians and trainees improve care together and develop important professional skills Effective quality improvement relies on collaborative working with colleagues and patients and the use of a structured method Enthusiasm, perseverance, good project management skills, and a willingness to explain your project to others and seek their support are key skills Quality improvement (box 1) is a core component of many undergraduate and postgraduate curriculums.1 2 3 4 5 Numerous healthcare organisations,6 professional regulators,7 and policy makers8 recognise the benefits of training clinicians in quality improvement. Box 1 Defining quality improvement1 Quality improvement aims to make a difference to patients by improving safety, effectiveness, and experience of care by: Using understanding of our complex healthcare environment Applying a systematic approach Designing, testing, and implementing changes using real time measurement for improvement Engaging in quality improvement enables clinicians to acquire, assimilate, and apply important professional capabilities7 such as managing complexity and training in human factors.1 For clinical trainees, it is a chance to improve care9; develop leadership, presentation, and time management skills to help their career development10; and build relationships with colleagues in organisations that they have recently joined.11 For more experienced clinicians, it is an opportunity to address longstanding concerns about the way in which care processes and systems are delivered, and to strengthen their leadership for improvement skills.12 The benefits to patients, clinicians, and healthcare providers of engaging in quality improvement are considerable, but there are many challenges involved in designing, delivering, and sustaining an improvement intervention. These range from persuading colleagues that there is a problem that needs to be tackled, through to keeping them engaged once the intervention is up and running as other clinical priorities compete for their attention.13 You are also likely to have competing priorities and will need support to make time for quality improvement. The organisational culture, such as the extent to which clinicians are able to question existing practice and try new ideas,14 15 16 also has an important bearing on the success of the intervention. This article describes the skills, knowledge, and support needed to get started in quality improvement and deliver effective interventions. What skills do you need? Enthusiasm, optimism, curiosity, and perseverance are critical in getting started and then in helping you to deal with the challenges you will inevitably face on your improvement journey. Relational skills are also vital. At its best quality improvement is a team activity. The ability to collaborate with different people, including patients, is vital for a project to be successful.17 18 You need to be willing to reach out to groups of people that you may not have worked with before, and to value their ideas.19 No one person has the skills or knowledge to come up with the solution to a problem on their own. Learning how systems work and how to manage complexity is another core skill.20 An ability to translate quality improvement approaches and methods into practice (box 2), coupled with good project and time management skills, will help you design and implement a robust project plan.27 Box 2 Quality improvement approaches Healthcare organisations use a range of improvement methods,21 22 such as the Model for Improvement, where changes are tested in small cycles that involve planning, doing, studying, and acting (PDSA),23 and Lean, which focuses on continually improving processes by removing waste, duplication, and non-value adding steps.24 To be effective, such methods need to be applied consistently and rigorously, with due regard to the context.25 In using PDSA cycles, for example, it is vital that teams build in sufficient time for planning and reflection, and do not focus primarily on the “doing.”26 Equally important is an understanding of the measurement for improvement model, which involves the gradual refinement of your intervention based on repeated tests of change. The aim is to discover how to make your intervention work in your setting, rather than to prove it works, so useful data, not perfect data, are needed.28 29 Some experience of data collection and analysis methods (including statistical analysis tools such as run charts and statistical process control) is useful, but these will develop with increasing experience.30 31 Most importantly, you need to enjoy the experience. It is rare that a clinician can institute real, tangible change, but with quality improvement this is a real possibility, which is both empowering and satisfying. Finally, don’t worry about what you don’t know. You will learn by doing. Many skills needed to implement successful quality improvement will be developed as you go; this is a fundamental feature of quality improvement. How do you get started? The first step is to recruit your improvement team. Start with colleagues and patients,32 but also try to bring in people from other professions, including non-clinical staff. You need a blend of skills and perspectives in your team. Find a colleague experienced in quality improvement who is willing to mentor or supervise you. Next, identify a problem collaboratively with your team. Use data to help with this (eg, clinical audits, registries of data on patients’ experiences and outcomes, and learning from incidents and complaints) (box 3). Take time to understand what might be causing the problem. There are different techniques to help you (process mapping, five whys, appreciative inquiry).35 36 37 Think about the contextual factors that are contributing to the problem (eg, the structure, culture, politics, capabilities and resources of your organisation). Box 3 Clinical audit and quality improvement Quality improvement is an umbrella term under which many approaches sit, clinical audit being one.33 Clinical audit is commonly used by trainees to assess clinical effectiveness. Confusion of audit as both a term for assurance and improvement has perhaps limited its potential, with many audits ending at the data collection stage and failing to lead to improvement interventions. Learning from big datasets such as the National Clinical Audits in the UK is beginning to shift the focus to a quality improvement approach that focuses on identifying and understanding unwanted variation in the local context; developing and testing possible solutions, and moving from one-off change to multiple cycles of change.34 Next, develop your aim using the SMART framework: Specific (S), Measurable (M), Achievable (A), Realistic (R), and Timely (T).38 This allows you to assess the scale of the intervention and to pare it down if your original idea is too ambitious. Aligning your improvement aim with the priorities of the organisation where you work will help you to get management and executive support.39 Having done this, map those stakeholders who might be affected by your intervention and work out which ones you need to approach, and how to sell it to them.40 Take the time to talk to them. It will be appreciated and increases the likelihood of buy in, without which your quality improvement project is likely to fail irrespective of how good your idea is. You need to be clear in your own mind about the reasons you think it is important. Developing an “elevator pitch” based on your aims is a useful technique to persuade others,38 remembering different people are hooked in for different reasons. The intervention will not be perfect first time. Expect a series of iterative changes in response to false starts and obstacles. Measuring the impact of your intervention will enable you to refine it.28 Time invested in all these aspects will improve your chances of success. Right from the start, think about how improvement will be embedded. Attention to sustainability will mean that when you move to your next job your improvement efforts, and those of others, and the impact you have collectively achieved will not be lost.41 42 What support is needed? You need support from both your organisation and experienced colleagues to translate your skills into practice. Here are some steps you can take to help you make the most of your skills: Find the mentor or supervisor who will help identify and support opportunities for you. Signposting and introduction to those in an organisation who will help influence (and may hinder) your quality improvement project is invaluable Use planning and reporting tools to help manage your project, such as those in NHS Improvement’s project management framework27 Identify if your local quality improvement or clinical audit team may be a source of support and useful development resource for you rather than just a place to register a project. Most want to support you. Determine how you might access (or develop your own) local peer to peer support networks, coaching, and wider improvement networks (eg, NHS networks; Q network43 44) Use quality improvement e-learning platforms such as those provided by Health Education England or NHS Education for Scotland to build your knowledge45 46 Learn through feedback and assessment of your project (eg, via the QIPAT tool47 or a multi-source feedback tool.48 49 Quality improvement approaches are still relatively new in the education of healthcare professionals. Quality improvement can give clinicians a more productive, empowering, and educational experience. Quality improvement projects allow clinicians, working within a team, to identify an issue and implement interventions that can result in true improvements in quality. Projects can be undertaken in fields that interest clinicians and give them transferable skills in communication, leadership, project management, team working, and clinical governance. Done well, quality improvement is a highly beneficial, positive process which enables clinicians to deliver true change for the benefit of themselves, their organisations, and their patients. Quality improvement in action: three doctors and a medical student talk about the challenges and practicalities of quality improvement This box contains four interviews by Laura Nunez-Mulder with people who have experience in quality improvement. Alex Thompson, medical student at the University of Cambridge, is in the early stages of his first quality improvement project We are aiming to improve identification and early diagnosis of aortic dissections in our hospital. Our supervising consultant suspects that the threshold for organising computed tomography angiography for a suspected aortic dissection is too high, so to start with, my student colleague and I are finding out what proportion of CT angiograms result in a diagnosis of aortic dissection. I fit the project around my studies by working on it in small chunks here and there. You have to be very self motivated to see a project through to the end. Anna Olsson-Brown, research fellow at the University of Liverpool, engaged in quality improvement in her F1 year, and has since supported junior doctors to do the same. This extract is adapted from her BMJ Opinion piece (https://blogs.bmj.com/bmj/) Working in the emergency department after my F1 job in oncology, I noticed that the guidelines on neutropenic sepsis antibiotics were relatively unknown and even less frequently implemented. A colleague and I devised a neutropenic sepsis pathway for oncology patients in the emergency department including an alert label for blood tests. The pathway ran for six months and there was some initial improvement, but the benefit was not sustained after we left the department. As an ST3, I mentored a junior doctor whose quality improvement project led to the introduction of a syringe driver prescription sticker that continues to be used to this day. My top tips for those supporting trainees in quality improvement: Make sure the project is sufficiently narrow to enable timely delivery Ensure regular evaluation to assess impact Support trainees to implement sustainable pathways that do not require their ongoing input. Amar Puttanna, consultant in diabetes and endocrinology at Good Hope Hospital, describes a project he carried out as a chief registrar of the Royal College of Physicians The project of which I am proudest is a referral service we launched to review medication for patients with diabetes and dementia. We worked with practitioners on the older adult care ward, the acute medical unit, the frailty service, and the IT teams, and we promoted the project in newsletters at the trust and the Royal College of Physicians. The success of the project depended on continuous promotion to raise awareness of the service because junior doctors move on frequently. Activity in our project reduced after I left the trust, though it is still ongoing and won a Quality in Care Award in November 2018. Though this project was a success, not everything works. But even the projects that fail contain valuable lessons. Mark Taubert, consultant in palliative medicine and honorary senior lecturer for Cardiff University School of Medicine, launched the TalkCPR project Speaking to people with expertise in quality improvement helped me to narrow my focus to one question: “Can videos be used to inform both staff and patients/carers about cardiopulmonary resuscitation and its risks in palliative illness?” With my team I created and evaluated TalkCPR, an online resource that has gone on to win awards (talkcpr.wales). The most challenging aspect was figuring out which tools might get the right information from any data I collected. I enrolled on a Silver Improving Quality Together course and joined the Welsh Bevan Commission, where I learned useful techniques such as multiple PDSA (plan, do, study, act) cycles, driver diagrams, and fishbone diagrams. Education into practice In designing your next quality improvement project: What will you do to ensure that you understand the problem you are trying to solve? How will you involve your colleagues and patients in your project and gain the support of managers and senior staff? What steps will you take right from the start to ensure that any improvements made are sustained? How patients were involved in the creation of this article The authors have drawn on their experience both in partnering with patients in the design and delivery of multiple quality improvement activities and in participating in the Academy of Medical Royal Colleges Training for Better Outcomes Task and Finish Group1 in which patients were involved at every step. Patients were not directly involved in writing this article. Sources and selection material Evidence for this article was based on references drawn from authors’ academic experience in this area, guidance from organisations involved in supporting quality improvement work in practice such as NHS Improvement, The Health Foundation, and the Institute for Healthcare Improvement, and authors’ experience of working to support clinical trainees to undertake quality improvement.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: found
            Is Open Access

            Using data for improvement

            Amar Shah (2019)
            What you need to know Both qualitative and quantitative data are critical for evaluating and guiding improvement A family of measures, incorporating outcome, process, and balancing measures, should be used to track improvement work Time series analysis, using small amounts of data collected and displayed frequently, is the gold standard for using data for improvement We all need a way to understand the quality of care we are providing, or receiving, and how our service is performing. We use a range of data in order to fulfil this need, both quantitative and qualitative. Data are defined as “information, especially facts and numbers, collected to be examined and considered and used to help decision-making.”1 Data are used to make judgements, to answer questions, and to monitor and support improvement in healthcare (box 1). The same data can be used in different ways, depending on what we want to know or learn. Box 1 Defining quality improvement2 Quality improvement aims to make a difference to patients by improving safety, effectiveness, and experience of care by: Using understanding of our complex healthcare environment Applying a systematic approach Designing, testing, and implementing changes using real-time measurement for improvement Within healthcare, we use a range of data at different levels of the system: Patient level—such as blood sugar, temperature, blood test results, or expressed wishes for care) Service level—such as waiting times, outcomes, complaint themes, or collated feedback of patient experience Organisation level—such as staff experience or financial performance Population level—such as mortality, quality of life, employment, and air quality. This article outlines the data we need to understand the quality of care we are providing, what we need to capture to see if care is improving, how to interpret the data, and some tips for doing this more effectively. Sources and selection criteria This article is based on my experience of using data for improvement at East London NHS Foundation Trust, which is seen as one of the world leaders in healthcare quality improvement. Our use of data, from trust board to clinical team, has transformed over the past six years in line with the learning shared in this article. This article is also based on my experience of teaching with the Institute for Healthcare Improvement, which guides and supports quality improvement efforts across the globe. What data do we need? Healthcare is a complex system, with multiple interdependencies and an array of factors influencing outcomes. Complex systems are open, unpredictable, and continually adapting to their environment.3 No single source of data can help us understand how a complex system behaves, so we need several data sources to see how a complex system in healthcare is performing. Avedis Donabedian, a doctor born in Lebanon in 1919, studied quality in healthcare and contributed to our understanding of using outcomes.4 He described the importance of focusing on structures and processes in order to improve outcomes.5 When trying to understand quality within a complex system, we need to look at a mix of outcomes (what matters to patients), processes (the way we do our work), and structures (resources, equipment, governance, etc). Therefore, when we are trying to improve something, we need a small number of measures (ideally 5-8) to help us monitor whether we are moving towards our goal. Any improvement effort should include one or two outcome measures linked explicitly to the aim of the work, a small number of process measures that show how we are doing with the things we are actually working on to help us achieve our aim, and one or two balancing measures (box 2). Balancing measures help us spot unintended consequences of the changes we are making. As complex systems are unpredictable, our new changes may result in an unexpected adverse effect. Balancing measures help us stay alert to these, and ought to be things that are already collected, so that we do not waste extra resource on collecting these. Box 2 Different types of measures of quality of care Outcome measures (linked explicitly to the aim of the project) Aim—To reduce waiting times from referral to appointment in a clinic Outcome measure—Length of time from referral being made to being seen in clinic Data collection—Date when each referral was made, and date when each referral was seen in clinic, in order to calculate the time in days from referral to being seen Process measures (linked to the things you are going to work on to achieve the aim) Change idea—Use of a new referral form (to reduce numbers of inappropriate referrals and re-work in obtaining necessary information) Process measure—Percentage of referrals received that are inappropriate or require further information Data collection—Number of referrals received that are inappropriate or require further information each week divided by total number of referrals received each week Change idea—Text messaging patients two days before the appointment (to reduce non-attendance and wasted appointment slots) Process measure—Percentage of patients receiving a text message two days before appointment Data collection—Number of patients each week receiving a text message two days before their appointment divided by the total number of patients seen each week Process measure—Percentage of patients attending their appointment Data collection—Number of patients attending their appointment each week divided by the total number of patients booked in each week Balancing measures (to spot unintended consequences) Measure—Percentage of referrers who are satisfied or very satisfied with the referral process (to spot whether all these changes are having a detrimental effect on the experience of those referring to us) Data collection—A monthly survey to referrers to assess their satisfaction with the referral process Measure—Percentage of staff who are satisfied or very satisfied at work (to spot whether the changes are increasing burden on staff and reducing their satisfaction at work) Data collection—A monthly survey for staff to assess their satisfaction at work How should we look at the data? This depends on the question we are trying to answer. If we ask whether an intervention was efficacious, as we might in a research study, we would need to be able to compare data before and after the intervention and remove all potential confounders and bias. For example, to understand whether a new treatment is better than the status quo, we might design a research study to compare the effect of the two interventions and ensure that all other characteristics are kept constant across both groups. This study might take several months, or possibly years, to complete, and would compare the average of both groups to identify whether there is a statistically significant difference. This approach is unlikely to be possible in most contexts where we are trying to improve quality. Most of the time when we are improving a service, we are making multiple changes and assessing impact in real-time, without being able to remove all confounding factors and potential bias. When we ask whether an outcome has improved, as we do when trying to improve something, we need to be able to look at data over time to see how the system changes as we intervene, with multiple tests of change over a period. For example, if we were trying to improve the time from a patient presenting in the emergency department to being admitted to a ward, we would likely be testing several different changes at different places in the pathway. We would want to be able to look at the outcome measure of total time from presentation to admission on the ward, over time, on a daily basis, to be able to see whether the changes made lead to a reduction in the overall outcome. So, when looking at a quality issue from an improvement perspective, we view smaller amounts of data but more frequently to see if we are improving over time.2 What is best practice in using data to support improvement? Best practice would be for each team to have a small number of measures that are collectively agreed with patients and service users as being the most important ways of understanding the quality of the service being provided. These measures would be displayed transparently so that all staff, service users, and patients and families or carers can access them and understand how the service is performing. The data would be shown as time series analysis, to provide a visual display of whether the service is improving over time. The data should be available as close to real-time as possible, ideally on a daily or weekly basis. The data should prompt discussion and action, with the team reviewing the data regularly, identifying any signals that suggest something unusual in the data, and taking action as necessary. The main tools used for this purpose are the run chart and the Shewhart (or control) chart. The run chart (fig 1) is a graphical display of data in time order, with a median value, and uses probability-based rules to help identify whether the variation seen is random or non-random.2 The Shewhart (control) chart (fig 2) also displays data in time order, but with a mean as the centre line instead of a median, and upper and lower control limits (UCL and LCL) defining the boundaries within which you would predict the data to be.6 Shewhart charts use the terms “common cause variation” and “special cause variation,” with a different set of rules to identify special causes. Fig 1 A typical run chart Fig 2 A typical Shewhart (or control) chart Is it just about numbers? We need to incorporate both qualitative and quantitative data to help us learn about how the system is performing and to see if we improve over time. Quantitative data express quantity, amount, or range and can be measured numerically—such as waiting times, mortality, haemoglobin level, cash flow. Quantitative data are often visualised over time as time series analyses (run charts or control charts) to see whether we are improving. However, we should also be capturing, analysing, and learning from qualitative data throughout our improvement work. Qualitative data are virtually any type of information that can be observed and recorded that is not numerical in nature. Qualitative data are particularly useful in helping us to gain deeper insight into an issue, and to understand meaning, opinion, and feelings. This is vital in supporting us to develop theories about what to focus on and what might make a difference.7 Examples of qualitative data include waiting room observation, feedback about experience of care, free-text responses to a survey. Using qualitative data for improvement One key point in an improvement journey when qualitative data are critical is at the start, when trying to identify “What matters most?” and what the team’s biggest opportunity for improvement is. The other key time to use qualitative data is during “Plan, Do, Study, Act” (PDSA) cycles. Most PDSA cycles, when done well, rely on qualitative data as well as quantitative data to help learn about how the test fared compared with our original theory and prediction. Table 1 shows four different ways to collect qualitative data, with advantages and disadvantages of each, and how we might use them within our improvement work. Table 1 Different ways to collect qualitative data for improvement Data collection method Advantages Disadvantages Using the data Free-text question in a survey Quick and easy to create, on paper or electronic Questions are pre-determined so cannot adapt based on answers Beware of survey fatigue At the start of a project to capture opinions, ideas, and feedback from service users and staff Interviews Can be individual or groupCan be structured, semi-structured, or unstructuredCan explore deeper meaning Time intensive Need to facilitate the interview and take notes or record the discussion Analysing large amounts of narrative requires skill To help us understand the issue we want to work on in more detail with multiple perspectives To help us appreciate a deeper meaning behind people’s views and theories Observations Able to see behaviour and impact of human factors in real-world setting Can be useful in understanding robustness of implementation Time intensive Obtrusive, so risk of Hawthorne (observer) effect—knowing you are being observed affects how you behave Useful to understand the system from another perspective Can be particularly helpful in monitoring whether implementation has been successful Review of documents Large amounts of documentation are usually available, and may yield useful information (such as complaints, incident forms, clinical documentation) Can be time intensive May need a defined search and sampling strategy—you could ask your informatics or business intelligence team for help At start of project to identify opportunities for improvement through analysing service user feedback, incidents. or complaints Tips to overcome common challenges in using data for improvement? One of the key challenges faced by healthcare teams across the globe is being able to access data that is routinely collected, in order to use it for improvement. Large volumes of data are collected in healthcare, but often little is available to staff or service users in a timescale or in a form that allows it to be useful for improvement. One way to work around this is to have a simple form of measurement on the unit, clinic, or ward that the team own and update. This could be in the form of a safety cross8 or tally chart. A safety cross (fig 3) is a simple visual monthly calendar on the wall which allows teams to identify when a safety event (such as a fall) occurred on the ward. The team simply colours in each day green when no fall occurred, or colours in red the days when a fall occurred. It allows the team to own the data related to a safety event that they care about and easily see how many events are occurring over a month. Being able to see such data transparently on a ward allows teams to update data in real time and be able to respond to it effectively. Fig 3 Example of a safety cross in use A common challenge in using qualitative data is being able to analyse large quantities of written word. There are formal approaches to qualitative data analyses, but most healthcare staff are not trained in these methods. Key tips in avoiding this difficulty are (a) to be intentional with your search and sampling strategy so that you collect only the minimum amount of data that is likely to be useful for learning and (b) to use simple ways to read and theme the data in order to extract useful information to guide your improvement work.9 If you want to try this, see if you can find someone in your organisation with qualitative data analysis skills, such as clinical psychologists or the patient experience or informatics teams. Education into practice What are the key measures for the service that you work in? Are these measures available, transparently displayed, and viewed over time? What qualitative data do you use in helping guide your improvement efforts? How patients were involved in the creation of this article Service users are deeply involved in all quality improvement work at East London NHS Foundation Trust, including within the training programmes we deliver. Shared learning over many years has contributed to our understanding of how best to use all types of data to support improvement. No patients have had input specifically into this article.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              The three faces of performance measurement: improvement, accountability, and research.

              In the current climate of public accountability, many clinicians have become uncomfortable with any efforts to create measurement systems. That is unfortunate because measurements are absolutely essential to efforts for improving the processes of medical care. In their guideline implementation and measurement efforts, ISCI and the IMPROVE Project in Minnesota have gradually learned how to distinguish between measurement for improvement and that for accountability. Both approaches are different from the approach that physicians are used to in their encounters with medical research. Understanding these differences and respecting the confidentiality of individual medical groups has been crucial to moving past confusion and suspicion to genuine improvement actions involving multiple medical groups and their contracting managed care plans.
                Bookmark

                Author and article information

                Contributors
                Role: quality improvement programme lead
                Role: public health specialty registrar
                Journal
                BMJ
                BMJ
                BMJ-UK
                bmj
                The BMJ
                BMJ Publishing Group Ltd.
                0959-8138
                1756-1833
                2020
                31 March 2020
                : 368
                : m865
                Affiliations
                [1 ]North London Partners in Health and Care, Islington CCG, London N1 1TH, UK
                [2 ]Institute of Applied Health Research, Public Health, University of Birmingham, B15 2TT, UK
                Author notes
                Correspondence to: A Backhouse adam.backhouse@ 123456nhs.net
                Article
                baca050916
                10.1136/bmj.m865
                7190269
                32234777
                3e4f7a19-29ae-4ed2-99a7-a3b77f8a0956
                © Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

                This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

                History
                Categories
                Practice
                Clinical Updates

                Medicine
                Medicine

                Comments

                Comment on this article