Maximising the impact of the FCA programme

This report does not aim to examine the impact of the overall FCA programme. We will be in a better position to explore the overall impact once the findings of the summative evaluation of the programme, which has been commissioned by the Health Foundation, are known. However, some important learning points have emerged from the earlier formative evaluation regarding the steps required to enable the FCA programme to maximise its chances of delivering sustained improvements in care processes and outcomes. As well as discussing these learning points, this section includes local case studies illustrating the impact already achieved by flow coaching pathway teams. These case studies illustrate the potential contribution that the FCA programme stands to make to health and care across the UK.

Allowing time to achieve impact is vital

For many pathways, it is too soon to assess the impact on measurable outcomes immediately after the training. Flow improvements on care pathways need to be sustained beyond the first year to enable the delivery of measurable results. It also takes time for flow coaching pathway teams to identify, test and refine improvements, something that some organisations have found difficult to accept. Several interviewees described how organisations still tend to look for quick fixes for service improvement. They were confident that while the slow burn nature of the FCA intervention takes longer to deliver results, these are more likely to be sustained improvement outcomes and that the coaching relationship is what enables a sustainable improvement.

‘Flow isn’t about very quick turnaround. [It’s] repeated PDSA cycles and … a drip effect that leads to success rather than doing things in a big way very quickly. So that’s been a bit of a culture change that we’ve had to work on explaining. And it’s why it’s important to … take our time and to really understand the problem before we come up with solutions.’

(Flow coach, evaluation report)

‘You have to let the emergent work mature and keep people with you over the 2 years. After 2 years’ investment, you then start to see results. In my experience, it’s worth far more than 8 years of piecemeal QI projects with patchy results.’

(Local FCA lead)

There are challenges in measuring impact across complex care pathways

The FCA programme needs to take a broader view on how impact is measured across the programme. In many ways the pathway work is going beyond what can be measured on SPC charts in response to PDSA tests of change. When communication and cooperation improve between teams along a pathway, all sorts of profound changes in performance can happen. This reduces delays and improves coordination of care, but not in ways that can be clearly linked to a PDSA cycle.

The focus on meso-level improvement across the whole pathway compounds the difficulty, as data need to be collated and integrated from different organisations, which NHS IT systems are not well set up to do, requiring multiple data permissions from different organisations. FCA improvement work is sometimes the first attempt to collect data along the whole pathway.

The Central FCA insights and analysis workstream coordinates the collation and analysis of quantitative and qualitative data on the programme’s impact, including relevant contextual information. This enables assessment of whether observed changes or improvements are a result of flow coaching activities.

The Health Foundation has commissioned Ipsos MORI (in partnership with The Strategy Unit) to undertake a summative evaluation of the FCA. This evaluation will seek to understand the overall impact of the programme during its 5 years of operation.

The capacity and capability to access, collect and analyse impact data is scarce

It is a challenge for flow coaches to identify, access, collect and analyse the data to show improvement and research shows it is a common barrier to health care improvement., The scarcity of data analytical support across the NHS is also well documented. The curriculum co-design meetings have explored how coaches can best be supported to set measures and access the data required, including knowing who to ask for help with data and how this relies on building relationships.

Some local FCAs have a depth of data expertise to call upon and have produced robust data to show pathway improvement. In other organisations, there are only a few Big Rooms that can secure regular input from a data analyst. All flow coaches are now offered a software programme to help with appropriate data analysis. With each cycle of the programme the production of data from the pathways is more robust.

‘The measurement and data modules are the most important QI technical skills for flow coaching. This has traditionally been the weakest area of QI implementation. The whole time series measurement, run charts and SPC approach is new to most clinicians and it’s a revelation. Doctors like data and revel in the robustness of the SPC data – once they ‘get it’.’

(Local FCA lead)

More pathway teams are robustly charting improvement data as the programme develops. The FCA network are encouraged to add their case studies to each local FCA’s dedicated pages on the programme website.

Placing the patient at the centre of the FCA programme is key

Patients are central to the FCA programme, ensuring a focus on improvements that matter to service users. Organisations are actively encouraged to develop ways in which patients can be meaningfully represented in the work, and ultimately where care can be co-produced.

‘We’ve definitely moved up the ‘ladder of engagement’ through the FCA. In the past we used to think we were ‘involving’ patients when we told them about improvement work we were doing, now patients feed into the design of services. It’s all part of flipping the parent/child dynamic of doctor/patient relationships. There’s no doubt that Big Rooms have accelerated this.’

(Local FCA lead)

Some Big Rooms have patient representatives as regular attendees at meetings, although this is more common for long-term condition pathways. It requires a confident patient to become a member of a Big Room. However, there is already evidence that virtual Big Rooms are including patients more frequently than in-person Big Rooms, possibly because (for some people) the logistics of joining are easier. Patients joining virtual Big Room meetings from home feel an equal partner when others are joining from their home, clinic or office.

Patient experience can be highlighted through patient stories, often linked to poor care outcomes. The patient may attend a meeting that is focused on their story, or do a filmed interview. Another technique is to build up a representative patient profile using social and clinical information. This gives a rounded picture of a ‘typical’ patient, so the patient is then central to considerations of tests of change. Other FCAs have used patient shadowing, which follows a patient through all the stages of an outpatient visit. Another technique is the patient diary, where patients record their experience and reflect on it, and share their diaries with the Big Room.

‘We’re using the approach of coaching for existing patient leads to supervise new patients getting involved. It’s all about thinking more deeply about the relationships and expectations, helping people in a new role.’

(Local FCA lead)

Focusing on patient experience helps translate insights from one area of care to others along the pathway who are less aware of the impact either upstream or downstream of these aspects of care. For example, a frailty Big Room drove improvement by highlighting how each day of hospital immobility can reduce patients’ muscle strength, so early mobilisation became a patient-focused goal. Coaches identified the use of patient mobility surveys and analysis of mobility outcomes as a facilitator in increasing patients’ mobility. There was a measured increase in weekly discharges.

While there are some good examples of patient voice in FCAs, these are not universal and realising greater patient involvement is recognised as a major challenge. The ongoing aim is for learning to be shared through the network, so that FCAs, including the Central FCA, can learn from those who are further ahead. By engaging with patient involvement experts in the network, the FCA programme will further develop its model for routes of engagement with patients, service users and the wider public.

Some Big Rooms have carried out advanced patient involvement leading to coproduction of improvement. In FCA Northern Ireland work on the gestational diabetes pathway has involved women at every stage, so the service reflects and responds to their care needs (Box 3).

Box 3: FCA Northern Ireland – co-production with women with gestational diabetes

Gestational diabetes increases the risk of maternal and foetal adverse outcomes during pregnancy. Gestational diabetes affects about 5–8% of pregnancies, with incidence steadily increasing: from an average of 7.9 women per month in 2013 to an average of 20.6 new gestational diabetes diagnoses per month in 2019. Women who develop gestational diabetes have more frequent hospital appointments with obstetric and specialist diabetes teams.

The experience of women with gestational diabetes is central to improvement; all the design ideas have been initiated in response to service user feedback. A member of trust staff, who experienced gestational diabetes, represented the patient voice in Big Room meetings. The team are also working to acquire longer term involvement from engaged service users. The team gather continuous qualitative feedback from women on their pregnancy experience, from conception to birth, through semi-structured surveys and focus groups. Feedback is collated on the whole pregnancy journey after completion of the pregnancy, aiding candid feedback. Big Room meetings always start with reciting the feedback from questionnaires received in the previous couple of weeks. The group have also shadowed women attending the clinic to understand the minute-by-minute experience of outpatient visits.

The frequency of appointments, waiting time at clinic and flow of clinic visits from one professional to the next contributed to the experience of poor care. Average waiting time was 1 hour per patient per visit, to spend 5 minutes with a diabetes specialist and 15 minutes with obstetrics. The frequent visits are intrusive to women’s work and family life. The idea of virtual clinics was inspired by a patient request to FaceTime the clinic rather than travel there in person. As part of the co-design, women with gestational diabetes were involved in editing and reviewing a video on virtual clinics, and in the choice of device for cloud-based blood glucose monitoring technology.

Virtual video clinics covered 428 appointments in the first year of operation, with a corresponding reduction in face-to-face diabetes specialist and obstetric appointments by 32.7% and 25% respectively. Structured clinic slots meant clinics finished on time, improving staff morale. The tests of change became standard practice with confidence of sustainability.

Women reported being more confident with self-management. The cloud-based glucose data tool enabled easier recognition of on-target and out-of-target glucose values, transforming care planning discussions at diabetes consultations and resulting in co-produced health care decisions. Women gave positive feedback that virtual clinics reduced the burden of clinic visits and enabled increased self-management.

In summary, the gestational diabetes pathway at the Western Health and Social Care Trust has improved the flow of appointments and cut waiting times. The introduction of virtual video clinics, supported by cloud-based glucose monitoring technology, reduced the number of face-to-face specialist appointments and cut travelling times for patients. The team were commended for their multidisciplinary approach and won the Innovation in Quality Improvement Team of the Year at The BMJ Awards 2020.

The FCA programme has had positive impacts on care

While it is too soon to understand the impact of the FCA programme as a whole, a number of flow coaching pathway teams have reported some positive impacts on care. Case studies examining the impact of the work of two teams, the Sheffield skin cancer pathway team and the Imperial sepsis pathway team are described below (see the Appendix for a longer list of example care pathways).

FCA Sheffield skin cancer pathway

Skin cancers have a higher overall incidence than other types of cancer and a wide range of severity, from extremely good prognosis to life threatening. It is often possible to detect skin cancers at an early stage and therefore offer effective treatment for patients. The waiting time target for a specialist appointment after an urgent referral for people with suspected malignant melanoma is 2 weeks or less.

The skin cancer pathway aimed to increase the number of cancer target referrals seen by reducing the waiting time from referral to being seen in the clinic. National targets were being achieved, but the team believed they could improve. Figure 8 shows data for the period from September 2015 to October 2017 that covers a change in practice of collaborative working between consultant dermatologists and consultant plastic surgeons working in a joint clinic. This was introduced in October 2016 and the SPC chart indicates a step-change increase in the number of cancer target referrals seen on the skin cancer pathway, following this change. In addition, the reliability of the process was improved, with less variation in the range of patient numbers attending. After being trialled for several months, this clinic became a permanent fixture of the service.

The pathway improvement had further impact in reducing the number of attendances for patients, reducing time patients waited with a known diagnosis of skin cancer before treatment, from 29 to 9 days and reducing the associated administrative and clinic staffing costs. However, these are harder to show with a classic SPC chart. Subsequent developments have included further joint clinics for complex cancers and the Big Room has been influential in the development of a shared minor operations facility, releasing capacity in main theatres for other essential surgery. The skin cancer Big Room continues to meet weekly and is part of core business for the staff who attend.

Figure 8: FCA Sheffield skin cancer SPC chart

FCA Imperial sepsis pathway

The Imperial sepsis Big Room aimed to improve management of sepsis across the trust to ensure the earliest possible identification and treatment. There were already plans for an EPR alert and it was recognised that processes needed to be developed to give information on the treatment required and to trigger that care to occur quickly and effectively.

The EPR system captures patient observations, such as pulse rate and blood pressure and laboratory results. Certain combinations of observations and laboratory results can indicate sepsis. Using this data, the EPR system produces an alert if there is the possibility the patient has sepsis. The alert prompts an immediate review of the patient and, if they have sepsis, the diagnosis is recorded on the EPR. This prompts the launch of sepsis power plans, detailing the investigations and treatments required. The combination of the alert and the power plans help to make sure the patient receives the right antibiotic treatment.

The Big Room piloted the alert at the acute medical unit at St Mary’s Hospital in London. The alert revealed that several improvements were needed: not just technical aspects of the alert, but also a range of issues around effective communication between staff and departments. The Big Room tested changes to improve the alert system, then rolled it out in the emergency departments at St Mary’s Hospital and Charing Cross Hospital and the haematology service. Improvements have been made to how the alert function works in the EPR and the team constantly refine data collection and feedback to facilitate improvements.

The digital sepsis alert has made a significant impact. The team initially improved identification of sepsis and increased patients coded with a diagnosis of sepsis by 85%, that is, from an average of 26 cases per week to 48 cases per week. They then implemented interventions that decreased sepsis mortality by 23%. Retrospective analysis of the introduction of the alert was associated with:

  • lower odds of death (OR:0.76; 95%CI:(0.70, 0.84) n=21,183)
  • lower odds of hospital stay ≥7 days (OR:0.93; 95%CI:(0.88, 0.99) n=9988)
  • in-patients who required antibiotics, increased odds of receiving timely antibiotics in 60 minutes (OR:1.71; 95%CI:(1.57, 1.87) n=4622).

In short, more patients are correctly diagnosed with sepsis and, of these, more are surviving sepsis too. Research evidence shows that the effectiveness of digital sepsis alerts is mixed. An alert system in the EPR alone may not lead to such a level of improved outcomes. At Imperial, the introduction of the alert was a driver for QI initiatives to make sure there were effective treatment responses to the alert.

Previous Next