Results

Matching produced intervention and control groups with broadly similar characteristics

The matched control group was found to be broadly similar to the vanguard residents in the study across the range of individual and care home characteristics considered, for example the average age was 85 years among both vanguard and matched control residents (see technical appendix, Table A1). The majority (84%) of residents in vanguard care homes lived in nursing homes; as we matched within care home type, the proportion is the same in the matched control group. Figure 2 shows that the two groups had a similar profile of existing health conditions. The mean follow-up time in both groups was approximately six months (vanguard residents: 175 days [standard deviation 127]; control residents: 182 days [standard deviation 135]). However, one-third of residents were in the study for less than three months. Mortality rates in the two groups were also similar: 28% of residents in vanguard care homes died during the study period compared with 29% of residents in the matched control group.

Figure 3. Percentage of residents with certain health conditions at the start of the study

Note: the figure is based on diagnoses recorded on the inpatient record during the three years before the person moved into the care home. Because of how the conditions were identified, there were overlaps between some categories (eg, cognitive impairment and dementia). Individuals may have additional conditions not recorded in inpatient data, or which materialised during the care home stay.

Source: analysis by the Improvement Analytics Unit

Forty per cent of vanguard residents were ‘existing’ residents and had lived in the care home for an average of 239 days (eight months) before the start of the study. Forty-seven per cent of the matched control residents were existing residents and had lived in the care home for an average of 246 days (eight months).

Outcomes excluded from the report

Outpatient attendances, elective admissions and elective bed days were not targeted by the enhanced support but were initially included in the analysis to provide a fuller picture. However, less than 5% of care home residents in the study experienced any elective admissions or elective bed days, and these outcomes were therefore excluded from the presentation in the report. We also observed that a considerable percentage (56%) of outpatient attendances were scheduled prior to the start of the study, and so could not realistically have been influenced by the enhanced support. In the light of this observation, we did not consider our findings for this outcome to be informative; as such, we do not present them in this report.

Trends in hospital use

Figure 4 shows trends in hospital use over time. For each chart, the horizontal x-axis represents time in the study (with quarterly increments), and the start of the study is set at time zero. For new residents (56% of all residents), the start of the study is when they moved into a care home. For existing residents, the start of the study is when the enhanced support was introduced in the care home (ie February or September 2016), which on average was eight months after moving into a care home. The y-axis shows the crude rate of a given outcome for each corresponding quarter for vanguard residents and matched control group residents before moving to a care home and after the start of the study (negative and positive x-axis values, respectively). As expected, given the matching process, the vanguard residents in the study and control residents experienced similar rates of hospital activity before moving into care homes (left panel within each chart).

Crude rates of hospital activity in both groups were lower after the start of the study period compared with before moving to a care home. After the start of the study period, the rates in the two groups appear relatively similar for A&E attendances. Resident numbers were lower in the later quarters (eg 126 vanguard residents and 138 matched control residents in quarter four) so the rates are more likely to fluctuate (see technical appendix Table A2).

Figure 4. Comparison of vanguard and matched control residents in the study across selected outcome measures

Vanguard residents appeared to have fewer potentially avoidable emergency admissions than the matched controls but there were no discernible differences in overall emergency admissions or A&E attendances

Source: analysis by the Improvement Analytics Unit

Table 2 compares the hospital use of vanguard residents with that of the matched control residents over the follow-up period as a whole. The crude rates indicate the number of events per person per year, and are not adjusted for the differences that remained between the two groups after matching. The relative differences, on the other hand, account for some of the remaining differences between the two groups and will therefore be referred to when drawing conclusions and interpretations from the evaluation.

We found that vanguard residents had on average 0.42 potentially avoidable admissions per person per year, compared to 0.47 in the matched control group. After adjusting for some remaining differences between the groups, we estimated that vanguard residents had on average 27% fewer potentially avoidable admissions, with the true value likely to be between 45% and 2% fewer such admissions. Although this is a statistically significant result, it is worth remembering that our confidence intervals are likely to be underestimated (see methods section), therefore this result should be viewed with some caution.

There were no statistically significant differences in hospital use between residents in vanguard care homes and residents in control care homes on any of the other reported emergency hospital measures: A&E attendances, emergency admissions or emergency bed days. All 95% confidence intervals spanned 0%, indicating no significant difference between groups at a 5% significance level.

Looking at for example emergency admissions in more detail, vanguard residents had (on average) 1.02 emergency admissions per year compared with 0.97 for control residents. After risk adjustment, there were 1% fewer emergency admissions for vanguard residents than control residents, but the relative difference could lie anywhere between 19% fewer and 22% more emergency admissions for residents in vanguard care homes. In absolute terms, vanguard residents had 0.01 fewer emergency admissions per person per year than the matched control patients (95% confidence interval: 0.18 less to 0.21 more).

Table 1. Comparison of hospital use between vanguard and matched control residents, February 2016 to March 2017

Crude rates for (number per person per year)

Absolute differences (per person per year, adjusted)

Relative difference (adjusted rate ratio)

P-value

vanguard residents

control group residents

Best estimate

95% confidence interval

Best estimate

95% confidence interval

Emergency admissions

1.02

0.97

0.01 fewer

0.18 fewer to 0.21 more

1% lower

19% lower to 22% higher

0.956

A&E attendances

1.70

1.76

0.05 fewer

0.33 fewer to 0.28 more

3% lower

19% lower to 16% higher

0.709

Potentially avoidable emergency admissions

0.42

0.47

0.13 fewer

0.01 to 0.21 fewer

27% lower

45% lower to 2% lower

0.034

Emergency hospital bed days (mean, standard deviation)

4.6 (11)

5.4 (12.9)

2.51 fewer

5.14 fewer to 1.2 more

23% lower

47% lower to 11% higher

0.151

Note: See technical appendix Table A5 for a list of variables that were adjusted for.

Source: analysis by the Improvement Analytics Unit

No statistically significant difference in the proportion of deaths that occurred in hospital was detected

During the study period, 147 of the vanguard residents died, as did 153 of the matched control residents. Among the vanguard residents who died, 30% of deaths occurred in hospital, compared with 31% of deaths for the matched control residents. After adjustment, the proportion of deaths in hospital was 20% higher for vanguard residents but the confidence interval was wide and the relative difference in proportion of deaths in hospital could lie in the range of 31% lower to 108% higher in the vanguard (see Table 2).

Table 2. Comparison of percentage of deaths occurring in hospital

Vanguard residents

Matched control residents

Relative difference from matched control (adjusted odds ratio)

95% confidence interval

P-value

Percentage of deaths in hospital (number of deaths in hospital/total deaths)

29.9%

31.4%

20% higher

31% lower to 108% higher

0.518

Not adjusted for all baseline characteristics. See technical appendix Table A5 for a list of variables that were adjusted for.

Source: analysis by the Improvement Analytics Unit

Residents who were in the study for at least three months experienced fewer potentially avoidable admissions

It is likely that the effect of the enhanced support would not be seen for an individual resident in the first couple of months. We therefore looked at residents that that been in the study for at least three months: 371 vanguard residents (183 new and 188 existing residents) and 356 matched control residents (138 new and 218 existing residents).

All outcome measures reported above for the overall population were also analysed for the group that were in the study for at least three months (see technical appendix, Table A6). Among residents that were in the study for at least three months, vanguard residents had 0.39 potentially avoidable emergency admissions per person per year compared with 0.46 for control residents. After risk adjustment, potentially avoidable admissions were estimated to be 38% less likely for vanguard residents than for the control group, with the relative difference lying between 16% fewer and 54% fewer potentially avoidable emergency admissions for residents in vanguard care homes. This result was statistically significant (p<0.001) (see technical appendix Table A7). In absolute terms, vanguard residents had 0.17 fewer potentially avoidable emergency admissions per person per year than the matched control patients (95% confidence interval: 0.07 to 0.25 less). No other outcomes were statistically significant.

There was no conclusive evidence of difference in hospital use between new and existing residents

Analyses were carried out separately on the group of residents that moved in before the enhanced care package was introduced (existing residents) or afterwards (new residents). The period involved in the study was shorter for new residents (mean four months) than existing residents (mean eight months). None of the outcomes showed a statistically significant difference.

Existing residents had in general lower crude rates of hospital use than new residents within both the vanguard and matched control groups (see technical appendix, Table A8). However, there was no conclusive evidence that the effect of the enhanced support differed depending on whether a resident was new or existing.

Previous Next