Patient experiences with family medicine: a longitudinal study after the Dutch health care reforms in 2006

Abstract

Background

In 2006 The Dutch Health Care system changed to a market oriented system. The GP remuneration changed from ± 2/3 capitation patients and 1/3 private patients before 2006 to a mixed payment scheme. From 2006 onward every patient was insured and the GP received partly capitation, partly fees for consultations and for specific services. This change coincided with many other organisational changes in General Practice care. Our research question was if during the years after 2006 patient experiences of Dutch family practice had changed. We also wanted to explore the influence of patient and practice characteristics on patient experiences. Data on patient experiences were available from 2007 to 2012.

Method

In a series of annual cross sectional patient surveys the performance of GPs and practices was measured. Patient sampling took place as a part of the Dutch accreditation program in 1657 practices involving 2966 GPs. Patients’ experiences, gender, age, health status, and number of annual consultations were documented as well as the type and location of practices. Linear regression analysis was used to examine time trends in patient experiences and the impact of patient and practice characteristics.

Results

78,985 patients assessed the performance of 2966 GPs, and 45,773 patients assessed the organisation of 1657 practices. The number of patients with positive experiences increased significantly between 2007 and 2012; respectively 4.8 % for GPs (beta 0.20 and p < 0.0001) and 6.6 % for practices (beta 0.10, p < 0.004). Higher age, having no chronic illness, more frequent consultations and attending single-handed practices, predicted better patient experiences.

Conclusions

In our evaluation of patient experiences with general practice care from 2007 to 2012 we found an increase of 4.8 % for GPs and 6.6 % for practices respectively. This improvement is significant. While no direct causation can be made, possible explanations may be found in the various reforms in Dutch family practice since 2006. More insight is needed into key determinants of this improvement before policymakers and care providers can attribute the improvement to these reforms.

Background

In 2006 The Dutch Health Care system changed to a market oriented system (Table 1). The GP remuneration changed from a 2/3 capitation and 1/3 private patients before 2006 to a mixed payment scheme. From 2006 onward every patient was insured and the GP received partly capitation, partly fee for consultations and for specific services. Between 2005 and 2007 costs for GP care rose 11,2 % yearly before slowing down to 2.7 % yearly till 2012 [1]. This switch coincided with other organisational changes in general practice care, which were all meant to improve quality of care e.g. an increase in the number of nurse practitioners, incentivizing diagnostic and therapeutic activities, rewarding adherence to guidelines on availability and accessibility. and strengthening vocational training (Table 2). Changes like incentivizing care and increasing staff for chronic disease management improved clinical care in some settings, but whether these changes improved patient experience is unclear [2, 3]. Clinical care and patient experiences are distinct aspects of quality. Information on the patients’ overall evaluation of the quality of family practice care following the changes in The Netherlands was lacking [4]. The data of patient experiences using Europep [5] of a large sample of practices entering the Dutch Practice accreditation scheme each year, offered an opportunity to monitor patient experiences. The study also explored the impact of patient and practice characteristics.

Table 1 Changes in primary health care in The Netherlands after 2006

Table 2 Changes in the practice organisation and in the training of GPs

The Europep questionnaire has proved to be sufficiently responsive to detect changes in countries with various health policy decisions [6]. The study of Petek et al. also used Europep and compared patients with cardiovascular disease in eight European countries in 2009 with a subgroup of patients with self-defined chronic illness from their study in 1998 [7]. It showed no overall trends for the eight countries combined, but some changes in specific countries.

Allan at al. looked at the effect of Continuous Quality Improvement (CQI) on patient satisfaction using patient questionnaire data collected in a Patient Participation Program of the RACGP in Australia with a 10 year follow-up (1993–2003) [8]. They found no significant change in satisfaction but the scores showed little variation (often close to 100 % from the start). We did not find other long term studies showing measurable improvement in patient experience following organisational interventions. We therefore hypothesized that we would not find significant changes in patient experience in the years 2007-2012 in our study.

Method

Study design and setting

The data were collected as part of the Dutch accreditation program (NPA) between 2007 and 2012. The study focused on the patient survey that was part of the data collection preceding the Practice visit. Participating in the NPA was voluntary, yet strongly supported by the Dutch College of General Practitioners, incentivized by the insurers and becoming a future reregistration obligation for GP-trainers. The incentives stimulated hundreds of practices to enter the NPA-program each year [9]. The central outcome measures were the scores on the Dutch Europep questionnaire, which measures patient experiences with the GP- and the practice organisation. Patients (>18 years) who visited the practice were asked by the practice assistant to complete the questionnaire in the waiting room before or after the consultation, and to drop it in a sealed box warranting anonymity. The practice staff was asked to make sure that close to 30 questionnaires per GP were returned. The results of the questionnaire were used only for internal feedback for the GP and the team.

Participants

Participants were 30 invited patients per GP entering the accreditation program.

Measures

The Europep questionnaire has 23 items; 17 items on the GP performance and 6 items on the practice management [5]. The items of Europep are a concise reflection of what patients view as important aspects of general practice care across European countries. All items use a Likert scale (1 = poor and 5 = excellent), and a sixth option “do not know/ not applicable”. To warrant anonymity no patient characteristics were asked for except gender and age. From 2009 to 2012 the questionnaires had additional questions on percentage with chronic illness and consultation rate to allow more in depth analysis. Europep was validated in several studies and has proved to show relevant variation on all items [10]. Practice and respondents characteristics are in Tables 3 & 4.

Table 3 Practice characteristics compared to the national average

Table 4 Characteristics of the respondents compared to the national average

Analysis

We assessed the scores per item by calculating the percentage of people with a rating of 4 or 5 on the 5-point Likert scale [11]. The response to the category “do not know/not applicable” was excluded. Two separate means were calculated for the items regarding GP- and practice performance.

In a linear regression model using SPSS we evaluated the trend in patient experiences over time (from 2009 to 2012; 2007 and 2008 did not have sufficient data for a linear regression). Associations between time (year) and the total scores on GP- and practice performance were explored. We also analyzed the trend for each of the individual items in separate models. In addition, we used models in which we corrected for patient age, gender, whether they self-reported chronic illness, the consultation frequency of the patients and whether the practice was a single handed practice or not.

Results

Study population

In total 2966 GPs in 1657 practices were included. We excluded 8.0 % of the questionnaires using three exclusion criteria; respondent age (3.8 % was below 18), number of questionnaires per practice (1.0 % had less than 10 questionnaires) and repeated measurements in the same practice (3.2 %). This resulted in 78,985 questionnaires on the performance of 2966 GPs and 45,773 questionnaires on the performance of their 1657 practices. Out of 30 questionnaires on average 27 were completed per GP and 28 per practice. The study practices were reasonably representative for Dutch general practices (Table 3). Training practices were overrepresented (around 50 % with a top of 69 % in 2010).

General trend in patient experiences

GP-score

Overall, more than 80 % of the patients rated the performance of their GP positively on aspects of time, empathy, listening, examining, informing, treatment and advice (Table 5). The positive trend from 82.1 % to 86.9 % (Fig. 1) over 2007–2012 is significant (Beta 0.20 and p < 0.001). Table 5 shows that GPs improved their care from 2009 up to 2012 regarding time for the patient, empathy, shared decision making, communication, thoroughness, patient centeredness and providing information. An analysis which corrected for differences between the cross-sectional samples regarding patient and practice characteristics confirms the positive trend between 2009 and 2012 (Beta 0,10 and p < 0.001).

Table 5 Trend of the various aspects of the Europep questionnaire from 2009 to 2012, corrected for patient age, gender, chronic illness, consultfrequency and practice type

Fig. 1

General trend in patient experience with primary care between 2007 and 2012: The grey background (2007 and 2008) are crude scores without correction for patient characteristics. The white background are scores corrected for patient characteristics (see Table 4)

Practice score

Patients rated the practice organisation slightly less positively than they rated their GP. The rating was 64.9 % in 2007 and 71.5 % in 2012 (rise of 6.6 %) (Fig. 1). This positive trend is significant (beta 0.19, p < 0.001) and was confirmed after correcting for differences between the cross-sectional samples in the period 2009–2012 (Beta 0.10, p < 0.004). Almost all items contribute to this positive trend (Table 5). The best scoring items are on “helpfulness of the staff”, “getting a suitable appointment” and “getting through to the practice on the phone”.

Factors associated with patient experiences

Table 6 shows which factors are associated with GP performance and practice management. The year of the visit is an important explanatory factor. The trend in the period 2009–2012 in improved patient experience was confirmed after correcting for background variables.

Table 6 Linear regression models for both GP performance and Practice performance (2009–2012)

Patient and practice factors which related to patient experiences are consistent across the year cohorts. The GP performance and practice management are rated significantly higher by older compared to younger patients and by patients with a higher frequency of consultations. Patients with a chronic disease rated the GP performance and the practice management less positively than other patients. Patients’ gender and practice urbanisation do not affect the ratings. The practice management was rated higher in single handed practices than in other types of practices, but practice type (group practice, health center) had no effect on GP performance.

Discussion

Patient experience with Dutch general practice care changed positively in the period 2007–2012 with 4.8 % on GP personal performance and 6.6 % on practice organisation (Fig. 1). The positive change could be demonstrated for each item. The increase followed a period of profound changes in the healthcare system among which ‘investments in primary care’ and ‘the introduction of incentives in the healthcare system’. This positive trend in Dutch patient experiences is reinforced by the yearly results of the European Health Consumers Index (EHCI), that reported the Netherlands to be in the top 3 since 2007 and a first position in 2014 with a 40 points advantage over number 2 in 2014 [12].

Changes in primary care since 2006 that could have affected patient experiences

Various bodies of research provide potential determinants for positive change in patient experiences. A Cochrane meta-analysis showed that investment in practice nurses for the treatment of chronic diseases had a positive effect on patient experiences [2]. In our practices the available time of practice nurses rose from 4.8 to 5.7 h per 1000 patients between 2009 and 2011. More time per patient proved to be associated with better patient experience in a previous study that used the same data base of practice visits [13].

A change in reimbursement for the care of chronic patients proved to be effective in the UK for clinical care [14]. But in the evaluation of the pay-for-performance (P4P) program conducted from 2003 to 2007, patients did not experience changes in quality of care for communication, nursing care, coordination, and overall satisfaction [2, 15]. Some aspects of access improved but patients reported seeing their usual physician less often and gave lower satisfaction ratings for continuity of care [3].

Patients highly value the accessibility and availability of general practice [11]. Starting in 2008 Dutch insurers incentivised service with 4 € extra capitation per patient when targets on accessibility and availability were met (Table 1). This could have helped the positive change in patient experiences on access, availability and continuity. In the UK these aspects of care did not change or worsened after P4P was introduced [15].

A positive effect on patient experience may be attributed to the change to ‘fee per consultation’ (9 € ) and ‘home visit’ (14 €) meant to compensate for the proportionate lowering of the capitation (114 € to 57 €). Although GP care was exempted from market forces and competition, the new blended system of capitation and fee for service aligning incentives more closely to professional values may have influenced patient experiences positively [14, 16].

From 2006 onward the scope of diagnostic and therapeutic procedures widened and more procedures were done in the practice also because it was financially attractive. In previous research a wider scope was associated with better medical performance in videotaped patient contacts [17].

Improvement in patient experiences may also be attributed to an extensive project to renew vocational training, which was completed in 2006. The project focused on assessing and improving trainers’ skills in giving feedback, coaching of and assessing the CANMEDS (Canadian Medical Education Directives for Specialists concerning 7 competencies: Medical Expert, Communicator, Collaborator, Manager, Health Advocate, Scholar, and Professional). Dutch GP-trainers score significantly better on quality of care and organisation including patient experiences than non-training GPs [18].

In the UK investment in family medicine training—both in GP-trainers & trainees—improved the score on the GPPS in the P4P program in the UK. GP training practice status (29 % of practices) was a significant predictor of positive GPPS responses to all questions in the ‘doctor care’ (n = 6) and ‘overall satisfaction’ (n = 2) domains but not to any of the ‘nurse care’ or ‘out-of-hours’ domain questions [19]. Doctors in GP training practices appeared to offer more patient-centered care with patients reporting more positively on attributes of doctors such as ‘listening’ or ‘care and concern’.

Extra patient time, introducing practice nurses, enhancing accessibility and availability, changing some payments in fee for services, improving consultation skills during vocational training all could have attributed to positive patient experiences. A negative effect could be expected from the increase in practice size between 2007 and 2012. Larger practices with more GPs have less positive experiences with care [6] and many patients prefer smaller practices [20, 21].

Strengths & limitations

The data were collected within the Dutch accreditation program with a voluntary participation of practices and with maybe better practices entering first. This selection of the better practices entering first is at odds with the increase of improved patient experience. However, year after year practices who felt ready for the practice visit entered the program. This yearly mix of training and non-training practices is a selection of voluntary practices, but we had expected a negative change in patient experience in the later years, because less ambitious practices entered later in the program. We consider this a strength of this study.

Another strength is the large and representative sample of practices that could be analysed and the high numbers of new patients each year that completed the questionnaires. Selection bias due to selecting patients would very likely to have been constant over the years.

Unfortunately we could only do a linear regression analysis for the years 2009–2012, because we lacked sufficient data in 2007 & 2008.

A point of discussion was that feminisation of the profession could have contributed to the improvement. However, the role of gender was doubtful in other studies [22–24].

Comparison with other studies

Previous studies of patient experience did show no change or mixed results after organisational change. All but one of these studies concerned P4P-studies, whereas our study included all patients who had an appointment with their doctor. Our findings that a higher age, a ‘higher frequency of consulting the GP’, ‘having no chronic illness’ and ‘a short waiting time for the consultation’ were associated with more positive patient experiences on GP performance resonate with similar analyses in previous studies [8, 24–26].

Implications

The positive change in patient experiences with family practice cannot be related to the interventions in General Practice care. Patient experience was found to be correlated to better clinical quality in hospitals in a review by Price et al. Research indicates that better patient care experiences are associated with higher levels of adherence to recommended prevention and treatment processes, better clinical outcomes, better patient safety within hospitals, and less health care utilisation [27]. In primary care the correlation between patient experience measured with national General Practice Patient Survey (GPPS) and the national pay-for-performance scheme (QOF) was weak. The 2 domains of quality of care remain predominantly distinct [19].

Longitudinal data collection on patient experiences should span longer periods with a standardized and validated instrument such as Europep, to allow comparison over the years. Such data could enable GPs and policymakers to make better choices on practice organisation, e.g. optimal list size, being a training practice, optimal staff, etcetera [28].

Conclusion

In our evaluation following the trend in patient experiences from 2007 to 2012 we found an increase of 4.8 % for GPs and 6.6 % for practices respectively. This is considerable given the often reported limited range for improvement in patient experience surveys. Most previous studies of patient experiences over time showed no or mixed results.

Though an attribution of the reforms to the improvement of patient experiences is impossible on the basis of this research, it is important to study the changes in Dutch Family Medicine preceding the improved patient experiences . The literature yields as possible contributors to improved patient experience: 1. The introduction of a practice nurse for chronic diseases, 2. incentivizing accessibility and availability, 3. change to a mixed capitation and fee for service payment + incentivizing additional diagnostic and therapeutic services and 4. improvement of the vocational FM-training. Policymakers and professionals could benefit from monitoring patient experiences.