Skip to main content
Download PDF

Patient satisfaction with computer-assisted structured initial assessment facilitating patient streaming to emergency departments and primary care practices: results from a cross-sectional observational study accompanying the DEMAND intervention in Germany

BMC Primary Care volume 23, Article number: 213 (2022) Cite this article

Abstract

Background

Patient numbers in emergency departments are on the rise. The DEMAND intervention aims to improve the efficacy of emergency services by computer-assisted structured initial assessment assigning patients to emergency departments or primary care practices. The aims of our study were to evaluate patient satisfaction with this intervention and to analyse if reduced patient satisfaction is predicted by sociodemographic data, health status or health literacy.

Methods

We conducted a cross-sectional patient survey in emergency departments and co-located primary care practices. Each intervention site was planned to participate for two observation periods, each with a duration of one full week. Study participants were recruited by the local staff. The patients filled out a written questionnaire during their waiting time. Patient satisfaction was assessed by agreement to four statements on a four point Likert scale. Predictors of patient satisfaction were identified by multilevel, multivariable logistic regression models adjusted for random effects at the intervention site level.

Results

The sample included 677 patients from 10 intervention sites. The patients had a mean age of 38.9 years and 59.0% were women. Between 67.5% and 55.0% were fully satisfied with aspects of the intervention. The most criticised aspect was that the staff showed too little interest in the patients’ personal situation. Full satisfaction (“clearly yes” to all items) was reported by 44.2%. Reduced patient satisfaction (at least one item rated as “rather yes”, “rather no”, “clearly no”) was predicted by lower age (odds ratio 0.79 for ten years difference, 95% confidence interval 0.67/0.95, p = 0.009), presenting with infections (3.08,1.18/8.05,p = 0.022) or injuries (3.46,1.01/11.82,p = 0.048), a higher natural logarithm of the symptom duration (1.23,1.07/1.30,p = 0.003) and a lower health literacy (0.71 for four points difference, 0.53/0.94,p = 0.019).

Conclusions

The patients were for the most part satisfied with the intervention. Assessment procedures should be evaluated a) regarding if all relevant patient-related aspects are included; and whether patient information can be improved b) for patients with strong opinions about cause, consequences and treatment options for their health problem; and c) for patients who have problems in the handling of information relevant to health and healthcare.

Trial registration

German Clinical Trials Register (https://www.drks.de/drks_web/setLocale_EN.do) no. DRKS00017014.

Peer Review reports

Background

Patient numbers in emergency departments are on the rise while treatment of emergencies by outpatient services is diminishing [1, 2]. Emergency department crowding can be a threat to patient safety. For example, assessment of symptoms and delivery of care can be delayed, the hospital staff is less likely to adhere to clinical practice guidelines and the risk of certain adverse events including mortality might increase [3,4,5]. Ambulatory care-sensitive conditions, defined as health problems for which hospital stays could be prevented by standard outpatient care [6, 7] are one factor contributing to emergency department crowding. Treatment of ambulatory care-sensitive conditions in emergency departments is also associated with largely increased healthcare costs [8, 9].

A substantial proportion of the patients in emergency departments do not consider their medical condition to be an emergency [10]. The rationale of patients for visiting the emergency departments often differs from a clinician´s perspective and includes perceptions regarding a limited availability of outpatient services, patient preferences and the context in which the health problem occurred [10,11,12]. Many patients report that they do not know relevant outpatient emergency services they could use as an alternative to the emergency department [10, 11], which might indicate missing information, reduced access to these services or deficits in the patients’ health literacy. Another factor probably influencing the patients’ healthcare use is their satisfaction with medical services. Patient satisfaction describes the quality of healthcare from a patient perspective and is likely to affect patient steering, the amount of time that the patients require from medical and nursing staff and their compliance [13,14,15].

One possible strategy for reducing crowding in emergency departments is co-location of primary care services in the emergency department [16]. However, recent reviews suggest that evidence regarding effectiveness and safety of patient streaming to primary care services is limited and outdated [17, 18]. The DEMAND intervention addresses this research gap. The intervention aims to improve the efficacy of emergency services by computer-assisted structured initial assessment assigning patients to the emergency services suited best to their health problems, eg, to emergency departments or primary care practices. DEMAND is implemented at the telephone counselling services of the Associations of Statutory Health Insurance Physicians and at emergency departments and co-located primary care practices [2, 19].

The accompanying research to the DEMAND intervention is composed of three subprojects evaluating a) the effects of the intervention on service utilisation; b) the experience of healthcare professionals with implementing the intervention; and c) the patients’ perspective on process and outcome of the intervention including reasons for non-use of recommended services and patient satisfaction [19, 20]. This study was conducted in the context of the third subproject and aimed 1) to evaluate the patient satisfaction with the computer-assisted structured initial assessment at emergency departments and co-located primary care practices and 2) to analyse if reduced patient satisfaction with this intervention is predicted by sociodemographic data, health status or health literacy of the patients.

Methods

Design, setting and participants

We conducted a cross-sectional observational study based on a survey of patients from participating hospitals. The DEMAND intervention was scheduled for implementation in 18 emergency departments and co-located primary care practices in seven German federal states. However, five intervention sites did not start regular operations during the observation period. Another two intervention sites included only paediatric emergency services und were therefore excluded. Thus, the accompanying research focused on eleven intervention sites. Participation status of each intervention site can be found in Table A in the additional files.

Before starting the survey, we conducted a pre-test in six intervention sites between 20 May and 28 July 2019. Each site recruited patients for one full week. In total, 107 questionnaires were returned. Subsequent talks with the staff involved in the implementation of the pre-test and the data resulting from the pre-test were used for revising our research methods and questionnaire.

In the main survey, each intervention site was planned to participate in our study for two observation periods, each with a duration of one full week (from Monday to Sunday). The calendar dates of the observation periods were randomly assigned in the time frame between 16 September 2019 and 29 March 2020. However, due to the COVID-19 pandemic and the related lockdown measures, we had to stop data collection after 8 March 2020 and three observation periods could not be realised.

On each day of the weeks selected for data collection, study participants were recruited by the staff working at the intervention sites. The staff included all patients who received a computer-assisted initial assessment and excluded patients who were less than 18 years old, had insufficient German language skills or could not participate in the survey due to functional impairments (eg, insufficient ability to read or write).

All eligible patients received the questionnaire and the written patient information about the study. The patients filled out the questionnaire during their waiting time after being assigned to primary care practice or emergency department. They expressed their consent to study participation by returning the completed questionnaire to the staff at the intervention site. Retrospectively, we excluded patients if their questionnaire had been completed by a third person.

Intervention

We evaluated the DEMAND-intervention in emergency departments and co-located primary care practices. Before the intervention, there were heterogeneous, non-systematic and unstructured procedures for patient streaming in this setting, eg, in many cases it depended on the experience and personal opinion of the staff if patients presenting their symptoms to the emergency departments were sent to the primary care practice and vice versa. In the DEMAND-intervention, this decision was based on a computer-assisted structured initial assessment.

The patient flow regarding intervention and data collection is shown in Fig. 1. The staff members were instructed to conduct the computer-assisted structured initial assessments with all patients presenting their symptoms at the intervention site. The assessments were facilitated by the software SmED (“Strukturierte medizinische Ersteinschätzung in Deutschland” – structured medical initial assessment in Germany), which was developed on the basis of the established SMASS software (“Swiss Medical Assessment System”; https://www.in4medicine.ch/smass.html) adapted to the German healthcare system.

Fig. 1
figure 1

Patient flow regarding intervention and data collection. ED: emergency department; PCP: primary care practice

Full size image

SmED facilitates a structured clinical assessment of treatment urgency considering the 85 most prevalent principal diagnoses in the International Classification of Primary Care (ICPC). Based on a systematic query of symptoms and complaints, previous illnesses and risk factors, SmED assesses the treatment urgency and recommends which service (emergency department or primary care practice) should be utilised. SmED is used as tool supporting decision-making and documentation. The assessment can be ended early if the highest service level is recommended. The staff can deviate from the SmED recommendation in special cases, eg, if services are not available or if in the opinion of the staff a higher treatment urgency is indicated.

Target and predictor variables

Target variable of our analyses was the patients’ satisfaction with the computer-assisted initial assessment they received. The patients rated their satisfaction with the time and interest that the staff of the intervention site devoted to them during structured initial assessment. They also evaluated if they could say everything they wanted to say and if they would recommend the hospital to friends with acute health problems. The items were assessed on a four point Likert scale (“clearly yes”, “rather yes”, “rather no”, and “clearly no”). The full instrument can be found in the additional files. For our analyses, we dichotomised the answers into the subgroup “full patient satisfaction” consisting of patients rating “clearly yes” on all four items; and the subgroup “reduced patient satisfaction” consisting of patients rating at least one item with “rather yes”, “rather no”, or “clearly no”.

Predictor variables were sociodemographic data, data about the patients’ health status and their self-reported health literacy. Sociodemographic data included age, sex, educational level, migrant status, and the living arrangement (cf. additional files). Living arrangement was dichotomised into patients living alone and patients living together with other people. The migrant status was split into the groups “natives” (ie, if the patients and their parents were born in Germany); “people with migration background” (ie, if the patients were born in Germany, but at least one of their parents were born abroad); and “migrants” (ie, if the patients were born abroad).

The educational level was based on the patients ‘ general and vocational education and coded according to the Comparative Analysis of Social Mobility in Industrial Nations (CASMIN) classification system into the groups “low educational level” for inadequately completed general education, general elementary education or basic vocational qualification; “medium educational level” for secondary school certificate or A level equivalent; and “high educational level” for higher or lower tertiary education [21].

The health status was assessed by the subjective treatment urgency, the duration of symptoms, and the consultation reasons (cf. additional files). Additionally, we measured the health-related quality of life. The subjective treatment urgency was rated on a numerical rating scale ranging from 0 (indicating ‘no urgent need for treatment’) to 10 (indicating ‘very urgent, life threatening’). For our descriptive analyses, the duration of symptoms was coded into seven categories (“less than six hours”; “six hours to less than one day”;”one day to less than three days”; “three days to less than one week”; “one week to less than one month”; “one month to less than one year”; and “one year or more”). For our multivariable models, we used the natural logarithm of the symptom duration.

The consultation reasons were assessed by open questions and retrospectively coded by the project staff (JHO, AM) in the International Classification of Primary Care, Second Revision (ICPC-2) [22], which facilitates grouping by organ systems (eg, “respiratory system” or “psychological disorders”) and by diagnosis type (ie, “symptoms/complaints”, “infections”, “injuries”, “congenital anomalies”, “neoplasms” and “other diagnoses”). Health-related quality of life was assessed by the five level version of the EuroQol Five-Dimension Scale (EQ-5D-5L) comprising the domains mobility, self-care, usual activities, pain or discomfort and anxiety or depression [23]. An EQ-5D summary score was calculated using the German value set. It indicates the value 1.000 for full health, which is reduced by up to five subtrahends between -0.026 and -0.612 depending on the severity of limitations in each of the five dimensions [24].

We measured the self-reported health literacy by the short form of the European Health Literacy Questionnaire (HLS-EU-Q16). It includes 16 questions focusing on the four dimensions accessing, understanding, appraising and applying information to take decisions concerning health care (7 questions), disease prevention (5 questions) and health promotion (4 questions) [25]. The items were rated on a four point Likert scale and dichotomised for our analyses. For each item, we grouped “fairly easy” and “very easy” to the value of 1 and “fairly difficult” and “very difficult” to the value of 0. Thus, the HLS-EU-Q16 summary score ranges from 0 to 16 points. The summary score can be divided in three categories. “Inadequate” health literacy is assumed at 0–8 points, “problematic” health literacy at 9–12 points and “sufficient” health literacy at 13–16 points [26].

Statistical analyses

The patient satisfaction with the computer-assisted initial assessment streaming patients to emergency departments or co-located primary care practices was analysed by descriptive analyses. The possible predictors of reduced patient satisfaction were analysed in two steps. First, we performed chi-squared-tests and t-tests to describe the differences in sociodemographic data, health status and self-reported health literacy between patients with full and impaired patient satisfaction.

Second, we conducted multilevel, multivariable logistic regression models adjusted for random effects at the intervention site level to analyse the association between predictor variables and reduced patient satisfaction (dependent variable). The potential predictors of reduced patient satisfaction included sociodemographic data, health status, and self-reported health literacy. Results from inferential statistics were reported as ß-coefficients with 95% confidence intervals. Additionally, odds ratios of significant predictor variables were calculated. An alpha level of 5% (p < 0.05) was defined as statistically significant. All statistical analyses were performed using Stata 15.1.

Results

During the observation time, nine intervention sites could be observed for two weeks and one intervention site for one week. One intervention site had to be excluded, because both observation periods had been randomised to the time during the COVID-19 pandemic and therefore no data collection could be realised. The periods of data collection in each intervention site and the local response rates can be found in Table B in the additional files.

The recruitment of patients is described in Fig. 2. In total 1,357 patients were registered for the study. Of these, 237 had to be excluded due to being minors, insufficient German language skills or functional impairments. Out of 1,120 eligible patients 429 did not participate because they refused study participation, did not return the questionnaire or did not complete all relevant items. A completed questionnaire was returned by 691 patients corresponding to a response rate of 61.7%. Retrospectively, we had to exclude 14 patients, because they were less than 18 years old or because they documented in the open-ended questions that the questionnaire was completed by a third person. In the end, 677 patients from 10 intervention sites were included in our data analysis.

Fig. 2
figure 2

Patient recruitment

Full size image

Descriptive data of the sample are shown in Table 1. The patients had a mean age of 38.9 years and 59.0% were women. About one quarter of the patients (23.1%) were living alone and more than half of the population (54.4%) had a medium education. Four out of ten patients (39.1%) were migrants or had a migration background. On average, the patients rated their treatment urgency in the medium range (5.7 ± 2.1 points). For 36.3% patients, symptoms had already persisted for three days or more before seeking medical help at the hospital. On average, most patients had mildly to moderately impaired health-related quality of life (0.73 ± 0.26 points) and problematic to sufficient health literacy (11.9 ± 3.3 points).

Table 1 Descriptive data of the sample
Full size table

Details on the health problems of the patients are shown in Table C in the additional files. The most frequently affected organ systems were the respiratory system (22.0%), the digestive system (19.8%) and the musculoskeletal system (19.6%). The most prevalent health problems were “throat symptom/complaint” (7.9%), “fever” (7.8%) and “headache” (7.5%). Generally, the ICPC-2 diagnosis type “symptoms and complaints” (77.0%) was much more often used than “infections” (17.8%), “injuries” (7.5%) and “other diagnoses” (6.5%).

Patient satisfaction with the computer-assisted initial assessment is described in Fig. 3. Depending on the respective item, full agreement (“clearly yes”) ranged between 67.5% and 55.0%. Another 33.3% to 25.5% did rather agree (“rather yes”). Non-agreement was comparably rare and ranged between 8.1% and 3.6% (“rather no”) and 4.1% and 3.1% (“clearly no”), respectively. The item “patient could say everything he wanted to say” received the highest rating (93.0% “clearly yes” or “rather yes”) and the item “staff member showed interest in the patient’s personal situation” the lowest (88.0% “clearly yes” or “rather yes”). Full patient satisfaction (ie, “clearly yes” in all four items) was rated by 44.2% of the patients.

Fig. 3
figure 3

Patient satisfaction

Full size image

Univariable differences between patients with reduced and full satisfaction are shown in Table 1 and Table C in the additional files. Patients with reduced satisfaction were younger (37.2 ± 15.4 years vs. 41.0 ± 16.4 years, p = 0.002) and they had a lower proportion of health problems from the urological system (7.5% vs. 13.0%), a lower prevalence of “dysuria/painful urination” (1.2% vs. 4.1%), and a higher prevalence of “abdominal pain localized other” (8.7% vs. 3.7%). There were no significant differences in other analysed variables including the frequency of the four ICPC-2 diagnosis types found in the data set.

The results from the multivariable models analysing the association of reduced patient satisfaction with sociodemographic data, health status and health literacy are shown in Table 2. A lower age was associated with reduced patient satisfaction (Odds Ratio [OR] 0.79 for ten years difference, 95% confidence interval [CI] 0.67/0.95, p = 0.009). Additionally, presenting with infections (OR 3.08, 95% CI 1.18/8.05, p = 0.022) or injuries (OR 3.46, 95% CI 1.01/11.83, p = 0.048) and a higher duration of symptoms (OR 1.23 for one step on the natural logarithmic scale, 95% CI 1.07/1.40, p = 0.003) were related to reduced patient satisfaction. For example, one step on the natural logarithmic scale represents the approximated difference between one and three days, between one and three weeks or between one and three months. We also identified lower health literacy (OR 0.71 for four points difference, 95% CI 0.53/0.94, p = 0.019) as predictor of reduced patient satisfaction.

Table 2 Predictors of reduced patient satisfaction: Results from logistic regression in mixed models adjusted for random effects on the intervention site level
Full size table

Discussion

Statement of principal findings

Almost half of the study participants were fully satisfied with the computer-assisted initial assessment in the DEMAND intervention. Dissatisfaction was comparably rare. In our analyses, satisfaction with the initial assessment was independent of the patients’ sex, educational level, migrant status and living arrangement. Younger patients, however, more often showed a reduced satisfaction than older patients. The severity of the health problems as indicated by impairment in the health-related quality of life was not related to the level of satisfaction, but patients with infections, injuries or conditions that already existed for a long time were less likely to be fully satisfied. Additionally, lower health-literacy was associated with a higher probability of reduced satisfaction with the initial assessment.

Comparison with the literature

Our population had a mean age of 39 years and 59% were women. An insurance claims data based analysis of the age distribution in outpatient emergency patients showed a comparable mean and variance of age as in our study [27]. However, in two studies observing patients with unselected, non-urgent conditions, the distribution of sex was more balanced than in our study [10, 28].

Between 88 and 93% of the patients in our study were fully or rather satisfied with different aspects of our interventions. The high levels of satisfaction we observed were also found in other studies evaluating different methods of triage in the emergency department, eg, nurse-led triage [29,30,31]. In a systematic review, determinants of patient satisfaction with nurse-led triage included the nurses’ ability to provide patient-centred care, communication skills, concern for the patient and competence in diagnosing [32]. Many studies highlighted waiting time, particularly in the waiting room, as highly predictive of reduced patient satisfaction [31,32,33,34,35,36].

We observed that lower age was associated with reduced patient satisfaction. Other socio-demographic factors were not related to the level of satisfaction. With few exceptions [37], most other studies found the same age-dependency of patient satisfaction as our study [38,39,40,41]. The results reported in various studies concerning the influence of sex on patient satisfaction are contradictory [38, 39, 42]. Some studies found a higher patient satisfaction in men [41], some in women [43].

Grouped into three categories, 50% of our population had sufficient, 32.8% had problematic, and 17.0% had inadequate health literacy. The rates of problematic and inadequate health literacy were higher than in the general population [44], but comparable to another study in the non-urgent emergency department setting [28]. We observed that a lower health literacy was associated with reduced patient satisfaction. Other studies from different settings and countries found comparable results [45,46,47,48].

In contrast to our results, many studies also found that a lower educational level was related to reduced satisfaction [38,39,40]. As lower educational level is associated with lower health literacy [44, 49, 50], the differences to other studies might therefore be explained by our multivariable models adjusting both factors for each other.

In our study, certain types of health problems were associated with reduced satisfaction, but severity and treatment urgency of the health problems did not predict patient satisfaction. Some other studies also found a relationship between health status and patient satisfaction, eg, a reduced satisfaction in patients with multiple chronic conditions, moderate or severe migraine-related disability or poorly controlled diabetes [38, 51,52,53]. Higher treatment urgency predicted higher patient satisfaction in some studies [54, 55], while others found no effect [34].

Taken altogether, the results of our study are mostly in line with existing evidence. The dependency of patient satisfaction on factors like age or health literacy might therefore be based to a certain amount on general tendencies in patient satisfaction rather than on than specific problems with our intervention. Nevertheless, achieving sufficient patient satisfaction with the provided services remains an important aim of our intervention.

Implications for clinical practice

The patients in our study were – for the most part and across most sociodemographic groups – satisfied with the services they received. Only few patients felt that the staff devoted too little time to them or that they could not say everything they wanted to say. The most criticised aspect was that the staff showed too little interest in the patients’ personal situation. Therefore, the staff should be trained to pay more attention to the specific situation of the patients. It also seems important to conduct a continuous monitoring if all relevant aspects for triaging patients appropriately are included in the initial assessments.

The type of health problem that the patients presented was related to their satisfaction. This could reflect associations of the medical care with patient satisfaction [38, 51,52,53], but it could also be related to our intervention. Patients visiting the emergency department with infections, injuries and long-lasting conditions probably have had a stronger opinions regarding cause, consequences and treatment options for their health problem than patients who come with new and undiagnosed complaints like fever, cough, nausea, or vertigo and they might therefore have had less understanding for the first assessment they received. As waiting times are one of the most important predictors for reduced patient satisfaction [31,32,33,34,35,36], this patient group should be informed why first assessment is necessary in their specific case.

We also identified that a lower health literacy was associated with reduced satisfaction, which is know from other studies as well [45,46,47,48]. With regard to our specific intervention, it could be that patients who have problems in the handling of information relevant to health and healthcare did not understand the rationale and importance of the initial assessment very well. As targeted information can improve patient satisfaction in the inpatient emergency setting [32, 33], it could be helpful to accompany the initial assessment by patient-centred information in easy language explaining why the initial assessment is being conducted and what the patients can expect.

Strengths and limitations of the study

Unfortunately, it was not possible to conduct a randomised-controlled trial evaluating the patient satisfaction with the computer-assisted initial assessment. For this reason, the satisfaction of patients receiving the intervention could not be compared to patients receiving care as usual. Furthermore, there was no pre-intervention study. We therefore do not know if the low levels of dissatisfaction we observed are related to a change to the better, no change at all or a change to the worse compared to care as usual. But we were able to identify predictors of reduced satisfaction in order to determine if specific patient groups feel dissatisfied with the initial assessment. In these analyses, we used strict criteria for full satisfaction in order to compensate for the missing control group in our study.

However, our definition of full satisfaction, including only patients who “fully agree” to each of the statements, might be too strict for patients who tend to make cautious ratings. In a sensitivity analysis, we therefore adjusted for rating “rather yes” on all items of patient satisfaction, which applied to 47 patients. In this analysis, injuries and infections lost their statistical significance, but lower age (OR 0.80 for ten years difference, 95% CI 0.67–0.97, p = 0.021), higher symptom duration (OR 1.22 for one step on the natural logarithmic scale, 95% CI 1.05–1.41, p = 0.009) and lower health literacy (OR 0.65 for four points difference, 95% CI 0.48–0.89, p = 0.007) were still associated with reduced patient satisfaction.

It must be noted that we did not make qualitative exploration of the patient perspective on our intervention. For this reason, we do not know if it was clear for patients which processes were part of the DEMAND intervention and which related to standard operating procedures of the hospital. The four items assessing patient satisfaction therefore also covered a broader subject and cannot be fully attributed to our intervention. The questions were piloted in a pre-test, but we did not conduct psychometric validation of these items. In our multivariable models, we did not include waiting time and the outcome of the initial assessment as predictor variables. However, both variables might influence patient satisfaction and the set of predictors could therefore be incomplete.

Health literacy was measured by the validated [56] and established [57] questionnaire HLS-EU-Q16. The questionnaire was used in the national GEDA cohort providing representative data on the distribution of health literacy in the general population in Germany [44]. However, the HLS-EU-Q16 was also criticised for using subjective estimates of the patients’ own competencies and for errors regarding the assessment of patient leaflets and screening examinations [58].

Reduced health literacy is known to be related to low socioeconomic status, migration background and language-related communication barriers [59,60,61]. The statistical analyses were adjusted for educational level and migration status. However, the association between reduced health literacy and low patient satisfaction might still be explained in part by factors like income-related social deprivation, language problems, or cultural factors.

Other limitations of our study include the mode of data collection, the patient selection and the sample size. The patients completed the survey during their waiting time and we do not know how the level of satisfaction with the intervention altered following the completion of their episode of care. As in most surveys, we cannot rule out that recall problems, errors or social desirability have biased the data.

We do not know to what extent the included patients are representative of the studied population. In this context it should be noted that the proportion of women in our sample was higher than in comparable studies. We excluded minors, patients with specific functional limitations and patients, who cannot read or write in German. Additionally, 38.3% of the eligible patients did not participate in our study. We also did not conduct a sample size calculation. It is therefore possible that significant predictors of reduced patient satisfaction were missed due to limited statistical power.

Strengths of our study relate to the selection of observation periods, the standardisation of data collection, the selection of study regions and the statistical methods. The specific calendar dates on which the specific intervention sites were observed had been randomised. The likeliness of bias introduced by events such as flu epidemics or TV reports is therefore reduced. The intervention sites used standardised procedures of data collection and were closely monitored by the scientific staff in the project. The study includes patients from urban and rural areas and many different regions in Germany are covered. And the statistical methods consider potential confounders and the clustering of patients in the specific intervention sites.

Conclusions

The patients were for the most part satisfied with the intervention. Reduced patient satisfaction was predicted by lower age, presenting with infections or injuries, a higher symptom duration and a lower health literacy. Assessment procedures should therefore be evaluated a) regarding if all relevant patient-related aspects are included; and whether patient information can be improved b) for patients with strong opinions about cause, consequences and treatment options for their health problem; and c) for patients who have problems in the handling of information relevant to health and healthcare.

Availability of data and materials

The datasets generated and analysed during the current study are not publicly available, because the ethics approval does not allowed data sharing, but available from the corresponding author on reasonable request.

References

  1. Lowthian JA, Curtis AJ, Jolley DJ, Stoelwinder JU, McNeil JJ, Cameron PA. Demand at the emergency department front door: 10-year trends in presentations. Med J Aust. 2012;196:128–32.

    Article  PubMed  Google Scholar 

  2. von Graf Stillfried D, Czihal T, Meer A. Sachstandsbericht: Strukturierte medizinische Ersteinschätzung in Deutschland (SmED) [State of the art report - structured medical first assessment in Germany (SmED)]. Notfall + Rettungsmedizin. 2019;22:578–88.

    Article  Google Scholar 

  3. Chiu IM, Lin YR, Syue YJ, Kung CT, Wu KH, Li CJ. The influence of crowding on clinical practice in the emergency department. Am J Emerg Med. 2018;36:56–60.

    Article  PubMed  Google Scholar 

  4. Morley C, Unwin M, Peterson GM, Stankovich J, Kinsman L. Emergency department crowding: a systematic review of causes, consequences and solutions. PLoS One. 2018;13:e0203316.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  5. Carter EJ, Pouch SM, Larson EL. The relationship between emergency department crowding and patient outcomes: a systematic review. J Nurs Scholarsh. 2014;46:106–15.

    Article  PubMed  Google Scholar 

  6. Basu J, Friedman B, Burstin H. Primary care, HMO enrollment, and hospitalization for ambulatory care sensitive conditions: a new approach. Med Care. 2002;40:1260–9.

    Article  PubMed  Google Scholar 

  7. Caminal J, Starfield B, Sánchez E, Casanova C, Morales M. The role of primary care in preventing ambulatory care sensitive conditions. Eur J Public Health. 2004;14:246–51.

    Article  PubMed  Google Scholar 

  8. McWilliams A, Tapp H, Barker J, Dulin M. Cost analysis of the use of emergency departments for primary care services in Charlotte. North Carolina North Carolina Med J. 2011;72:265–71.

    Article  Google Scholar 

  9. Galarraga JE, Mutter R, Pines JM. Costs associated with ambulatory care sensitive conditions across hospital-based settings. Acad Emerg Med. 2015;22:172–81.

    Article  PubMed  Google Scholar 

  10. Scherer M, Lühmann D, Kazek A, Hansen H, Schäfer I. Patients attending emergency departments - a cross-sectional study of subjectively perceived treatment urgency and motivation for attending. Dtsch Arztebl Int. 2017;114:645–52.

    PubMed  PubMed Central  Google Scholar 

  11. Somasundaram R, Geissler A, Leidel BA, Wrede CE. Beweggründe für die Inanspruchnahme von Notaufnahmen – Ergebnisse einer Patientenbefragung [Reasons for Emergency Department Visits: Results of a Patient Survey]. Gesundheitswesen. 2018;80:621–7.

    Article  CAS  PubMed  Google Scholar 

  12. Durand AC, Palazzolo S, Tanti-Hardouin N, Gerbeaux P, Sambuc R, Gentile S. Nonurgent patients in emergency departments: rational or irresponsible consumers? Perceptions of professionals and patients. BMC Res Notes. 2012;5:525.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Ilioudi S, Lazakidou A, Tsiron M. Importance of patient satisfaction measurement and electronic surveys: methodology and potential benefits. Int J Health Res Innov. 2013;1:67–87.

    Google Scholar 

  14. Chow A, Mayer EK, Darzi AW, Athanasiou T. Patient-reported outcome measures: the importance of patient satisfaction in surgery. Surgery. 2009;146:435–43.

    Article  PubMed  Google Scholar 

  15. Ng JHY, Luk BHK. Patient satisfaction: concept analysis in the healthcare context. Patient Educ Couns. 2019;102:790–6.

    Article  PubMed  Google Scholar 

  16. Jarvis PRE. Improving emergency department patient flow. Clin Exp Emerg Med. 2016;3:63–8.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Cooper A, Carson-Stevens A, Hughes T, Edwards A. Is streaming patients in emergency departments to primary care services effective and safe? BMJ. 2020;368:m462.

    Article  PubMed  Google Scholar 

  18. Ramlakhan S, Mason S, O’Keeffe C, Ramtahal A, Ablard S. Primary care services located with EDs: a review of effectiveness. Emerg Med J. 2016;33:495–503.

    Article  PubMed  Google Scholar 

  19. Herrmann, T; Willms, G (2021). DEMAND – Erfahrungen bei der Implementierung eines Großprojektes im Innovationsfonds. In: Innovationsfonds – Transfer in die Regelversorgung. Engehausen, R; Scholz, S (Eds.): medhochzwei: 115–132.

  20. Roth C, Breckner A, Paulus J, Wensing M. Implementation of a Standardized initial assessment for demand management in outpatient emergency care in Germany: early qualitative process evaluation. JMIR Form Res. 2020;4(9):e18456.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Brauns H, Steinmann S. Educational reform in France, West-Germany and the United Kingdom: updating the CASMIN educational classification. ZUMA-Nachrichten. 1999;44:7–44.

    Google Scholar 

  22. WONCA International Classification Committee. ICPC-2-R: International Classification of Primary Care. Revised 2nd ed. Oxford: Oxford University Press; 2005.

  23. Hinz A, Kohlmann T, Stöbel-Richter Y, Zenger M, Brähler E. The quality of life questionnaire EQ-5D-5L: psychometric properties and normative values for the general German population. Qual Life Res. 2014;23:443–7.

    Article  PubMed  Google Scholar 

  24. Ludwig K, von der Graf Schulenburg JM, Greiner W. German value set for the EQ-5D-5L. Pharmacoeconomics. 2018;36:663–74.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Sørensen K, Pelikan JM, Röthlin F, Ganahl K, Slonska Z, Doyle G, et al. Health literacy in Europe: comparative results of the European health literacy survey (HLS-EU). Eur J Public Health. 2015;25:1053–8.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Lorini C, Santomauro F, Grazzini M, Mantwill S, Vettori V, Lastrucci V, Bechini A, Boccalini S, Bussotti A, Bonaccorsi G. Health literacy in Italy: a cross-sectional study protocol to assess the health literacy level in a population-based sample, and to validate health literacy measures in the Italian language. BMJ Open. 2017;7:e017812.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Mangiapane S, Czihal Z, von Stillfried D. Entwicklung der ambulanten Notfallversorgung in Deutschland von 2009 bis 2020. ZI-Paper 16/2021. Berlin: Zentralinstitut für die kassenärztliche Versorgung, 2021. www.zi.de/fileadmin/images/content/Publikationen/Zi-Paper-16-2021-Notfallversorgung.pdf. Accessed 03.06.2022.

  28. Schäfer I, Menzel A, Oltrogge JH, Slagman A, Möckel M, Lühmann D, Scherer M. Is subjectively perceived treatment urgency of patients in emergency departments associated with self-reported health literacy and the willingness to use the GP as coordinator of treatment? Results from the multicentre, cross-sectional, observational study PiNo Bund. BMJ Open. 2021;11:e053110.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Thrasher C, Purc-Stephenson R. Patient satisfaction with nurse practitioner care in emergency departments in Canada. J Am Acad Nurse Pract. 2008;20:231–7.

    Article  PubMed  Google Scholar 

  30. Wilson A, Shifaza F. An evaluation of the effectiveness and acceptability of nurse practitioners in an adult emergency department. Int J Nurs Pract. 2008;14:149–56.

    Article  PubMed  Google Scholar 

  31. Rehman SA, Ali PA. A review of factors affecting patient satisfaction with nurse led triage in emergency departments. Int Emerg Nurs. 2016;29:38–44.

    Article  PubMed  Google Scholar 

  32. Krishel S, Baraff LJ. Effect of emergency department information on patient satisfaction. Ann Emerg Med. 1993;22:568–72.

    Article  CAS  PubMed  Google Scholar 

  33. McCarthy ML, Ding R, Zeger SL, Agada NO, Bessman SC, Chiang W, Kelen GD, Scheulen JJ, Bessman ES. A randomized controlled trial of the effect of service delivery information on patient satisfaction in an emergency department fast track. Acad Emerg Med. 2011;18:674–85.

    Article  PubMed  Google Scholar 

  34. Dinh MM, Enright N, Walker A, Parameswaran A, Chu M. Determinants of patient satisfaction in an Australian emergency department fast-track setting. Emerg Med J. 2013;30:824–7.

    Article  PubMed  Google Scholar 

  35. Yildirim C, Kocoglu H, Goksu S, Gunay N, Savas H. Patient satisfaction in a university hospital emergency department in Turkey. Acta Medica (Hradec Kralove). 2005;48:59–62.

    Article  Google Scholar 

  36. Boudreaux ED, O’Hea EL. Patient satisfaction in the Emergency Department: a review of the literature and implications for practice. J Emerg Med. 2004;26:13–26.

    Article  PubMed  Google Scholar 

  37. Hall MF, Press I. Keys to patient satisfaction in the emergency department: results of a multiple facility study. Hosp Health Serv Adm. 1996;41:515–32.

    CAS  PubMed  Google Scholar 

  38. Thiedke CC. What do we really know about patient satisfaction? Fam Pract Manag. 2007;14:33–6.

    PubMed  Google Scholar 

  39. Tucker JL. The moderators of patient satisfaction. J Manag Med. 2002;16:48–66.

    Article  PubMed  Google Scholar 

  40. Hall JA, Dornan MC. Patient sociodemographic characteristics as predictors of satisfaction with medical care: a meta-analysis. Soc Sci Med. 1990;30:811–8.

    Article  CAS  PubMed  Google Scholar 

  41. Tucker JL 3rd, Kelley VA. The influence of patient sociodemographic characteristics on patient satisfaction. Mil Med. 2000;165:72–6.

    Article  PubMed  Google Scholar 

  42. Lewis JR. Patient views on quality care in general practice: literature review. Soc Sci Med. 1994;39:655–70.

    Article  CAS  PubMed  Google Scholar 

  43. Like R, Zyzanski SJ. Patient satisfaction with the clinical encounter: social psychological determinants. Soc Sci Med. 1987;24:351–7.

    Article  CAS  PubMed  Google Scholar 

  44. Jordan S, Hoebel J. Health literacy of adults in Germany: findings from the German health update (GEDA) study. Bundesgesundheitsbl Gesundheitsforsch Gesundheitsschutz. 2015;58:942–50.

    Article  Google Scholar 

  45. MacLeod S, Musich S, Gulyas S, Cheng Y, Tkatch R, Cempellin D, Bhattarai GR, Hawkins K, Yeh CS. The impact of inadequate health literacy on patient satisfaction, healthcare utilization, and expenditures among older adults. Geriatr Nurs. 2017;38:334–41.

    Article  PubMed  Google Scholar 

  46. Hayran O, Özer O. Organizational health literacy as a determinant of patient satisfaction. Public Health. 2018;163:20–6.

    Article  CAS  PubMed  Google Scholar 

  47. Yim CK, Shumate L, Barnett SH, Leitman IM. Health literacy assessment and patient satisfaction in surgical practice. Ann Med Surg (Lond). 2018;35:25–8.

    Article  Google Scholar 

  48. Shea JA, Guerra CE, Ravenell KL, McDonald VJ, Henry CA, Asch DA. Health literacy weakly but consistently predicts primary care patient dissatisfaction. Int J Qual Health Care. 2007;19:45–9.

    Article  PubMed  Google Scholar 

  49. Sørensen K, Pelikan JM, Röthlin F, Ganahl K, Slonska Z, Doyle G, et al. Health literacy in Europe: comparative results of the European health literacy survey (HLS-EU). Eur J Pub Health. 2015;25:1053–8.

    Article  Google Scholar 

  50. Tiller D, Herzog B, Kluttig A, Haerting J. Health literacy in an urban elderly east-German population – results from the population-based CARLA study. BMC Public Health. 2015;15:883.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Parchman ML, Noël PH, Lee S. Primary care attributes, health care system hassles, and chronic illness. Med Care. 2005;43:1123–9.

    Article  PubMed  Google Scholar 

  52. Walling AD, Woolley DC, Molgaard C, Kallail KJ. Patient satisfaction with migraine management by family physicians. J Am Board Fam Pract. 2005;18:563–6.

    Article  PubMed  Google Scholar 

  53. Redekop WK, Koopmanschap MA, Stolk RP, Rutten GE, Wolffenbuttel BH, Niessen LW. Health-related quality of life and treatment satisfaction in Dutch patients with type 2 diabetes. Diabetes Care. 2002;25:458–63.

    Article  PubMed  Google Scholar 

  54. Boudreaux ED, Friedman J, Chansky ME, Baumann BM. Emergency department patient satisfaction: examining the role of acuity. Acad Emerg Med. 2004;11:162–8.

    Article  PubMed  Google Scholar 

  55. Mack JL, File KM, Horwitz JE, Prince RA. The effect of urgency on patient satisfaction and future emergency department choice. Health Care Manage Rev. 1995;20:7–15.

    Article  CAS  PubMed  Google Scholar 

  56. Röthlin F, Pelikan JM, Ganahl K. Die Gesundheitskompetenz der 15-jährigen Jugendlichen in Österreich. Abschlussbericht der österreichischen Gesundheitskompetenz Jugendstudie im Auftrag des Hauptverbands der österreichischen Sozialversicherungsträger. Wien: Ludwig Boltzmann Institute Health Promotion Research; 2013.

    Google Scholar 

  57. Niedorys B, Chrzan-Rodak A, Ślusarska B. Health literacy: a review of research using the European health literacy questionnaire (HLS-EU-Q16) in 2010–2018. Pielegniarstwo XXI wieku. 2020;19:29–41.

    Article  Google Scholar 

  58. Steckelberg A, Meyer G, Mühlhauser I. Questionnaire should not be used any longer. Dtsch Arztebl Int. 2017;114:330.

    PubMed  PubMed Central  Google Scholar 

  59. Sørensen K, Van den Broucke S, Fullam J, Doyle G, Pelikan J, Slonska Z, Brand H, (HLS-EU) Consortium Health Literacy Project European. Health literacy and public health: a systematic review and integration of definitions and models. BMC Public Health. 2012;12:80.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Jessup RL, Osborne RH, Beauchamp A, Bourne A, Buchbinder R. Health literacy of recently hospitalised patients: a cross-sectional survey using the Health Literacy Questionnaire (HLQ). BMC Health Serv Res. 2017;17:52.

    Article  PubMed  PubMed Central  Google Scholar 

  61. Schaeffer D, Berens EM, Vogt D. Health literacy in the German population. Dtsch Arztebl Int. 2017;114:53–60.

    PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We would like to express our appreciation to the staff members of the intervention sites who facilitated this study with their participation and to the Associations of Statutory Health Insurance Physicians of Baden-Württemberg, Brandenburg, Bremen, North Rhine-Westphalia, Rhineland-Palatinate, and Schleswig-Holstein for their support.

Funding

Open Access funding enabled and organized by Projekt DEAL. The study was funded by the Innovation Fund of the Federal Joint Committee (grant no. 01VSD17019). The funding body had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.

Author information

Authors and Affiliations

  1. Department of Primary Medical Care, University Medical Center Hamburg-Eppendorf, Martinistr. 52, 20246, Hamburg, Germany

    Ingmar Schäfer, Agata Menzel, Jan Hendrik Oltrogge, Dagmar Lühmann & Martin Scherer

  2. aQua Institut für angewandte Qualitätsförderung und Forschung im Gesundheitswesen GmbH, Göttingen, Germany

    Tobias Herrmann

Authors
  1. Ingmar Schäfer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Agata Menzel
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tobias Herrmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jan Hendrik Oltrogge
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Dagmar Lühmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Martin Scherer
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

IS, AM, TH, JO, DL and MS conceived and designed the study. IS performed the statistical analyses and drafted the manuscript. All the authors commented on the draft and read and approved the final version of the manuscript.

Corresponding author

Correspondence to Ingmar Schäfer.

Ethics declarations

Ethics approval and consent to participate

The research was performed in accordance with the Declaration of Helsinki and institutional guidelines for safeguarding good research practice. The study was approved by the Ethics Committee of the Hamburg Medical Association on 08 April 2019 (approval no. PV6035). The study participants received written patient information and gave informed consent to study participation. The institutional data security officer was involved in the design of the study.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Table A.

Intervention sites, federal states and participation status. Table B. Location of intervention sites, periods of data collection and local response rates. Table C. Health problems with prevalence ≥ 2% (pursuant to ICPC-2).

Additional file 2.

Patient questionnaire.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Schäfer, I., Menzel, A., Herrmann, T. et al. Patient satisfaction with computer-assisted structured initial assessment facilitating patient streaming to emergency departments and primary care practices: results from a cross-sectional observational study accompanying the DEMAND intervention in Germany. BMC Prim. Care 23, 213 (2022). https://doi.org/10.1186/s12875-022-01825-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12875-022-01825-5

Keywords

BMC Primary Care

ISSN: 2731-4553

Contact us