Skip to main content

Actual timing versus GPs’ perceptions of optimal timing of advance care planning: a mixed-methods health record-based study

Abstract

Background

Timely initiation of advance care planning (ACP) in general practice is challenging, especially in patients with non-malignant conditions. Our aim was to investigate how perceived optimal timing of ACP initiation and its triggers relate to recorded actual timing in patients with cancer, organ failure, or multimorbidity.

Methods

In this mixed-methods study in the Netherlands, we analysed health records selected from a database with primary care routine data and with a recorded ACP conversation in the last two years before death of patients who died with cancer, organ failure, or multimorbidity. We compared actual timing of ACP initiation as recorded in health records of 51 patients with the perceived optimal timing as determined by 83 independent GPs who studied these records. Further, to identify and compare triggers for GPs to initiate ACP, we analysed the health record documentation around the moments of the recorded actual timing of ACP initiation and the perceived optimal timing of ACP initiation. We combined quantitative descriptive statistics with qualitative content analysis.

Results

The recorded actual timing of ACP initiation was significantly closer to death than the perceived optimal timing in patients with cancer (median 88 vs. 111 days before death (p = 0.049)), organ failure (227 vs. 306 days before death (p = 0.02)) and multimorbidity (113 vs. 338 days before death (p = 0.006)). Triggers for recorded actual versus perceived optimal timing were similar across the three groups, the most frequent being ‘expressions of patients’ reflections or wishes’ (14% and 14% respectively) and ‘appropriate setting’ (10% and 13% respectively).

Conclusion

ACP in general practice was initiated and recorded later in the illness trajectory than considered optimal, especially in patients with organ failure or multimorbidity. As triggers were similar for recorded actual and perceived optimal timing, we recommend that GPs initiate ACP shortly after a trigger is noticed the first time, rather than wait for additional or more evident triggers when the illness is in an advanced stage.

Peer Review reports

Background

The importance of patient centeredness of care at the end of life is increasingly acknowledged. Patients, bereaved family, and healthcare professionals all express that it is essential for a good end of life that patients’ wishes are met and a sense of control is achieved [1,2,3]. Advance care planning (ACP) is believed to play a role in improving the quality of end-of-life care [4,5,6]. ACP is a process that enables patients to specify and share their values, goals and preferences for future medical treatment and care [7, 8]. This process is perceived as a task that is typically suited to general practitioners (GPs) as they usually have a longstanding relationship with patients enlisted in their practice [9, 10]. However, there is a wide variety and generally low uptake of ACP and it mainly takes place reactively and thus late in the disease trajectory of patients, particularly in patients with non-malignant conditions such as organ failure, dementia or multimorbidity [11,12,13,14,15].

Inconsistent application of ACP in general practice may relate to timing difficulties. In non-malignant diseases, such as heart failure, key moments to initiate ACP and the life-limiting nature of the diseases are not always apparent to GPs [9, 16, 17]. Furthermore, GPs reported concerns about taking away hope from patients [9]. Yet, timely initiation of ACP may prevent ad-hoc end-of-life treatment that tends not to reflect patients´ wishes [18].

Recent research has studied either the recorded actual timing of ACP initiation in daily practice [19], or GPs’ perceptions of optimal timing of ACP initiation [20]. Understanding matches and mismatches between the two may, however, inform better timing of ACP conversations in practice. The aim of the current study is to investigate how perceived optimal timing of ACP initiation and its triggers relate to recorded actual timing for patients with cancer, organ failure, or multimorbidity in general practice.

Methods

Study design and setting

In this mixed-method health record review study, we used records of patients who died with cancer, organ failure or multimorbidity [19, 20]. We compared the actual timing of ACP initiation in general practice, as recorded in the patients’ health records, with the perceived optimal timing according to independent GPs who examined the last two years of the health records retrospectively. Further, to identify and compare triggers for GPs to initiate ACP, we analysed the health record documentation around the moments of the recorded actual timing of ACP initiation and the perceived optimal timing of ACP initiation. The actual and the perceived optimal timing of ACP initiation were determined in previously published after death health record studies [19, 20].

Data source

Pseudonymized patient health records were selected from FaMe-net, a database with primary care routine data collected in the region of Nijmegen, the Netherlands, covering patient health record data from seven general practices. We selected records of patients who died between 2003 and 2016 that contained patient characteristics, GP reports, correspondence to and from other healthcare providers, laboratory values, and medication prescriptions. We used data from the last two years of life and excluded health records of patients with fewer than 2 years documented before death. Further, records of patients under the age 18 and those with a diagnosis of dementia were excluded. In 150 randomly sampled health records equally distributed across the seven general practices, we identified three patient groups based on different illness trajectories [21, 22]: (i) patients who died with cancer, whose decline is generally evident and progressive. (ii) patients who died with organ failure (heart failure, COPD, kidney failure, liver failure and chronic-progressive neurological illness such as Parkinson’s or ALS), whose decline is characterized by long-term limitations with intermittent worsening of symptoms and some recovery, often with a rather sudden death. (iii) older patients (age > 65) who died with multiple (> 2) chronic diseases, other than cancer and organ failure (i.e., multimorbidity), whose decline is generally prolonged and gradual. Patients who could be allocated to more than one group, were allocated to the first fitting group in the following order: cancer (1), organ failure (2), multimorbidity (3). Allocation was based on verified diagnosis from recorded medical history. We excluded records that could not be assigned to any of these three groups, as death may have been a ‘sudden death’ (unpredictable, acute illness or trauma) and records with unknown cause of death.

Data on recorded actual timing of ACP initiation

In a previous study, the authors (among them SG and HS) examined the documentation of ACP for patients with cancer, organ failure and multimorbidity [19]. In this study the same selection procedure as described above was followed and resulted in 119 included health records. Data abstracted from the health records included the presence of ACP and the timing of the first ACP conversation. ACP is referred to, consistent with a recent international consensus definition, as proactive conversations, registrations or actions such as conversations on treatment preferences for future care and conversations regarding prognosis, personal wishes and goals or concerns, and hopes for the future [8].

Data on perceived optimal timing of ACP initiation

Another study we use data from in the current research, aimed to identify the optimal moment, and reasons to initiate ACP in patients with cancer, organ failure and multimorbidity. In this study, a selection of 90 health records (30 records per patient group), selected with the same process as above, was assessed by 83 independent GPs. GPs were recruited from networks with and without a particular interest in end-of-life care from various geographical areas and through snowballing, to ensure diversity in GPs’ backgrounds and took place between October 31st, 2020 and January 10th, 2021.The included GPs, with an average of 15 year experience as GP and with 24% of them having an additional expertise in palliative care, assessed optimal timing of ACP initiation The researchers first removed all indicators of actual performed ACP in these records. Then, the GPs reviewed, independently of each other, three patient health records (one from each patient group) in an online environment to determine what time they perceived as the optimal time to initiate ACP through thorough assessment of all documentation (patient characteristics, GP reports, correspondence to and from other healthcare providers, laboratory values, and medication prescriptions) in the last two years of life. Furthermore, they were asked to explain why they thought this would be the optimal time to initiate ACP [20].

Data analysis

In the current study, we selected and analysed health records that were included in both previous studies. We excluded health records where ACP was not recorded (Fig. 1). We compared the recorded actual timing of ACP initiation with the perceived optimal timing of ACP initiation, as identified in previous performed studies [19, 20]. The perceived optimal timing of ACP initiation for each health record was determined by taking the average of the optimal timing as identified by the maximum of three independent GPs who assessed that same record. We present recorded actual timing of ACP initiation and optimal timing in the three patient groups (cancer, organ failure, and multimorbidity) referring to the median number of days and interquartile range (IQR) between timing and patients’ death. Differences between actual and optimal timing of ACP initiation were tested for every patient group using the Wilcoxon Signed Rank test to accommodate skewed distributions. A p-value of < 0.05, based on two-sided tests was considered statistically significant. We performed quantitative analysis in SPSS version 25 (IBM, 2017).

Fig. 1
figure 1

Selection of health records for comparative analysis

To identify what seems to have triggered the GPs to initiate ACP, we conducted directed qualitative content analysis [23], with the codes and categories developed in the previous study [20] on health record documentation around the recorded actual timing and the perceived optimal timing of ACP initiation. Texts were abstracted to Microsoft Excel 2016 for coding. One researcher (WT) first coded the texts around the perceived optimal timing of ACP and then the texts around the first recorded ACP conversation. Ambiguous cases (equal to 20%) were discussed extensively with a second researcher (PvP), whereafter codes in all records were adapted as needed. Subsequently, codes and themes were counted for and compared between the actual and the optimal timing of ACP initiation, within and between the three groups.

Results

The characteristics of the 51 patients whose health record were analysed are shown in Table 1.

Table 1 Characteristics of the patients whose health records were analysed

Recorded actual vs. perceived optimal timing of ACP initiation

The median recorded actual timing of ACP initiation was 128 days before death (IQR 299). This was significantly closer to death than the perceived optimal timing (median 244 days before death, IQR 307; p < 0.001). In all patient groups, the recorded actual timing of ACP initiation was significantly closer to death than the perceived optimal timing (cancer, median (IQR): 88 (299) vs. 111 (248), p = 0.049; organ failure, median (IQR): 227 (356) vs. 306 (225), p = 0.020; multimorbidity, median (IQR): 113 (307) vs. 338 (413), p = 0.006; Fig. 2).

Fig. 2
figure 2

Distribution plot of recorded actual ACP timing in general practice vs. perceived optimal ACP timing as determined by independent GPs in cancer (n = 24), organ failure (n = 16) and multimorbidity (n = 11). Each point in the plot of perceived optimal ACP represents a health record assessed by a maximum of three independent GPs: in the cancer group, 18 health records were reviewed by three GPs and 6 by two GPs; in the organ failure group, 12 records were reviewed by three GPs, two records by two GPs and two records by one GP; in the multimorbidity group, 9 records were reviewed by three GPs, one record by two GP and one record by one GP

Qualitative analysis of the moment of the actual vs. perceived optimal ACP initiation

Our qualitative analysis of moments of recorded actual versus perceived optimal ACP conversations across all 51 health records showed that actual ACP was most frequently initiated when patients expressed their reflections or wishes (14%), when the setting was appropriate (10%; e.g., period of relative wellness, a setting with adequate time, or presence of a family member), and when patients or family members expressed their emotions (10%) (Fig. 3). Perceived optimal timing of ACP initiation was most frequently identified when patients expressed their reflections or wishes (14%), when the setting was appropriate (13%), and when treatment or diagnostics were started (9%). Across all health records, GPs slightly more often reported an appropriate setting for the optimal timing of ACP initiation compared to the actual timing for ACP initiation (13% vs. 10%). Further, actual ACP was more frequently initiated as a response to ‘general deterioration’ compared to perceived optimal timing of ACP (5% vs. 2%) (see Additional file 1 for the complete results of the qualitative analysis).

Fig. 3
figure 3

Triggers around the moments of the recorded actual and the perceived optimal ACP initiation. ‘Appropriate setting’ constitutes a period of relative wellness, a setting with adequate time, or presence of a family member

The distribution of triggers for ACP (what possibly made GPs decide to initiate ACP) per patient group were largely similar for recorded actual and perceived optimal timing of ACP initiation (Table 2). In patients who died with cancer, actual and perceived optimal timing of ACP initiation was most frequently triggered by a specific moment ‘in the timeline of the disease’ (e.g., diagnosis, no curative treatment options available, or at start of treatment or diagnostics), which was less often a trigger for actual than for perceived optimal timing (32% vs. 39%). ‘Symptoms indicating deterioration’ were more often a trigger in actual timing for ACP initiation than in perceived optimal timing (25% vs. 17%). There were also modest differences in the other patient groups: for example, in health records of patients who died with organ failure, ‘symptoms indicating deterioration’ were less often a trigger for actual timing of ACP initiation (24%) than for perceived optimal timing (29%), while the reverse applied to the multimorbidity group (44% actual vs. 36% optimal timing).

Table 2 Triggers (main categories) around the moments of the recorded actual and the perceived optimal ACP timing

Discussion

We compared the recorded actual timing of ACP initiation in general practice in patients who died with cancer, organ failure, or multimorbidity, with the perceived optimal timing of ACP initiation as assessed by peer GPs. When initiated, ACP in general practice, especially in patients with organ failure or multimorbidity, was initiated significantly later than what was considered optimal by their independent peers. However, across the three patient groups, the triggers for recorded actual timing and for perceived optimal timing of ACP initiation were quite similar. Nevertheless, ‘appropriate setting’ (e.g., period of relative wellness, a setting with adequate time, or presence of a family member) was slightly more often a trigger for perceived optimal timing of ACP initiation than for initiating ACP in actual practice. Further, optimal timing of ACP was less often in response to ‘general deterioration’ compared to actual ACP.

Interpretation of results in the light of existing literature

Our findings are in line with previous studies indicating that GPs often initiate ACP late, when the disease has reached a critical stage [9, 13, 16, 24]. Reasons given for suboptimal timing are that proactively initiating ACP can be difficult as patients are not always open to having them and healthcare providers are afraid to take away a patients’ hope for a cure [9].

Nevertheless, the fear of causing anxiety and catching patients off guard and thereby damaging the patient-doctor relationship might not be warranted. Previous research found that the majority of the oncology patients preferred to have ACP discussions early, before their prognosis worsened. Additionally, almost half of the patients wished these conversations had taken place even before they were diagnosed with cancer [25]. In another study, participants who received ACP shortly after their diagnosis of advanced cancer, acknowledged that the conversation was emotional, but not burdensome and felt it helped them [26]. Studies conducted in patients with heart failure and healthy older people, although few, suggest that patients might be more open to ACP than physicians think [27, 28].

It has also been shown that patients do not have to be ready for all ACP topics to be able to participate in ACP conversations [29]. Additionally, readiness can alternate during the course of the ACP conversation. Thus, it is important to verify who wants what information at that specific moment and tailor the conversation to the patients’ needs, and to not postpone initiating ACP until patients are ready for all ACP topics [30].

To ensure triggers to initiate ACP are not missed, screening tools such as SPICT, RADPAC or the ‘surprise question’ can be used [31,32,33]. In these tools some triggers are also used such as frequent hospital admissions, lower functional status and weight loss. However these tools aim to identify patients who are in need for palliative care because they are at high risk of dying, which is different from identifying patients who could benefit from ACP. We found additional triggers to identify patients who are in need of ACP such as patients expressing wishes themselves, other health care professionals raises opportunity to initiate ACP or the opportunity of a setting with adequate time.

Strengths and limitations

To the best of our knowledge, this is the first study to research how perceived optimal timing of ACP initiation and its triggers relates to recorded actual timing in general practice. Our original, mixed-method approach indicates a difference between actual timing of ACP initiation in general practice and the optimal ACP timing as indicated by independent GPs. The quantitative findings were enhanced with qualitative findings showing that that the nature and distribution of the many possible triggers initiating ACP in practice did not differ much from the triggers related to the optimal moment. Also, some limitations must be acknowledged. Actual ACP timing in our analysis was defined as the first recorded ACP conversation. It is possible that ACP was conducted earlier without recording it. However, we expect that GPs affiliated with a practice-based research network have a better registration routine than other GPs. Furthermore, in order to minimalize the risk of missing the initiation of ACP the full health record was assessed including free text fields.

Another limitation is that optimal timing involves a subjective judgement. However, by evaluation of multiple GPs with variable experience and expertise, on the same health records, we could capture an inter-subjective understanding of the optimal timing of ACP initiation. Further, the follow-back perspective removed prognostic insecurity (as the GPs knew when the patient actually died) and therefore may have reduced variability in the identification of the optimal timing. Additionally, we could not include many patients per group, perhaps due to low prevalence of ACP in general practice, as previously described in literature [13,14,15] This underlines the importance of our research even more.

Last, the data of recorded actual timing of ACP initiation comprises real life data between 2003 and 2016, whereas perceived optimal timing of ACP initiation was determined by GPs more recently, in 2021. ACP practice and how it is being perceived might have changed in this period, which may also partly explain the differences between perceived optimal timing and recorded actual timing of ACP initiation [8, 34].

Implications for practice and future research

Our results suggest that in most cases, triggers to initiate ACP are already in place before ACP is initiated in general practice. It is important to act upon triggers at an early stage adopting a proactive approach, and not postpone initiating ACP or wait for additional triggers.

As triggers to initiate ACP can be subtle and are sometimes either missed by GPs or not translated into action in real life situations, future research should focus on developing practical tools that automatically detect these triggers in electronic health records and support GPs in deciding when to initiate ACP. Artificial Intelligence, algorithms and flagging aids could be useful.[35] Whether such practical tools will eventually lead to more and more timely initiation of ACP in general practice, especially in patients with non-malignant diseases, should be investigated further. In addition, more research is needed that solicits patients’ views on ACP timing.

Conclusions

This study shows that ACP in general practice was initiated and recorded later in the illness trajectory than considered optimal, especially in patients with organ failure and patients with multimorbidity. The triggers for recorded actual timing of ACP and the perceived optimal timing appeared to be similar. Because the timely initiation of ACP could optimize care at the end of life, we recommend that GPs initiate ACP when a trigger first becomes apparent rather than wait for additional or more evident triggers, or at least consider inviting the patient to an ACP conversation. It is hoped that this will promote a more proactive approach in initiating ACP in particular for patients with non-malignant diseases.

Availability of data and materials

Data are available upon request from the corresponding author on reasonable request, except the content of the patient health records from FameNet as this data is not publicly available.

Abbreviations

ACP:

Advance Care Planning; GP: General practitioner

References

  1. Mistry B, Bainbridge D, Bryant D, Tan Toyofuku S, Seow H. What matters most for end-of-life care? Perspectives from community-based palliative care providers and administrators. BMJ Open. 2015;5(6): e007492.

    Article  Google Scholar 

  2. Martin DK, Emanuel LL, Singer PA. Planning for the end of life. The Lancet. 2000;356(9242):1672–6.

    Article  CAS  Google Scholar 

  3. Vedel I, Ghadi V, Lapointe L, Routelous C, Aegerter P, Guirimand F. Patients’, family caregivers’, and professionals’ perspectives on quality of palliative care: a qualitative study. Palliat Med. 2014;28(9):1128–38.

    Article  Google Scholar 

  4. Houben CHM, Spruit MA, Groenen MTJ, Wouters EFM, Janssen DJA. Efficacy of advance care planning: a systematic review and meta-analysis. J Am Med Dir Assoc. 2014;15(7):477–89.

    Article  Google Scholar 

  5. Detering KM, Hancock AD, Reade MC, Silvester W. The impact of advance care planning on end of life care in elderly patients: randomised controlled trial. BMJ. 2010;340: c1345.

    Article  Google Scholar 

  6. Brinkman-Stoppelenburg A, Rietjens JA, van der Heide A. The effects of advance care planning on end-of-life care: a systematic review. Palliat Med. 2014;28(8):1000–25.

    Article  Google Scholar 

  7. Sudore RL, Lum HD, You JJ, Hanson LC, Meier DE, Pantilat SZ, et al. Defining Advance Care Planning for Adults: A Consensus Definition From a Multidisciplinary Delphi Panel. J Pain Symptom Manage. 2017;53(5):821-32 e1.

    Article  Google Scholar 

  8. Rietjens JAC, Sudore RL, Connolly M, van Delden JJ, Drickamer MA, Droger M, et al. Definition and recommendations for advance care planning: an international consensus supported by the European Association for Palliative Care. Lancet Oncol. 2017;18(9):e543–51.

    Article  Google Scholar 

  9. Wichmann AB, van Dam H, Thoonsen B, Boer TA, Engels Y, Groenewoud AS. Advance care planning conversations with palliative patients: looking through the GP’s eyes. BMC Fam Pract. 2018;19(1):184.

    Article  Google Scholar 

  10. Evans N, Costantini M, Pasman HR, Van den Block L, Donker GA, Miccinesi G, et al. End-of-life communication: a retrospective survey of representative general practitioner networks in four countries. J Pain Symptom Manage. 2014;47(3):604-19 e3.

    Article  Google Scholar 

  11. Evans N, Pasman HR, Donker GA, Deliens L, Van den Block L, Onwuteaka-Philipsen B, et al. End-of-life care in general practice: A cross-sectional, retrospective survey of “cancer”, “organ failure” and “old-age/dementia” patients. Palliat Med. 2014;28(7):965–75.

    Article  Google Scholar 

  12. Meeussen K, Van den Block L, Echteld M, Bossuyt N, Bilsen J, Van Casteren V, et al. Advance care planning in Belgium and The Netherlands: a nationwide retrospective study via sentinel networks of general practitioners. J Pain Symptom Manage. 2011;42(4):565–77.

    Article  Google Scholar 

  13. Ermers DJM, van Bussel KJH, Perry M, Engels Y, Schers HJ. Advance care planning for patients with cancer in the palliative phase in Dutch general practices. Fam Pract. 2019;36(5):587–93.

    Article  Google Scholar 

  14. Glaudemans JJ, Moll van Charante EP, Willems DL. Advance care planning in primary care, only for severely ill patients? A structured review. Fam Pract. 2015;32(1):16–26.

    Article  Google Scholar 

  15. Azizi B, Tilburgs B, van Hout HPJ, van der Heide I, Verheij RA, Achterberg WP, et al. Occurrence and Timing of Advance Care Planning in Persons With Dementia in General Practice: Analysis of Linked Electronic Health Records and Administrative Data. Front Public Health. 2022;10: 653174.

    Article  Google Scholar 

  16. De Vleminck A, Pardon K, Beernaert K, Deschepper R, Houttekier D, Van Audenhove C, et al. Barriers to advance care planning in cancer, heart failure and dementia patients: a focus group study on general practitioners’ views and experiences. PLoS ONE. 2014;9(1): e84905.

    Article  Google Scholar 

  17. Schichtel M, MacArtney JI, Wee B, Boylan AM. Implementing advance care planning in heart failure: a qualitative study of primary healthcare professionals. Br J Gen Pract. 2021;71(708):e550–60.

    Article  Google Scholar 

  18. Billings JA, Bernacki R. Strategic targeting of advance care planning interventions: the Goldilocks phenomenon. JAMA Intern Med. 2014;174(4):620–4.

    Article  Google Scholar 

  19. Bekker YAC, Suntjens AF, Engels Y, Schers H, Westert GP, Groenewoud AS. Advance care planning in primary care: a retrospective medical record study among patients with different illness trajectories. BMC Palliat Care. 2022;21(1):21.

    Article  Google Scholar 

  20. Tros W, van der Steen JT, Liefers J, Akkermans R, Schers H, Numans ME, et al. General practitioners’ evaluations of optimal timing to initiate advance care planning for patients with cancer, organ failure, or multimorbidity: A health records survey study. Palliat Med. 2021;36(3):510–8.

    Article  Google Scholar 

  21. Murray SA, Kendall M, Boyd K, Sheikh A. Illness trajectories and palliative care. BMJ. 2005;330:1007–11.

    Article  Google Scholar 

  22. Lynn J, Adamson DM. Living well at the end of life: Adapting health care to seriouss chornic illness in old age. 2003.

    Book  Google Scholar 

  23. Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.

    Article  Google Scholar 

  24. Dujardin J, Schuurmans J, Westerduin D, Wichmann AB, Engels Y. The COVID-19 pandemic: A tipping point for advance care planning? Experiences of general practitioners Palliat Med. 2021;35(7):1238–48.

    Google Scholar 

  25. Kubi B, Istl AC, Lee KT, Conca-Cheng A, Johnston FM. Advance care planning in cancer: patient preferences for personnel and timing. ASCO. 2020;16(9):e875–83.

    Google Scholar 

  26. Fliedner M, Zambrano S, Schols JM, Bakitas M, Lohrmann C, Halfens RJ, et al. An early palliative care intervention can be confronting but reassuring: A qualitative study on the experiences of patients with advanced cancer. Palliat Med. 2019;33(7):783–92.

    Article  Google Scholar 

  27. Malcomson H, Bisbee S. Perspectives of healthy elders on advance care planning. J Am Acad Nurse Pract. 2009;21(1):18–23.

    Article  Google Scholar 

  28. Ahluwalia SC, Levin JR, Lorenz KA, Gordon HS. Missed opportunities for advance care planning communication during outpatient clinic visits. J Gen Intern Med. 2012;27(4):445–51.

    Article  Google Scholar 

  29. Zwakman M, Milota MM, van der Heide A, Jabbarian LJ, Korfage IJ, Rietjens JAC, et al. Unraveling patients’ readiness in advance care planning conversations: a qualitative study as part of the ACTION Study. Support Care Cancer. 2021;29(6):2917–29.

    Article  CAS  Google Scholar 

  30. Scott IA, Mitchell GK, Reymond EJ, Daly MP. Difficult but necessary conversations - the case for advance care planning. Med J Aust. 2014;200(10):578.

    Article  Google Scholar 

  31. Highet G, Crawford D, Murray SA, Boyd K. Development and evaluation of the Supportive and Palliative Care Indicators Tool (SPICT): a mixed-methods study. BMJ Support Palliat Care. 2014;4(3):285–90.

    Article  Google Scholar 

  32. Thoonsen B, Engels Y, van Rijswijk E, Verhagen S, van Weel C, Groot M, et al. Early identification of palliative care patients in general practice: development of RADboud indicators for PAlliative Care Needs (RADPAC). Br J Gen Pract. 2012;62(602):e625–31.

    Article  Google Scholar 

  33. Downar J, Goldman R, Pinto R, Englesakis M, Adhikari NK. The “surprise question” for predicting death in seriously ill patients: a systematic review and meta-analysis. CMAJ. 2017;189(13):E484–93.

    Article  Google Scholar 

  34. Advance DA, Planning C. Clin Geriatr Med. 2021;37(4):605–10.

    Article  Google Scholar 

  35. Beeksma M, Verberne S, van den Bosch A, Das E, Hendrickx I, Groenewoud S. Predicting life expectancy with a long short-term memory recurrent neural network using electronic medical records. BMC Med Inform Decis Mak. 2019;19(1):36.

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank all GPs who reviewed the electronic health records.

Funding

The study was funded by the Netherlands Organization for Health Research and Development (ZonMw, project number 844001510). The funders did not have any influence on the data collection, data analysis or data interpretation.

Author information

Authors and Affiliations

Authors

Contributions

S.G. designed the protocol; H.S collected the electronic patient health records and made them available for the research; S.G. selected and manually anonymized these health records; J.L, J.S, P.P, M.N, S.G, and W.T. were involved in data collection; J.L, R.A., S.G, J.S, and M.N. advised and assisted before and during data analysis and data interpretation; W.T. and P.P. performed data analysis; W.T. wrote the first draft of the manuscript; All authors contributed to critical revision and agreed with the final manuscript.

Corresponding author

Correspondence to Willemijn Tros.

Ethics declarations

Ethics approval and consent to participate

This project was performed in accordance with the Declaration of Helsinki and all methods were performed in accordance with the relevant guidelines and regulations. The research ethics committee of the Radboud university medical center (CMO Radboudumc) approved the research protocol and waived the need for informed consent (File number: 2018–4589). The Radboudumc Technology Center Health Data supports FaMe-Net in the distillation and secure storage of routine data from the affiliated general practices. It adheres to the regulations of Dutch and European laws and has received ethical approval from the research ethics committee of Radboudumc (CMO number 2020- 6871).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tros, W., van der Steen, J.T., Liefers, J. et al. Actual timing versus GPs’ perceptions of optimal timing of advance care planning: a mixed-methods health record-based study. BMC Prim. Care 23, 321 (2022). https://doi.org/10.1186/s12875-022-01940-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12875-022-01940-3

Keywords