Depression is a common illness, often treated in primary care. Guidelines provide recommendations for referral to mental health care. Several studies investigated determinants of referral, none investigated guideline criteria as possible determinants.
We wanted to evaluate general practitioner's referral of depressed patients to mental health care and to what extent this is in agreement with (Dutch) guideline recommendations.
We used data of primary care respondents from the Netherlands Study of Depression and Anxiety with major depressive disorder in the past year (n = 478). We excluded respondents with missing data (n = 134). Referral data was collected from electronic patient files between 1 year before and after baseline and self report at baseline and 1-year follow-up. Logistic regression was used to describe association between guideline referral criteria (e.g. perceived need for psychotherapy, suicide risk, severe/chronic depression, antidepressant therapy failure) and referral.
A high 58% of depressed patients were referred. Younger patients, those with suicidal tendency, chronic depression or perceived need for psychotherapy were referred more often. Patients who had used ≥2 antidepressants or with chronic depression were more often referred to secondary care. Referred respondents met on average more guideline criteria for referral. However, only 8-11% of variance was explained.
The majority of depressed patients were referred to mental health care. General practitioners take guideline criteria into account in decision making for referral of depressed patients to mental health care. However, other factors play a part, considering the small percentage of variance explained. Further research is necessary to investigate this.
Most patients with depression are treated in primary care [1, 2]. Primary care guidelines for the treatment of depression, including the Dutch guideline, recommend antidepressants and/or various forms of psychotherapy [3–7]. When psychotherapy or counselling is indicated, a general practitioner (GP) can choose to counsel the patient himself or refer the patient to another health professional . In case of depression with psychotic features, a depressive episode in the course of bipolar disorder, a severe depression with social impairment or high suicide risk, or insufficient response to two or more antidepressants or other treatment, most guidelines recommend referral to secondary care [3–7]. In addition, most guidelines recommend referral for psychological interventions in certain cases, although criteria differ between guidelines [3–7]. Finally, patients with seasonal affective disorder may be referred for light therapy . For the current study, we used the Dutch primary care depression guideline, which is comparable to international primary care depression guidelines.
A few studies investigating referral behaviour of GPs suggest that multiple factors play a role in whether or not a patient is referred to mental health care, including disease characteristics (diagnosis, severity of symptoms, psychiatric comorbidity, personality characteristics, somatic comorbidity), patient characteristics (age, gender, race, education, insurance policy), whether the patient presented with psychological complaints, and lastly characteristics of the GP (e.g. organization of practice, experience of the GP, and degree of urbanization) [8–15]. However, none of these studies evaluated specifically the criteria for referral as mentioned in the guidelines.
The aim of this study was to evaluate the referral practice by GPs to primary (i.e. psychologist, psychiatric nurse or social worker affiliated with the GP practice) and secondary mental health care (i.e. psychiatrist or psychotherapist in free practice, or health care professional affiliated with hospital/institute for mental health care), of patients with depression who had visited their GP for whatever reason during the past four months. First, we wanted to know how many patients with depression were referred to primary and secondary mental health care. Second, if any differences existed between non-referred and referred patients, and between patients referred to primary and secondary mental health care. Third, we wanted to know if the Dutch guideline recommendations for referral to primary and secondary mental health care corresponded with clinical practice.
We hypothesized that all criteria for referral mentioned in the Dutch guideline would independently increase the likelihood of referral. We had no hypothesis as to where most patients would be referred i.e. primary or secondary mental health care.
This study was conducted with baseline-and 1-year follow-up data from the Netherlands Study of Depression and Anxiety (NESDA, http://www.nesda.nl), a large prospective cohort study (n = 2981) on the course of depression and anxiety disorders among respondents aged 18-65 years, recruited from the community, primary care and secondary mental health care, that started in 2004. Detailed information on the objectives and methods of NESDA were published elsewhere .
In The Netherlands access to secondary (mental) health care is impossible without a referral from a GP. Moreover, in The Netherlands all patients are listed with a single GP or GP practice.
At baseline an extensive interview was conducted. At 1-year follow-up all respondents filled in an elaborate questionnaire. In addition, we used data collected from the electronic patient file (EPF) of the GP for the period of one year before until one year after the baseline interview. Finally, we used data from questionnaires filled in by the GPs themselves.
Details on recruiting methods were published elsewhere . In short a screening questionnaire was sent to a random sample of 23,750 patients from 65 GPs, who consulted their GP in the past four months irrespective of reason for consultation. The screener was returned by 10,706 persons (45%). Those screening positive were approached for a telephone interview consisting of Composite International Diagnostic Interview (CIDI) short form, which has proven diagnostic quality for screening purposes [17, 18]. Those fulfilling criteria for a current disorder on the CIDI short form were invited to participate in NESDA, as was a random selection of screen-negatives (both from the written screener and telephone interview). In total 1610 persons were recruited, and underwent an extensive baseline interview, including the CIDI [19, 20]. The GP was not aware of the results of the screening and interview.
From these, we included in our study only respondents with a major depressive disorder in the past year (n = 478).
We excluded respondents who did not give permission to use their EPF (n = 15) or did not fill in the 1-year follow-up questionnaire (n = 98), as we did not have full referral data on these respondents. We also excluded respondents of whom the GP had not filled in the GP questionnaire (n = 21), as we would be unable to determine the influence of GP characteristics on referral in these cases. We thus included 344 respondents in our analysis. Excluded respondents were on average younger and had a higher Inventory of Depressive Symptomatology (IDS) score at baseline.
Indicators/guideline criteria for referral
A detailed description of all measures can be found elsewhere . Demographic data (age, gender, education) were assessed during the baseline interview. Current and lifetime diagnoses of MDD based on DSM-IV were assessed with the CIDI, as well as duration of symptoms and number of previous episodes, we constructed from these data the variable chronic depression defined as >12 months with depression in the past two years. Suicidal tendency (suicidal ideations past week, suicide attempt ever) was measured with the Beck Suicide Ideation Scale . Current and past use of antidepressants were based on self report, we derived from these data, which patients had stopped two or more antidepressants.
During the baseline interview number of chronic somatic diseases was recorded. The Perceived Need for Care Questionnaire (PNCQ) and Trimbos/iMTA questionnaire for Costs associated with Psychiatric Illness (Tic-P) were administered during the baseline interview to assess need for care and care received . From these questionnaire we used the answers to the questions of perceived need for psychotherapy and perceived need for any other treatment.
Finally, we used several GP and practice characteristics (years of experience as a GP, self-reported interest in depression, presence of a social worker, social psychiatric nurse or psychologist in the GP practice), derived from the GP questionnaires.
Table 1 shows a summary of indicators/guideline criteria used.
We constructed the variable "referral", indicating whether or not referral had taken place. Referral was considered present when a letter to or from a mental health professional was present in the EPF or when the respondent reported contact with a mental health professional in the past 6 months at baseline as measured with the PNCQ and Tic-P and in the past year with the Tic-P at 1-year follow-up.
We also created a variable indicating whether referral had been to primary (i.e. a psychologist, psychiatric nurse or social worker affiliated with the GP practice) or secondary mental health care (i.e. a psychiatrist or psychotherapist in free practice, or any health care professional affiliated with a hospital or institute for mental health care). Exact content of treatment by each mental health professional could not be determined.
The study protocol of NESDA was approved centrally by the Ethical Review Board of the VU University Medical Center and subsequently by local review boards of each participating center. After full verbal and written information about the study, written informed consent was obtained from all participants at the start of baseline assessment. A full ethics statement of NESDA is found elsewhere.
Results were presented with descriptive statistics: qualitative variables with absolute and relative frequencies, quantitative variables with means and standard deviation. Differences between two groups were tested with Chi square test (qualitative variables) and Student's t test (quantitative variables). Logistic regression was used to estimate association of referral with observed parameters. Differences were considered significant when the p-value was < 0.05. All variables with a bivariate correlation with p-value ≤0,150 were eligible for multivariate analysis. We excluded from these variables one of each pair with a mutual correlation > 0.7 and dichotomous variables with less than 5.0% of respondents in one of the groups. For this multivariate analysis, logistic regression was used, with the dichotomous variable "referral" as dependent variable. We used a manual stepwise backward method to remove non-significant variables.
All statistical analyses were performed with the "Statistical Package for the Social Sciences" version 16.0 (SPSS Inc., Chicago).
Of the 344 respondents with MDD, 241 were female and 103 were male with an average age of 45.5 years (SD 11.7). 199 (57.8%) were referred to mental health care and 145 (42.2%) were not. Of the 199 referred, 93 (46.7%) were referred to primary mental health care and 106 (53.3%) to secondary mental health care.
We compared referred and non-referred respondents on the guideline criteria and patient and GP/practice characteristics (table 2). Suicidal tendency, chronic depression (≥12 months with depression in past two years) and perceived need for psychotherapy were more often present in the referred group, these patients were on average younger. None of the GP or practice characteristics were significantly different between groups.
Next, we compared the groups referred to primary and to secondary mental health care (table 3). Having stopped two or more antidepressants and chronic depression, were more common in respondents referred to secondary mental health care.
Subsequently, we tested all variables from table 1 bivariately against the dependent variable "referral". Age and gender were tested, in order to control for them in the model, if they where significant. All variables with a bivariate p-value ≤0.150 were entered into the model, after step-wise backward deletion, only need for (more) psychotherapy and suicidality remained significant, when controlled for age. This model explained eight to eleven percent of variance (table 4).
Finally, we tested whether the number of criteria present would predict the chance of referral. Indeed, referred respondents met significantly more criteria (median 2.00) than non-referred respondents (median 1.00), p = 0.000. Respondents with one or more criteria had an odds ratio of referral compared to respondents without any criteria of 2.70 (95% CI for odds ratio 1.49 - 4.87). Relation between referral and number of criteria is graphically depicted in Figure 1.
Strengths and limitations of the study
Our study has several strong points. First, as a screening method was used to recruit participants and all respondents were interviewed by independent interviewers, GPs were unaware of the psychiatric diagnosis. They could only rely on their own judgement in their treatment decisions, including referral. Second, the use of a structured interview (CIDI) for diagnosis. Third, with the extensive interview of NESDA, almost all relevant criteria for referral could be assessed.
There are also limitations. First, the specific Dutch situation where GPs are gatekeepers to mental health care, rendering it unclear if these results can be generalized to countries with other referral systems. Second, we were unable to examine certain criteria presented in the guideline, such as comorbid personality disorders (also a guideline criterion for referral), as these were not assessed in NESDA. Third, missing data on diagnoses in 30% of the GP EPFs, rendering it impossible to clarify the influence of "recognition" on referral practice. Fourth, we were unable to investigate the influence of symptom severity on referral, as referral was initiated at a different point in time for each participant, while symptom severity was measured at baseline and 1-year follow-up only. The symptom severity at time of referral could be very different from the symptom severity at any of these set points in time.
Comparison with existing literature
Referral rate in our study (almost 58% of patients with MDD in the past year) was high compared to the previous studies. Kendrick et al. reported an overall percentage of 22.8%, including patients with minimal or mild depressive symptoms according to either the 9-item Patient Health Questionnaire or the depression subscale of the Hospital Anxiety and Depression Scale . In the study by Wang et al. 26% of patients with a "mental health visit" and 25% with any visit to their GP were referred to a psychologist or psychiatrist . Finally, Grembowski et al. found that 23% of patients with depressive symptoms were referred, while 38% had contact with a mental health specialist, as this was also possible without referral . These differences are probably a result of different populations of patients and methods for diagnosing depression: GP diagnosis, questionnaires such as Hospital Anxiety and Depression Scale or structured interviews like the CIDI, and different definitions of referral and mental health care. Kendrick et al. included patients with minimal or mild depressive symptoms; Grembowski et al. patients with depressive symptoms, from both groups at least some patients would probably not fulfil criteria for MDD as used in our study [23, 24]; Wang et al. only considered referrals to psychiatrists or psychologists, while we also investigated social workers, social psychiatric nurses, psychotherapists and professionals in institutes for mental health care ; and lastly, the study by Grembowski et al. was performed in the United States where a referral from a GP is not required to see a specialist .
Although none of the studies investigated all of the determinants we did, several of our determinants were investigated by others. Younger age was associated with more referral in our study, and in the study of Wang et al. and Grembowski et al. [14, 24] The incidence of comorbid anxiety disorder did not differ between groups, in line with the study by Simon et al.  Referral rates for males and females were the same in our study in concordance with the studies of Miller et al. and Simon et al., but in contrast to the studies by Grembowski et al. and Kendrick et al. [23–26] Chronic somatic disease did not significantly differ between referred and non-referred patients in our population either, in contrast to the study of Kendrick et al. and Miller et al. [23, 26]
Implications for future research and clinical practice
Our study shows that Dutch GPs use guideline criteria in their decision to refer depressed patients to mental health care. However, the small percentage of explained variance by the guideline criteria for referral in our multivariate model suggests that there is room for further improvement in clinical practice. If GPs would adhere strictly to the guidelines, a higher percentage would have been expected. At the same time, the small percentage of explained variance opens a door toward future research: it shows that also other factors (including patient factors) play a part in the decision making process. Future research should focus on investigating these factors. If we better understand why patients are referred (or not referred), courses on recognition and treatment of depression could educate GPs in these areas so that they might be able to take even better care of their patients. Also, while recommendations towards the need for secondary mental health care in depression are quite clear in most guidelines, the indications and possibilities of primary mental health care are less so. This could also be an interesting field of research.
The majority (210/363; 57.9%) of patients with depression in primary care was referred to a mental health professional while GPs seem to apply the guideline criteria when making decisions about referral. Our hypothesis that all guideline criteria independently increased referral chance, was rejected, still suicide risk, chronic depression and patient preference for psychotherapy rendered referral more likely. Failure of treatment (chronic depression and/or stopped treatment with ≥2 antidepressants) led more often to referral to secondary mental health care.
EP is a GP and PhD-student conducting research on major depressive disorder in general practice.
KM is a emeritus professor in general practice, interested in psychiatric disorders in general practice.
BWJHP is professor of psychiatric epidemiology and PI of NESDA.
PFMV is extraordinary professor of mental health care.
WAN is a professor in psychiatry, with special interest in affective disorders.
Wilson I, Duszynski K, Mant A: A 5-year follow-up of general practice patients experiencing depression. Fam Pract. 2003, 20: 685-689. 10.1093/fampra/cmg611.
Kessler RC, Berglund P, Demler O, Jin R, Koretz D, Merikangas KR, Rush AJ, Walters EE, Wang PS: The epidemiology of major depressive disorder: results from the National Comorbidity Survey Replication (NCS-R). JAMA. 2003, 289: 3095-3105. 10.1001/jama.289.23.3095.
Van Marwijk H, Grundmeijer H, Bijl D, Van Gelderen M, De Haan M, Van Weel-Baumgarten E, Burgers J, Boukes F, Romeijnders A: NHG-standaard depressieve stoornis (depressie) (eerste herziening). Huisarts Wet. 2003, 46: 614-633. 10.1007/BF03083439.
Anderson IM, Ferrier IN, Baldwin RC, Cowen PJ, Howard L, Lewis G, Matthews K, lister-Williams RH, Peveler RC, Scott J, Tylee A: Evidence-based guidelines for treating depressive disorders with antidepressants: a revision of the 2000 British Association for Psychopharmacology guidelines. J Psychopharmacol. 2008, 22: 343-396. 10.1177/0269881107088441.
Sorgaard KW, Sandanger I, Sorensen T, Ingebrigtsen G, Dalgard OS: Mental disorders and referrals to mental health specialists by general practitioners. Soc Psychiatry Psychiatr Epidemiol. 1999, 34: 128-135. 10.1007/s001270050123.
Kravitz RL, Franks P, Feldman M, Meredith LS, Hinton L, Franz C, Duberstein P, Epstein RM: What drives referral from primary care physicians to mental health specialists? A randomized trial using actors portraying depressive symptoms. J Gen Intern Med. 2006, 21: 584-589. 10.1111/j.1525-1497.2006.00411.x.
Stein MB, Sherbourne CD, Craske MG, Means-Christensen A, Bystritsky A, Katon W, Sullivan G, Roy-Byrne PP: Quality of care for primary care patients with anxiety disorders. Am J Psychiatry. 2004, 161: 2230-2237. 10.1176/appi.ajp.161.12.2230.
Penninx BW, Beekman AT, Smit JH, Zitman FG, Nolen WA, Spinhoven P, Cuijpers P, De Jong PJ, van Marwijk HW, Assendelft WJ, van der MK, Verhaak P, Wensing M, De GR, Hoogendijk WJ, Ormel J, van DR: The Netherlands Study of Depression and Anxiety (NESDA): rationale, objectives and methods. Int J Methods Psychiatr Res. 2008, 17: 121-140. 10.1002/mpr.256.
Sunderland M, Andrews G, Slade T, Peters L: Measuring the level of diagnostic concordance and discordance between modules of the CIDI-Short Form and the CIDI-Auto 2.1. Soc Psychiatry Psychiatr Epidemiol. 2010
Patten SB, Brandon-Christie J, Devji J, Sedmak B: Performance of the composite international diagnostic interview short form for major depression in a community sample. Chronic Dis Can. 2000, 21: 68-72.
Wittchen HU, Robins LN, Cottler LB, Sartorius N, Burke JD, Regier D: Cross-cultural feasibility, reliability and sources of variance of the Composite International Diagnostic Interview (CIDI). The Multicentre WHO/ADAMHA Field Trials. Br J Psychiatry. 1991, 159: 645-53, 658. 10.1192/bjp.159.5.645.
Meadows G, Harvey C, Fossey E, Burgess P: Assessing perceived need for mental health care in a community survey: development of the Perceived Need for Care Questionnaire (PNCQ). Soc Psychiatry Psychiatr Epidemiol. 2000, 35: 427-435. 10.1007/s001270050260.
Kendrick T, Dowrick C, McBride A, Howe A, Clarke P, Maisey S, Moore M, Smith PW: Management of depression in UK general practice in relation to scores on depression severity questionnaires: analysis of medical record data. BMJ. 2009, 338: b750-10.1136/bmj.b750.
Grembowski DE, Martin D, Patrick DL, Diehr P, Katon W, Williams B, Engelberg R, Novak L, Dickstein D, Deyo R, Goldberg HI: Managed care, access to mental health specialists, and outcomes among primary care patients with depressive symptoms. J Gen Intern Med. 2002, 17: 258-269. 10.1046/j.1525-1497.2002.10321.x.
We would like to thank all respondents for their participation and Klaas H Groenier, PhD for his statistical assistance for this paper.
The infrastructure for the NESDA study http://www.nesda.nl is funded through the Geestkracht program of the Netherlands Organisation for Health Research and Development (Zon-Mw, grant number 10-000-1002) and is supported by participating universities and mental health care organizations (VU University Medical Center, GGZ inGeest, Arkin, Leiden University Medical Center, GGZ Rivierduinen, University Medical Center Groningen, Lentis, GGZ Friesland, GGZ Drenthe, Scientific Institute for Quality of Healthcare (IQ healthcare), Netherlands Institute for Health Services Research (NIVEL) and Netherlands Institute of Mental Health and Addiction (Trimbos Institute).
There was no additional funding for this study.
Authors and Affiliations
Department of General Practice, University Medical Center Groningen, University of Groningen, Antonius Deusinglaan 1, Postbus 196, 9700, AD, Groningen, The Netherlands
Ellen Piek, Klaas van der Meer & Peter FM Verhaak
Department of Psychiatry, University Medical Center Groningen, University of Groningen, Hanzeplein 1, Postbus 30.001, 9700, RB, Groningen, The Netherlands
Brenda WJH Penninx & Willem A Nolen
Department of Psychiatry, EMGO Institute for Health and Care Research, VU University Medical Center, AJ Ernststraat 887, 1081, HL, Amsterdam, The Netherlands
Brenda WJH Penninx
Department of Psychiatry, Leiden University Medical Center, Leiden, The Netherlands
Brenda WJH Penninx
Netherlands Institute for Health Services Research, Utrecht, The Netherlands
WA Nolen: received grants form the Netherlands Organisation for Health Research and Development, the European Union, the Stanley Medical Research Institute, Astra Zeneca, Eli Lilly, GlaxoSmithKline and Wyeth, received honoraria and speaker's fees from Astra Zeneca, Eli Lilly, Pfizer, Servier and Wyeth and participated in advisory boards of Astra Zeneca, Cyberonics, Pfizer and Servier
EP, KM and WAN designed the study, BWJHP and PFMV critically revised the design. EP did the interpretation of the data and the writing of the manuscript; KM, PFMV and WAN contributed in the interpretation of the data and in writing/supervising of this manuscript. BWJHP critically revised the manuscript. All authors read and approved the final manuscript.
BWJH Penninx is guarantor of the study.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Piek, E., van der Meer, K., Penninx, B.W. et al. Referral of patients with depression to mental health care by Dutch general practitioners: an observational study.
BMC Fam Pract12, 41 (2011). https://doi.org/10.1186/1471-2296-12-41