Barriers to apply cardiovascular prediction rules in primary care: a postal survey
BMC Family Practice volume 8, Article number: 1 (2007)
Although cardiovascular prediction rules are recommended by guidelines to evaluate global cardiovascular risk for primary prevention, they are rarely used in primary care. Little is known about barriers for application. The objective of this study was to evaluate barriers impeding the application of cardiovascular prediction rules in primary prevention.
We performed a postal survey among general physicians in two Swiss Cantons by a purpose designed questionnaire.
356 of 772 dispatched questionnaires were returned (response rate 49.3%). About three quarters (74%) of general physicians rarely or never use cardiovascular prediction rules. Most often stated barriers to apply prediction rules among rarely- or never-users are doubts concerning over-simplification of risk assessment using these instruments (58%) and potential risk of (medical) over-treatment (54%). 57% report that the numerical information resulting from prediction rules is often not helpful for decision-making in practice.
If regular application of cardiovascular prediction rules in primary care is in demand additional interventions are needed to increase acceptance of these tools for patient management among general physicians.
General physicians play an important role for individual directed primary prevention of cardiovascular disease during patient consultation. Their recommendations on life style changes or additional management decisions (like drug treatment) should be based on estimates of global absolute risk [1–3].
Estimation of global cardiovascular risk is challenging and cardiovascular prediction rules have been developed as useful tools for risk estimation [1–3]. Studies have shown, however, that general physicians rarely apply cardiovascular prediction rules [4, 5]. Little is known about barriers for application in daily practice [6, 7].
We performed a postal survey among general physicians in two Swiss Cantons to evaluate barriers impeding the application of cardiovascular prediction rules for primary prevention.
Study design and participants
We conducted a postal survey among physicians in the field of general Medicine (general practitioners and specialists for general internal medicine) working in their own practice in two Swiss regions (Canton of Zurich and Canton of Aargau). The address databases were provided by the regional physician organisations, which cover all practising physicians in each region (Zürcher Ärztegesellschaft for the Canton of Zurich and Aargauischer Ärzteverband for the Canton of Aargau).
In a first survey the numbered questionnaires were sent to all eligible physicians in the Canton of Aargau (n = 386) and to a randomly selected sample in the Canton of Zurich (n = 386 out of 1337). We provided a short introduction letter with the same mailing to explain the context of the study. After three weeks we conducted a second mailing (reminder) among those physicians who did not respond to our first mailing.
The survey was conducted quasi-anonymously to avoid bias caused by social desirability. To reduce the logistic effort for the second mailing, we traced each participant using a tracking number. The Institute for Social and Preventive Medicine, University of Zurich, guaranteed blinding (the authors of the study could not link answers with names of participants).
Based on a literature search and the results of a recent workshop with experts from the health care system including general physicians  we first gathered potential obstacles for application of cardiovascular prediction rule in daily routine.
In a next step, we discussed these possible barriers in a focus group of general physicians in order to derive a set of them, which may explain why cardiovascular prediction rules are not or only rarely applied in practice. Twenty potential obstacles were listed and pilot tested for comprehensibility and additional items in a group of 8 general physicians, who were not involved in the questionnaire development. We interviewed the participating physicians about their understanding and perceptions of the content of the questionnaire. Unclear wording was amended accordingly and integrated in the final form of the questionnaire.
Finally, the questionnaire [see Additional file 1] contained a set of potential barriers covering three different dimensions: (1) Lack of knowledge (like "no overview about all the existing prediction rules"), (2) distrust (like "distrust in the validity of instruments", or "not all important risk factors are included in the prediction rules"), and (3) practicability aspects (like "risk estimation is time consuming"). Labelling of dimensions was not visible for participating physicians. One open-ended question asked for other reasons for "rarely"- or "never"-use of prediction rules.
In addition, we collected data about frequency of use of prediction rules in three categories ("often" defined as at least once a week; "rarely" defined as less than once a week; and "never"). We also asked general physicians to rate usefulness of support measures (like "journal articles" or "workshops") to resolve open questions concerning prediction rules.
Only physicians answering that they "never" or "rarely" use prediction rules were requested to answer questions about obstacles. Our primary interest pertained the frequency of specific obstacles for application of cardiovascular prediction rules among physicians who reported to "rarely" or "never" use those rules.
For our descriptive analysis we used medians and inter-quartile ranges (IQR: 25% and 75% percentiles) for continuous data and proportions for categorical data.
Data analysis was performed with SPSS for Windows, version 12.0.1 (SPSS Inc., Chicago, Illinois).
Out of all 1723 general physicians registered in the two Swiss regions we recruited a study sample of 772 doctors (study flow figure 1). The response rate was 49.3% (380 of 771; one address was invalid). For our further analysis we excluded 24 participants who stated in the questionnaire that they did not work as general physicians anymore. Thus our final dataset consisted of 356 participants. Data quality was high (range for completeness of data for the primary interest: 91 – 96 %).
For characteristics of participants see table 1. The sample consisted of experienced doctors (median time interval since Medical license 25 years, IQR: 18 – 29), most of them working as general practitioners (63.7%).
About three quarters of general physicians (73.9%; 263/356) reported that they "rarely" or "never" used cardiovascular prediction rules, while 22.5% (80/356) reported to use them "often" (13 respondents with missing data). The various prediction rules, which are applied in our sample of general physicians, are listed in table 2.
Reasons not to apply cardiovascular prediction rules
Among the 263 doctors, who used cardiovascular prediction rules "rarely" or "never", the most often stated barriers to apply these instruments were doubts concerning over-simplification of risk assessment and potential risk of over-treatment (for detailed results see figure 2). 58% (152/263) stated that they did not use prediction rules because "a single risk value does not take into account the complex situation of the patient" and 54% (142/263) because "the results of prediction rules may lead to over-treatment (over-use of statins)". 133 of 263 physicians (51%) agreed to the statement "I do not use prediction rules as I know my patients well and can estimate their global risk correctly without a prediction rule".
Statements in the dimension "lack of knowledge" or "aspects of practicability" were chosen much less frequently (range: 4% – 35%). Overall, for 57% (150/263) of respondents "the results of prediction rules often are not helpful for decision making in practice". The open-ended question for other reasons did not reveal different information compared to the predefined categories.
Support to resolve open questions concerning prediction rules
More than one quarter of all respondents (26.7%) stated that they did not need additional support to resolve open questions concerning cardiovascular prediction rules (table 3). Additional information about prediction rules was rated helpful in form of journal articles (26.1%), lectures (19.9%), workshops (27.5%), and more simple prediction rules (24.2%).
About three quarters of general physicians rarely or never use cardiovascular prediction rules in their daily work. Most often stated barriers to apply them are doubts concerning over-simplification of risk assessment with these instruments and potential risk of over-treatment. More than half of respondents stated that they were able to estimate cardiovascular risk correctly without such rules and that information generated with prediction rules is often not helpful for decision-making.
Validity of the findings
Our questionnaire was not formally tested for internal consistency and validity. However, we judge the face validity of our instrument as adequate. We choose a thorough, stepwise development process (literature search; interactive workshop; focus group discussion; pilot testing) that included experts from the health care system and experienced general practitioners. The response rate of about 50% and the completeness of data were acceptably high for a postal survey. In addition, we believe that the quasi-anonymous data collection has further improved validity of results. However, we could not thoroughly evaluate if non-responders of our survey were comparable to responders due to protection of data privacy. The true application rate of cardiovascular prediction rules in daily routine may even be lower as motivated physicians may be over-represented in our study.
Our data fit well with recent qualitative research identifying obstacles to apply cardiovascular risk tables in routine general practice [7, 9]. In those studies barriers related to the instrument (like distrust in the validity of prediction rules), to aspects of environment and society (like marketing efforts of pharmaceutical industry) and to practice routine (like management of single risk factors) were some of the relevant factors. These obstacles were among the most frequent reasons for non-application in our study. Scepticism in cardiovascular prediction rules seems to be considerable among our respondents. The rate of "rarely"- or "never"-users was 74%, which is beyond the results of about 50% reported in recent surveys [4, 5] but fits well with the results of a postal survey among Norwegian general practitioners . In addition, the application of more than five prediction rules with partly diverse outcomes may reflect a general uncertainty even among "often-users" which prediction rule to apply for daily practice.
Estimation of cardiovascular risk
Argumentation of general physicians is not free of contradiction. While 58% argue that a single risk value derived from prediction rules is an oversimplification, 46% state that they use information derived from single risk factors for their decisions. Application of prediction rules may be regarded as oversimplification but evidence exists that even experienced family doctors may estimate global baseline risk less precise than prediction rules despite the moderate accuracy of these tools [11–13]. Risk estimation without prediction rules may be specifically difficult if several risk factors are only mildly or moderately elevated. Family doctors probably misinterpret comprehensive knowledge about their patients as an ability to correctly estimate their global cardiovascular risk. In addition, among some doctors a "treatment reflex" with prescription of lipid-lowering drugs for persons with isolated hyperlipidemia may exist (irrespective of a possibly low global risk like in persons without hypertension, without smoking, and of young age) . The data from our survey support this hypothesis. Thus persons with low absolute risk may receive medical treatment, which is in conflict with the frequently stated concern about medical over-treatment.
Implications for practice
A possible explanation for the rejection of prediction rules might be the judgement that statistical risk information seems to be incompatible with comprehensive and individualised patient care. Acceptance of prediction rules might be higher if family doctors understand risk information as an additional tool beside their clinical experience to tailor recommendations to the individual patient. Given suitable communication measures (like communication training for physicians; educational material for patients; or graphical presentations of individual risk values with average risk estimates of the same age group) , cardiovascular risk estimates derived from prediction rules may strengthen motivation for life style changes as the first choice intervention or drug treatment, where necessary [1, 3].
Controlled trials evaluating the impact of prediction rules on patient management have concentrated on technical aspects (like computerized calculation of global risk and standardized documentation) [15, 16]. However, little is known about which educational intervention is most effective to overcome distrust in prediction rules. A recent Cochrane review has favored interactive workshops rather than didactic presentations to influence professional practice . Respondents of our survey do not seem to favor a specific form of medical education, if any, to resolve their open questions concerning prediction rules. Specific tailored interventions to overcome barriers (like educational outreach visits with audit and feedback as well as computerised reminders linked to the medical record system) have been evaluated in a recent controlled trial . The intervention had no or little impact on the frequency of formal risk assessment.
If regular application of cardiovascular prediction rules in primary care is in demand, additional interventions are needed to increase acceptance of these tools for patient management among general physicians.
De Backer G, Ambrosioni E, Borch-Johnsen K, Brotons C, Cifkova R, Dallongeville J, Ebrahim S, Faergeman O, Graham I, Mancia G, Manger Cats V, Orth-Gomer K, Perk J, Pyorala K, Rodicio JL, Sans S, Sansoy V, Sechtem U, Silber S, Thomsen T, Wood D: European guidelines on cardiovascular disease prevention in clinical practice. Third Joint Task Force of European and Other Societies on Cardiovascular Disease Prevention in Clinical Practice. Eur Heart J. 2003, 24: 1601-1610. 10.1016/S0195-668X(03)00347-6.
Wood D: Joint British recommendations on prevention of coronary heart disease in clinical practice. Heart. 1998, 80: S1-S29.
Anonymous: Executive Summary of The Third Report of The National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, And Treatment of High Blood Cholesterol In Adults (Adult Treatment Panel III). Jama. 2001, 285: 2486-2497. 10.1001/jama.285.19.2486.
De Muylder R, Lorant V, Paulus D, Nackers F, Jeanjean M, Boland B: Obstacles to cardiovascular prevention in general practice. Acta Cardiol. 2004, 59: 119-125. 10.2143/AC.59.2.2005165.
Hobbs FD, Erhardt L: Acceptance of guideline recommendations and perceived implementation of coronary heart disease prevention among primary care physicians in five European countries: the Reassessing European Attitudes about Cardiovascular Treatment (REACT) survey. Fam Pract. 2002, 19: 596-604. 10.1093/fampra/19.6.596.
Backlund L, Skaaner Y, Montgomery H, Bring J, Strender LE: The role of guidelines and the patient's life-style in GPs' management of hypercholesterolaemia. BMC Fam Pract. 2004, 5: 3-10.1186/1471-2296-5-3.
van Steenkiste B, van der Weijden T, Stoffers HE, Grol R: Barriers to implementing cardiovascular risk tables in routine general practice. Scand J Prim Health Care. 2004, 22: 32-37. 10.1080/02813430310004489.
Eichler K, Biller-Andorno N, Traindl O, Tschudi P, Bachmann LM, Steurer J: Kardiovaskuläre "Prediction rules": Was sind Probleme bei der Anwendung? - Resultate der Diskussion in einem Workshop [Cardiovascular prediction rules: Problems for application in practice. - Results of a workshop]. Schweiz Rundsch Med Prax. 2006, 95: 1751-1756.
Fretheim A, Oxman AD, Flottorp S: Improving prescribing of antihypertensive and cholesterol-lowering drugs: a method for identifying and addressing barriers to change. BMC Health Serv Res. 2004, 4: 23-10.1186/1472-6963-4-23.
Fretheim A, Havelsrud K, Flottorp S, Oxman AD: Påvirker takster og refusjonsregler praksis? [Do the fee-for-service and reimbursement influence medical practice?]. Tidsskr Nor Laegeforen. 2003, 123: 795-796.
Jackson R: Guidelines on preventing cardiovascular disease in clinical practice. BMJ. 2000, 320: 659-661. 10.1136/bmj.320.7236.659.
Montgomery AA, Fahey T, MacKintosh C, Sharp DJ, Peters TJ: Estimation of cardiovascular risk in hypertensive patients in primary care. Br J Gen Pract. 2000, 50: 127-128.
Friedmann PD, Brett AS, Mayo-Smith MF: Differences in generalists' and cardiologists' perceptions of cardiovascular risk and the outcomes of preventive therapy in cardiovascular disease. Ann Intern Med. 1996, 124: 414-421.
van Steenkiste B, van der Weijden T, Timmermans D, Vaes J, Stoffers J, Grol R: Patients' ideas, fears and expectations of their coronary risk: barriers for primary prevention. Patient Educ Couns. 2004, 55: 301-307. 10.1016/j.pec.2003.11.005.
Hall LM, Jung RT, Leese GP: Controlled trial of effect of documented cardiovascular risk scores on prescribing. BMJ. 2003, 326: 251-252. 10.1136/bmj.326.7383.251.
Lowensteyn I, Joseph L, Levinton C, Abrahamowicz M, Steinert Y, Grover S: Can computerized risk profiles help patients improve their coronary risk? The results of the Coronary Health Assessment Study (CHAS). Prev Med. 1998, 27: 730-737. 10.1006/pmed.1998.0351.
O'Brien MA, Freemantle N, Oxman AD, Wolf F, Davis DA, Herrin J: Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2001, CD003030-
Fretheim A, Oxman AD, Havelsrud K, Treweek S, Kristoffersen DT, Bjorndal A: Rational Prescribing in Primary Care (RaPP): A Cluster Randomized Trial of a Tailored Intervention. PLoS Med. 2006, 3: e134-10.1371/journal.pmed.0030134.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2296/8/1/prepub
We are grateful to the general physicians who joined the study and completed the questionnaire.
The study was supported by the Helmut Horten Foundation. The funding source had no influence on study design; in the collection, analysis, and interpretation of the data; in the writing of the manuscript; and in the decision to submit the manuscript for publication.
The author(s) declare that they have no competing interests.
JS had the study idea. KE, MZ, PT and JS designed the study. KE was responsible for data acquisition and analysis. All authors made substantial contributions to interpretation of the data. KE and JS drafted the manuscript. All authors were involved in revising the manuscript critically for important intellectual content and have given final approval of the version to be published.
Klaus Eichler, Marco Zoller, Peter Tschudi and Johann Steurer contributed equally to this work.
Electronic supplementary material
Additional file 1: Questionnaire: Potential barriers for application of cardiovascular prediction rules. For descriptive purposes questions are sorted according to dimensions. Labelling of dimensions was not visible for participating physicians. (PDF 17 KB)
About this article
Cite this article
Eichler, K., Zoller, M., Tschudi, P. et al. Barriers to apply cardiovascular prediction rules in primary care: a postal survey. BMC Fam Pract 8, 1 (2007). https://doi.org/10.1186/1471-2296-8-1