Awareness of, attitude toward, and willingness to participate in pay for performance programs among family physicians: a cross-sectional study
BMC Family Practice volume 21, Article number: 60 (2020)
The National Health Insurance Administration of Taiwan has introduced several pay-for-performance programs to improve the quality of healthcare. This study aimed to provide government with evidence-based research findings to help primary care physicians to actively engage in pay-for-performance programs.
We conducted a questionnaire survey among family physicians with age-stratified sampling from September 2016 to December 2017. The structured questionnaire consisted of items including the basic demographics of the surveyee and their awareness of and attitudes toward the strengths and/or weaknesses of the pay-for-performance programs, as well as their subjective norms, and the willingness to participate in the pay-for-performance programs. Univariate analysis and multivariate logistic regression analysis were performed to compare the differences between family physicians who participate in the pay-for-performance programs versus those who did not.
A total of 543 family physicians completed the questionnaire. Among family physicians who participated in the pay-for-performance programs, more had joined the Family Practice Integrated Care Project [Odds ratio (OR): 2.70; 95% Confidence interval (CI): 1.78 ~ 4.09], had a greater awareness of pay-for-performance programs (OR: 2.37; 95% CI: 1.50 ~ 3.83), and a less negative attitude to pay-for-performance programs (OR: 0.50; 95% CI: 0.31 ~ 0.80) after adjusting for age and gender. The major reasons for family physicians who decided to join the pay-for-performance programs included believing the programs help enhance the quality of healthcare (80.8%) and recognizing the benefit of saving health expenditure (63.4%). The causes of unwillingness to join in a pay-for-performance program among non-participants were increased load of administrative works (79.6%) and inadequate understanding of the contents of the pay-for-performance programs (62.9%).
To better motivate family physicians into P4P participation, hosting effective training programs, developing a more transparent formula for assessing financial risk, providing sufficient budget for healthcare quality improvement, and designing a reasonable profit-sharing plan to promote collaboration between different levels of medical institutions are all imperative.
Pay for performance (P4P) programs have become an emerging quality improvement movement in healthcare systems worldwide [1, 2]. They aim at rendering payment for healthcare providers according to their value-based performance . Healthcare facilities and providers are encouraged to observe essential guidelines to provide patients with comprehensive, continuous, and coordinative care through justified incentives for improving both the quality and value of healthcare. The major incentive factor for motivating P4P participation is to help physicians improve health outcome by following clinical guidelines and standard operational procedure [4, 5]. Quite a few P4P programs have been implemented in Taiwan and all over the world in response to the healthcare demands of our increasingly aging global village [6,7,8,9]. In terms of manpower, primary care physicians, especially those specializing in family medicine, form the cornerstone of P4P programs [10, 11].
Taiwan has launched a universal healthcare coverage plan called “National Health Insurance Plan” since 1995. Starting from 2001, the National Health Insurance Administration (NHIA) has selected several common diseases to be handled under “P4P” design with the hope to enhance healthcare quality and efficiency. Diseases currently covered under P4P programs include: diabetes mellitus, asthma, breast cancer, cervical cancer, hypertension, tuberculosis, chronic hepatitis B and C, schizophrenia, early stage chronic kidney disease, comprehensive maternal care for pregnant women, early treatment for development retardation, chronic kidney disease, chronic obstructive lung disease, and others . Moreover, NHIA also has implemented the Family Practice Integrated Care Project (FPICP) since March 2003 to promote community health care group (CHCG)-based practice in the primary care sector, striving to recruit more primary care practitioners to join force in establishing primary community care networks (PCCNs) island-wide in Taiwan . Above all, NHIA P4P programs intend to provide reasonable incentives such as expense reimbursement to drive healthcare providers to deliver holistic and quality care.
All stakeholders, including health plans, physicians, and patients, would benefit from health plans collaborating on their P4P efforts to maximize physician participation . Foels T et al. also suggest that the success of P4P programs for diabetes care is attributed to the engagement of physicians, actionable reports, office-based education, written action plans, and alignment with internal disease management . Cross DA et al. recommend delivering best care through external learning opportunities, and fostering intrinsic motivation to pursue transformational improvements in chronic disease patient care . Girault A et al. suggest increasing clarity in P4P program rules and awareness among hospital staff potential challenges, as well as incentivizing time-consuming quality care to P4P program efficacy . The numbers of P4P programs primary care physicians’ participants in Taiwan are growing but still limited. Therefore, to understand the willingness of family physicians to participate in P4P programs, this study aimed to investigate the following four issues: first, the current status of P4P participation among family physicians in Taiwan; second, the relationship between the characteristics of family physicians and their willingness to participate in P4P programs with a focus on the differences between junior doctors and senior doctors; third, the relationship between family physicians’ awareness of P4P programs, their subjective norms, and their P4P participation willingness; and the last, the determining factors affecting family physicians’ willingness to participate in P4P programs.
The conceptual architecture of this study was modified based on Rosenstock’s Health Belief Model after adding the factors of research interest. (Fig. 1)  The independent variables included physician demographic data (physician traits), and intermediate factors covered physician’s awareness scores on P4P programs, their attitude towards P4P programs, and their subjective norms. The dependent variable or the outcome was “Whether family physicians participate in P4P programs.”
The characteristics of participants
The study conducted a survey during the period from September 2017 to December 2017 on TAFM (the Taiwan Association of Family Medicine) board certified family physicians based on age stratified sampling. At the time of this study, there are 5186 Family Medicine board-certified members in TAFM. As this study would like to explore the active members’ opinion for practice, 725 members aged over 70 years were excluded. The remaining 4461 certified family physicians were placed in four 10-year age groups from 30 to 70 years, with an equal number of participants in each age group selected by random sampling based on their TAFM certificated numbers so as to ensure sample representativeness. We predicted effective sample size of 250 to 500 following the rule of 5 to 10 times the number of questions in the questionnaire, so we aimed to gather 500–600 participants finally [19, 20]. As the response rate of questionnaire survey is estimated 20~25% for doctors in Taiwan, we draw 2000 physicians for final mailing list . We sent the paper questionnaire by mail and electronic version by Email two times through the assistance of TAFM staffs to increase the response rate. We also provided 250 NTD (8 USD) gift card of convenience store for every responder. The study participants were divided into two groups based on duration of practice since first-year residence. Participants with a duration of practice less than 7 years were regarded as junior doctors, and those over 7 years as senior doctors.
A structured questionnaire was developed, covering items concerning the basic demographics of the study participants, their awareness of and attitudes toward the strengths (benefits) and weaknesses (barriers) of P4P programs, their subjective norms, and P4P participation willingness. The characteristics of surveyee included: age, gender, level of affiliated medical institution, CHCG enrollment, and duration of practice. Ten items of the questionnaire aimed at assessing awareness of P4P programs with a respondent scoring either 0 or 1 point for each item. Study participants scoring 7 points or higher were deemed to have a better understanding of P4P programs using last one quantile as baseline. For measuring attitude, a 5-point Likert-type scale based on the degree of agreement and importance was used for understanding the opinions of the study participants about the strengths/benefits and weaknesses/barriers of P4P programs. A higher score, defined as 18 points or over in a total of 30 points, indicated a more positive attitude toward P4P programs assuming the last one quantile as baseline. The subjective norms of the surveyed family physicians, that is, the people, places, events, or other factors that might affect P4P participation, were also measured by a 5-point Likert-type scale whose total score read 20 points, and a score reaching or exceeding 12 points was regarded as relatively higher subjective norms assuming the last one quantile as baseline.. With respect to the measurement of P4P participation willingness, another 5-point Likert-type scale was used to examine positive as well as negative affecting factors with 4 or 5 points defined as a higher score indicating greater willingness providing the last one quantile as baseline.
Five experts were invited to assess the validity of the questionnaire content, paying special attention to whether the content was relevant and the text clear. In terms of surface validity, the questionnaire was pre-tested by 10 resident medical doctors to facilitate correction of the textual language and safeguard its clarity. We performed the reliability and validity testing for the questionnaire. The overall content validity index was 0.98 regarding importance as well as adequacy. The confirmatory factor analysis of the eight-factor model without cross-loadings shows that the Cronbach’s alpha estimates for the composite measures range from 0.71 to 0.86, indicating acceptable internal consistency. The values of the composite reliability for the composite measures range from 0.69 to 0.86. For the convergent validity, the estimates of the factor loadings of the single-item measures into the composites are all significant at p < 0.0001. The correlations among the eight composites range from − 0.45 to 0.86.
The study was approved by the Institutional Review Board of Clinical Ethics at National Taiwan University Hospital (NO. 201702014RIND) and funded by grants from the Ministry of Scientific Technology, Taiwan (MOST 106–2314-B-002 -110) and the TAFM.
Univariate analysis was used to calculate the frequency for each item, including demographics, awareness, attitudes, subjective norms, and willingness. The differences between the two groups of P4P-participating and non-participating family physicians were examined by t test for continuous variables, such as age, knowledge, and subjective norms. Chi-square test was performed to compare categorical variables, including, gender, level of affiliated medical institution, CHCG participation, and subjective norms, etc. Logistic regression analysis was conducted to assess the above variables’ effects on P4P participation willingness. We analyzed the data using SAS/STAT® software and SPSS 20 software for statistics. Statistical significance was set a p-value < 0.05.
Of the 2000 sampled family physicians, 543 completed the questionnaire, resulting in a response rate of 27.2%. The mean age of the respondents was 48.1 ± 12.6 years old. 49.0% of them had joined at least one P4P program, and the top three higher P4P programs participation are diabetes (34.4%), early stage CKD (30.0%), as well as asthma (12.5%). 67.7% were primary health care providers in community settings, and 78.3% worked in private clinics. Most (82.4%) of them had been family physicians for at least 7 years since first-year residence. P4P participants and non-participants showed no difference in gender, mean age, work area, and duration of practice. Working in public medical institutions or hospitals, participating in the FPICP, and sufficient self-reported understanding of P4P programs appeared to indicate a greater willingness to participate in P4P programs. (p < 0.001) (Table 1).
Table 2 shows the awareness of and attitude toward P4P programs between participants and non-participants. The P4P participation rate of the surveyed family physicians marked with a higher awareness score was higher than that of those reporting a lower awareness score (54.4% vs. 33.8%; p < 0.001). Regarding attitude towards P4P programs, for strengths and benefits, the surveyee showing higher scores in either agreement or importance were more likely to participate in P4P programs. (52.1% vs. 31.3, and 53.2% vs. 24.4%). For weaknesses and barriers, those reporting lower scores in agreement and importance were more likely to participate in P4P programs. (62.6% vs. 45.1 and 58.6% vs. 49.4%; p < 0.01).
In terms of subjective norms that might affect P4P participation decision, NHIA (79.0%), peers/colleagues (67.4%), public health bureaus (61.1%) and senior doctors (56.4%) appeared to be the top four affecting factors. (Table 3) Regarding the surveyee’ perceptions about P4P programs that might affect their participation willingness, more than half of them who agreed on issues like the benefits of P4P programs in promoting healthcare quality and reducing NHI expenditure showed greater willingness to participate in the P4P programs. As for perceptions that might dampen participation willingness, P4P-participating respondents outnumbered their non-participating counterparts in registering disagreement on the following items: “It is not easy for P4P programs to demonstrate the healthcare quality they claims to improve,” (28.4% vs. 14.2%) “Participation in P4P programs involves steep financial risk,” (29.2% vs. 16.7%), “It is not an easy task understanding P4P programs,” (13.9% vs. 5.8%) and “Current reward incentives and quality and other related indicators are not satisfying enough to induce my P4P participation willingness” (19.3% vs. 9.5%; (p < 0.01). (Table 4).
As shown in Table 5, over 80% of the surveyed family physicians agreed on all of the four suggested measures for increasing P4P participation willingness, including hosting training programs to facilitate better understanding about P4P programs, developing a more transparent formula for assessing financial risk, providing adequate budget to improve healthcare quality, and drafting a reasonable profit-sharing plan to expedite collaboration between different levels of medical institutions (p < 0.01).
Results of univariate logistic regression analysis indicated that the surveyed family physicians marked with a better understanding about P4P programs, higher subjective norms, a more positive attitude toward P4P programs, and FPICP participation were respectively 2.65 times (95%C.I.:1.72~ 4.09), 2.60 times (95%C.I.:1.44~ 4.68), 2.37 times (95%C.I.:1.33~ 4.25), and 2.27 times (95%C.I.:1.56~ 3.31) more likely to participate in P4P programs. On the contrary, those showing a more negative attitude toward P4P programs were 55% (95%C.I.: 29%~ 71%) less likely to participate in P4P programs. After adjustment for the age and gender, the most striking factors affecting P4P participation willingness were FPICP participation (2.70 times, 95%C.I.:1.78~ 4.09), better understanding about P4P programs (2.39 times, 95%C.I.:1.50~ 3.83), as well as a negative attitude toward P4P programs (0.50 times, 95%C.I.:0.31~ 0.8). (Table 6).
To the best of our knowledge, this study is the first one aiming to understand the current status of P4P participation among family physicians in Taiwan. It provides public health government with evidence-based research findings to help primary care physicians to actively engage in P4P programs. The main results identified the following major affecting factors for family physicians to join the P4P programs: better awareness and understanding of P4P programs, currently FPICP participants, and a less negative attitude toward P4P programs.
Consistent with previously reported results, our study indicates that better awareness of P4P programs is associated with greater willingness to participate in P4P programs [11, 22]. However, the P4P programs participation rate is still low(< 35%) from the result of this study. Fisher ES found that the major weaknesses and barriers lie in the modest magnitude of incentives from resistance or indifference among physicians and the actual realization of quality improvement . Our study indicates that neither age nor duration of practice are significant factors affecting P4P participation willingness, but the surveyed family physicians showing a more positive attitude toward P4P programs through recognition of more benefits and less barriers are more willing to participate in P4P programs. It is worth noting that more than three-fourths of the surveyee still disclose a low understanding about P4P programs. As the main workforce of P4P programs comes from primary care physicians, the results of our study can persuade the government health authorities to promote better understanding of P4P programs among family physicians.
Table 3 points out that the surveyee likely to be affected by NHIA and public health bureaus but unlikely to be affected by their families seemed more inclined to participate in P4P programs. They seem to concern more about issues related to payment, governance, and peers influence. Berendsen AJ et al. found that ‘developing personal relationships’ and ‘gaining mutual respect’ appear to dominate as the motivational factors to develop new collaborative care model . Nevertheless, issues concerning physicians’ decreased clinical autonomy and loss of professionalism need to be addressed with considerable care and sensitivity while implementing P4P programs [24,25,26]. A systematic review conducted by Mendelson et al. in 2017 emphasized that value-based payments are likely to improve quality of care and reduce costs . In other words, we need more evidence-based studies on the long term outcome of P4P programs to convince primary care physicians to participate in P4P programs for quality improvement in healthcare. Using diabetic care as an example, in Taiwan, most related studies show that diabetes P4P programs result in favorable outcome in process (examining HbA1C, LDL), patient outcome (decreasing mortality, nephropathy, and cost-effectiveness analyses) [28,29,30,31]. The other limitations of P4P initiatives for physicians in designing and implementing P4P programs include cost consideration, standardized reward systems, rewards allocation among team members, and barriers to organizational changes aiming at influencing the behaviors of individual physicians [32, 33]. Above all, the importance of effective and efficient delivery of accurate information to primary care physicians cannot be overemphasized as it certainly helps enhance their willingness to participate in P4P programs. The payment system needs to be revamped in a way that render physicians more willing to invest in the value-based payment model for quality healthcare. And less administrative procedures and paperwork should be taken a priority for lowering the barrier against P4P participation among family physicians [8, 34].
As to limitations of this study, in spite of our effort to ensure sample representativeness by doing our best to perform systemic age-stratified random sampling, our cross-sectional questionnaire survey relies mainly on the NHIA data of family physicians. Moreover, due to our exclusive focus on family physicians, the findings of the study may not be applicable to physicians of other medical specialties. Further studies are needed to explore whether primary care physicians of other specialties demonstrate similar attitudes and concerns related to P4P participation. It should also be noted that, because of limited time, our study did not incorporate all the constructs from providers’ perspectives, such as clinical relevance, cooperation, unintended consequences, control, financial salience, and impact .
Our finding suggests that P4P program design, and the experience of P4P participants are key issues demanding careful consideration in facilitating sustainable development of P4P programs. To better motivate family physicians into P4P participation, this study recommends increasing physicians’ awareness and understanding of P4P programs, providing technical and educational support, reducing administrative burden, forging a cooperative relationship with other medical facilities or healthcare providers, developing more accurate quality measures, and minimizing unintended consequences.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Community Health Care Group
Family Practice Integrated Care Project
Low density lipoprotein
National Health Insurance Administration
Pay for performance
Primary Community Care Network
Taiwan Society of Family Medicine
Eijkenaar F, Emmert M, Scheppach M, Schoffski O. Effects of pay for performance in health care: a systematic review of systematic reviews. Health Policy (Amsterdam, Netherlands). 2013;110(2–3):115–30.
Glickman SW, Peterson ED. Innovative health reform models: pay-for-performance initiatives. Am J Manag Care. 2009;15(10 Suppl):S300–5.
VanLare JM, Conway PH. Value-based purchasing--national programs to move from volume to value. N Engl J Med. 2012;367(4):292–5.
Committee on Quality of HealthCare in America IoM. Crossing the quality chasm : a new health system for the 21st century. Washington, D.C: National Academy Press; 2001.
Ouwens M, Wollersheim H, Hermens R, Hulscher M, Grol R. Integrated care programmes for chronically ill patients: a review of systematic reviews. Int J Qual Health Care. 2005;17(2):141–6.
Roland M. Linking physicians' pay to the quality of care--a major experiment in the United Kingdom. N Engl J Med. 2004;351(14):1448–54.
Campbell SM, Reeves D, Kontopantelis E, Sibbald B, Roland M. Effects of pay for performance on the quality of primary care in England. N Engl J Med. 2009;361(4):368–78.
Gillam SJ, Siriwardena AN, Steel N. Pay-for-performance in the United Kingdom: impact of the quality and outcomes framework: a systematic review. Ann Fam Med. 2012;10(5):461–8.
Organisation for Economic C-o, Development. Paying for Performance in Health Care Implications for Health System Performance and Accountability. Buckingham: Open University Press - McGraw-Hill; 2014.
Berendsen AJ, Benneker WH, Schuling J, Rijkers-Koorn N, Slaets JP, Meyboom-de Jong B. Collaboration with general practitioners: preferences of medical specialists--a qualitative study. BMC Health Serv Res. 2006;6:155.
Berendsen AJ, Benneker WH, Meyboom-de Jong B, Klazinga NS, Schuling J. Motives and preferences of general practitioners for new collaboration models with medical specialists: a qualitative study. BMC Health Serv Res. 2007;7:4.
National Health Insurance Administration MoHaW, Executive Yuan: Taiwan 2017–2018 National Health Insurance Annual Report. 2018.
Jan CF, Chiu TY, Chen CY, Guo FR, Lee MC. A 10-year review of health care reform on family practice integrated care project-Taiwan experience. Fam Pract. 2018;35(4):352–7.
de Brantes FS, D'Andrea BG. Physicians respond to pay-for-performance incentives: larger incentives yield greater participation. Am J Manag Care. 2009;15(5):305–10.
Foels T, Hewner S. Integrating pay for performance with educational strategies to improve diabetes care. Popul Health Manage. 2009;12(3):121–9.
Cross DA, Nong P, Harris-Lemak C, Cohen GR, Linden A, Adler-Milstein J. Practice strategies to improve primary care for chronic disease patients under a pay-for-value program. Healthc (Amst). 2019;7(1):30–37.
Girault A, Bellanger M, Lalloue B, Loirat P, Moisdon JC, Minvielle E. Implementing hospital pay-for-performance: Lessons learned from the French pilot program. Health Policy (Amsterdam, Netherlands). 2017;121(4):407–17.
Rosenstock IM, Strecher VJ, Becker MH. Social learning theory and the health belief model. Health Educ Q. 1988;15(2):175–83.
Tinsley HEA, Tinsley DJ. Uses of factor-analysis in counseling psychology research. J Couns Psychol. 1987;34(4):414–24.
Comrey AL. Factor-analytic methods of scale development in personality and clinical psychology. J Consult Clin Psychol. 1988;56(5):754–61.
Sudman S. Sample-Surveys. Annu Rev Sociol. 1976;2:107–20.
McDonald R, Roland M. Pay for performance in primary care in England and California: comparison of unintended consequences. Ann Fam Med. 2009;7(2):121–7.
Fisher ES. Paying for performance--risks and recommendations. N Engl J Med. 2006;355(18):1845–7.
Lester H, Matharu T, Mohammed MA, Lester D, Foskett-Tharby R. Implementation of pay for performance in primary care: a qualitative study 8 years after introduction. Br J Gen Pract. 2013;63(611):e408–15.
Roberts ET, Zaslavsky AM, McWilliams JM. The value-based payment modifier: program outcomes and implications for disparities. Ann Intern Med. 2018;168(4):255–65.
Saint-Lary O, Bernard E, Sicsic J, Plu I, Francois-Purssell I, Franc C. Why did most French GPs choose not to join the voluntary national pay-for-performance program? PLoS One. 2013;8(9):e72684.
Mendelson A, Kondo K, Damberg C, Low A, Motúapuaka M, Freeman M, O'neil M, Relevo R, Kansagara D. The effects of pay-for-performance programs on health, health care use, and processes of care: a systematic review. Ann Intern Med. 2017;166(5):341–53.
Cheng SH, Lee TT, Chen CC. A longitudinal examination of a pay-for-performance program for diabetes care: evidence from a natural experiment. Med Care. 2012;50(2):109–16.
Chen HJ, Huang N, Chen LS, Chou YJ, Li CP, Wu CY, Chang YC. Does pay-for-performance program increase providers adherence to guidelines for managing hepatitis B and hepatitis C virus infection in Taiwan? PLoS One. 2016;11(8):e0161002.
Hsieh HM, Lin TH, Lee IC, Huang CJ, Shin SJ, Chiu HC. The association between participation in a pay-for-performance program and macrovascular complications in patients with type 2 diabetes in Taiwan: a nationwide population-based cohort study. Prev Med. 2016;85:53–9.
Liao PJ, Lin TY, Wang TC, Ting MK, Wu IW, Huang HT, Wang FC, Chang HC, Hsu KH. Long-term and interactive effects of pay-for-performance interventions among diabetic nephropathy patients at the early chronic kidney disease stage. Medicine (Baltimore). 2016;95(14):e3282.
Christianson JB, Knutson DJ, Mazze RS. Physician pay-for-performance. Implementation and research issues. J Gen Intern Med. 2006;21(Suppl 2):S9–s13.
Lee JY, Lee SI, Jo MW. Lessons from healthcare providers' attitudes toward pay-for-performance: what should purchasers consider in designing and implementing a successful program? J Prev Med Public Health. 2012;45(3):137–47.
Roland M, Olesen F. Can pay for performance improve the quality of primary care? BMJ. 2016;354:i4058.
Meterko M, Young GJ, White B, Bokhour BG, Burgess JF Jr, Berlowitz D, Guldin MR, Nealon Seibert M. Provider attitudes toward pay-for-performance programs: development and validation of a measurement instrument. Health Serv Res. 2006;41(5):1959–78.
We gratefully thank Taiwan Ministry of Scientific Technology for grant support and Taiwan Association of Family Medicine (TAFM) for administrative support. We also thank Department of Medical Research, National Taiwan University Hospital for their precious review and suggestions in improving the draft.
Grants from the Ministry of Scientific Technology, Taiwan (MOST 106–2314-B-002 -110) and the Taiwan Society for Family Medicine (TAFM).
Ethics approval and consent to participate
The study was approved by the Institutional Review Board of Clinical Ethics at National Taiwan University Hospital (NO. 201702014RIND) Written informed consent was obtained from all the participants.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Jan, CF., Lee, MC., Chiu, CM. et al. Awareness of, attitude toward, and willingness to participate in pay for performance programs among family physicians: a cross-sectional study. BMC Fam Pract 21, 60 (2020). https://doi.org/10.1186/s12875-020-01118-9