Skip to main content

Development of a competency model for general practitioners after standardized residency training in China by a modified Delphi method

Abstract

Background

The “5 + 3” residency training is the main stream general practitioner training program in China. However, a competency model is absent for evaluating the clinical competence attained by general practitioners after training. This study was conducted to develop a consensus set of competencies for general practitioners after standardized residency training in China.

Methods

A modified Delphi process was deployed to develop the competency model, including two stages: (1) generation of an initial set of competencies derived from literature review, behavioral observation of GP–patient consultations, and critical incidents interview of GPs; (2) a 2-round, web-based Delphi survey of experts in general practice, selected using purposive sampling, to prioritize and gain consensus on the essential competencies of GPs.

Results

From literature review, behavioral observation, and critical incidents interview, 46 competencies in 7 domains were identified. After two rounds of Delphi survey of 28 participants (the mean age was 47.9 [9.3] years and 64.3% were women) representing a range of health professionals (GPs, managers, and researchers), a consensus was reached on 50 competencies categorized into 7 domains.

Conclusion

A consensus-based competency model for general practitioners in China has been identified which may be used to evaluate the general practitioners’ clinical competence after standardized training.

Peer Review reports

Background

Primary health care (PHC) plays a very crucial role in high-performing health care system. In recent years, hospital-centric health delivery system was prevailing in China, in which patients preferred to get medical services in large public tertiary hospitals rather than PHC institutions, leading to a perception of health services as “too difficult to access and too expensive” [1]. Therefore, several policies have been introduced to improve PHC system in China to provide citizens with affordable and equitable access to basic health care [2,3,4]. In 2019, Chinese government invested ¥215 billion to PHC institutions [5], increased by nearly eightfold from ¥27 billion in 2009 [6]. With strong support of the government, primary care network was widely developed around China. According to the statistics in 2019, there were 954,390 PHC institutions across China, with 4.53 billion PHC visits (accounting for 52.0% of the total visits) [7], increased by 58.9% in comparison with the PHC visits in 2009 [8].

General practitioners (GPs) are the first contact for patients within PHC system, who are often considered as “gatekeepers” of patients’ health in China. In 2011, there are three GP training models: (1) the “5 + 3” residency training model (5-year undergraduate medical education followed by 3-year standardized residency training), (2) the on-job training (1-year training for doctors who want to register as GP), (3) the “3 + 2” rural GP residency training (3-year junior college medical education followed by 2-year rural residency training) [9]. Trainees will register as GP upon completion of the “5 + 3” residency training or the on-job training and work in community health service institutions (CHSIs) or general practice department in hospitals. Trainees who have completed the “3 + 2” rural GP residency training will register as assistant GP and work in village clinics or township hospitals. The “5 + 3” residency training is the mainstream GP training program. There are general practice curriculums during undergraduate medical education, including didactic courses of basic theories and concepts of general practice, as well as CHSI-based learning designed to acquire the preliminary impression of PHC institutions. The 3-year standardized residency training for GP includes two stages: (1) hospital-based clinical rotation and (2) CHSI-based training [10, 11]. According to statistics in 2019, there were 365,000 GPs in China, with 2.61 GPs for per ten thousand population [6], and the goal was at least 2–3 GPs per ten thousand residents in 2020 [9, 12].

Recently, promoting professionalism has become an explicit objective in GP training. Evaluation of professional competence is a vital element of this initiative. Professional competence in medicine was defined as “the habitual and judicious use of communication, knowledge, technical skills, clinical reasoning, emotions, values, and reflection in daily practice for the benefit of the individual and community being served” by Epstein and Hundert in JAMA [13]. There were practical competency models in developed countries, such as the European Definition of General Practice/Family Medicine in Europe [14], CanMEDS-FM 2017 in Canada [15], The Family Medicine Milestone Project in the US [16], Workplace Based Assessment and Annual Review of Competence Progression guidance in the UK [17], and Competency profile of the Australian general practitioner at the point of fellowship in Australia [18].

In China, the evaluation of GPs’ abilities in the “5 + 3” residency training is mainly focused on process assessment, including case report, examination, objective structured clinical examination (OSCE) [19]. In recent years, many researchers have tried to explore the competencies required for the role of GP. However, only three concentrated on assessment of the clinical ability of GP trainees at the end of training process, none of them explored the performance and competency of GPs after training based on the workplace [20]. As competency-based training model was embraced in China, the evaluation of competency of GP after training in workplace was an important feedback of “5 + 3” residency training program. In response to this need, this research was conducted to develop a competency model used for evaluation of GPs after the “5 + 3” residency training.

Methods

Design

This was a study of developing competency model for general practitioners through a modified Delphi method. The Delphi method is a structured process for consensus-building among a diverse group of experts. The approach has commonly been adopted in medical research and remains today the most widely used method for selecting quality indicators in healthcare [21, 22]. The process ends when an agreement has been reached on the discussed topics. According to previous studies, two or three rounds are frequently used in the Delphi process [23, 24]. This study involved two rounds of questionnaires to an expert panel via e-mail from September to November 2020. All methods in the Delphi process were carried out in accordance with previous studies [23,24,25] and research guideline for the Delphi survey technique [26].

This modified Delphi process was deployed based on two stages: (1) generating an initial set of relevant competencies derived from literature review, behavioral observation of GP–patient consultations, and critical incidents interviews of GPs; (2) conducting a 2-round, web-based Delphi survey of experts in general practice to prioritize and gain consensus on the essential competencies of GPs. Please see Fig. 1 for the process of the Delphi study.

Fig. 1
figure 1

Flow diagram of the process of developing the competency model for general practitioners in China

Participants

A list of eligible experts was initially selected considering the representativeness of potential differences in background, occupational environment and clinical practices. The experts were invited upon the following criteria: (1) working as GP, researcher, or administrative leader in general practice department; (2) having at least 5 years’ working experience in general practice; (3) knowing about the work content of GP; (4) being familiar with “5 + 3” residency training; (5) being from various geographic regions within China. The participants were asked for their willingness to take part in the study. As in previous studies, a sample of at least fifteen has been suggested and more participants can increase the variety of expertise [27, 28]. Finally, 30 eligible experts were invited and 28 experts agreed to participate in this study.

Questionnaire preparation

Potential competencies were generated based on literature review, behavioral observations, and critical incidents interviews.

Literature review

A preliminary list of competencies was constructed from three sources by literature review. Firstly, literature was searched in PubMed and three Chinese databases (China National Knowledge Infrastructure, Wanfang Data, VIP Chinese Periodical Services) with terms commonly used to describe GP (e.g., general practitioner, family physician, family doctor, community health worker), competency (e.g., competency, competencies, core competencies) and evaluation (e.g., evaluation, measurement, tool, indicator). A total of 37 published research papers describing domestic and foreign GPs’ competencies were identified form literature review (references of these 37 papers were shown at supplementary file 1). Secondly, 5 published competency models from international general practice organizations were also identified, including: the World Organization of Family Doctors (WONCA) [14], the College of Family Physicians of Canada (CFPC) [15], the Accreditation Council for Graduate Medical Education (ACGME) [16], the Royal College of General Practitioners (RCGP) [17], the Royal Australian College of General Practitioners (RACGP) [18]. Thirdly, 2 published policy documents of the content and requirement of GP residency training in China were reviewed [11, 29].

Potential competencies were extracted from these sources and screened by a panel of 2 reviewers (YW and FYW, Ph.D. candidates) according to the following criteria: (1) the indicators were used to measure the competency of GP; (2) the indicators were relevant to requirements of GPs’ work in China; (3) the indicators was relevant to the “5 + 3” residency training content. When there were doubts about whether an indicator should be retained, the research team would discuss together to make a decision. There were 88 competencies identified by the screening process.

Behavioral observation

Eleven GPs from 5 community health service institutions (CHSIs) in Beijing with stable amounts of patient visits were observed as a convenience sample. Each participating GP was observed when providing medical care in general practice consultations for one workday during November 2019 to January 2020. All consecutive patients visiting the GPs on the observing workday were recruited in the study with oral agreement. During the observation, patients’ reasons for encounter (RFEs) and medical services provided by GPs were recorded. Three research assistants (YW, FYW, and ZLP, Ph.D. candidates) were trained as observers before the observation. During the observation, the observers were seated in the least intrusive corner of consulting room and will not talk to the GPs and patients. There were 21 competencies related to GPs’ work content identified by the behavioral observation process.

Critical incidents interview

The same 11 GPs as in behavioral observation were invited, 8 GPs participate in the critical incidents interview and 3 GPs declined due to other work or family affairs. During the interview, participants were asked to describe incidents with good effect and incidents with bad effect. Questions were asked based the “STAR Principle”, which included ‘What kind of situation was it at that time?’ (Situation), ‘What was the main task you faced at that time?’ (Task), ‘In that incident, what skills did the you display?’ (Action), ‘What was the final result of this incident?’ (Result). The information from incident interview was taped, transcribed, and coded. Three researchers (YW, FYW, and ZLP, Ph.D. candidates) extracted the information about GPs’ competencies from the incident interview data respectively. When there were doubts about whether a description of competency should be retained, the research team would discuss together to make a decision. There were 35 competencies related to GPs’ work content identified by the critical incidents interview process.

A total of 144 competencies were identified by these three processes above. After deleting duplicate competencies and integrating the competencies with similar dimensions, a preliminary list of 63 potential competencies were constructed. Then, the competencies were discussed in detail one by one in a research team meeting (2 educators and 3 GPs), concentrating on whether these competencies were measurable and wording them by referring to other competency models. The competencies considered as unmeasurable by more than half of the participants were removed. After further removal and integration, 46 potential competencies were left, which were categorized into 7 domains.

Delphi questionnaire

All 46 potential competencies were formatted into Delphi questionnaire. Importance and feasibility of the competencies were rated on a 1–9 Likert scale (1 = not important/feasible; 9 = very important/feasible). Spaces were left for experts to make comments on these existing competencies or recommend new competencies which they considered should be included in.

Delphi survey

First round

The first round of Delphi survey was performed in 4 weeks from September to October 2020. Materials were sent to experts by e-mail, including first-round questionnaire, research background, and basic demographic information collection form. In the first-round questionnaire, experts were asked to rate the importance and feasibility of each competency, and give their comments.

After the first round of Delphi survey, data was collected and analyzed. The median and the distribution of scores (frequency count of answer choices), and comments were reported. For the experts’ comments, including modification, deletion and addition, we sort out and make a summary of comments expressed by at least two participants [30]. If the comments were expressed by two (or more) participants from the same professional field, further discussion was conducted in our research team.

Second round

The second round of Delphi survey was performed from October to November 2020, lasting 4 weeks. The second-round questionnaire was sent to experts who had completed the first-round questionnaire by e-mail. In the second-round questionnaire, the competencies which were achieved consensus level or modified based on comments in the first round were retained for Delphi round 2. New competencies were added based on the suggestion by more than two experts in the first round. Competencies were removed which did not achieved consensus level or was recommended to be removed by more than 2 experts. Along with the second-round questionnaire, graph-based report of the results of the first round was also sent to experts. Importance and feasibility of each competency were rated using the same 1–9 Likert scale as in the first round.

Consensus

There is no definite consensus criteria for the Delphi study [31]. In this study a consensus was reached based on two selection criteria: median score greater than seven on a nine-point scale and at least 75% of panel ratings in the top tertile (7–9) for importance and feasibility.

Statistical analysis

Descriptive analysis was used to describe the characteristics of participates and results. Means [with standard deviation (SD)] were used to report continuous variables, while frequencies (%) were used to report categorical variables. The Data management and analysis were performed using Statistical Package for Social Science (SPSS), version 22.0.

Results

Panel characteristics in Delphi survey

All of the 28 experts participated in both two rounds of Delphi survey. Among them, 21 experts were from Beijing, 2 experts were from Shanghai, and other 5 experts were from 5 provinces of China (Hainan, Zhejiang, Anhui, Hebei, Inner Mongolia). There were more female participants (64.3%) in this panel, and the mean age of the experts was 47.9 years (standard deviation: 9.3 years). Nearly one third of the participants were GPs in CHSI, 39.3% were GPs in hospital, 10.7% were researchers in primary care, and 17.9% were leaders of CHSI. The average length of general practice experience was 14.4 years, with 67.9% experts working for over 10 years in this field. There were 78.6% experts had master or PhD degree and 64.3% experts were with senior grade title (Table 1).

Table 1 Panel characteristics of the Delphi process (n = 28)

First round

In the first round, 44 (95.7%) of the original 46 competencies achieved consensus in round one. The median score of importance and feasibility ranged from 8.00 to 9.00 and 7.00 to 9.00, respectively. The percentage of panel ratings in the top tertile (7–9) for importance and feasibility ranged from 85.7 to 100% and 69.9 to 100%, respectively. There were 2 competencies did not achieve 75.0% agreement in terms of feasibility, which were “3.2 Screen of at risk individuals for population health issues” (69.9% agreement) and “5.5 Allocate external resources of the institution for optimal patient care” (71.4% agreement). The indicator “3.4 Provide chemoprevention care” was recommended to be removed by 2 experts (a GP and a researcher), despite the agreement being achieved. So, three competencies were deleted in the first round.

Description of two domains were modified. “2. Basic Medical Services” was modified into “2. Patient care”. “3. Preventive care and basic public health service” was modified into “3. Basic public health service”. Eight competencies (1.10, 2.3, 2.7, 2.8, 3.7, 4.1, 4.5, and 5.4) were modified based on the experts’ comments. For example, “1.10 Record electronic health information” was modified into “1.10 Use electronic health record system effectively”. New competencies were suggested by 13 of the 28 experts in the first round. Only 7 new competencies were suggested by more than two experts and hence included in the second round (Table 2). Thus, 50 competencies were included in the second round.

Table 2 Results of the Delphi process

Second round

At this step, 50 competencies were evaluated, including retained, modified, and new competencies. In the second round, the median score of importance and feasibility ranged from 7.50 to 9.00 and 7.00 to 9.00, respectively. The percentage of panel ratings in the top tertile (7–9) for importance and feasibility ranged from 85.7 to 100% and 82.1 to 100%, respectively. As a result, more than 75% of the experts gave ratings in the top tertile (7–9) to 50 competencies, all of which had a median of 7 or above and a high degree of consensus was achieved in terms of importance and feasibility. Descriptive statistics including the median and percentage agreement for each indicator is shown in Table 2.

At the end of the Delphi process, 50 competencies finally achieved consensus in the second round in 7 domains: knowledge and skills (10 competencies), patient care (9 competencies), basic public health services (6 competencies), communication (7 competencies), teamwork (6 competencies), professionalism (6 competencies) and education, learning and research (6 competencies) (Table 3).

Table 3 Final competencies in the competency model for general practitioners in China

Discussion

Main finding

This study was a rigorous process, which involved a multi-method approach to analyze behaviors associated with the performance of GP, including literature review, behavioral observation of GP–patient consultation, and critical incidents interview of GP. Then a modified Delphi survey was conducted with 28 general practice experts to achieve consensus on the most essential competencies of GPs after standardized residency training in China. The final consensus set included 50 competencies categorized into 7 domains.

As described in foreign competency models, the competency of GP involved many aspects, such as patient care, communication, professional knowledge and skills, professionalism and practice-based learning [14,15,16,17,18], which were also important for GPs’ role in China. As the first contact for patients within PHC system, the main task of GP is patient care in clinics, including medical care to patients with acute and chronic health problems. Professional knowledge and skills are the foundation of patient care. Effective communication was crucial to doctor-patient relationship [32], which was also indicated by the GPs in critical incidents interview in our study. For general practice, communication and empathy are essential in patient-centered care [33]. In addition, practice-based learning plays a very important role in the improvement of GPs ability, as the evidence or knowledge are clinically relevant and reflect the circumstances of real practice [34]. In the competency model for GPs after standardized residency training in China, the competencies mentioned above were identified as 34 items based on literature, GPs’ work content in China, and the experts’ consensus.

It is notable that there are three aspects special in China: basic public health service, teamwork, and research. To tackle health inequity, providing universal basic public health services for residents is the main goal of the new health reform in China. Since 2009, basic public health service programs have been widely carried out across PHC sectors in China [35], which now includes 14 categories, such as health records management for residents, health education, vaccination, reporting of infectious diseases and public health emergencies, and etc. [36]. GPs in PHC system play key roles in delivering majority of the basic public health services. Therefore, we made an attempt to identify competencies in this domain on the basis of basic public health services programs and the experts’ consensus. Six competencies were identified in an independent domain “3. Basic public health service”. Since 2011, many provinces and cities in China have explored the model of “family doctor contract” services, which help to let patients have their personal doctors and improve the continuity of care based on GP team with a GP, a nurse, and a preventive care physician [1, 37]. The ability of working effectively with others in a collaborative team-based model is emphasized to GPs in China. Besides, collaborative leadership is also an important indicator as GP plays the role of leader in the team. In China, research ability and paper are critical to physicians in career advancement. During the standardized training program, GPs can be trained with the ability of scientific research [11], which should be evaluated. Therefore, three domains of competencies were included in our competency model.

Compared with previous assessment tools of GPs’ competency in China, the competency model for GPs after standardized residency training in this study made improvement on method and content. A literature review of 31 studies evaluating competencies of GPs in China, conducted by our research team before this research, found that more than half of the included studies did not use a psychometrically robust, high-quality instrument to measure the competency of GP [20]. In this study, the competency model for GPs after standardized residency training was developed through a modified Delphi method. The Delphi questionnaire encompassed previous studies regarding GP competencies and published competency models from international general practice organizations [14,15,16,17,18]. In addition, further competencies related to the work content of GPs were added by behavioral observation of GP–patient consultations and critical incidents interview of GPs [25]. These two methods had not been introduced in the process of developing competency assessment tools for Chinese GP before. Besides, for the “5 + 3” residency training model, the evaluation of GP trainees usually focused on process assessment to monitor the progress of training. In this study, we developed a competency model for evaluation of GPs after standardized residency training. In questionnaire preparation, the Content and Rules for Standardized Training of General Practitioners (2019 revised edition) was referred [11]. In Delphi process, the experts were familiar with “5 + 3” residency training. Therefore, this competency model can be used to explore the performance and competency of GPs after standardized residency training in workplace. The results may provide feedback to GPs and trainers of the “5 + 3” residency training model for further improvement.

In this study, the importance and feasibility of the competencies achieved consensus in the Delphi process. This set of competencies provided a basis for competency measurement of GPs after standardized residency training in China, which still needs to be tested in practice in further studies [38]. We suggest compiling these competencies in our model into a questionnaire for self-evaluation by GPs or multi-source assessment by other staff and patients in workplace [39].

Strengths and limitations

The quality of panel experts and their opinions on given topics is seen as key factor of the Delphi technique [40]. In this study, the presence of different professionals (GPs in hospitals, GPs in CHSIs, leaders of CHSIs, and researchers in universities) and geographical areas (28 experts from 7 provinces of China), along with the average length of general practice experience (14.4 years) and similar ratio of experts with GPs in actual practice (64.3% female experts VS 58.0% female GPs in actual practice [6]), suggested that our expert panel represented a broad and experienced group. Furthermore, the response rate of our study was 100% in two rounds of Delphi process. This was a satisfactory result as response rate was a recognized problem in Delphi study. Importantly, this meant that experts had strong interest and active participation in this topic.

There are limitations of this study. First, although experts in this study were from different geographical areas, most of them were from Beijing and the proportion of experts in other provinces was low. They may not adequately represent the full spectrum of views held by individuals in different regions across China. Second, patients’ opinion was not involved in the sources of competency. Patients are the customers and beneficiaries of general practice services, who may give deep insights in health care experience and doctor-patient communication [25]. This should be taken into consideration in further study. The methodology of Delphi process relies on the perception of experts, which may entail further evidence from implementation in real practice settings [41]. Further study is needed to apply this competency model and confirm the validity of these competencies.

Conclusion

Based on a systematic consensus process, the competency model for GPs after standardized residency training in China has been developed and described. This model can be used in self-evaluation and multi-source feedback to explore GPs’ clinical performance and professional behaviour. Before application in general practice, this competency model still need to be validated in a further study.

Availability of data and materials

The data used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

PHC:

Primary health care

GPs:

General practitioners

WONCA:

The World Organization of Family Doctors

CFPC:

The College of Family Physicians of Canada

ACGME:

The Accreditation Council for Graduate Medical Education

RCGP:

The Royal College of General Practitioners

RACGP:

The Royal Australian College of General Practitioners

CHSI:

Community health service institution

RFEs:

Reasons for encounter

References

  1. Li H, Liu K, Gu J, Zhang Y, Qiao Y, Sun X. The development and impact of primary health care in China from 1949 to 2015: a focused review. Int J Health Plann Manage. 2017;32(3):339–50. https://doi.org/10.1002/hpm.2435.

    Article  PubMed  Google Scholar 

  2. Chen Z. Launch of the health-care reform plan in China. Lancet. 2009;373(9672):1322–4. https://doi.org/10.1016/S0140-6736(09)60753-4.

    Article  PubMed  Google Scholar 

  3. State Council of the People’s Republic of China. Opinions on deepening the health care reform [in Chinese]. 2009. http://www.gov.cn/jrzg/2009-04/06/content_1278721.htm. Accessed 17 Feb 2021.

    Google Scholar 

  4. State Council, Central Committee of the Communist Party of China. Guiding opinions of the General Office of the State Council on promoting the construction of hierarchical diagnosis and treatment system [in Chinese]. 2015. http://www.gov.cn/zhengce/content/2015-09/11/content_10158.htm. Accessed 17 Feb 2021.

    Google Scholar 

  5. National Health Commission of the People’s Republic of China. China health statistical yearbook 2020 [in Chinese]. Beijing: Peking Union Medical College Publishing House; 2020.

    Google Scholar 

  6. Ministry of Health of the People’s Republic of China. China health statistical yearbook 2010 [in Chinese]. Beijing: Peking Union Medical College Publishing House; 2010.

    Google Scholar 

  7. National Health Commission of the People’s Republic of China. Statistical communique on the development of health and family planning in China in 2019 [in Chinese]. 2020. http://www.nhc.gov.cn/guihuaxxs/s10748/202006/ebfe31f24cc145b198dd730603ec4442.shtml.

    Google Scholar 

  8. The Central People’s Government of People’s Republic of China. Statistical communique on the development of health and family planning in China in 2009 [in Chinese]. 2010. http://www.gov.cn/gzdt/2010-04/09/content_1576944.htm.

    Google Scholar 

  9. State Council. Guidance of the state council on establishing the general practitioner system [in Chinese]. 2011. http://www.gov.cn/zwgk/2011-07/07/content_1901099.htm. Accessed 17 Feb 2021.

    Google Scholar 

  10. Shao S, Wu T, Guo A, Jin G, Chen R, Zhao Y, Du J, Lu X. The training contents, problems and needs of doctors in urban community health service institutions in China. BMC Fam Pract. 2018;19(1):182. https://doi.org/10.1186/s12875-018-0867-6.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Chinese Medical Doctor Association. The content and standards for standardized residency training (revised in 2019)- general practice training rules [in Chinese]. 2019. http://www.cmda.net/u/cms/www/201911/12161044874h.pdf. Accessed 3 June 2021.

    Google Scholar 

  12. Lian SQ, Chen Q, Yao M, Chi CH, Fetters MD. Training pathways to working as a general practitioner in China. Fam Med. 2019;51:262–70. https://doi.org/10.22454/FamMed.2019.329090.

    Article  PubMed  Google Scholar 

  13. Epstein RM, Hundert EM. Defining and assessing professional competence. JAMA. 2002;287(2):226–35. https://doi.org/10.1001/jama.287.2.226.

    Article  PubMed  Google Scholar 

  14. European Academy of Teachers in General Practice (Network within WONCA Europe). The European definition of general practice/family medicine. 2005. http://www.woncaeurope.org/sites/default/files/documents/Definition%20EURACTshort%20version.pdf. Accessed 17 Feb 2021.

    Google Scholar 

  15. The College of Family Physicians of Canada. CanMEDS-FM 2017: a competency framework for family physicians across the continuum. 2017. https://www.cfpc.ca/canmedsfm/. Accessed 17 Feb 2021.

    Google Scholar 

  16. The Accreditation Council for Graduate Medical Education and The American Board of Family Medicine. The Family Medicine Milestone Project. 2015. http://www.acgme.org/Portals/0/PDFs/Milestones/FamilyMedicineMilestones.pdf. Accessed 17 Feb 2021.

    Google Scholar 

  17. The Royal College of General Practitioners. Workplace Based Assessment (WPBA) competencies. 2016. https://www.rcgp.org.uk/training-exams/mrcgp-exam-overview.aspx. Accessed 17 Feb 2021.

    Google Scholar 

  18. The Royal Australian College of General Practitioners. Competency profile of the Australian general practitioner at the point of fellowship. 2015. https://www.racgp.org.au/FSDEDEV/media/documents/Education/Registrars/Fellowship%20Pathways/FRACGP/Competency-profile.pdf. Accessed 17 Feb 2021.

    Google Scholar 

  19. Zheng JT, Fang J, Dong AM, Kong YX, Fei XW, Chi CH. Reflection and suggestions on teaching and assessment model for standardized residency training of general practitioners [in Chinese]. Chin J Gen Pract. 2019;18(7):694–6. https://doi.org/10.3760/cma.j.issn.1671-7368.2019.07.019.

    Article  Google Scholar 

  20. WeiI Y, Wang FY, Wang MR, Pan ZL, Jin GH, Lu XQ. Recent advances in position-specific competencies evaluation system development for Chinese general practitioners [in Chinese]. Chin Gen Pract. 2021;24(19):2394–400. https://doi.org/10.12114/j.issn.1007-9572.2021.00.103.

  21. Sumsion T. The Delphi technique: an adaptive research tool. Br J Occup Ther. 1998;61(4):153–6. https://doi.org/10.1177/030802269806100403.

    Article  Google Scholar 

  22. Boulkedid R, Abdoul H, Loustau M, Sibony O, Alberti C. Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review. PLoS ONE. 2011;6(6): e20476. https://doi.org/10.1371/journal.pone.0020476.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  23. Jin G, Wei Y, Liu Y, Wang F, Wang M, Zhao Y, et al. Development of type 2 diabetes mellitus quality indicators in general practice by a modified Delphi method in Beijing, China. BMC Fam Pract. 2020;21(1):146. https://doi.org/10.1186/s12875-020-01215-9.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Gagliardi D, Rondinone BM, Mirabile M, Buresti G, Ellwood P, Hery M, et al. The perspective of European researchers of national occupational safety and health institutes for contributing to a European research agenda: a modified Delphi study. BMJ Open. 2017;7(6):e015336. https://doi.org/10.1136/bmjopen-2016-015336.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Patterson F, Ferguson E, Lane P, Farrell K, Martlew J, Wells A. A competency model for general practice: implications for selection, training, and development. Br J Gen Pract. 2000;50(452):188–93.

    CAS  PubMed  PubMed Central  Google Scholar 

  26. Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32(4):1008–15. PMID: 11095242.

    CAS  PubMed  Google Scholar 

  27. Linstone HA, Turoff M. The Delphi survey: method techniques and applications. Reading: Addison-Wesley; 1975.

    Google Scholar 

  28. McMillan SS, King M, Tully MP. How to use the nominal group and Delphi techniques. Int J Clin Pharm. 2016;38(3):655–62. https://doi.org/10.1007/s11096-016-0257-x.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Beijing Municipal Health Commission. Opinions on accelerating the development of community health services [in Chinese]. 2000. http://wjw.beijing.gov.cn/. Accessed 17 Feb 2021.

    Google Scholar 

  30. Madsen MM, Eiset AH, Mackenhauer J, Odby A, Christiansen CF, Kurland L, et al. Selection of quality indicators for hospital-based emergency care in Denmark, informed by a modified-Delphi process. Scand J Trauma Resusc Emerg Med. 2016;24:11. https://doi.org/10.1186/s13049-016-0203-x.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Diamond IR, Grant RC, Feldman BM, Pencharz PB, Ling SC, Moore AM, et al. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol. 2014;67(4):401–9. https://doi.org/10.1016/j.jclinepi.2013.12.002.

    Article  PubMed  Google Scholar 

  32. Wong SYS, Lee A. Communication skills and doctor patient relationship. Hong Kong Med Diary. 2006;11(3):7–9.

    Google Scholar 

  33. Mercer SW, Reynolds W. Empathy and quality care. Br J Gen Pract. 2002;52:S9–12.

    PubMed  PubMed Central  Google Scholar 

  34. Moore DE Jr, Pennington FC. Practice-based learning and improvement. J Contin Educ Health Prof. 2003;23(Suppl 1):S73–80. https://doi.org/10.1002/chp.1340230411.

    Article  PubMed  Google Scholar 

  35. Li T, Lei T, Xie Z, Zhang T. Determinants of basic public health services provision by village doctors in China: using non-communicable diseases management as an example. BMC Health Serv Res. 2016;16:42. https://doi.org/10.1186/s12913-016-1276-y.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Li X, Lu J, Hu S, Cheng KK, De Maeseneer J, Meng Q, et al. The primary health-care system in China. Lancet. 2017;390(10112):2584–94. https://doi.org/10.1016/S0140-6736(17)33109-4.

    Article  PubMed  Google Scholar 

  37. Wang HH, Wang JJ, Wong S, Wong M, Mercer SW, Griffiths S. The development of urban community health centres for strengthening primary care in China: a systematic literature review. Br Med Bull. 2015;116(1):139–53. https://doi.org/10.1093/bmb/ldv043.

    Article  PubMed  Google Scholar 

  38. Campbell S, Kontopantelis E, Hannon K, Burke MJ, Barber A, Lester H. Framework and indicator testing protocol for developing and piloting quality indicators for the UK quality and outcomes framework. BMC Fam Pract. 2011;12(1):85. https://doi.org/10.1186/1471-2296-12-85.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Royal College of General Practitioners. The multi-source feedback (MSF). https://www.rcgp.org.uk/training-exams/training/new-wpba/msf.aspx. Accessed 17 Feb 2021.

  40. Powell C. The Delphi technique: myths and realities. J Adv Nurs. 2003;41(4):376–82. https://doi.org/10.1046/j.1365-2648.2003.02537.x.

    Article  PubMed  Google Scholar 

  41. McGinn CA, Gagnon MP, Shaw N, Sicotte C, Mathieu L, Leduc Y, et al. Users’ perspectives of key factors to implementing electronic health records in Canada: a Delphi study. BMC Med Inform Decis Mak. 2012;12:105. https://doi.org/10.1186/1472-6947-12-105.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors thank the Capital General Practice Research Project (17QK06) for the support. The authors also thank all of the participants for their support and help to our research.

Funding

This work was supported by the Capital General Practice Research Project (17QK06). The funding organization had no role in the design, conduct, analysis and interpretation or preparation of this study.

Author information

Authors and Affiliations

Authors

Contributions

YW and XQL designed the study. XQL obtained funding and ethical approval. YW, FYW, ZLP, MRW, and YLL were responsible for the indicator generation and Delphi survey process and statistical analyses. YW drafted the manuscript. YLL was responsible for the revision of the manuscript. GHJ was responsible for the improvement of the English language within the manuscript. XQL contributed to the interpretation of the results and critical revision of the manuscript for important intellectual content and approved the final version of the manuscript. All authors have read and approved the final manuscript.

Corresponding author

Correspondence to Xiaoqin Lu.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Ethical Committee of Capital Medical University, Beijing, China. Written informed consents were achieved from all the participants in this study. The participants were assured that their information would only be used for analysis in this study. All methods were carried out in accordance with relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

References of the 37 papers by literature review.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wei, Y., Wang, F., Pan, Z. et al. Development of a competency model for general practitioners after standardized residency training in China by a modified Delphi method. BMC Fam Pract 22, 171 (2021). https://doi.org/10.1186/s12875-021-01508-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12875-021-01508-7

Keywords