Skip to main content

What GPs do to meet accreditation standards – implementation activities and perceived improvements attributed to general practice accreditation

Abstract

Background

Healthcare accreditation is a widely implemented tool used to enhance the quality of care and underpin quality control. However, research is sparse on the accreditation process in general practice. The aim of this study was to explore how team-based implementation activities preceding accreditation were associated with self-perceived improvements in emergency preparedness (preparedness for urgent disease and cardiac arrest) and handling of prescription renewals in Danish general practice.

Methods

GPs (general practitioners) completed a questionnaire exploring practice-team activities conducted to implement two specific accreditation standards and the related improvements as perceived by the GPs. The following implementation activities were selected, inspired by Normalization Process Theory: Common understanding (obtaining a common understanding of the purpose of implementing changes according to the accreditation standard), key person (assigning a key person responsible for working with the standard), and easy integration (finding it easy to integrate changes into existing working procedures). Data were analysed with logistic regression, and adjusted analyses included practice type, number of GP partners, number of staff, training site for junior GPs and administrative region.

Results

The total response rate was 74% (n = 920). Around 80% of the clinics reported having conducted team-based implementation activities. Almost half of the clinics (48%) reported perceived improvements in the emergency preparedness, and 30% reported perceived improvements in the handling of prescription renewals. Obtaining a common understanding was found to have a strong, significant association with perceived improvements in the emergency preparedness (OR = 5.07 (3.06–8.40)) and handling of prescription renewals (OR = 3.66 (2.07–6.46)). Easy integration of changes was also significantly associated with improvements in both emergency preparedness (OR = 1.88 (1.24–2.85)) and handling of prescription renewals (OR = 2.34 (1.44–3.79)), whereas assigning a key person was only significantly associated with improved emergency preparedness (OR = 1.95 (1.19–3.19)).

Conclusion

Clinical quality initiatives that involve collaboration within a practice team are more likely to cause improvements if specific team-based implementation activities are conducted. It is particularly important to facilitate a common understanding of the purpose of the initiative. Therefore, external support for quality initiatives aiming at the practice level in general practice should facilitate such team-based activities.

Peer Review reports

Background

Accreditation is defined as an evaluation of an organisation by an accreditation agency based on a set of predefined accreditation standards [1]. The purpose of accreditation is to improve the quality and safety of care and to underpin quality control [2, 3]. Accreditation was introduced in the primary healthcare sector in Australia in the 1990s and has been used in the secondary healthcare sector since the beginning of the 20th century [4]. Since then, a number of countries, including the USA, New Zealand and many European countries, have developed accreditation programmes for general practice [2]. Despite the widespread use of healthcare accreditation, research on its implementation and influence on clinical practice in general practice is sparse [2].

In Denmark, a mandatory accreditation programme for general practice was rolled out in 2016–2018 [5]. The Danish Institute for Quality and Accreditation in Healthcare (IKAS), which is an impartial institution, developed and managed the accreditation programme. The standards and indicators were developed by IKAS in collaboration with representatives from the Organization of General Practitioners in Denmark, the Danish College of General Practitioners, Danish Regions, Danish Patients and the Danish Association of Practicing Medical Specialists [6]. The clinics were advised one year in advance about the date of their accreditation survey and were offered support through training courses and workshops, and they were offered on-line information and access to consultants [7]. On this date, the clinic received a visit from two surveyors: a general practitioner (GP) and a practice staff. After the visit, the surveyors prepared a report based on their assessment; this report was used by the accreditation board to decide whether the clinic was eligible for accreditation [5]. The clinics were evaluated based on 16 quality standards containing indicators about professional quality, organisational quality and patient-perceived quality [5]. The standards formed a framework intended to stimulate reflection and inspire quality improvement activities [8]. However, another purpose of the programme was quality control, and many GPs were sceptical and perceived the mandatory accreditation programme as an external control tool [9]. Each clinic received 20,000 Danish kroner (approximately €2650) per GP in the clinic for their participation in the accreditation programme. The clinics received half of the amount in advance and the rest when the clinic was accredited [10].

Attaining successful implementation of complex interventions, such as accreditation, is a challenge [11, 12]. Studies on healthcare accreditation show that implementation is influenced by a variety of factors at the individual, group, structural and organizational levels [11, 13]. In the Danish accreditation programme, only 1.2% of general practice clinics failed to become accredited [14]. Still, a qualitative study shows that the implementation varied markedly; some clinics changed only very few elements, whereas other clinics made many considerable changes in response to accreditation [10]. Moreover, some studies report that the implemented changes are not always perceived to measure up to the efforts made and that the implementation process is challenging [6, 10]. Yet, interventions with external inspections, such as accreditation, have the ability to engage and involve staff, facilitate leader engagement, improve communication and enable the creation of new networks for reflection on clinical practice. Also, inspections can contribute to creating an awareness of the inspected organisation’s current practice and performance gaps, and a commitment to change and facilitate planning and implementation of change [15]. Quantitative studies of the extent of the effect are few in a general practice setting [16, 17], and results include positive, negative and mixed results [18,19,20,21]. To our knowledge, no quantitative studies investigate associations between implementation and[16] effects of general practice accreditation.

The aim of this study is to explore how team-based implementation activities preceding accreditation are associated with self-perceived improvements in the emergency preparedness (preparedness for urgent disease and cardiac arrest) and handling of prescription renewals in a general practice setting.

Methods

Setting

In Denmark, general practice is the primary entry point to the healthcare system, and general practice acts as a gatekeeper to the more specialised parts of the healthcare system [22]. GPs are self-employed, and their clinics can be organised as individual clinics with only one GP or in different types of partnership practices [23]. Most clinics employ staff members, such as practice nurses and receptionists, and approximately half of the clinics have GP trainees [23].

Study design and participants

This is a cross-sectional study of the implementation of two specific standards in the Danish accreditation programme for general practice: emergency preparedness and handling of prescription renewals (Fig. 1). These specific standards were chosen as they are both concerned with patient care and therefore expected to be prioritized by the respondents. Though both standards are patient-centered, they are vastly different; the standard on emergency preparedness refers to rare incidents that the clinic must be prepared for, while the standard on handling of prescription renewals is a daily, routine task.

Fig. 1
figure 1

The standards of emergency preparedness and handling of prescription renewals

The paper conforms to the STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) Standards [24].

Participants included general practice clinics conducting their accreditation survey between 27 and 2016 and 31 December 2018. After the accreditation survey, the participants received a questionnaire about their experiences with the accreditation process. The questionnaire was handed out by the visiting GP surveyor immediately after completion of the survey. The surveyor invited the GP who was most deeply involved in the accreditation to answer the questionnaire on behalf of the clinic. If the questionnaire had not been returned within two weeks, the clinics received a reminder and a new questionnaire as well as a postage-paid return envelope by regular mail.

The questionnaire consisted of 26 questions covering different aspects of the accreditation programme, including the conducted team-based implementation activities, the experience with the change process and the perceived effect of specific clinical standards included in the accreditation programme.

The questionnaire underwent a pilot test among 14 participants, including surveyors, GPs who had just completed their accreditation survey, and experienced researchers in general practice. Six of the informants gave verbal feedback to the interviewer, using cognitive interviewing techniques, during the completion of the questionnaire, whereas eight of them gave verbal feedback after completing the questionnaire [25]. In the pilot phase, the questionnaire was continually revised.

Theoretical framework

Normalization Process Theory (NPT) provides a useful framework to gain insight into the mechanisms governing the implementation of changes in small organizations, such as general practice clinics. It was developed to describe how new interventions are introduced in various settings, and how they become routines in everyday practice [26, 27]. NPT mainly focuses on how people work together in the implementation process and is less concerned with individual intentions or attitudes [28]. The theory describes four mechanisms, which are driven by different types of team-based implementation activities that motivate and shape implementation processes [28]. [22][29]. Coherence describes the ways participants make sense of the intervention. Cognitive participation focuses on the ways participants engage in the initial implementation activities. Collective action relates to the way participants support the initial implementation by investing skills and resources in the intervention. Finally, reflexive monitoring refers to the individual and collective assessment of the implementation and how it affects the participants [29]. Each of the four constructs contain multiple sub-constructs exploring different aspects of the main construct.

The Normalisation MeAsure Development (NoMAD) instrument derives from NPT and can be used to quantitatively measure team-based implementation activities and their outcomes [28, 30]. It consists of 25 questions covering all NPT sub-constructs which assess the team-based implementation activities from the perspective of the professionals who are directly involved in the activities [28, 30].

Team-based implementation activities

In this study, we explored three specific NPT sub-constructs within implementation: Communal specification (coherence), interactional workability (collective action), and initiation (cognitive participation). To operationalize the sub-constructs, three NoMAD questions were included in the questionnaire. A professional interpreter translated the questions and, together with the researchers, made a culturally adaptation to fit a GP setting and the context of the study (Table 1).

Table 1 NPT constructs and sub-constructs used to explore team-based implementation activities

Coherence and collective action were assessed on a five-point Likert scale comprising ‘mainly agree’, ‘partly agree’, ‘neither agree nor disagree’, ‘partly disagree’ or ‘mainly disagree’. In the analyses, they were dichotomised and ‘occurrence of implementation activity’ included the first two response options. Cognitive participation was assessed through a Yes/No question, with the option to report the professional background of potential key person(s).

Self-perceived improvements

To investigate whether the emergency preparedness had improved after the accreditation process, the respondents were asked, “How is the emergency preparedness in your clinic today compared to the time before the work with the standard?” Similarly, to evaluate if the handling of prescription renewals had improved after the accreditation process, the respondents were asked, “How is the handling of prescription renewal in your clinic today compared to the time before the work with the standard?” For both questions, the respondents could select ‘better’, ‘just as good’ or ‘worse’. In the analysis, ‘better’ indicated improvements, whereas ‘worse’ and ‘just as good’ indicated no improvements.

Practice characteristics

Practice characteristics such as practice type, number of GP partners, number of staff, training site for junior GPs and administrative region were included as potential predictors, as they were considered to be potentially influencing the team-based implementation activities [7, 31]. Since GPs were asked to answer the questionnaire on behalf of the clinic, no individual data was collected. Practice type was categorised as single-handed or group practice, where group practice was defined as clinics with more than one GP partner and/or formalised cooperation with other clinics. Number of GP partners, and number of staff were included as continuous variables. Training site for junior GPs was categorised as a dichotomous variable indicating whether the clinic had GP trainees (Yes/No). Geographical location was based on the five Danish administrative regions: North Denmark Region, Capital Region of Denmark, Region Zealand, Region of Southern Denmark and Central Denmark Region.

Statistical analysis

Descriptive statistics were performed to characterize the dataset and assess the frequency of implementation activities and self-perceived improvements.

Logistic regression analyses tested associations between team-based implementation activities and perceived improvements in the emergency preparedness and handling of prescription renewals. The hypothesis is that clinics who engage in team-based implementation activities preceding accreditation are more likely to experience improvements in their emergency preparedness as well their handling of prescription renewals.

Associations were calculated as unadjusted as well as adjusted odds ratios (ORs). The adjusted statistical model included the crude improvement rate adjusting for implementation activities, practice type, number of GP partners, number of staff, GP trainees in clinic and administrative region. All variables in the adjusted model were entered in one step. The analyses were restricted to respondents with complete data on all variables in the models. Spearman’s correlation coefficients were used to test for multicollinearity. No strong collinearity was found between independent variables.

The 95% confidence intervals (CIs) were calculated, and P values of ≤ 5% were considered statistically significant. Data were analysed using Stata (version 16.1).

Results

Between 27 and 2016 and 31 December 2018, 1,230 clinics conducted their accreditation survey. A total of 920 clinics returned the questionnaire (74%). Of these, 721 clinics filled out the questionnaire which was handed out at the survey, and 199 clinics answered the reminder questionnaire. Table 2 shows the characteristics of the responding clinics.

Table 2 Characteristics of the respondents (total n = 920)

Self-perceived improvements

In almost half of the clinics (48%), the respondents perceived to have obtained a better emergency preparedness compared to before. In the remaining clinics, no changes were perceived, except for one clinic in which the respondents reported to do worse (Table 3). In around a third (31%) of the clinics, the respondents reported that prescription renewals were handled better after compared to before the accreditation process. In only one clinic, the handling of prescription renewals was reported to be worse while the remaining respondents reported to experience no difference (Table 3).

Table 3 Perceived improvements in the emergency preparedness and handling of prescription renewals

Team-based implementation activities

Obtaining a common understanding of the purpose of preparing the guidelines was frequently reported (85% and 79%). The most commonly reported team-based implementation activity was the assignment of a key person responsible for working with the standards (88% and 86%) (Fig. 2). Finding it easy to integrate changes into existing working procedures was reported by 83% and 78% of the clinics (Fig. 2).

Fig. 2
figure 2

Frequency of clinics reporting team-based implementation activities

Most often, the role as key person was held by one or more GPs (56% and 63%). In some clinics, the role was shared by GPs and staff (30% and 63%), whereas the key person was one or more of the staff members in few clinics (6% and 7%).

Associations between implementation activities and improvements

The univariate logistic regression analysis showed that all team-based implementation activities were significantly associated with perceived improvements, except for the association between assigning a key person and improvements in prescription renewals (Table 4). The associations were still significant after adjusting for practice characteristics.

Table 4 Association between team-based implementation activities and perceived improvements

Obtaining a common understanding of the purpose of implementing changes according to the accreditation standard was found to have the strongest association with perceived improvements (OR = 5.07 (3.06–8.40) regarding the emergency preparedness and OR = 3.66 (2.07–6.46) regarding handling of prescription renewals). Easy integration of changes was also significantly associated with improvements in both emergency preparedness (OR = 1.88 (1.24–2.85)) and handling of prescription renewals (OR = 2.34 (1.44–3.79)). Assigning a key person responsible for working with the standard was only significantly associated with improved emergency preparedness (OR = 1.95 (1.19–3.19)) (Table 4). Additional file 1 shows the full adjusted model with all covariates.

Discussion

Main findings

Around 80% of the clinics had performed several specific, team-based implementation activities to fulfil the criteria for accreditation. Almost half of the clinics (48%) reported perceived improvements in the emergency preparedness, and 30% reported perceived improvements in the handling of prescription renewals. Very few respondents experienced impairment of their work procedures.

For both emergency preparedness and handling of prescription renewals, around 80% of the clinics reported to have obtained a common understanding of the purpose of preparing the guidelines, and that the preparation of the guidelines could be easily integrated into their way of working. The team-based implementation activities also included assignment of a key person which was reported by 86-88%. This role was seldomly delegated exclusively to a staff member.

The results revealed significant associations between the three types of team-based implementation activities and perceived improvements in the emergency preparedness and handling of prescription renewals. Obtaining a common understanding of the purpose of implementing changes according to the accreditation standard was found to have the strongest, significant association with perceived improvements. Finding it easy to integrate changes into existing working procedures was also significantly associated with improvements, whereas assigning a key person responsible for working with the standard was only significantly associated with improved emergency preparedness.

Strengths and limitations

An important strength of this study includes the high response rate compared to other questionnaire studies in this setting [32, 33]. Another strength includes hand distribution of the questionnaire by GP surveyors to all general practices in the study period immediately after their survey visit. In general, GP surveyors in Denmark succeeded at establishing a trust-based relation to GPs and GP staff [34] and are therefore valid distributers of the questionnaire. An important limitation of the study is the study design since cross-sectional studies do not allow us to draw firm causal conclusions. Another limitation is the embedded risk of recall bias as the experiences with both the team-based implementation activities and the perceived improvements were measured some time after the actual implementation processes. To address the risk of recall bias, we asked the GP most involved in the accreditation process to complete the questionnaire.

In the interpretation of the findings, it should also be borne in mind that the study explored the first round of accreditation in Danish general practice. The implementation activities and the perceived effects might have been different if the clinics were familiar with the concept of accreditation [18].

Furthermore, only two of the 16 accreditation standards were explored in this study. Both standards are about patient care and were chosen based on perceived clinical relevance. The findings might reflect this, and the effects of team-based implementation could be different for accreditation standards focusing on organization and management. Though most results showed associations between team-based implementation activities and self-perceived improvements, assigning a key person responsible for working with the standard was only significantly associated with improved emergency preparedness and not with prescription renewals. A possible explanation might relate to the fact that emergency preparedness refers to rare incidents, whereas prescription renewals is a daily, routine task where GPs and staff already must be expected to have more well-defined roles. Thus, a study from general practice found that implementation processes might be different for daily routine work compared to infrequent processes [35]. Assigning a key person to take care of prescription renewals might therefore be less important.

Accreditation is a highly complex process, which takes place in a complex clinical reality. Although accreditation has been studied in multiple settings [1, 18, 36], a link between accreditation and improvements in the quality of care has not been fully established [21, 37]. Also, it is difficult to ensure that measured effects can be attributed to accreditation. In this study, we sought to increase the content validity of the questions regarding perceived effects by asking questions on two specific accreditation standards.

The NoMAD instrument was chosen as a means for measuring implementation activities. In the current study, only three NoMAD questions were included as proxy measures for team-based implementation of accreditation in general practice; therefore, they should be seen as a simplification of the highly complex concept of implementation activities. The relevance of the NoMAD instrument is supported by its use in other recent studies, also in general practice [38, 39]. Furthermore, the instrument has been translated to a range of other languages, including a Danish version launched after the initiation of our data collection. Only minor differences exist between the translated version of the questions in our questionnaire, which was used in this study, and the official Danish version of the NoMAD instrument [40].

Comparison with literature

Studies of Danish GPs’ experiences with accreditation have found large variations in the use of external implementation support during the accreditation process [7], as well as their in-clinic implementation activities and the impact of accreditation [10]. In our study, the large majority of the clinics had been engaged in specific, team-based implementation activities. However, it is not possible to assess the thoroughness of these activities.

In our study, we found that improvements in work procedures were significantly more likely to appear if any of the specific, team-based implementation activities were conducted. This is in line with other studies, finding that a shared understanding among staff [35, 41] and assigning a key person for the implementation activities [41, 42] were important factors for successful implementation of accreditation standards or other quality interventions in general practice. However, other factors may also influence the implementation activities and the effect of the accreditation programme, e.g. that the Danish programme is mandatory [13].

Implementation and effectiveness can be influenced by the pre-existing motivation to comply with a top-down mandatory intervention [43] such as an accreditation programme, which can be criticized for causing a focus on bureaucratic exercises rather than improving healthcare [44]. Thus, a favourable perception of accreditation has been identified as an enabling factor for implementation [13]. A previous study found widespread scepticism prior to the implementation of accreditation standards in general practice in Denmark [9]. This individual scepticism might influence implementation activities as well as perceived effects of accreditation. Perhaps scepticism is mostly related to the accreditation standards that are perceived as bureaucratic (e.g. standards concerning management) and less related to the more directly clinically relevant standards which are included in our study.

Implications

We found that the percentage of clinics engaging in specific, team-based implementation activities was similar for both emergency preparedness and handling of prescription renewals. Moreover, the association between team-based implementation activities and perceived effects was to a large degree similar for both procedures. This suggests that our findings might also apply to the implementation of other accreditation standards dealing with clinical behaviour, and most likely also in other quality development initiatives aiming at improving clinical behaviour in general practice. Therefore, facilitating team-based implementation activities such as those explored can increase the likelihood of improvements in working procedures and quality of care.

Conclusion

Clinical quality initiatives that involve collaboration within a practice team are more likely to cause improvements if specific team-based implementation activities are conducted. It is particularly important to facilitate a common understanding of the purpose of the initiative, but also assigning a key person responsible for the quality work and finding it easy to integrate changes into existing working procedures is important. Therefore, external support for quality initiatives aiming at the practice level in general practice should facilitate such team-based activities.

Data Availability

The datasets generated and/or analysed during the current study are not publicly available due to the lack of consent of participants but are available from the corresponding author on reasonable request.

Abbreviations

GP:

General practitioner

IKAS:

(Danish) Institute for Quality and Accreditation in Healthcare

NoMAD:

Normalisation MeAsure Development

NPT:

Normalisation Process Theory

References

  1. Hinchcliff R, Greenfield D, Moldovan M, Westbrook JI, Pawsey M, Mumford V, Braithwaite J. Narrative synthesis of health service accreditation literature. BMJ Qual Saf. 2012;21(12):979–91.

    Article  Google Scholar 

  2. O’Beirne M, Zwicker K, Sterling PD, Lait J, Lee Robertson H, Oelke ND. The status of accreditation in primary care. Qual Prim Care. 2013;21(1):23–31.

    PubMed  Google Scholar 

  3. Greenfield D, Braithwaite J. Health sector accreditation research: a systematic review. Int J Qual Health Care. 2008;20(3):172–83.

    Article  Google Scholar 

  4. Mainz J. Basal kvalitetsudvikling [Basic quality improvement] Kbh. Munksgaard; 2017.

  5. Danish Institute for Quality and Accreditation in Healthcare (IKAS). Den Danske Kvalitetsmodel, Akkrediteringsstandarder for almen praksis [Danish Healthcare Quality Programme, Accreditation standards for general practice]. 2018.

  6. Due TD, Thorsen T, Kousgaard MB. Understanding accreditation standards in general practice – a qualitative study. BMC Fam Pract. 2019;20(1):1–12.

    Article  Google Scholar 

  7. Jensen MLO, Bro F, Mygind A. Implementation of healthcare accreditation in Danish general practice: a questionnaire study exploring general practitioners’ perspectives on external support. Scand J Prim Health Care. 2021;39:85–91.

    Article  Google Scholar 

  8. IKAS. Accreditation standards. https://www.ikas.dk/den-danske-kvalitetsmodel/ddkm-in-english/accreditation-standards. Accessed 13 February 2020.

  9. Waldorff FB, Nicolaisdottir DR, Kousgaard MB, Reventlow S, Sondergaard J, Thorsen T, Andersen MK, Pedersen LB, Bisgaard L, Hutters CL, et al. Almost half of the Danish general practitioners have negative a priori attitudes towards a mandatory accreditation programme. Dan Med J. 2016;63:9.

    Google Scholar 

  10. Kousgaard MB, Thorsen T, Due TD. Experiences of accreditation impact in general practice – a qualitative study among general practitioners and their staff. BMC Fam Pract. 2019;20:1.

    Article  Google Scholar 

  11. Dogherty EJ, Estabrooks CA. Why do barriers and facilitators matter? In: Complex interventions in health. Edited by Richards DA, Hallberg IR. New York: Routledge; 2015. 273–281.

  12. Skolarus TA, Sales AE. Implementation issues. In: Complex interventions in health. Edited by Richards DA, Hallberg IR. New York: Routledge; 2015. 265–272.

  13. Hinchcliff R, Greenfield D, Westbrook JI, Pawsey M, Mumford V, Braithwaite J. Stakeholder perspectives on implementing accreditation programs: a qualitative study of enabling factors. BMC Health Serv Res. 2013;13(1):437.

    Article  Google Scholar 

  14. IKAS. Akkreditering af almen praksis - status pr. 11.09.2019 [Accreditation in general practice - status as of 11 September 2019]. Aarhus; 2019.

  15. Hovlid E, Braut GS, Hannisdal E, Walshe K, Bukve O, Flottorp S, Stensland P, Frich JC. Mediators of change in healthcare organisations subject to external assessment: a systematic review with narrative synthesis. BMJ open. 2020;10(8):e038850.

    Article  Google Scholar 

  16. O’Beirne M, Zwicker K, Sterling PD, Lait J, Lee Robertson H, Oelke ND. The status of accreditation in primary care. Qual Prim Care. 2013;21:23–31.

    PubMed  Google Scholar 

  17. Greenfield D, Braithwaite J. Health sector accreditation research: a systematic review. Int J Qual Health Care. 2008;20:172–83.

    Article  Google Scholar 

  18. Nouwens E, van Lieshout J, Bouma M, Braspenning J, Wensing M. Effectiveness of Improvement Plans in Primary Care Practice Accreditation: A Clustered Randomized Trial. PLoS ONE. 2014;9(12):14.

    Article  CAS  Google Scholar 

  19. Szecsenyi J, Campbell S, Broge B, Laux G, Willms S, Wensing M, Goetz K. Effectiveness of a quality-improvement program in improving management of primary care practices. CMAJ. 2011;183(18):E1326–33.

    Article  Google Scholar 

  20. Riisgaard H, Waldorff FB, Kirstine Andersen M, Pedersen LB. Does accreditation of general practice promote patient-reported quality of care? A natural cluster randomised experiment. BMJ open. 2020;10(6):e034465.

    Article  Google Scholar 

  21. van Doorn-Klomberg AL, Braspenning JCC, Wolters RJ, Bouma M, Wensing M. Effect of accreditation on the quality of chronic disease management: a comparative observational study. Bmc Family Practice 2014:15:8.

  22. Pedersen KM, Andersen JS, Sondergaard J. General practice and primary health care in Denmark. J Am Board Fam Med. 2012;25(Suppl 1):34–8.

    Article  Google Scholar 

  23. The Danish Health Data Authority. Beskrivelse af almen praksissektoren i Danmark [Description of the primary care sector in Denmark]. 2016.

  24. Elm Ev, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: guidelines for reporting observational Studies. Ann Intern Med. 2007;147(8):573–7.

    Article  Google Scholar 

  25. Beatty PC, Gordon WB. Research synthesis. Pract Cogn interviewing Public Opin Q. 2007;71:287–311.

    Article  Google Scholar 

  26. May C. Applying normalization process theory to the implementation of complex interventions. In: Complex interventions in health. edn. Edited by Richards DA, Hallberg IR. New York: Routledge; 2015: 293–299.

  27. Rapley T, Girling M, Mair FS, Murray E, Treweek S, McColl E, Steen IN, May CR, Finch TL. Improving the normalization of complex interventions: part 1 - development of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT). BMC Med Res Methodol. 2018;18(1):133.

    Article  Google Scholar 

  28. May C, Finch T, Rapley T. Normalization Process Theory In: Handbook on implementation science. edn. Edited by Nilsen P, Birken SA. Cheltenham Edward Elgar Publishing Limited; 2020: 144–167.

  29. May C, Finch T. Implementing, Embedding, and Integrating Practices: An Outline of Normalization Process Theory. Sociology. 2009;43(3):535–54.

    Article  Google Scholar 

  30. Finch TL, Girling M, May CR, Mair FS, Murray E, Treweek S, McColl E, Steen IN, Cook C, Vernazza CR, et al. Improving the normalization of complex interventions: part 2 - validation of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT). BMC Med Res Methodol. 2018;18(1):135.

    Article  Google Scholar 

  31. Mygind A, Munksgaard PP, BF. Regional støtte til implementering af akkreditering i almen praksis: Udbud og anvendelighed [Regional support for implementation of accreditation in general practice: Supply and applicability]. Danish. Aarhus: The Research Unit for General Practice; 2019.

    Google Scholar 

  32. Ahnfeldt-Mollerup P, dePont Christensen R, Halling A, Kristensen T, Lykkegaard J, Nexoe J, Barwell F, Spurgeon P, Sondergaard J. Medical engagement and organizational characteristics in general practice. Fam Pract. 2016;33(1):69–74.

    Article  Google Scholar 

  33. Le JV, Pedersen LB, Riisgaard H, Lykkegaard J, Nexøe J, Lemmergaard J, Søndergaard J. Variation in general practitioners’ information-seeking behaviour - a cross-sectional study on the influence of gender, age and practice form. Scand J Prim Health Care. 2016;34:327–35.

    Article  Google Scholar 

  34. Due TD, Thorsen T, Kousgaard MB. The survey visit as a key evaluative event in accreditation–a qualitative study of survey visit experiences among surveyors and general practice professionals. BMC Fam Pract. 2021;22(1):163.

    Article  Google Scholar 

  35. Høj K, Mygind A, Bro F. Exploring implementation processes in general practice in a feedback intervention aiming to reduce potentially inappropriate prescribing: a qualitative study among general practitioners. Implement Sci Commun. 2021;2(1):4.

    Article  Google Scholar 

  36. Bogh SB, Falstie-Jensen AM, Bartels P, Hollnagel E, Johnsen SP. Accreditation and improvement in process quality of care: a nationwide study. Int J Qual Health Care. 2015;27(5):336–43.

    Article  Google Scholar 

  37. Brubakk K, Vist GE, Bukholm G, Barach P, Tjomsland O. A systematic review of hospital accreditation: the challenges of measuring complex intervention effects. BMC Health Serv Res. 2015;15:280.

    Article  Google Scholar 

  38. Mills K, Griffin SJ, Sutton S, Usher-Smith JA. Development and usability testing of a very brief intervention for personalised cancer risk assessment to promote behaviour change in primary care using normalisation process theory. Prim Health Care Res Dev. 2020;21:e1.

    Article  Google Scholar 

  39. Sturgiss EA, Elmitt N, Haesler E, van Weel C, Douglas K. Feasibility and acceptability of a physician-delivered weight management programme. Fam Pract. 2017;34(1):43–8.

    Article  Google Scholar 

  40. ImpleMentAll. Normalization Measure Development Questionnaire (short NoMAD). 2018. https://www.implementall.eu/NoMAD_Danish.pdf. Accessed 5 September 2022.

  41. Shea CM, Turner K, Albritton J, Reiter KL. Contextual factors that influence quality improvement implementation in primary care: The role of organizations, teams, and individuals. Health Care Manage Rev. 2018;43(3):261–9.

    Article  Google Scholar 

  42. Nouwens E, van Lieshout J, Wensing M. Determinants of impact of a practice accreditation program in primary care: a qualitative study. BMC Fam Pract. 2015;16:8.

    Article  Google Scholar 

  43. Weske U, Boselie P, van Rensen ELJ, Schneider MME. Using regulatory enforcement theory to explain compliance with quality and patient safety regulations: the case of internal audits. BMC Health Serv Res. 2018;18(1):62.

    Article  Google Scholar 

  44. Pomey MP, François P, Contandriopoulos AP, Tosh A, Bertrand D. Paradoxes of French accreditation. Qual Saf Health Care. 2005;14(1):51–5.

    Article  Google Scholar 

  45. World Medical Association. WMA Declaration of Helsinki - Ethical Principles for Medical Research Involving Human Subjects. Helsinki; 2013.

  46. The European Parliament and the Council of the European Union: The protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation) In.: https://gdpr-info.eu/; 2016.

  47. National Committee on Health Research Ethics. Act on Research Ethics Review of Health Research Projects. 2018. https://en.nvk.dk/rules-and-guidelines/act-on-research-ethics-review-of-health-research-projects.

Download references

Acknowledgements

We would like to thank all GPs who completed the questionnaire, the surveyors for engaging in the project and handing over all the questionnaires, Pia Pinholt Munksgaard for project coordination and Henrik Schou Pedersen for statistical support.

Funding

This study was supported by an unrestricted grant from the Danish Institute for Quality and Accreditation in Healthcare (IKAS) and the Danish Research Foundation for General Practice (Fonden for Almen Praksis).

Author information

Authors and Affiliations

Authors

Contributions

AM and FB generated the idea for and designed the study. AM managed the data collection. CM conducted the analysis and led the drafting of the manuscript. All authors contributed to the drafting of the manuscript and approved the final version.

Corresponding author

Correspondence to Cecilie Mølgaard.

Ethics declarations

Ethics approval and consent to participate

The study was conducted in accordance with the general ethical principles of good clinical research practice drawn up by the World Medical Association in the Helsinki Declaration [45]. The respondents were informed by a written formal cover letter about the study, including purpose, confidentiality, voluntariness, and anonymity. Returning the completed questionnaire was interpreted as informed consent to participate in the study. The study was approved by the Danish Data Protection Agency (record number 2016-41-4579), and data storage and access comply with the General Data Protection Regulation guidelines. The project is registered in the Record of Processing Activities at the Research Unit for General Practice, Aarhus, in accordance with the Danish Data Protection Act (Act No. 502 of 23 May 2018) and the General Data Protection Regulation (GDPR) by the EU [46]. In Denmark, approval by the Committee on Health Research Ethics is not required for questionnaire and registry studies [47].

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Corresponding author:

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

File name: Additional file 1.

File format: Microsoft Word Document (.docx).

Title of data: Association between team-based implementation activities and perceived improvements (full model with all predictors).

Description of data: Adjusted model including all predictors in the logistic regression analyses.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mølgaard, C., Bro, F. & Mygind, A. What GPs do to meet accreditation standards – implementation activities and perceived improvements attributed to general practice accreditation. BMC Prim. Care 23, 265 (2022). https://doi.org/10.1186/s12875-022-01864-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12875-022-01864-y

Keywords