- Research article
- Open Access
Efficiency as a determinant of loyalty among users of a Community of Clinical Practice: a comparative study between the implementation and consolidation phases
BMC Family Practice volume 21, Article number: 15 (2020)
A community of clinical practice called the Online Communication Tool between Primary and Hospital Care (ECOPIH) was created to enable primary care and specialist care professionals to communicate with each other in order to resolve real clinical cases, thereby improving communication and coordination between care levels. The present work seeks to analyse whether ECOPIH makes it possible to reduce the number of referrals. To that end, the objectives are: (1) To find out the degree of loyalty among ECOPIH users, by comparing the medical professionals’ profiles in the tool’s implementation phase to those in its consolidation phase. (2) To evaluate the degree of fulfilment of users’ expectations, by establishing the determining factors that had an influence on the physicians’ intention to use ECOPIH in the implementation phase and observing whether its use had an effective, direct impact on the number of patient referrals that primary care physicians made to specialist care professionals.
Two studies were conducted. Based on a survey of all the physicians in a Primary Care area, Study 1 was a descriptive study in ECOPIH’s implementation phase. Study 2 was a randomised intervention study of ECOPIH users in the tool’s consolidation phase. The results from both studies were compared. Various bivariate and multivariate statistical techniques (exploratory factor analysis, cluster analysis, logistic regression analysis and ANOVA) were used in both studies, which were conducted on a sample of 111 and 178 physicians, respectively.
We confirmed the existence of an ECOPIH user profile stable across both phases: under-50-year-old women. Regarding the second objective, there were two particular findings. First, the discriminant factors that had an influence on greater ECOPIH use were habitual Social media website and app use and Perceived usefulness for reducing costs. Second, PC professionals who were ECOPIH members made fewer referrals to SC professionals in Cardiology, Endocrinology and Gastroenterology than older PC professionals who were not ECOPIH members.
The use of a community of clinical practice by primary care and specialist care professionals helps to reduce the number of referrals among medical professionals.
In the current context of healthcare spending containment, the role of primary care (PC) is fundamental because, when managed effectively, it can prevent unnecessary referrals and reduce waiting lists [1,2,3]. However, people with multiple and complex health problems are cared for in PC clinics . This means that physicians have to deal with several clinical aspects of patients at once; physicians may have doubts about how to manage complex patient needs in day-to-day clinical practice [5,6,7,8]. PC professionals therefore need an effective system that allows them to perform searches and find the necessary information to enhance their knowledge and find suitable solutions .
Face-to-face or telephone discussions with specialist care (SC) professionals enable PC professionals to address particular clinical concerns that crop up during patient care. However, given that the health system is at saturation point, communication between PC and SC may be difficult, slow, and ineffective [10,11,12,13], and it leads to many referrals to SC (hospitalisation or specialist outpatient clinics). In turn, this leads to excessive delays for appointments [14, 15] and to a significant increase in financial, time and psychological costs to physicians and patients. As Horner et al., have pointed out, 65% of referrals are inappropriate and up to 30% of them could be avoided .
Among the factors associated with a higher referral rate are the little coordination between care levels and the lack of training [10, 17,18,19]. Improving coordination between care levels would not only enhance healthcare, but also be of considerable educational value and lead to a more cost-effective use of health services [2, 20]. Telemedicine can improve communication between PC and SC, and thereby improve efficiency, cost-effectiveness, and medical care quality [21,22,23,24,25,26,27], with a high degree of patient satisfaction [28,29,30].. In addition, telemedicine can reduce the number of supplementary tests and referrals to SC (by between 8.9 and 51%) [30,31,32].
The formation of communities of practice (CoPs) is a recent approach . Applied to the field of healthcare, communities of clinical practice (CoCPs) are online platforms that draw on the advantages of Web 2.0 to construct knowledge among healthcare professionals working at different levels of care . Although there is limited evidence of their usefulness [35, 36], CoCPs have been shown to have considerable capacity to enable the transfer of knowledge gained in day-to-day practice [37,38,39], as well as a lot of potential in terms of professionals’ education, regardless of their care level [36, 40,41,42,43].
Set up in 2009, Eina de Comunicació Online entre Primària i Hospitalària (ECOPIH as abbreviated in Catalan, or Online Communication Tool between Primary and Hospital Care as translated in English) is a CoCP based on a Web 2.0 platform. It facilitates communication between PC and SC professionals respectively working at a number of PC centres and hospitals in the cities of Badalona and Sant Adrià de Besòs in greater Barcelona, Spain . It enables PC and SC professionals to share up-to-date information that is relevant to their interests, and PC professionals to raise clinical cases for consultation with specialists to improve patient management and to reduce the number of referrals to the next care level. After a two-year follow-up period (2011–2012), 1000 interventions had been made across six specialities through ECOPIH. Contributions had been read 12,200 times (each contribution approximately 10 times) and 209 clinical cases had been raised for consultation.
Presented in this article are the results from two ECOPIH follow-up studies conducted between 2011 and 2012, coinciding with the respective implementation (first year of ECOPIH use) and consolidation phases of that CoCP (end of the second year of use). Study 1 evaluated the discriminant factors that had an influence on the intention to use ECOPIH, and Study 2 performed a characterisation of ECOPIH users and analysed the impact of ECOPIH use on referrals. By comparing the results obtained from the two studies conducted, the present work seeks to analyse whether ECOPIH makes it possible to reduce the number of referrals to SC. To that end, the objectives are (Fig. 1):
(1) To find out the degree of loyalty among ECOPIH users. Specifically, by identifying and then comparing the medical professionals’ profiles in the tool’s initial implementation phase (Study 1) to those in its consolidation phase (Study 2) to see if they remained stable.
(2) To evaluate the degree to which users’ expectations are fulfilled by establishing the determining factors that influence physicians’ intention to use ECOPIH in the implementation phase (Study 1) and analysing whether the expectations identified in that phase were fulfilled by observing whether its use had an effective, direct impact on the number of patient referrals that PC physicians made to SC professionals (Study 2).
The research presented in this article is the result of a collaboration between the Badalona-Sant Adrià de Besòs Primary Care Service (PCS) in Catalonia, Spain, and the Open University of Catalonia (UOC, as abbreviated in the Catalan language), Spain. Some of the results obtained from this study relating to physicians’ and nurses’ adoption of the tool have been published elsewhere .
The Badalona-Sant Adrià de Besòs PCS includes nine PC centres and three SC centres: Germans Trias i Pujol University Hospital, Badalona Municipal Hospital and the Barcelonès Nord International Health Unit, with a total of 624 healthcare professionals. These centres serve 227,151 inhabitants.
Two studies were conducted. Study 1 was a descriptive study in ECOPIH’s implementation phase. Study 2 was a randomised intervention study of ECOPIH users conducted two years later, when use of the tool had become consolidated.
Study 1 (implementation phase): characterisation of ECOPIH users during the implementation phase and description of discriminant factors that have an influence on the intention to use ECOPIH
Settings, sampling and type of study
Study 1 was a descriptive study on a sample of healthcare professionals from the Badalona-Sant Adrià de Besòs PCS, who had the potential to become regular users of ECOPIH. An anonymous, optional survey consisting of open and closed questions was used to gather data .
The questionnaires were divided into three sections: 1) sociodemographic and professional background; b) access to and use of Information and Communication Technologies (ICTs) in professional and personal settings; and c) perceptions and use of ECOPIH. Information about the scientific objectives and data confidentiality was made available to potential respondents. A total of 357 healthcare professionals were invited, by e-mail, to fill in the questionnaire. All of those professionals were (a) involved in caring for patients in the Badalona-Sant Adrià de Besòs PCS and (b) could potentially become routine ECOPIH users. All professionals were invited to take part by e-mail, though it was made clear that they could decline if they wished. The questionnaires were provided in additional files 1 and 2. The study sample was formed by a total of 111 physicians who filled in the questionnaire (31.9% response rate). The study was conducted over a two-month period, from 1 December 2011 to 31 January 2012. As reflected by the above-mentioned percentage, the high response rate meant that it was a representative sample of the ECOPIH community population. Also, given the population’s finite size, it was possible to work with low margins of error (+ 7.7, 95% confidence level). This meant that the results could be extrapolated. Table 1 presents the study specifications, and Table 2 the variables used in the study.
Variables of study 1
The use of ECOPIH is a dependent variable and the rest are independent (explanatory) ones (Table 2). It should be pointed out that principal component analysis was used to obtain the two variables measuring perceived usefulness – Perceived usefulness for improving clinical practice quality, and Perceived usefulness for reducing costs. It was the multidimensional nature of these variables that suggested exploratory factor analysis (EFA) should be performed. EFA is a technique to reduce data dimensionality. By analysing a set of original variables, it seeks to determine the fewest dimensions capable of explaining the maximum amount of information within the data .
In total, nine variables were considered for the purpose of extracting the factor dimensions. Each variable was associated with the healthcare professionals’ perceived benefits of using ECOPIH. Regarding the particular benefits that ECOPIH could offer its users, some of these variables referred to quality improvement, while others referred to cost reduction (see Table 3 in Lacasta et al. ).
As the 2015 study showed , performing a set of statistical tests enabled us to establish the suitability of the analysis and the reliability of the scale. All of the correlation matrix’s variables displayed high correlations, and the value of their determinant was 0.041. The Kaiser-Meyer-Olkin index value was 0.924 and Bartlett’s test of sphericity value was 1983.717, with a significance of 0.000. This analysis explained 86.846% of the variance, and Cronbach’s alpha values were higher than 0.81 in all the scales. According to Nunnally , this indicator must have values higher than 0.7 in general and higher than 0.6 in the case of new scales. Thus, it is possible to assume that the scales used were reliable. In addition, the discriminant, convergent and nomological validity of the content and construct scales was addressed. Regarding the content, the scales were developed following a major review of the literature (see Table 3 in Lacasta et al. ).
In order to establish the physicians’ profiles, univariate analyses were performed on the different sociodemographic and ICT use variables for the selected sample. An important matter was to identify the physicians’ profiles by gender and age. To that end, hierarchical cluster analysis was carried out.
To identify the variables determining ECOPIH use, binary logistic regression analysis (Logit) was performed.
Study 2 (consolidation phase): characterisation of ECOPIH users during the consolidation phase and impact of ECOPIH use on referrals
Settings, sampling and type of study
Study 2 was an open, multi-centre, controlled, randomised intervention study over a 24-month follow-up period. It was conducted on three PCSs in Barcelona Province (Badalona-Sant Adrià de Besòs PCS, SAP Santa Coloma de Gramenet PCS and Maresme PCS), with 25 PC centres and 507 PC physicians, all belonging to the public health system of Catalonia, Spain.
The inclusion criteria were: PC clinicians who had been working for at least 6 months at the same PC centre for whom full patient visit and referral data were available in the official electronic records of the institution. Since only adult medicine specialities were analysed, PC paediatricians were excluded.
The population of 357 physicians at the Badalona-Sant Adrià de Besòs, Santa Coloma de Gramenet and Maresme PCSs was the reference point, from which a sample comprising 178 physicians was taken. It should be noted that this random sample was different from the one used in Study 1, although the study universe was the same – and finite – in both studies.
Variables of study 2
In order to establish the healthcare professionals’ profiles, hierarchical cluster analysis was performed, taking into account the Gender, Age and ECOPIH member variables.
The Background work for Study 2 was carried out in December 2012. Table 3 shows the variables analysed in that study.
In order to respond to the first objective, the healthcare professionals’ profiles were defined according to the intention to use the CoCP in the implementation phase (Study 1). After the tool’s consolidation, the professionals’ profiles were analysed again, taking into account the effective use of the tool (Study 2). By comparing the profiles obtained from the two studies, it was possible to find out if potential users had become actual users (loyalty).
Regarding the second objective, in order to confirm whether the tool actually had an influence on the professionals’ behaviour, an analysis was performed of the relationship between the profiles of the professionals using ECOPIH (Study 1) and the number of referrals they made in certain specialities (Study 2). Chi-square analysis was used to analyse the relationship of dependence between the variables.
This project adhered to Spanish legislation (Spanish Law 14/2007 of 3 July on Biomedical Research) and to international regulations on ethical issues (Declaration of Helsinki and Declaration of Tokyo). The research protocol (P11/39) was reviewed and approved by the Ethics and Clinical Research Committee of the Primary Care Research Institute IDIAP Jordi Gol, Barcelona, Spain. All the participants were informed in writing about their participation in the study and data confidentiality. In order to avoid bias, no information about the intervention was provided. Written informed consent was obtained from all participants. Confidentiality was maintained at all levels, thereby ensuring that professionals and patients could not be identified. The patients’ medical records could not be accessed from ECOPIH. Information was obtained from the survey responses and existing data related to visits and referrals, and subject-identifying information was coded and anonymised. The features of the intervention meant that it did not have to meet national regulations for clinical trials. Confidentiality was assured under the Spanish Personal Data Protection Law (15/1999 of 13 December).
First objective: to find out the degree of loyalty among ECOPIH users
Implementation phase: sample profile study 1
At the start of ECOPIH implementation, sample distribution by sex and age was fairly balanced: 56.9% women and 43.1% men. Regarding age, 32.4% were under 40 years old, 25.2% were between 40 and 49 years old, 29.7% were between 50 and 59 years old, and only 12.6% were 60 years old or over. Finally, it should be noted that the large majority’s Mobile device use was medium-high (70.7%), whereas their Social media website and app use was medium (59.8%) or low (38.3%) (Table 4).
As shown in Table 5, the results obtained indicated the existence of two different groups. The first profile (1A) comprised 64 individuals, of whom 65.6% were under-50-year-old women, and the second profile (1B) comprised 47 individuals, of whom 53.2% were over-50-year-old men. The differences between the two groups were significant for both the Age variable and the Gender variable, with t-test values of 8.708 and 4.437, respectively, at 99 and 95% confidence levels (Table 5).
When analysing each group’s relationship with technology, the distribution with respect to Social media website and app use was found to be quite homogenous and similar in both, hence the Chi-square value was not significant in either of them.
Consolidation phase: analysis of the ECOPIH users’ profiles. Sample profile study 2
As shown in Table 6, the results obtained indicated the existence of two different groups. The first profile (2A) comprised 72 professionals under 50 years old (100%), most of whom were women (76.4%) and ECOPIH members (68.1%), and the second group (Profile 2B) comprised 106 individuals over 50 years old (100%), most of whom were women (62.3%) and not ECOPIH members (85.8%).
The healthcare professionals’ profiles obtained from the analysis of the sample in the first year (Study 1, implementation phase) coincided with those obtained in the second year of ECOPIH development (Study 2, consolidation phase). Thus, a professional profile was observed in both the implementation and the consolidation phases (profiles 1A and 2A) corresponding to healthcare professionals who were young, mostly women, and habitual users of technology. In another profile (profiles 1B and 2B in the respective stages), the healthcare professionals were older, mostly men, whose ICT use was lower. This explains why the first segment’s use of ECOPIH (profile 1A and 2A) was high (68.1%) and the second group’s use of the tool (profile 1B and 2B) was very low (14.2%). We can therefore confirm the existence of an ECOPIH user profile – under-50-year-old women who habitually use ICTs – that was stable in both the implementation phase and the consolidation phase, thus maintaining their loyalty to the tool.
Second objective: to evaluate the degree of fulfilment of users’ expectations
Implementation phase: determinants of ECOPIH use
The model’s goodness of fit was confirmed by the values and level of significance of the Chi-square statistic (68.228, sig. 0.000) and the Hosmer-Lemeshow test (10.224, p = 0.250). In addition, the value of Nagelkerke’s statistic indicated that the model obtained explained 62.1% of the dependent variable’s variance.
From the analysis in Table 7, it is possible to observe that the variables influencing frequency of use are, on the one hand, the user’s profile in terms of his or her frequency of Social media website and app use (B = 1.933 p = 0.002) and, on the other, Perceived usefulness for reducing costs (time and financial costs) that ECOPIH use entails (B = 1.706 p = 0.025). No significant differences were found taking into account the professionals’ gender or age.
Consolidation phase: impact of ECOPIH on referrals
Table 8 shows that the PC professionals’ behaviour was significantly different for three of the specialities analysed. Thus, it was found that, ECOPIH members in PC professions made a low or average number of referrals to SC professionals in Cardiology, Endocrinology, and Gastroenterology, whereas older professionals who were not members of ECOPIH made a high or very high number of referrals. No significant differences were found with regard to the number of referrals made by each group at the start of the study period, so the differences found could be related to ECOPIH use.
For the remaining specialities (Nephrology, Respiratory Medicine and Neurology), no differences were found in the number of referrals. However, it should be noted that the three specialities in which differences were found were those that involved higher total numbers of referrals and healthcare professionals.
The analysis of the results of the two studies shown has enabled us to respond to the two stated objectives:
(1) To find out the degree of loyalty among ECOPIH users, and;
(2) To evaluate the degree of fulfilment of users’ expectations.
Both objectives are closely related since one of the main reasons why potential users become actual users is the fulfilment of their expectations from the tool.
Regarding the first objective, after comparing the professional profiles in the implementation phase to those in the consolidation phase, two professional profiles were found to remain similar over time. In one profile, the healthcare professionals were young, mostly women, and habitual users of technology. In another, the healthcare professionals were older, mostly men, whose ICT use was lower.
The findings suggest that the degree of loyalty (from initial use to consolidated use) was high among the group of younger female professionals. This seems to be supported by the fact that those professionals in the segment comprising mostly under-50-year-old women who stated their intention to use ECOPIH in the implementation phase were actual members of it two years later.
The results obtained show that the professionals in the over-50-year-old profile were those who used ECOPIH to a lesser extent, as identified in Study 2. This segment bears considerable similarity to Profile 1B observed in Study 1 (except for gender), in which the professionals rated information security higher than cost reduction.
In order to respond to the second objective, the determining factors that had an influence on the use of ECOPIH in the implementation year were analysed. The impact of the tool’s use on the number of referrals in an uncontrolled real-life setting was then evaluated, based on the medical professionals’ voluntary use thereof. This enabled us to establish whether the expectations created at the start of ECOPIH use (specifically, that PC professionals felt that ECOPIH use would allow costs associated with clinical practice to be reduced), had been fulfilled.
Concerning the factors determining the adoption of ECOPIH, our study revealed that two factors explained physicians’ use of this tool. Firstly, professionals’ ICT user profiles influenced intention to use ECOPIH (B = 1.933 p = 0.002). All professionals, regardless of their age and whether or not they were ECOPIH users, habitually used mobile devices and extensively used social media websites and apps. It is logical to think that those who habitually used social media/online platforms would be more likely to use a CoP in a clinical setting because they are already more comfortable with online platforms. Furthermore, the majority of under-50-year-old professionals would have used ICTs intensively at various stages throughout their higher education and professional development. In contrast, many professionals among the over-50-year-old generation could be classified as late adopters of ICTs, mainly because such adoption occurred in the workplace. Consequently, some professionals were reluctant to use ICTs because they saw it as an obligation and considered them hard to use and not particularly useful.
In the explanation of the physicians’ ECOPIH use, second in order of importance was Perceived usefulness for reducing costs (time and financial costs). Physicians decided to use the CoCP because they considered that it could become an effective tool for reducing various costs (B = 1.706 p = 0.025). Considering time strain, it is reasonable to think that healthcare professionals would opt for the development of more efficient professional activities. Thus, it is understood that the intention to use ECOPIH is conditional upon it being perceived as a tool that enables a correct diagnosis to be made while minimising the amount of time, effort and financial cost involved for both the physicians and the healthcare institutions . However, this tendency appears to be more apparent among younger, especially female professionals than among older male professionals. The setting’s cultural history might explain the gender differences between the two groups identified. Thus, the group of older professionals is mostly male because, at the start of the second half of the twentieth century in Spain, women’s access to certain types of higher education – such as medicine or engineering – was quite limited. The medical profession underwent a gradual feminisation, meaning that those generations of healthcare professionals trained at the end of the last century included a high percentage of women. In the early twenty-first century, 70% of new medical students were women; this has since risen to 85% [48, 49]. Moreover, the younger generation of professionals is very aware of patients’ service experience because of the more active role that patients play in healthcare provision models (empowerment and decision-making)  .
An important aspect that affects the professionals’ decision to use the tool continuously over time is its ability to fulfil the expectations created in the implementation phase. Regarding the impact of the tool’s use on the number of referrals in an uncontrolled real-life setting, and as seen in other studies , the degree of tool use has an influence on the tool’s potential usefulness; this is linked to Perceived usefulness for reducing costs (time and financial costs) that ECOPIH use entails. The segment of physicians who predominantly used ECOPIH regularly had lower referral rates in those specialities for which it had been used the most. This particularly reinforces the idea that, for this group of professionals, the tool fulfilled their expectations in terms of its ability to reduce costs associated with clinical practice. These findings are consistent with the results from other studies on the use of telemedicine applied to consultations among professionals [32, 52]. These results indicate that the tool has great potential because we are on the point of a generational changeover. Given today’s user profile, use of ECOPIH, and therefore its usefulness, are expected to increase in the near future.
It should be noted that these results were only obtained in three of the six specialities evaluated (Cardiology, Endocrinology and Gastroenterology, and not Respiratory Medicine, Nephrology or Neurology). This is probably due to two reasons. First, the latter three specialities were incorporated into ECOPIH later, and that might have hindered its use. Second, they are specialities in which fewer referrals are made, probably because the most common disorders within them are more protocolised and less individualised, thereby facilitating an independent handling of them by PC professionals.
Finally, the results obtained show that the professionals in the over-50-year-old profile are those who used ECOPIH to a lesser extent and, in turn, made the most referrals. This segment, as identified in Study 2, bears considerable similarity to Profile 1B observed in Study 1 (except for gender), who used ICTs to a lesser extent and rated information security higher than cost reduction. Hence, it can be seen that the number of referrals made remained unchanged.
This study has a number of limitations. First, the difficulty of recording the impact of such tools should not be overlooked. The impact of CoCP tools should also take into account the quality of referrals, the physician’s trust, and interprofessional communication. Furthermore, use and effectiveness of ECOPIH may have been influenced by other factors not considered in our study. Examples of such factors include: (a) availability of other PC-SC consultation systems; (b) each centre’s healthcare workload, and; (c) being or not being a teaching centre for resident physicians. The results obtained from this study need to be complemented by a qualitative evaluation in order to assess the tool comprehensively [37, 53,54,55].
Second, we are aware that both the number of ECOPIH users (65 members) and the referral rate (number of referrals per professional) limit the study’s statistical power. In order to solve both of these problems, we could have conducted a randomised controlled study on one specific group of professionals, that is to say, those who were enthusiastic about and committed to using ECOPIH. If we had done so, results of greater magnitude might have been obtained, though it would have affected the external validity of our study, which was conducted in a real-life setting of clinical practice and gave the professionals the freedom to use the tool as they wished, which we believe is one of the greatest strengths of our study.
Finally, during the study design phase, the inclusion of clinical variables as a measure of the effect of ECOPIH use was considered. That option was ultimately rejected owing to the difficulty of isolating the effect of the tool’s use from other influencing factors (e.g., courses taken by the professionals) and of finding a single clinical variable to encapsulate the improved clinical control of patients, since ECOPIH is a platform on which any type of clinical case can be raised for consultation.
We believe that further research should be done on the impact of CoCPs for professionals working in different areas of healthcare to communicate with one another, from the perspective of both the financial implications (a reduction in referrals and visits, and cost analysis) and the clinical outcomes. We propose that longer-term follow-ups should be done and that the use of the tool should be more actively promoted and encouraged, while ensuring that its use is never made compulsory . In order to do that, it will be necessary to ensure that the firm managing the tool guarantees its continuity, that users are given time to actually use it, and that solutions to any technological aspects representing barriers to its use are found. As a future strategy, and in keeping with the recommendations of some authors, it might be appropriate to push ahead with the tool’s dissemination, presenting it in a way that facilitates its use. This would strengthen the available evidence and the relative advantages of using ECOPIH, which would significantly help to increase its use .
Finally, it would be interesting to expand the research by looking into the impact of a CoP in a PC clinical setting as a novel tool for training based on real clinical cases.
ECOPIH and other CoCPs can be used to raise clinical cases for consultation and share information among PC and SC professionals; such tools may reduce the number of referrals to SC. Furthermore, ECOPIH and similar tools offer advantages for clinical efficiency. The potential of the tool increases as more and more young professionals use it. We also believe that its use should be strengthened because of the advantages it offers in terms of efficiency, learning and spreading knowledge.
Availability of data and materials
All data generated or analysed during this study are included in this published article.
Community of clinical practice
Community of practice
Eina de Comunicació entre Primària i Hospitalària (Online Communication Tool between Primary and Hospital Care)
Information and communication technologies
Primary Care Service
Open University of Catalonia
Murray M, Berwick DM. Advanced access: reducing waiting and delays in primary care. JAMA. 2003;289(8):1035–40 Available from: http://www.ncbi.nlm.nih.gov/pubmed/12597760.
Musgrove H, Creese A, Preker A, Baeza C, Anell A, Prentice T. The World health report 2000 : health systems: improving performance, vol. 78. Geneva: The World health report 2000; 2000. Available from: http://www.who.int/whr/2000/en/whr00_en.pdf
Starfield B, Shi L, Macinko J. Contribution of primary care to health systems and health. Milbank Q. 2005;83(3):457–502 Available from: http://www.ncbi.nlm.nih.gov/pubmed/16202000.
Beasley JW, Hankey TH, Erickson R, Stange KC, Mundt M, Elliott M, et al. How many problems do family physicians manage at each encounter? A WReN study. Ann Fam Med [Internet]. 2004;2(5):405–10 Available from: http://www.annfammed.org/content/2/5/405.short.
Davidoff F, Miglus J. Delivering clinical evidence where it’s needed: building an information system worthy of the profession. JAMA. 2011;305(18):1906–7 Available from: http://www.ncbi.nlm.nih.gov/pubmed/21558524.
Smith R. Strategies for coping with information overload. BMJ. 2010;341:c7126 Available from: http://www.ncbi.nlm.nih.gov/pubmed/21159764.
Grant RW, Ashburner JM, Hong CS, Hong CC, Chang Y, Barry MJ, et al. Defining patient complexity from the primary care physician’s perspective: a cohort study. Ann Intern Med. 2011;155(12):797–804 Available from: http://www.ncbi.nlm.nih.gov/pubmed/22184686.
Del Fiol G, Workman TE, Gorman PN. Clinical questions raised by clinicians at the point of care: a systematic review. JAMA Intern Med. 2014;174(5):710–8 Available from: http://archinte.jamanetwork.com/article.aspx?articleid=1846630.
Lacasta Tintorer D, Manresa Domínguez JM, Pujol-Rivera E, Flayeh Beneyto S, Mundet Tuduri X, Saigí-Rubió F. Keys to success of a community of clinical practice in primary care: a qualitative evaluation of the ECOPIH project. BMC Fam Pract. 2018;19(1):56 Available from: https://bmcfampract.biomedcentral.com/articles/10.1186/s12875-018-0739-0.
Alonso Pérez de Ágreda JP, Febrel Bordejé M, Huelin Domeco de Jarauta J. Factores Asociados a la Derivación Inadecuada Entre Atención Primaria y Especializada: Estudio Cualitativo en Médicos de Atención Primaria. Gac Sanit. 2000;14(2):122–30 Available from: http://apps.elsevier.es/watermark/ctl_servlet?_f=10&pident_articulo=13008602&pident_usuario=0&pcontactid=&pident_revista=138&ty=119&accion=L&origen=elsevier&web=www.elsevier.es&lan=es&fichero=138v14n2a13008602pdf001.pdf.
Terraza Núñez R, Vargas Lorenzo I, Vázquez Navarrete ML. Coordination among healthcare levels: systematization of tools and measures. Gac Sanit. 2006;20(6):485–95 Available from: http://scielo.isciii.es/pdf/gs/v20n6/revision.pdf.
O’Malley AS, Reschovsky JD. Referral and consultation communication between primary care and specialist physicians: finding common ground. Arch Intern Med. 2011;171(1):56–65 Available from: http://archinte.ama-assn.org/cgi/reprint/171/1/56.
Bodenheimer T. Coordinating care--a perilous journey through the health care system. N Engl J Med. 2008;358(10):1064–71 Available from: http://amcp.org/WorkArea/DownloadAsset.aspx?id=12358.
Louro González A, Fernández Obanza E, Fernández López E, Vázquez Millán P, Villegas González L, Casariego VE. Análisis de las dudas de los médicos de atención primaria. Aten Primaria. 2009;41(11):592–7.
Montero Ruiz E, López-Álvarez J. La interconsulta médica: problemas y soluciones. Med Clin (Barc). 2011;136(11):488–90 Available from: http://linkinghub.elsevier.com/retrieve/pii/S0025775309011099.
Horner K, Wagner E, Tufano J. Electronic consultations between primary and specialty care clinicians: early insights. Issue Brief (Commonw Fund). 2011;23:1–14 Available from: http://mobile.commonwealthfund.org/~/media/Files/Publications/Issue Brief/2011/Oct/1554_Horner_econsultations_primary_specialty_care_clinicians_ib.pdf.
Forrest CB, Nutting PA, von Schrader S, Rohde C, Starfield B. Primary care physician specialty referral decision making: patient, physician, and health care system determinants. Med Decis Mak. 2006;26(1):76–85 Available from: http://www.ncbi.nlm.nih.gov/pubmed/16495203.
Blank L, Baxter S, Woods HB, Goyder E, Lee A, Payne N, et al. What is the evidence on interventions to manage referral from primary to specialist non-emergency care? A systematic review and logic model synthesis. Heal Serv Deliv Res. 2015;3(24):1–430.
Brez S, Rowan M, Malcolm J, Izzi S, Maranger J, Liddy C, et al. Transition from specialist to primary diabetes care: a qualitative study of perspectives of primary care physicians. BMC Fam Pract. 2009;10:39 Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2704171&tool=pmcentrez&rendertype=abstract.
Harrison R, Clayton W, Wallace P. Can telemedicine be used to improve communication between primary and secondary care? BMJ. 1996;313(7069):1377–80-1 Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2352902&tool=pmcentrez&rendertype=abstract.
Carey M, Noble N, Mansfield E, Waller A, Henskens F, Sanson-Fisher R. The Role of eHealth in Optimizing Preventive Care in the Primary Care Setting. J Med Internet Res. 2015;17(5):e126 Available from: http://www.jmir.org/2015/5/e126/.
Saigi-Rubió F, Jiménez-Zarco A, Torrent-Sellens J. Determinants of the intention to use telemedicine: Evidence from Primary Care physicians. Int J Technol Assess Health Care. 2016;32(1–2):29–36.
Díaz-Chao Á, Torrent-Sellens J, Lacasta-Tintorer D, Saigí-Rubió F. Improving Integrated Care: Modelling the performance of an online community of practice. Int J Integr Care. 2014;14(1) Available from: http://www.ijic.org/article/10.5334/ijic.1200/.
Bashshur RL, Shannon G, Krupinski EA, Grigsby J. Sustaining and realizing the promise of telemedicine. Telemed J E Health [Internet]. 2013;19(5):339–45 Available from: http://online.liebertpub.com/doi/abs/10.1089/tmj.2012.0282.
Waldura JF, Neff S, Dehlendorf C, Goldschmidt RH. Teleconsultation improves primary care clinicians’ confidence about caring for HIV. J Gen Intern Med. 2013;28(6):793–800.
Liddy C, Rowan MS, Afkham A, Maranger J, Keely E. Building access to specialist care through e-consultation. Open Med. 2013 Jan;7(1):e1–8.
Vimalananda VG, Gupte G, Seraj SM, Orlander J, Berlowitz D, Fincke BG, et al. Electronic consultations (e-consults) to improve access to specialty care: a systematic review and narrative synthesis. J Telemed Telecare. 2015;21(6):323–30.
Angstman KB, Adamson SC, Furst JW, Houston MS, Rohrer JE. Provider satisfaction with virtual specialist consultations in a family medicine department. Health Care Manag (Frederick). 2009;28(1):14–8 Available from: http://www.ncbi.nlm.nih.gov/pubmed/19225331.
Stoves J, Connolly J, Cheung CK, Grange A, Rhodes P, O’Donoghue D, et al. Electronic consultation as an alternative to hospital referral for patients with chronic kidney disease: a novel application for networked electronic health records to improve the accessibility and efficiency of healthcare. Qual Saf Health Care. 2010;19(5):e54 Available from: http://www.ncbi.nlm.nih.gov/pubmed/20554576.
Zanaboni P, Scalvini S, Bernocchi P, Borghi G, Tridico C, Masella C. Teleconsultation service to improve healthcare in rural areas: acceptance, organizational impact and appropriateness. BMC Health Serv Res. 2009;9:238.
Kim-Hwang JE, Chen AH, Bell DS, Guzman D, Yee HF, Kushel MB. Evaluating electronic referrals for specialty care at a public hospital. J Gen Intern Med. 2010;25(10):1123–8. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2955477&tool=pmcentrez&rendertype=abstract.
Straus SG, Chen AH, Yee H, Kushel MB, Bell DS. Implementation of an electronic referral system for outpatient specialty care. AMIA Annu Symp Proc. 2011;2011:1337–46 Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3243286&tool=pmcentrez&rendertype=abstract.
Wenger E. Communities of practice: learning, meaning, and identity: Cambridge University Press; 1999. 318 p. Available from: https://books.google.com/books?id=heBZpgYUKdAC&pgis=1.
Gabbay J, le May A. Evidence based guidelines or collectively constructed “mindlines?” Ethnographic study of knowledge management in primary care. BMJ. 2004;329(7473):1013 Available from: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC524553/.
Li LC, Grimshaw JM, Nielsen C, Judd M, Coyte PC, Graham ID. Use of communities of practice in business and health care sectors: a systematic review. Implement Sci. 2009;4(1):27 Available from: http://www.ncbi.nlm.nih.gov/pubmed/19445723.
McGowan BS, Wasko M, Vartabedian BS, Miller RS, Freiherr DD, Abdolrasulnia M. Understanding the factors that influence the adoption and meaningful use of social media by physicians to share medical information. J Med Internet Res. 2012;14(5):e117 Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3510763&tool=pmcentrez&rendertype=abstract.
Wenger E, Snyder W. Communities of Practice: The Organizational Frontier. Harv Bus Rev. 2000:139–45 Available from: https://hbr.org/2000/01/communities-of-practice-the-organizational-frontier. Accessed 3 June 2018.
Norman GR, Schmidt HG. Effectiveness of problem-based learning curricula: theory, practice and paper darts. Med Educ. 2000;34(9):721–8.
OSMA Legal Services Group. Social networking and the medical practice. J Okla State Med Assoc. 2010;103(10):517–26 Available from: http://www.ncbi.nlm.nih.gov/pubmed/21189831.
Maloney EJ. What Web 2.0 Can Teach Us About Learning. The Chronicle of Higher Education, vol. B26; 2007. Available from: http://www.chronicle.com/article/What-Web-20-Can-Teach-Us/8332
Cain J, Policastri A. Using Facebook as an informal learning environment. Am J Pharm Educ. 2011;75(10):207 Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3279026&tool=pmcentrez&rendertype=abstract.
Yamout SZ, Glick ZA, Lind DS, Monson RAZ, Glick PL. Using social media to enhance surgeon and patient education and communication. Bull Am Coll Surg. 2011;96(7):7–15 Available from: http://www.ncbi.nlm.nih.gov/pubmed/22315896.
Paton C, Bamidis PD, Eysenbach G, Hansen M, Cabrer M. Experience in the use of social media in medical and health education. Contribution of the IMIA Social Media Working Group. Yearb Med Inform. 2011;6:21–9 Available from: http://www.ncbi.nlm.nih.gov/pubmed/21938320.
Lacasta Tintorer D, Flayeh Beneyto S, Alzaga Reig X, Mundet Tuduri X, De la Fuente JA, Manresa JM, et al. Impact of the implementation of an online network support tool among clinicians of primary health care and specialists: ECOPIH Project. BMC Fam Pract. 2013;14(1):146 Available from: http://www.biomedcentral.com/1471-2296/14/146.
Lacasta Tintorer D, Flayeh Beneyto S, Manresa JM, Torán-Monserrat P, Jiménez-Zarco A, Torrent-Sellens J, et al. Understanding the discriminant factors that influence the adoption and use of clinical communities of practice: The ECOPIH case. BMC Health Serv Res. 2015;15(1):373.
Fabrigar L, Wegener D, MacCallum R. Evaluating the use of exploratory factor analysis in psychological research. Psychological. 1999; Available from: http://psycnet.apa.org/journals/met/4/3/272/.
Nunnally JC. Psychometric theory. University of Michigan, US: McGraw-Hill; 1978. p. 701.
Arrizabalaga P, Bruguera M. The feminization and the profession of Medicine. Med Clin (Barc). 2009;133(5):184–6 Available from: http://www.ncbi.nlm.nih.gov/pubmed/19426998 PMID: 19426998.
Paik JE. The feminization of medicine. JAMA. 2000;283(5):666 Retrieved August 8, 2019. Available from: http://jama.jamanetwork.com/article.aspx?doi=10.1001/jama.283.5.666-JMS0202-2-1).
Torrent-Sellens J, Díaz-Chao Á, Soler-Ramos I, Saigí-Rubió F. Modeling and predicting outcomes of eHealth usage by European physicians: multidimensional approach from a survey of 9196 general practitioners. J Med Internet Res. 2018;20(10):e279. https://doi.org/10.2196/jmir.9253.
Lee Y, Lin J. Do patient autonomy preferences matter? Linking patient-centered care to patient-physician relationships and health outcomes. Soc Sci Med. 2010;71(10):1811–8.
Vimalananda VG, Gupte G, Seraj SM, Orlander J, Berlowitz D, Fincke BG, et al. Electronic consultations (e-consults) to improve access to specialty care: a systematic review and narrative synthesis. J Telemed Telecare [Internet]. 2015;21(6):323–30 Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=4561452&tool=pmcentrez&rendertype=abstract.
May C, Harrison R, Finch T, MacFarlane A, Mair F, Wallace P, et al. Understanding the normalization of telemedicine services through qualitative evaluation. J Am Med Inform Assoc. 2003;10(6):596–604 Available from: http://www.researchgate.net/publication/10607429_Understanding_the_Normalization_of_Telemedicine_Services_through_Qualitative_Evaluation_Table_1.
Greenhalgh T, Russell J. Why do evaluations of eHealth programs fail? An alternative set of guiding principles. PLoS Med. 2010;7(11):e1000360 Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2970573&tool=pmcentrez&rendertype=abstract.
Lacasta Tintorer D, ; Manresa Domínguez JM; Pujol-Rivera E; Flayeh Beneyto S; Mundet Tuduri X; Saigí-Rubió F. Keys to success of a Community of Clinical Practice in primary care: A qualitative evaluation of the ECOPIH project. BMC Fam Pract. 2018;19(1):56.
Wenger E, McDermott RA, Snyder W. Cultivating communities of practice: a guide to managing knowledge: Harvard Business School Press; 2002. Available from: http://dl.acm.org/citation.cfm?id=560383.
Masso M, Thompson C. Attributes of innovations and approaches to scalability - lessons from a national program to extend the scope of practice of health professionals. J Multidiscip Healthc. 2016;9:401–10 Available from: http://www.ncbi.nlm.nih.gov/pubmed/27616889.
This project received a grant from the 7th 2011 Award for Primary Health Research of the Barcelona Health Region, Government of Catalonia.
This study was also supported through funding from the UAB–Novartis Chair at the Autonomous University of Barcelona. It did not play any role in the study design.
The English version of this work was language-edited by Steven Norris thanks to the support of the eLearn Center at the Open University of Catalonia.
Ethics approval and consent to participate
The research protocol (P11/39) was reviewed and approved by the Ethics and Clinical Research Committee of the Primary Care Research Institute IDIAP Jordi Gol, Barcelona, Spain.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Lacasta Tintorer, D., Manresa Domínguez, J., Jiménez-Zarco, A. et al. Efficiency as a determinant of loyalty among users of a Community of Clinical Practice: a comparative study between the implementation and consolidation phases. BMC Fam Pract 21, 15 (2020). https://doi.org/10.1186/s12875-020-1081-x
- Remote consultation
- Primary health care
- Problem solving
- Referral and consultation
- Continuing medical education