Effects of online palliative care training on knowledge, attitude and satisfaction of primary care physicians

Abstract

Background

The Spanish Palliative Care Strategy recommends an intermediate level of training for primary care physicians in order to provide them with knowledge and skills. Most of the training involves face-to-face courses but increasing pressures on physicians have resulted in fewer opportunities for provision of and attendance to this type of training. The effectiveness of on-line continuing medical education in terms of its impact on clinical practice has been scarcely studied. Its effect in relation to palliative care for primary care physicians is currently unknown, in terms of improvement in patient's quality of life and main caregiver's satisfaction. There is uncertainty too in terms of any potential benefits of asynchronous communication and interaction among on-line education participants, as well as of the effect of the learning process.

The authors have developed an on-line educational model for palliative care which has been applied to primary care physicians in order to measure its effectiveness regarding knowledge, attitude towards palliative care, and physician's satisfaction in comparison with a control group.

The effectiveness evaluation at 18 months and the impact on the quality of life of patients managed by the physicians, and the main caregiver's satisfaction will be addressed in a different paper.

Methods

Randomized controlled educational trial to compared, on a first stage, the knowledge and attitude of primary care physicians regarding palliative care for advanced cancer patients, as well as satisfaction in those who followed an on-line palliative care training program with tutorship, using a Moodle Platform vs. traditional education.

Results

169 physicians were included, 85 in the intervention group and 84 in the control group, of which five were excluded. Finally 82 participants per group were analyzed. There were significant differences in favor of the intervention group, in terms of knowledge (mean 4.6; CI 95%: 2.8 to 6.5 (p = 0.0001), scale range 0-33), confidence in symptom management (p = 0.02) and confidence in terms of communication (p = 0.038). Useful aspects were pointed out, as well as others to be improved in future applications. The satisfaction of the intervention group was high.

Conclusions

The results of this study show that there was a significant increase of knowledge of 14%-20% and a significant increase in the perception of confidence in symptom management and communication in the intervention group in comparison with the control group that received traditional methods of education in palliative care or no educational activity at all. The overall satisfaction with the intervention was good-very good for most participants.

This on-line educational model seems a useful tool for palliative care training in primary care physicians who have a high opinion about the integration of palliative care within primary care. The results of this study support the suggestion that learning effectiveness should be currently investigated comparing different Internet interventions, instead of Internet vs. no intervention.

Trial Registration

German Clinical Trials Register DRKS00000694

Background

Palliative care (PC) in Spain can be delivered to patients at hospital and in the last months of life mainly at home, by primary care physicians (PCPs) supported by specialist PC teams, not equally distributed all over the country, and with access to an inpatient facility when required. The Spanish PC Strategy recommends an intermediate level of training for PCPs in order to provide them with knowledge and skills. Most of the training consists of face-to-face courses, but increasing pressures on PCPs have resulted in fewer opportunities for provision and attendance to this type of training.

Training needs of PCPs in PC have been described at great length in scientific literature [1–4]. A systematic review of educational methods in PC for PCPs showed that those educational activities with multi-faceted methodology offered better results than those using simple didactic approaches [5]. The only study using Internet as supporting element, together with a joint approach, showed significant outcomes in terms of palliative treatment choice, and regarding PCPs' attitude and satisfaction in the intervention group.

E-learning or learning facilitated and supported through the use of information and communication technologies offers a learner centred model consistent with the adult learning theory [6, 7], where a direct and active learner involvement is required in order to obtain a subsequent behavior change. E-learning puts learners in control of their own learning in comparison with traditional instructor centred teaching. On-line educational programs offer practical benefits for learners who work well with computers and have access to Internet. It provides a real alternative to traditional methods of education because of its flexibility and interaction capabilities and is rapidly gaining in importance [8]. The efficacy of on-line continuing medical education is already quite well established in two aspects: knowledge acquisition, with results comparable to other traditional models, and learner satisfaction, with higher satisfaction results compared to other models. However, there is uncertainty in terms of potential benefits of asynchronous communication and interaction among participants, and the effect of the learning process. Asynchronous communication, or the relay of information with a time lag, e.g. in discussion forums and e-mails, provides benefits for learning. Some proposed benefits are: that it helps learners to internalize and process information, it offers all learners equal opportunities to participate, it needs a lower hardware and network specification and it is very flexible. The main disadvantages to asynchronous communication are the waste of time while waiting for a response, and the learner's isolation [9].

There has been less research in terms of the effectiveness of on-line continuing medical education, in order to identify whether said model has an impact on clinical practice; and those few known results are mostly based on the physicians' own perception, instead of objective clinical measurements; therefore, these outcomes are still uncertain [10–13]. Data from a systematic review [14] and from other studies [15] have detected discreet improvements of 4%-5%, or none at all. In the topic of PC and cancer the on-line model has also been successfully used for end-of-life care consultation [16], for pain management [17], or to obtain clinical information [18]. However, the effectiveness of on-line PC training for PCPs is currently uncertain, regarding improvement in patient's quality of life and main caregiver's satisfaction, which points out to the need of a clinical impact assessment through objective measurements [5, 19].

On-line continuing medical education is promising in terms of its ability to improve clinical practice, as long as the information provided, dissemination planning and pedagogical approach are accessible, useful, high quality, and focused on the learner [12, 20]. To determine its effectiveness in PC training for PCPs is important due to the fact of increasing constrains of attendance to face to face training and the quickly development of new technologies applied to instruction.

Planning and design of on-line training is particularly complex, as it involves multidisciplinary teams working together in order to shape educational materials according to the chosen pedagogical approach. Didactic resources must be organized and scheduled, tutor-mediated interaction between learners and teaching staff must be planned, and satisfaction and efficacy in terms of learning must be provided.

The authors have developed an on-line educational model for PC which has been applied to PCPs to measure its effectiveness regarding knowledge, attitude towards PC, perception of confidence of symptom management and communication with advanced cancer patients requiring PC and their relatives, and PCPs' satisfaction, in comparison with a control group and random allocation.

The effectiveness evaluation at 18 months, through objective clinical measures, of the impact on the quality of life of patients managed by the physicians, and the main caregiver's satisfaction will be addressed in a different paper.

Methods

Experience Setting: the training model being assessed has been applied during 2009 to PCPs from primary care centers in Spain. Participants were recruited by informing specific groups about the project, and offering teaching credits, participation as collaborator in the final publication of patients' results and financial incentives (80 euros per patient included). Participants had to be: PCPs from the Spanish NHS (with a practice of their own, substitute position ≥ two years, acceptable level of English in order to read medical texts, and Internet access). Those PCPs included were randomized (the physician is the unit of randomization) in two groups by computer-generated exchangeable sequence of two-blocks kept in opaque envelopes. Allocation was conducted when PCPs agreed to take part, by a researcher who didn't know the random sequence, and a sequential numerical code was then assigned. The intervention group had access to the on-line program for PC self-training, while the control group did not, but could voluntarily receive or not the usual PC training offered for his working area (traditional training).

Educational Contents: it was prepared by the authors according to clinical competences of PCPs in PC, as recently defined in the specialty program [21], and distributed in four modules (Figure 1). These modules were divided into subjects including: objectives, contents directed to clinical practice, with clear and concise explanations, PC bibliography and websites. These websites were chosen according to a previous pilot study, in which 27 PCPs assigned a score to the best websites based on their clinical usefulness, the quality of their information, and their accessibility. Each subject included links to explanations for the presentation, and self-guided questions which could be reviewed several times, without a final score.

Figure 1

Contents of Didactic Modules for Palliative Care. Educational content of palliative care and the distribution of modules

Technological Platform: E-Learning platforms, also called VLE (Virtual Learning Environments) or LMS (Learning Management Systems), allow access to instructional information from any location and any time by using a personalized identification, making its use compatible with other activities. At the moment, there is no clear differential concept of technological platforms that facilitate learning and the variety of denominations are defined in terms of their functionality or a description of their functions and tools, instead of a definition consistent with the final objectives of the platform. All these platforms use a system or combination of rules, process or workflows that effectively manages any type of digital information, whether text, images, video, documents, sound files, etcetera. The main concept behind any Content Management System is to make the digital information available for inter-office or on-line edition.

Moodle is a very popular e-learning platform, which is widely used in health education contexts because it allows instructors to prepare and store educational resources easily, in order to deliver them to potential users. It was selected for our study in order to provide physicians with a common repository for the educational resources used in the current experience [22–24]. The Dreamweaver tool was used for content design, and the platform resources (Figure 2) were prepared based on Word documents. Evaluation forums and questionnaires were conducted, complemented by other interactive resources (images, diagrams, videos, interactive webpages, among others).

Figure 2

Moodle Platform. General aspect of the educational content in the Moodle platform

Assessment: The quality of on-line training process, knowledge, and attitude towards PC were assessed, as well as satisfaction with the teaching activity.

Variables registered on-line were:

-Professional data

Age, gender, number of years working in Primary Care, specialty, Medical Residency Training, number of patients requiring PC/year on average (0 to 10, numerical and >10), PC training during the last five years.

-Attitude towards PC

Questionnaire prepared by the authors and previously used in the aforementioned pilot study, with 5-point Likert-scale answers. The perception of support by the area PC Team was explored, as well as the perception of confidence in symptom management, perception of confidence in communication, and a score was assigned to the statement: "PC for advanced cancer patients should be part of care offered by PCPs."

-Basic knowledge

A 33-item questionnaire with a single correct answer. The score consisted of the arithmetic sum of all correct items (with a maximum score of 33). This questionnaire was prepared by the authors following the recommendations about post-graduate medical education assessment [25], and tested in 12 PCPs from different primary care centers, to ensure the validity of its contents and those required modifications to facilitate its understanding.

The intervention group had two tutors available to answer to any doubt through the platform and forums, thus facilitating communication among learners. On-line training, lasting 96 hours, and with 15 credits, was conducted during 75 days (March to May, 2009), with 15-20 days per module, though the platform could be accessed during the whole study.

Evaluation was conducted through a second knowledge questionnaire, similar to the baseline one, as well as the same attitude questionnaire (confidence in symptom management and communication). The intervention group was asked a satisfaction questionnaire, based on the above mentioned pilot study, and another Moodle evaluation questionnaire, with more technical platform aspects (Tables 1, 2). PC training outside the study was registered, as well as group contamination.

Table 1 Process Aspects Assessed in On-line Education

Table 2 Technical Aspects Assessed in the Moodle Survey

A minimum of 60 PCPs per group was calculated, for a score difference of 20% in the short-form pain questionnaire (used to measure impact upon patients) among groups, 5% significance, 90% power, and 10% loss calculations. Frequencies and mean comparisons were analyzed with SPSS (version 18), non-parametric tests were conducted (sign test and Mann-Whitney U test for matched and independent ordinal data) with significant bilateral contrasts in level 0.05, and the Cohen's effect size was calculated between both groups. Group allocation was maintained using multiple imputation for missing values.

Results

The study involved 169 PCPs throughout the whole country, with 85 in the intervention group and 84 in the control group. Five participants (three from the intervention group, two from the control group) were excluded for not providing data; they were three men and two women, all of them on payroll except one substitute. Finally 82 participants per group were analyzed. Baseline characteristics (Tables 3, 4) were balanced with a minimal difference in terms of previous PC training in the intervention group (78%) vs. the control group (70%). Most participants were family doctors (through Medical Residency Training), women, age > 40 years, wide professional experience, on payroll, with recent PC training, and most of them seeing two-four patients per year requiring PC. Most participants had support by the area PC Team, and its performance was considered from good to very good; their perception of confidence in symptom management was acceptable-good, as well as confidence in communication; they agreed-highly agreed that PC for advanced cancer patients should be part of care offered by PCPs.

Table 3 Study Participant Characteristics

Table 4 Study Participant Baseline Characteristics (continued). Absolute Numbers and Value Percentages in Likert Scale.

Evaluation of Access to the On-line Platform

Out of 82 intervention group participants, 59 (72%) completed all modules, 12 (14.6%) didn't complete them, and 11 (13.4%) never accessed the platform. This sub-group of 23 (eight of which abandoned the study due to personal reasons), differentiated itself from those completing the modules by: being younger, less on payroll, and fewer family doctors. The 11 who never accessed the platform were mostly male with less Medical Residency and PC training. Nine were supported by the area PC team and perceived their self-confidence in symptom management between acceptable and good; all of them scored their self-confidence in communication between acceptable and good, and except one all agreed-highly agreed that PC for advanced cancer patients should be part of care offered by PCPs. Their mean score in knowledge was 19.2 (SD 2.8).

The average number of visits to the platform was 266.8 visits (SD 87.3; range 118-509) for those completing modules, and 56.2 (SD 58; range 8-189) for those who did no. Forty-two participants (59%) took part in the discussion forum.

Within the control group, 11 (13.4%) participants received PC training: hospital rotation in palliative unit (1), personal attendance courses (3), on-line course (1), self-study (5) and clinical session (1). These were all short-duration (around 20 hours), and only included basic PC aspects with less specific contents in terms of pain control, communication and quality of life.

Moodle Platform Evaluation

Sixty two (75.6%) survey forms about the platform were received. The most frequent score (Figure 3) was "agree", from 52.5% in question 9 (Do you think that the use of the Moodle Platform has allowed you to answer with higher security the activity assessment questions?), to 71% in question 7 (Do you think that using the Moodle Platform facilitates conducting the activity in an organized manner?). Twenty-seven participants (43.5%) made comments regarding: on-line application difficulties (communication in the forum, difficulties with the platform, sending of answers of questionnaires), or subject presentation (few graphs, subjects too segmented, lack of materials in pdf format).

Figure 3

Overall Score for the Moodle Platform Survey. Results of the technical evaluation of the platform

Evaluation of Knowledge, Attitude and Satisfaction

One hundred thirty one (80%) questionnaires were received, corresponding to 60 (73.2%) intervention group participants, including activity satisfaction; and to 71 (86.6%) control group participants. The most frequent score (Figure 4) was "good" or "very good" with a score of "poor" or "acceptable" the difficulty of conducting on-line training.

Figure 4

Overall Score for the Satisfaction Questionnaire. Results of the evaluation of satisfaction with the on-line training

In order to maintain intent to treat in the analysis missing values were examined and concentrated in five variables, in 35 (21.3%) cases (22 intervention and 13 control). Said examination indicated that they were not missing completely at random; therefore, five multiple imputations were conducted. The results in knowledge, confidence in symptom management and confidence in communication are shown in the Table 5.

Table 5 Results in knowledge and confidence in symptom management and communication

Significant differences among groups in favor of the intervention group were found in knowledge, confidence in symptom management and confidence in communication.

The intervention group showed a significant increase in knowledge and confidence in communication, but not in confidence in symptom management. Eight (13.3%) participants of this group received PC training outside this study: two of them, within the hospital palliative unit, one took a presence course, and the rest received other types of training. Within this sub-group, the median post-test knowledge was 24 (SD 4.6) in comparison with their group that was 25.4 (SD 3.7) that is 4.2% of difference.

The control group decreased knowledge and increase confidence in symptom management in a significant way while the change in confidence in communication was non significant. The subgroup of 11 (13.4%) that reported some kind of education in PC had a post-test knowledge score of 16.9 (SD 3.1) in comparison with 18.1 (SD 3.2) in their group, that is 3.6% of difference.

The most useful aspects pointed out in terms of on-line training (50 participants (83.3%)) were: practical, clear and systematic approach, with elaborated and updated materials; symptom management, death management, communication, opioid management; bibliography and Websites; tutoring and communication among participants. The aspects to be improved in terms of training, pointed out by 42 participants, were associated with computer program design, platform management, or specific subject aspects.

There was no group contamination.

The resources needed for the preparation and implementation of this training were four months for the elaboration of educational contents, one hour a week for three months for tutoring the participants, and about 10 hours for administrative tasks in all procedures. Participants spent about 96 hours in training. A total of 6.500 € were allocated for the on-line adaptation of the educational material. Teachers were the project researchers, so they did not receive any specific budget.

Discussion

The outcomes of the first stage of this study have shown that, after an on-line PC training program targeted to PCPs, using a Moodle Platform, with tutoring, and developed during 75 days, there was an increase of knowledge of 14%-20%, there was a significant increase in the perception of confidence in symptom management and communication, and overall satisfaction was good-very good for most participants. The cost for the education consisted of time spent by the authors in the implementation of the program and logistics. We value the time spent as very positive if we consider that the education model can be offered to other physicians interested in PC education in the near future.

These outcomes are comparable to other studies for on-line educational intervention, such as those reported about pain management and other oncology symptoms, or management of last hours of life [8–12, 26–29]. Most participants assigned a score of "good-very good" to the quality and usefulness of educational contents, with recommendation to other colleagues to take part, and agreement that the integration of platform resources facilitated the learning process. Even though some technical aspects to be improved were pointed out, the overall difficulty in terms of using the platform was considered low.

The decrease in knowledge in the control group, and specifically in the sub-group of 11 who received some kind of education, could be explained by the fact that the majority did not report any educational activity, and only four participants of 11 attended courses with more extensive subjects, while the rest reported self-study, perhaps with more emphasis on specific subjects, not so wide as those explored by the knowledge test. Regression to the mean could be another explanation. The probability of chance is low.

Confidence in communication increased significantly in one to three categories in the intervention group, with a marginal significance in the comparison among groups and low effect size in the data imputated. The subject of communication with the patient and the caregiver was elaborated through visual sketches and specific sentences that, in spite of being short in extension, could have made an impact on the confidence of the participants.

These results must be interpreted within the context of PCPs participating in this study with wide professional experience, knowledge, confidence in terms of symptom management and patient communication in PC from acceptable to high, frequently supported by the local PC team, and with a very high opinion about the integration of PC within Primary Care. Results could not necessarily be reproduced in another PCP profile, particularly in those with a low opinion about the integration of PC within primary care, and who are probably not able to read medical texts in English.

The variety of opinions by PCPs in terms of the on-line design of that training provided might be associated with different learning styles. Some studies about on-line training for healthcare professionals [30] suggest that those with an analytic learning style tend to respond better to less structured, long Web-pages, with an in-depth instead of a wide approach; on the other hand, those professionals with a more holistic style may respond better to less structured educational materials, shorter web-pages, and with a wider instead of an in-depth approach. It has been suggested that on-line education could be significantly encouraged by adapting teaching methods to analytic-holistic learning styles; this has not been thoroughly investigated in terms of medical education.

Another aspect about which there is limited knowledge is the emotional impact of terminal patient care, and how PCPs manage the relationship with patients and their family. Although this aspect was included in module 4 in our study, no specific questions came about from any participants about this issue. The study of this specific topic through a qualitative methodology, as has been carried out in other related topics [31], would allow us to include a future on-line module regarding emotional needs of PCPs, and tackle the issue at the same time.

Education using e-learning platforms has a highly positive and consistent effect when compared with no educational intervention, and seems to have the same efficacy and effectiveness than the traditional training system. A meta-analysis comparing medical knowledge acquired through internet vs. no intervention reported a considerable benefit in favor of Internet [32]. Even though these outcomes might be affected due to confusing factors or chance, it has been suggested that learning effectiveness should be currently investigated comparing different Internet interventions, instead of Internet vs. no intervention.

On-line PC training is increasingly spreading [33], and the on-going studies [34–36] will help to clarify its effectiveness. In our study, on-line training has been effective in improving PCPs' knowledge and attitude, and therefore we consider it a useful training tool.

Study Limitations

The effect upon these results caused by external PC training received by eight participants from the intervention group, that supposes 4.2% of the total score, could affect the evaluation of differences among groups. Nevertheless these situations could be present in studies evaluating effectiveness.

Missing data from 22 intervention participants and 13 control participants are within those reported by scientific literature [32]. This is the strongest limitation, and it somehow suggests that those incentives offered might not have been attractive enough or the physicians did not feel the necessity to follow this specific program.

We have tried to make up for this deficiency by multiple imputation, establishing a comparison with original data and showing more conservative data.

Conclusions

PC training for PCPs using an on-line educational model with a Moodle Platform and tutorship, showed an increase of knowledge of 14%-20%, and a significant increase in the perception of confidence in symptom management and communication, in comparison with a control group that received traditional methods of education or no educational activity at all. PCPs satisfaction was high.

According with the results this on-line educational model seems a useful tool for PC training in PCPs who have a high opinion that PC should be integrated in primary care, able to read English medical texts and supported at large by the PC team. Some limitations signaled are related with the current situation of medical practice.

The results of this study support the suggestion that learning effectiveness should be currently investigated comparing different Internet interventions, instead of Internet vs. no intervention.

The second phase of this study will examine on-line training effectiveness at 18 months, and its impact upon patient's quality of life and caregiver's satisfaction.