- Research article
- Open Access
Exploring why a complex intervention piloted in general practices did not result in an increase in chlamydia screening and diagnosis: a qualitative evaluation using the fidelity of implementation model
BMC Family Practice volume 18, Article number: 43 (2017)
Chlamydia trachomatis (chlamydia) is the most commonly diagnosed sexually transmitted infection (STI) in England; approximately 70% of diagnoses are in sexually active young adults aged under 25. To facilitate opportunistic chlamydia screening in general practice, a complex intervention, based on a previously successful Chlamydia Intervention Randomised Trial (CIRT), was piloted in England. The modified intervention (3Cs and HIV) aimed to encourage general practice staff to routinely offer chlamydia testing to all 15–24 year olds regardless of the type of consultation. However, when the 3Cs (chlamydia screening, signposting to contraceptive services, free condoms) and HIV was offered to a large number of general practitioner (GP) surgeries across England, chlamydia screening was not significantly increased. This qualitative evaluation addresses the following aims:
Explore why the modified intervention did not increase screening across all general practices.
Suggest recommendations for future intervention implementation.
Phone interviews were carried out with 26 practice staff, at least 5 months after their initial educational workshop, exploring their opinions on the workshop and intervention implementation in the real world setting. Interview transcripts were thematically analysed and further examined using the fidelity of implementation model.
Participants who attended had a positive attitude towards the workshops, but attendee numbers were low. Often, the intervention content, as detailed in the educational workshops, was not adhered to: practice staff were unaware of any on-going trainer support; computer prompts were only added to the female contraception template; patients were not encouraged to complete the test immediately; complete chlamydia kits were not always readily available to the clinicians; and videos and posters were not utilised. Staff reported that financial incentives, themselves, were not a motivator; competing priorities and time were identified as major barriers.
Not adhering to the exact intervention model may explain the lack of significant increases in chlamydia screening. To increase fidelity of implementation outside of Randomised Controlled Trial (RCT) conditions, and consequently, improve likelihood of increased screening, future public health interventions in general practices need to have: more specific action planning within the educational workshop; computer prompts added to systems and used; all staff attending the workshop; and on-going practice staff support with feedback of progress on screening and diagnosis rates fed back to all staff.
Chlamydia trachomatis (chlamydia) is the most commonly diagnosed STI in England, with 206,774 diagnoses made in 2014 . Sexually active young adults aged under 25 years old continue to be at the highest risk of contracting an STI . Chlamydia infection can cause significant short and long-term morbidity with complications including: pelvic inflammatory disease (PID), tubal infertility and ectopic pregnancy in females; and epididymo-orchitis and possible infertility in males [2–4].
The National Chlamydia Screening Programme (NCSP), established in 2003, aims to control chlamydia through early detection and treatment of asymptomatic infection, so reducing onward transmission and the consequences of untreated infection [5, 6]. A means of achieving this is through opportunistic screening [7–9]. As the majority of young people visit their GP surgery at least once annually, young people see it as an accessible and acceptable setting to receive sexual health services [10–12].
To facilitate opportunistic screening, Public Health England (PHE), in consultation with a primary care led advisory group comprising of general practitioners and practice nurses, developed a more complex intervention, based on a previously successful Chlamydia Intervention Randomised Trial (CIRT) [13, 14]. Whereas the only aim of CIRT was to increase chlamydia screening, the modified intervention, 3Cs and HIV , incorporated updated national policy change, such as the integration of chlamydia testing with other sexual health and reproductive services. It aimed to encourage general practice staff to routinely offer chlamydia testing, and provide information about the provision of contraceptive services and free condoms (the ‘3C’s) to all 15–24 year olds, regardless of their reason for consultation. Additionally, practice staff were encouraged to offer HIV screening in line with national guidelines .
The 3Cs and HIV intervention, based on the Theory of Planned Behaviour , consisted of two educational workshops, delivered by trained local sexual health staff, and an optional follow up with the trainer (see Fig. 1 for details). The first workshop focussed on the routine offer of 3Cs (chlamydia, contraception and condoms); and the second on facilitating HIV screening. The workshops, delivered between August 2013 and July 2015, were supported by a range of materials to engage practice staff and patients (posters, invitation cards and/or leaflets) , such as: advertising the availability and confidentiality of the service, in waiting areas; as a prompt for clinicians, in consultations. These resources were developed based on the Theory of Planned Behaviour , with engagement in mind. The intervention encouraged a ‘whole practice’ approach to screening, encouraging all staff members (clinical and non-clinical) to attend the educational workshops; and suggested a 3Cs champion be appointed to motivate, encourage and facilitate discussions and feedback within team meetings.
Following the protocol for the 3Cs & HIV programme , both quantitative and qualitative methods were planned to evaluate the effectiveness of the intervention in relation to increasing chlamydia screening (see Fig. 2 for more details on how the intervention was designed to increase chlamydia screening, specifically).
Although immediately after the workshop, practice staff who attended the educational workshops fed back that they intended to increase their chlamydia screening as a result of the training, the quantitative evaluation shows that there was no overall significant increase in chlamydia testing or diagnosis across all of the practices offered the workshops . However, chlamydia testing and diagnosis significantly increased in practices that received specific payments for testing before the intervention began. These practices were reminded about these incentives during the educational workshop.
This qualitative arm of the service evaluation aimed to: a) explore why an intervention based on a successful trial [13, 14] did not achieve the same sustained results in the wider pilot, b) make recommendations for future interventions, and their implementation, within the general practice setting in an effort to improve outcomes.
The fidelity of implementation model (Fig. 3) has been used to facilitate this research. The theory provides a conceptual framework referring to the degree to which an intervention or programme is delivered as intended . Unless such an assessment is made, it cannot be determined whether a lack of impact is due to poor implementation or inadequacies inherent in the programme itself, so called Type III error [21, 22]. The concept of implementation fidelity can be described in terms of five elements: adherence to an intervention; exposure or dose; quality of delivery; participant responsiveness; and programme differentiation . This paper will explore each of the first four elements, the relationship between them and suggest essential components of the intervention (programme differentiation, the fifth element) based on the qualitative and quantitative findings.
Recruitment and sampling
Practices that had participated in the 3Cs and HIV intervention were stratified by chlamydia screening rate per 100 registered 15–24 year old patients, from January 2013 until September 2014 . Practices were then contacted in a random order from this list via the practice managers. Interviews were arranged with practice staff that had previously attended the educational workshops. Data saturation was achieved after 18 interviews . However, as the quantitative analysis showed locally enhanced service (LES) payments to be a relevant factor , purposive sampling  was used recruit a further 8 participants from areas with an existing LES, at the time of the intervention. At this stage, male practice staff were prioritised, where there was an option, to reduce the gender imbalance.
The interview schedule explored staff’s opinions on the 3Cs and HIV educational workshop as a whole; which components of the intervention they had implemented and their opinion on these (ie. posters, cards, prompts, champion, further discussion); and the impact the intervention had had on their chlamydia testing, HIV testing and sexual health provision. Participants were specifically asked about any barriers to offering basic sexual health services in their practice and ideas on how these could be alleviated. In the initial stages of qualitative data collection, the interviewers were not aware of the quantitative findings. The semi structured interview schedule  was modified and developed throughout the data collection process, based on the findings from previous interviews and, following the results of the quantitative analysis, to assess why the intervention was not successful, overall (Additional file 1: Appendix 1 and Additional file 2: Appendix 2). Interviewers were practiced in the skill of interviewing, using probing as opposed to leading questions. Length of interviews ranged from 12.8 to 50.6 min, with an average length of 31.6 min.
Interviews were conducted by telephone, as practice staff reported that they had insufficient time for face-to-face interviews. Although visual cues cannot be obtained during telephone interviews [27, 28], results compared between telephone and face-to-face interviews are very similar . In order for the interviewee to feel they could speak openly and not be influenced by a pre-existing relationship with the interviewer, the interviewer had not facilitated the training or had any previous contact with the participants. Therefore, in order for the interviewer to build rapport with the practice staff, emails and phone calls were exchanged, in order to: set up a time for the interview; discuss the purpose of the research; and ensure the participant was fully informed before written consent was provided. Interviewees were explicitly encouraged to discuss all positive and negative features of the intervention, in order to understand facilitators and barriers to implementation.
Interviews were recorded and transcribed verbatim. Transcripts were analysed using a modified framework analysis . Transcripts were initially read through for accuracy and data familiarisation. Two researchers independently coded categories and themes: the lead researcher coded all transcripts and a second researcher coded 10% of the transcripts, to ensure coding consistency; minor discrepancies over specific terminology of themes were resolved through discussion and referral to the original transcripts until agreement was reached. Use of NVivo software (version 10) facilitated the organisation of the data. The one sheet of paper (OSOP) method  was used to clarify findings within, and between, themes. As the quantitative evaluation found that the intervention was not successful in increasing chlamydia screening and diagnosis rates in all general practices , deductive analysis  was used, whereby the principles of the fidelity of implementation model (Fig. 2) were applied to further analyse the themes.
From July 2014 to May 2016, at least 5 months post intervention, 26 members of practice staff were interviewed to see whether there had been a sustained behaviour change. Both clinical and non-clinical staff were interviewed, as everyone had been encouraged to attend the educational workshops. More women participated in the interviews than men, which is also reflected in attendance of the educational workshops. See Table 1 for more details.
The themes that emerged from the interviews were further examined using the fidelity of implementation model as outlined below.
Quality of delivery
Opinion on the trainer/training
Practice staff were very positive about the trainer, quality and format of the training received.
“actually quite interested to hear all the statistics because she did say a lot about the (geographical location) area and what was relevant to us rather than just about the whole country” (KIKT122- receptionist)
“The advantages of training like the 3C are that staff can talk to each other at in group sessions, and any sort of group training is good because, people, not from what you learn particularly from the lecturers, but from what you learn from the colleagues” (YNYCR126- nurse)
Participants felt that it was relevant to all staff, regardless of their previous sexual health training or their current role within the practice.
“I found it very useful, and it was… delivered at the right level… we had admin staff with varying knowledge and years of experience working in the NHS as well as two clinical staff attend. So she pitched it at the right level, made it interesting, made it informative and yeah, she’s a very pleasant lady and I think she did very well… Yes, no complaints whatsoever. It was easy to understand. There wasn’t any massive medical jargon. It gave a bit of background history as to each point and yeah, she delivered it well.” (DRA2- practice manager)
The training raised staff awareness of chlamydia and was facilitated by the fact that the trainer came to the practice and held the training over lunch, so it was not an added burden to staff’s workload. In a couple of practices, the 3Cs and HIV educational workshop prompted individuals within the practice with an interest in sexual health to provide further training sessions for staff.
“I think it’s made people more aware, because what we did was, we also expanded on the contraceptive side of things and we actually gave a very short training session to the staff as to the types of contraceptive that we actually offer…” (DRA2- practice manager)
Suggestions for the future
Most staff said that they did not: receive the 3Cs and HIV newsletter provided by the trainer to the practice for dissemination; or any other feedback on their progress; and were not aware of any further contact with the trainer following the start of the intervention.
“Never, ever had any feedback after the training…The training was very good, it was comprehensive, but I was asked then, to produce these figures and I’ll never know what they were for.” (DRA2- practice manager)
“I don’t think we got any support from my memory, I can’t remember having anything…which I think would have been helpful” (NSCR122- GP)
Participants recommended regular updates circulated to all staff, as initially staff were motivated and focussed, but as time passed, this was not sustained.
“We did have quite a big drive originally, and things just tend to drop off sometimes…
What do you think could be changed so that it doesn’t drop off?
I think just keeping up with this kind of training, really, and keeping us on our toes, I suppose…. we just need to do the reminders, I think, more than anything else.” (LIRA2- nurse)
Suggested formats included: the trainer coming back to train new staff; shorter but more regular training slots; making the training mandatory; training for a group of GP surgeries rather than individual surgeries; more regular updates on STIs.
“…you do a big screening event, for the few weeks after the event, it’s foremost in everyone’s mind because they’ve just had the training. A year later, they’ve forgotten all about it… If the same person that delivered the first training turned up 6 months later and said I’m only here for 10 minutes, do you remember we did the screening, the training, how are you getting on? Have any anything you want to discuss about difficulties?… You know if you just had a 10 minute refresher every 6 months that would, that would keep the plant watered” (NSCR121- GP)
“I think probably tiny amounts of training on a on a frequent basis…may be better than a big training session which nobody has got time for… I think small but regular training inputs are more effective” (NSCR121- GP)
“Following the training, were you clear on what your role was in taking the 3Cs forward and offering a routine chlamydia test?
At the time I was. I think I was crystal clear. Yeah. I’d like, I wouldn’t say I am now.
And why do you think it is?
…I need things repeating to me every so often and I think that’s what’s missing. I think if we had something like the 3Cs training yearly, that would keep it fresh in my mind… Yeah we do a lot of things yearly. It’s mandatory for a lot of things and that’s how we remember it. Because we’re all rubbish at remembering… So it would fit with something like that.” (YORA4- GP)
“The GPs have training every month… and that is the best way to get to GPs, because they’re all there at the same time… there’s nurse training as well, that we have every month.” (YORA1- nurse)
Exposure or dose
Who attended the training vs. who the training would be most useful for
Data from the quantitative analysis showed that 58% (268/460) of practices that agreed to participate in the intervention received at least one educational workshop . When discussing reasons for their colleagues non-attendance at the educational workshops, participants reported reasons, such as: lack of time (especially GPs); staff feeling that it is not their field, role, or area of expertise (especially male, older GPs); and the perception that chlamydia tests are offered in contraception consultations, which are generally for female patients, who prefer to see female staff.
“We didn’t complete it… only did the chlamydia and it’s not because she didn’t try, she kept trying to get in, but we had a massive, massive staff change round and then we’ve had a lot of sickness so I couldn’t, I just cannot get the meetings together for the rest of them.” (YNYER121- nurse)
“you’re going to find that female staff will go… it’s also in your area of speciality and it’s going to be interesting whereas, yeah, someone who’s just not got that in their kind of bag is not, unless it’s a learning need for them, they’re probably not going to rush to be there… are going to miss training” (DCR120- GP)
“[male GP talking about patient’s preference]…see the female doctors for, for consultations… I think it’s less of an issue less of something I’ve had to deal with than some of my colleagues but that of course puts me at risk of being less good at it” (NSKT124- GP)
Some participants felt that the training would be most beneficial for the staff that do not deal with sexual health or young people on a regular basis, but it was felt that these were often the members of staff that did not attend the training.
“If we didn’t already have the experience of talking to young people because we are a university eh campus site then I think that those for those clinicians then it would be hugely beneficial” (YNYKT125- nurse)
Staff’s perception of young people’s beliefs
It was felt that 15–24 years olds are overall more aware and responsive to the offer of a chlamydia screen than previously, due to campaigns related to screening, and education in personal, social, health and economic education (PSHE) and sex and relationship education (SRE) in schools. As such, participants reported that chlamydia screening has become more routine.
“Yeah, they are more aware and a lot of them have had, yeah a, well a lot of them say that they have had chlamydia screening in the last 3 months, when I’ve asked them, and they’re aware to do it every year if they’ve got a regular partner or when they change their partner” (NSCR122- GP)
“It’s part of their, you know, obligatory PHSE training in school now, they all have a lot of time erm being taught that, so I think, perhaps, patients don’t feel the need to come in and be taught that in the surgery, because they’ve already had it” (NSCR120- GP)
Practice staff reported that the 3Cs were mainly offered to young women in contraception consultations, as there was a reminder on the contraception template. It was the opinion of some practice staff that if a patient wanted to be tested for chlamydia, they would just pick up a self-screening kit, and therefore, did not need to be offered a test.
“I haven’t had the personal experience that that many people are coming in asking for screening. I think, if they want screening, they know they can pick up the self-testing kits” (NSCR120- GP)
It was the opinion of many practice staff that young people have a preference for receiving sexual health advice from services other than general practices. Reasons included: lack of GP appointments at appropriate times; preference to be in an environment with people of similar age to them; and the worry about the lack of confidentiality in general practice, especially if practice staff know the patient’s family members. Several sources gave their opinion that young people would rather attend sexual health or GUM clinics to get advice on sexual health or pick up a chlamydia screening kit.
“But for the young, with the time, they might talk about after school, before school, and general practice is quite restricted in time.” (LUCR120- nurse)
“They like that so and I think they feel more comfortable about accessing that service if there is people of a similar age to them” (KICR123- nurse)
“Young people that, they like to go somewhere where they think no one knows them and they’re worried maybe if they know the receptionist, or someone’s going to tell their parents, and they don’t realise how confidential the service is really, so that’s why I think they like anonymity of going maybe to a CASH service or an integrated contraception and sexual health service” (KICR123- nurse)
Practice staff’s responsiveness
Whose role is sexual health?
There were differing perceptions from participants on whose role sexual health was and whose responsibility it was to implement the suggested changes of the intervention.
“[talking about their colleagues’ perceptions] Not their field not their problem. Those sorts of patients go to family planning or women’s health or the nurses” (DCR120- GP)
This lack of clarity often resulted in components of the intervention not being completed, as individuals expected someone else to be doing it.
“Do you know whether, following the training, you had a sexual health champion or someone that reminded, kept prodding you to
Do you know what? We didn’t. That would have been a good idea. We didn’t. I think we rely on Dr ** in the practice and Dr ** [female GPs], an awful lot with this. But I think we haven’t actually got a champion.
Do you know whether that was something that was discussed or within the training?
Do you know, I think it was. I think actually in the meeting afterwards I think it was, and for my knowledge I don’t know if we’ve got one. But there could be, well be one in place and I’m just not aware of it.” (YORA4- GP)
“Doctors will be aware of it but they just I suppose haven’t got the time and they just think that nurse, the nurses are doing it [laughs] they just think the nurses are doing it” (KICR123- nurse)
Participants also reported a lack of discussion amongst staff members about chlamydia testing, especially between clinical and non-clinical staff.
“Probably if we had a meeting with the GPs and had a discussion about it and as to what the policy should be, that would probably be more useful, then we’d know where we stand really, If the GPs were on board with offering it then we would if, we’d probably do it ourselves more often as well” (YNYCR122- nurse)
There was a mixed response from non-clinical staff on their willingness to participate in the implementation, for example, some reception staff felt uncomfortable handing out the 3Cs invitation cards to patients.
“Because I kind of did all the spiel and left all the kits at reception and various information, only to discover when I checked a little while later if they’d been offering it, they said, ‘oh, well no one’s asked’” (KICR123- nurse)
“It’s not considered our role to ask patients if they want to have chlamydia screening done or anything like that…if someone wants a chlamydia test we’d book them in with Nurse C*” (KIKT122- receptionist)
The majority of staff felt that young people are receptive to a discussion about 3Cs.
“Where we work, there’s decent awareness of chlamydia amongst young people as an issue, so provided its phrased sensitively, I don’t think there’s a particular issue with making that offer” (NSKT124- GP)
Some participants stated that young people expect to be offered 3Cs as they are in the target age range. It was highlighted that the best approach was to phrase the offer of 3Cs correctly; emphasising the routine, non-judgemental nature of the offer. Gender difference in response to the offer was not identified, but it was highlighted that young men are especially hard to target as they did not attend as frequently.
“I mean men of that age, boys don’t, if they’re not coming for contraception they don’t consult… and when they do consult they’re not consulting about anything to do with sexual health… so for men, you’ve got somebody coming in about their asthma, and then you’re saying to them, as the doctor, ‘while you’re here, do you want a chlamydia check?’ Its, they’re going to look at you, thinking, ‘I’ve come about my asthma, why are you suggesting I need sexual, you know, why are you suggesting I’ve got a sexually transmitted disease?’” (NSCR121- GP)
In contrast, young women were often offered sexual health advice and chlamydia testing at contraception check-ups, as there was usually a tick box for this on the contraception computer template. Some sources said that it was more difficult to offer the 3Cs if the young person was accompanied. Despite the educational workshops, some sources still perceived that patients responded negatively to an offer of a chlamydia test, citing reasons, such as: the perception that patients are offended and feel judged if offered in a non- sexual health consultation; and that there is an excess of chlamydia testing offers to this age group, which causes frustration.
“And there are, some youngsters are constantly being offered chlamydia tests. They get offered them at college, they get offered them every time they go into the toilet there’s a poster about it and if you’re just unlucky enough to be the seventh person that week that’s offered them a test…they can actually be slightly irritated that it’s being overdone” (NSCR121- GP)
The difference between wanting to implement change and making that behaviour change
A locally enhanced service, including financial incentives was mentioned as a facilitator that could make a small difference, but targets set to gain these payments were often reported by participants as unrealistically high. One interviewee highlighted that offering the 3Cs becomes easier, more routine and more comfortable with practice.
Adherence to an intervention
Practice adherence: prompts and templates
Most staff said that they now had a reminder to offer a chlamydia test on the contraception template, which was useful, but no practices had added it to any other consultation template.
“The contraception template, there’s, you know, a tick box for condom supplied, tick box for chlamydia discussed or offered, and tick box for contraception counselling. So, you know, it does kind of, if you use the template, it does trigger you to go through those three things.” (DCR120- GP)
“…prompts on our, just for contraception about screening for chlamydia. We don’t have any other prompts” (NSCR122- GP)
Very few had added a computer prompt based solely on the age of the patient, which would encourage offering a chlamydia test to anyone in the age range, not just females presenting for their contraception consultations.
“I don’t think we could manage to make it toggle into our template, so I think then, it’s a separate thing we have to search for, and I think that is probably something that gets missed” (DCR120- GP)
Practice adherence: hard copy resources
All of the practices interviewed had made use of the posters and 3Cs cards provided in the 3Cs and HIV intervention. Many had positive views on the resources, reporting that they acted as good marketing tools to advertise the chlamydia screening service and highlight its confidential nature.
“We’ve got notices up saying that it’s about confidentiality… And I think, actually, it’s really useful having the posters because you can say, ‘this is a national screening programme.’” (NSCR120- GP)
The majority displayed the posters in the waiting rooms or a prominent place in corridors.
“We actually set up a campaign in the waiting rooms… to say that we were going to ask about chlamydia” (YNYER121- nurse)
Very few displayed the posters in clinical rooms, but those that did said that it was a useful prompt to open the conversation, as suggested in the intervention training videos used in some educational workshops. 3Cs cards were mainly left on reception or in the waiting area for patients to pick up, however, interviewees often did not know whether the receptionists had handed these out, as follow up discussions between practice staff about how the intervention had been implemented had not occurred.
Practice adherence: sexual health champion
Although it was suggested in the educational workshops, some practices were unaware of whether they had a sexual health champion; and when appointed, a couple of sexual health champions were unclear of the requirements of their role.
“I think we just need an update, and a reminder that we need to be thinking, that involves more of our staff. I’m sure, if somebody came, they wouldn’t tell us anything more than we already know, but sometimes you need that prompt every now and again.
Was there anyone within the practice that was giving those prompts?
No, I probably should do it as lead, but again, you just, it just gets absorbed into everything else that you’ve got to do.” (YORA1- nurse)
Barriers to adherence
Competing priorities; lack of time as patients often come in with more than one issue to discuss; or forgetting to offer the 3Cs, especially in a non-sexual health consultation, appeared to be the main barriers for practice staff.
“If a young person has come to talk about something else, it’s not always appropriate to then start talking about 3Cs…sometimes they kind of come with a shopping list of things that they want to come and get dealt with in 10 min, which is all, all medical, and then you are then going to add in well let’s talk about 3Cs, and if you do that properly, that really… can be a 10 min consultation itself, because it opens can often open up a whole can of worms and a whole other consultation and discussion with the patient, just, just to talk about the 3Cs” (YNYKT125- nurse)
“If a young man presents with back pain or shoulder pain then I wouldn’t really, I’m not very good at remembering” (NSCR122- GP)
However, a couple of participants pointed out that, although offering the 3Cs may mean a little extra work, it is something they are meant to, or should routinely be doing.
“So has working in a way, offering the 3Cs, meant that you’ve got any more work to do?
No… It’s just made me do the work that I was meant to do.” (YORA4- GP)
Lack of complete chlamydia kits or condoms in clinicians’ rooms were also limiting factors.
“Our support staff don’t have the kits made up…and that has hindered it… you know, if each time, I’ve got to go and find it, sort it out myself… and you look a plonker, you look a right wally. You know, if you say, ‘oh there’s a kit in the waiting room go’ and there isn’t… it’s down to couple of key individuals that just they perhaps see their role as that.” (NSKT123- GP)
“It’s all very well for me to sit here running 20 min late and think and four people in the waiting room waiting for me, and to think, ‘oh, I should offer this person chlamydia screening’. But, unless that’s at my fingertips, in terms of information for the patient all the testing materials… it makes me think, ‘oh I just can’t I just can’t do that now.’” (NSKT124- GP)
Lack of privacy in the reception area and lack of opportunity proved the main barriers for receptionists handing out the 3Cs cards.
“Because, if you’re a receptionist who’s not, not a clinician, it’s difficult to ask. You can’t. How can you ask someone, in the reception area, with a queue of people?” (NSCR120- GP)
Due to time pressures or lack of facilities, not all practices viewed the video clips as part of their educational workshop. These videos suggested “scripts” that could be used in different consultations to facilitate the offer of 3Cs.
Although participants were very positive about the educational workshops, they reported that not all staff attended and, therefore, a whole practice approach was not attained. Some practices did not plan who was going to take the intervention components forward and how this would be done. For example, patients often did not complete the test immediately and the main reason given was that kits often were not made up and in the clinicians’ rooms.
Additionally, although the educational workshops specifically encouraged the use of computer prompts and templates, practices generally only added a 3Cs prompt to the female contraception template. Many practices did not develop automatic computer prompts for all patients aged 15–24 years old; therefore, men were excluded [4, 33]. Nevertheless, if all patients attending their GPs for a contraception consultation had completed a chlamydia screen, the intervention effect would have been greater than observed , suggesting that this did not happen.
Furthermore, although the educational workshop explicitly addressed some misconceptions of patients’ preferences, practice staff’s opinions and beliefs had not always changed. This is highlighted in the opinion of a few practice staff that patients would just pick up a self-testing kit if they wanted to be screened; although the point of the intervention was to routinely offer a chlamydia screen to all 15–24 years olds, even if un-symptomatic and in un-related consultations. Although screening may be available through other services, the evidence provided at the educational workshops showed that young people see the GP setting as a non-threatening place for them and therefore an appropriate setting to be offered chlamydia screening . Many participants stated that, as chlamydia screening is becoming more routine, many patients had already completed a test recently and therefore refused the offer. It should be acknowledged that the number of times practice staff offered the test was not reported in the quantitative results; only the number of complete chlamydia screens. It may be that, as chlamydia screening kits are more readily available, young people are getting screened through other means, but as data shows that 60–70% of young people in the target age group visit the GP surgery at least annually , practice staff should still be encouraged to offer chlamydia screening to 15–24 year olds, routinely.
Practice staff were not aware of any on-going support with the trainer, which is a key difference from the successful CIRT trial; and, although trainers provided regular newsletters, these were not always circulated around the whole practice [13, 14]. Furthermore, in CIRT, the trainer was funded from a research grant; whereas the 3Cs & HIV intervention used existing staff resources to see whether the intervention was achievable and sustainable in a real world setting. The results suggest there are many challenges with moving from an RCT to real world setting.
Competing priorities, and time were the main barriers for implementation . These competing priorities were: within the general practice, overall; within a consultation, when the patient came in with many symptoms to discuss. Staff reported that financial incentives themselves were not a motivator as targets were too hard to achieve, however the quantitative results show that the practices with financial incentives had a significant increase in chlamydia screening and diagnosis . It is possible that the presence of LES agreements is an indicator of a pre-existing interest in the topic.
Strengths and limitations
Complimenting a quantitative service evaluation with a qualitative evaluation can achieve various aims, including: corroborating findings; generating more complete data; and using results from one method to enhance insights attained with the complementary method [36, 37]. This paper utilised a qualitative approach to attempt to explain and provide insights into the quantitative results. The qualitative findings reflect real issues with any intervention implementation in primary care [38, 39] and the approach enables understanding of ways to improve interventions to facilitate better implementation of already proven effective complex intervention strategies on larger scales outside of trial conditions, with existing local authority funded staff [40, 41].
An additional strength of the study is the range of staff, and characteristics of practices, interviewed. For example, a mixture of male and female: GPs, nurses, practice managers and receptionists; from a range of sized practices with or without a LES, were interviewed. Furthermore, data saturation was reached and no new themes emerged, confirming rich data and a rigorous methodology.
A further strength includes the consideration of the role of the interviewers. The interviewers had not delivered the workshop to the participants and therefore had not developed a relationship with the participants around the intervention delivery. However, the interviewers had been involved in intervention development and/or analysis and therefore had a good understanding of how the intervention was intended to be delivered and the reasoning behind this. This allowed for informed probing by the interviewer, but the participant was not affected by social desirability bias  as they did not link the intervention and the interviewer. The primary analyst had not been involved in the intervention development, and therefore was not biased in their analysis.
As this was a service evaluation across England, it was not possible to video the educational workshops to ascertain whether they were delivered as intended. Trainers were encouraged to adapt the presentation to suit their own presentation style and add statistics to make it applicable to the local authority. Therefore, it cannot be confirmed whether the presentation was delivered exactly as intended and whether the key messages were relayed in their entirety. This highlights the difficulty in ensuring a high fidelity of delivery when working with a wide range of people in differing contexts. For example, trainers reported that, sometimes, there were not the facilities to play the video clips role-playing typical situations, and occasionally there was no training room, so the educational workshop was delivered in the waiting room with staff huddled around the trainer (data not shown).
Comparison to other literature and recommendations
Complex interventions have greater scope for variation in their delivery, and so are more vulnerable to one or more components not being implemented as they should; both in delivery and actions following this [20, 41]. The fidelity of implementation model (Fig. 2) details that various moderators should be taken into consideration when implementing an intervention:
Participants in this study were familiar with and positive about the use of prompts and templates. A study by Walker et al.,  suggest that alerts alone may not be sufficient to significantly increase chlamydia screening, but that they could be included as part of a more complex intervention, such as the 3Cs and HIV. This complex intervention uses prompts in combination with hard copy resources, such as posters and leaflets. Therefore, strategies such as: providing a manual on how to set up a computer prompt based on age; or training the trainer on how to add this prompt to the system, and have the trainer set up the prompt at the first educational workshop, could facilitate implementation, which could have improved the outcomes .
Provision of chlamydia kits was not part of the 3Cs and HIV intervention, which relied on the use of existing kits, provided by the Clinical Commissioning Group (CCG). The chlamydia kits’ supplier was not recorded as part of the intervention, but future work may be necessary to liaise with the commissioners of primary care resources, to highlight the importance of providing the complete kits in GP surgeries, as this would resolve the problem of incomplete kits, identified by some participants. This further highlights the differences between an RCT and sustainably implementing change in real-life conditions, using existing resources and procedures.
Research on guidelines intended for GPs found that detailed and clear recommendations were almost twice as likely to be followed as vague and non-specific recommendations [20, 43]. It could have facilitated implementation if trainers had been explicit about the need for chlamydia kits to be available in every consultation room, to facilitate staff making the offer and facilitate patients completing the tests immediately.
Additionally, more specificity was necessary in regards to where the posters should have been displayed, as the educational workshops suggested that posters displayed in consultation rooms could be used as a prompt or conversation starter, but this was not always adhered to. Furthermore, as the 3Cs and HIV is a complex intervention with multifaceted components and outcomes, a specific action plan detailing staff’s roles and responsibilities to implement the intervention should have been agreed at the end of the training session and re-visited at practice meetings [44, 45].
The lack of fidelity of implementation of the intervention may also have been a result of not everyone attending the educational workshops. The workshop highlighted that if everyone within a practice understands what the 3Cs offer is and how it works in their practice, it makes a huge difference in increasing successful outcomes . Francis and Young  define a team as “an energetic group of people who are committed to achieving common objectives”. However, as not everyone attended the training sessions, there was rarely a whole team approach, which may have resulted in an inconsistent approach to testing, reported by participants, and thus, an overall reduction in fidelity of implementation. By: accessing existing protected learning time and networks; making attendance mandatory; or providing more regular training opportunities, the educational workshop would be attended by a higher percentage of staff, and therefore a whole team approach would be more likely.
Robbins and Finley  argue that team failure is often due to: mismatched needs; confused goals; unresolved roles; insufficient feedback and/or information; ill-conceived reward systems, some of which are consistent with the findings of this study.
The findings of this qualitative study indicate that the overall lack of significant increases in chlamydia testing across all general practices involved in the intervention could be due to lack of adherence to the intervention as it was intended, and how it was suggested in the educational workshops. CIRT  highlighted key components of the chlamydia intervention that resulted in a successful and sustained increase in chlamydia screening. However, this study highlights that, although in theory these components are known, it is not always possible to implement them outside of a research setting. Further research is required to explore the differences between research and real-life settings; however, this qualitative evaluation suggests minor modifications to the presentation, and support provided within the intervention, which could greatly facilitate implementation and may increase chlamydia screening (Table 2).
The majority of practices were initially very motivated by the educational workshop, but were not able to sustain this focus, which resulted in drop off in fidelity of implementation. To counter this, it is essential that contact is sustained between the trainer and the sexual health champion identified within the educational workshop, so that any questions are answered and ensure that the suggested changes have been implemented. Although the third educational workshop was optional, the majority of practices opted for this to be carried out by phone or felt that they did not need or have time for it . In an attempt to build relations, it could be advised that the trainer return to the practice to be able to see in person whether the intervention is being implemented as intended, give suggestions for improvements, and their presence would act as a reminder for staff to re-focus on their role. Although trainers attempted to find a suitable time to return to the practice, this was not always possible due to lack of time, both for the trainer who was not given additional funding or time to complete the role; and the practice who highlighted lack of time as their main barrier for implementation. It is a suggestion that practices without a locally enhanced service should be targeted first for extra support as there was not a significant increase in chlamydia testing within this group .
It is possible that the additional complexity of the 3Cs and HIV intervention in contrast to CIRT was not fully appreciated, and the additional support and facilitators required for implementation was not foreseen. Therefore, in an attempt to increase fidelity of implementation and consequently improve likelihood of increased screening, the intervention needs to have: more specific action planning; computer prompts added to systems and used; all staff attend the workshop in dedicated learning time; and on-going practice staff support.
- 3Cs and HIV:
Chlamydia, Contraception, Condoms, HIV
Clinical Commissioning Group
Chlamydia Intervention Randomised Trial
Intention to treat
Local enhanced service
National chlamydia screening programme
One sheet of paper
Public Health England
Pelvic inflammatory disease
Personal, social, health and economic education
Randomised controlled trial
Sex and relationship education
Sexually transmitted infection
Public Health England. Sexually transmitted infections and chlamydia screening in England, 2014, vol. 9. 2015.
Akande V, Turner C, Horner P, Horne A, Pacey A. Impact of Chlamydia trachomatis in the reproductive setting: British Fertility Society Guidelines for practice. Hum Fertil. 2010;13(3):115–25.
Nwokolo NC, Dragovic B, Patel S, Tong CW, Barker G, Radcliffe K. 2015 UK national guideline for the management of infection with Chlamydia trachomatis. Int J STD AIDS. 2015;27:251–67. doi:10.1177/0956462415615443.
Tebb KP, Pantell RH, Wibbelsman CJ, Neuhaus JM, Tipton AC, Pecson SC, Pai-Dhungat M, Ko TH, Shafer MB. Screening sexually active adolescents for Chlamydia trachomatis: what about the boys? Am J Public Health. 2005;95(10):1806–11.
LaMontagne D, Fenton K, Randall S, Anderson S, Carter P. Establishing the National Chlamydia Screening Programme in England: results from the first full year of screening. Sex Transm Infect. 2004;80(5):335–41.
Salisbury C, Macleod J, Egger M, McCarthy A, Patel R, Holloway A, Ibrahim F, Sterne AC, Horner P, Low N. Opportunistic and systematic screening for chlamydia: a study of consultations by young adults in general practice. Br J Gen Pract. 2006;56(523):99.
Adams J, Turner ME, Edmunds WJ. The cost effectiveness of opportunistic chlamydia screening in England. Sex Transm Infect. 2007;83(4):267.
Robinson S, Roberts T, Barton P, Bryan S, Macleod J, McCarthy A, Egger M, Sanford E, Low N, Chlamydia SG. Healthcare and patient costs of a proactive chlamydia screening programme: the Chlamydia Screening Studies project. Sex Transm Infect. 2007;83(4):276.
Turner KME, Adams EJ, Lamontagne DS, Emmett L, Baster K, Edmunds WJ. Modelling the effectiveness of chlamydia screening in England. Sex Transm Infect. 2006;82(6):496.
Hogan AH, Howell-Jones RS, Pottinger E, Wallace LM, McNulty CA. “…they should be offering it“: a qualitative study to investigate young peoples’ attitudes towards chlamydia screening in GP surgeries. BMC Public Health. 2010;10:616.
Ginige S, Fairley CK, Hocking JS, Bowden FJ, Chen MY. Interventions for increasing chlamydia screening in primary care: a review. BMC Public Health. 2007;7:95.
Guy RJ, Ali H, Liu B, Poznanski S, Ward J, Donovan B, Kaldor J, Hocking J. Efficacy of interventions to increase the uptake of chlamydia screening in primary care: a systematic review. BMC Infect Dis. 2011;11:211.
McNulty CA, Hogan AH, Ricketts EJ, Wallace L, Oliver I, Campbell R, Kalwij S, O’Connell E, Charlett A. Increasing chlamydia screening tests in general practice: a modified Zelen prospective Cluster Randomised Controlled Trial evaluating a complex intervention based on the Theory of Planned Behaviour. Sex Transm Infect. 2014;90(3):188–94.
McNulty CA, Thomas M, Bowen J, Buckley C, Charlett A, Gelb D, Foy C, Sloss J, Smellie S. Interactive workshops increase chlamydia testing in primary care--a controlled study. Fam Pract. 2008;25(4):279.
Town K, Ricketts E, Hartney T, Dunbar J, Nardone A, Folkard K, Charlett A, McNulty C. Supporting general practices to provide sexual and reproductive health services: protocol for the 3Cs & HIV programme. Public Health. 2015;129(9):1244–50.
National Institute for Health and Care Excellence (NICE), Public Health England (PHE). HIV testing: increasing uptake among people who may have undiagnosed HIV (Joint NICE and Public Health England guideline). 2016;1–62.
Ajzen I. Perceived behavioral control self-efficiacy locus of control and theory of planned behavior. J Appl Soc Psychol. 2002;32(4):665–83.
Freeman E, Howell-Jones R, Oliver I, Randall S, Ford-Young W, Beckwith P, McNulty C. Promoting chlamydia screening with posters and leaflets in general practice--a qualitative study. BMC Public Health. 2009;9:383.
Town K, McNulty CA, Ricketts EJ, Hartney T, Nardone A, Folkard KA, Charlett A, Dunbar JK. Service evaluation of an educational intervention to improve sexual health services in primary care implemented using a step-wedge design: analysis of chlamydia testing and diagnosis rate changes. BMC Public Health. 2016;16(1):1.
Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S. A conceptual framework for implementation fidelity. Implement Sci. 2007;2:40.
Dobson D, Cook TJ. Avoiding type III error in program evaluation: Results from a field experiment. Eval Program Plann. 1980;3(4):269–76.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.
Mihalic S. The importance of implementation fidelity. Emotional and Behavioral Disorders in Youth. 2004;4(4):83–105.
Fusch PI, Ness LR. Are we there yet? Data saturation in qualitative research. Qual Rep. 2015;20(9):1408.
Patton MQ. Qualitative research. In: Wiley Online Library. 2005.
Newton N. The use of semi-structured interviews in qualitative research: strengths and weaknesses. Exploring qualitative methods. 2010;1(1):1–11.
Novick G. Is there a bias against telephone interviews in qualitative research? Res Nurs Health. 2008;31(4):391–8.
Garbett R, Mccormack B. The experience of practice development: an exploratory telephone interview study. J Clin Nurs. 2001;10(1):94–102.
Vogl S. Telephone Versus Face-to-Face Interviews Mode Effect on Semistructured Interviews with Children. Sociol Methodol. 2013;43(1):133–77.
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.
Ziebland S, McPherson A. Making sense of qualitative data analysis: an introduction with illustrations from DIPEx (personal experiences of health and illness). Med Educ. 2006;40(5):405–14.
Pope C, Ziebland S, Mays N. Analysing qualitative data. BMJ. 2000;320(7227):114–6.
Walker J, Fairley K, Walker M, Gurrin C, Gunn M, Pirotta V, Carter R, Hocking S. Computer reminders for Chlamydia screening in general practice: a randomized controlled trial. Sex Transm Dis. 2010;37(7):445.
Bowden J, Currie J, Toyne H, McGuiness C, Lim L, Butler R, Glasgow J. Screening for Chlamydia trachomatis at the time of routine Pap smear in general practice: a cluster randomised controlled trial. Med J Aust. 2008;188(2):76.
Wallace L, McNulty C, Hogan A, Bayley J. Exploring attitudes and practices of General Practice staff towards offers of opportunistic screening for chlamydia: a UK survey. Prim Health Care Res Dev. 2012;13(3):255.
Curry LA, Nembhard IM, Bradley EH. Qualitative and mixed methods provide unique contributions to outcomes research. Circulation. 2009;119(10):1442–52.
Creswell JW, Clark VLP. Designing and conducting mixed methods research. 2007.
Smeets HM, Kuyvenhoven MM, Akkerman AE, Welschen I, Schouten GP, Van Essen GA, Verheij TJ. Intervention with educational outreach at large scale to reduce antibiotics for respiratory tract infections: a controlled before and after study. Fam Pract. 2009;26(3):183–7.
Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud P-AC, Rubin HR. Why don’t physicians follow clinical practice guidelines?: A framework for improvement. JAMA. 1999;282(15):1458–65.
Pope C, Mays N, Popay J. Synthesising Qualitative and Quantitative Health Evidence: A Guide to Methods: A Guide to Methods. UK: McGraw-Hill Education; 2007.
Greenhalgh T, Annandale E, Ashcroft R, Barlow J, Black N, Bleakley A, Boaden R, Braithwaite J, Britten N, Carnevale F, et al. An open letter to The BMJ editors on qualitative research. BMJ. 2016;352:i563.
Fisher RJ. Social desirability bias and the validity of indirect questioning. J Consum Res. 1993;20(2):303–15.
Grol R, Dalhuijsen J, Thomas S, Rutten G, Mokkink H. Attributes of clinical guidelines that influence use of guidelines in general practice: observational study. BMJ. 1998;317(7162):858–61.
Lorch R, Hocking J, Guy R, Vaisey A, Wood A, Donovan B, Fairley C, Gunn J, Kaldor J, Temple-Smith M, et al. Do Australian general practitioners believe practice nurses can take a role in chlamydia testing? A qualitative study of attitudes and opinions. BMC Infect Dis. 2015;15:31.
Lorch R, Hocking J, Temple-Smith J, Law M, Yeung A, Wood A, Vaisey A, Donovan B, Fairley CK, Kaldor J, et al. The chlamydia knowlegde awreness and testing practices of Australian General practitioners and practice nurses: survey findings from the Australian Chlamydia Control Effectiveness Pilot (ACCEPt). BMC Fam Pract. 2013;14(169):1471–2296.
Castka P, Bamber CJ, Sharp JM, Belohoubek P. Factors affecting successful implementation of high performance teams. Team Performance Management: An International Journal. 2001;7(7/8):123–34.
Francis D, Young D. Improving work groups, a practical manual for team building. La Jolla: University Associates; 1979.
Robbins H, Finley M. The new why teams don’t work: What goes wrong and how to make it right. San Francisco: Berrett-Koehler Publishers; 2000.
Ricketts EJ, Francischetto EOC, Wallace LM, Hogan A, McNulty CA. Tools to overcome potential barriers to chlamydia screening in general practice: Qualitative evaluation of the implementation of a complex intervention. BMC Fam Pract. 2016;17(1):1.
Bilardi E, Fairley K, Temple-Smith J, Pirotta V, McNamee M, Bourke S, Gurrin C, Hellard M, Sanci A, Wills J, et al. Incentive payments to general practitioners aimed at increasing opportunistic testing of young women for chlamydia: a pilot cluster randomised controlled trial. BMC Public Health. 2010;10:70.
Kalwij S, French S, Mugezi R, Baraitser P. Using educational outreach and a financial incentive to increase general practices’ contribution to chlamydia screening in South-East London 2003–2011. BMC Public Health. 2012;12:802.
We wish to thank the National Chlamydia Screening Programme (NCSP) and wider project group in England, especially John Saunders, Anthony Nardone, and Thomas Hartney, and all members of the 3Cs & HIV Project Group (Deborah Shaw, Sharron Ainslie). Also, the 3Cs & HIV Advisory Group in England (Sebastian Kalwij, Farah Paruk, Farhana Lockhart, Jane Wilkinson, Jason Warriner, Richard Ma, Suzie Clements, and Vicki Courage). We also wish to express our thanks to the CATTE Project Audit Committee (Karin Haar, Chris Foy, Ruth Lowbury, Olga Rostowska, and Torsten Berglund). We thank all of the practice staff who were involved.
This study was supported by a Leonardo Da Vinci Lifelong Learning programme project ChlamydiA Testing Training in Europe (number 2012-1-GB2-LEO05.08044) and Public Health England.
Availability of data and material
The anonymised datasets generated and/or analysed during the current study are available from the corresponding author on reasonable request.
CAM and EJR wrote the grant application and designed the study/project, and wrote the draft interview schedules and protocols for discussion. CR, KT, DML, CAM and RA discussed and agreed the protocols and interview schedule and were involved in adapting interview schedules. CAM, CR, KT, NO-P and RA conducted the interviews, and RA and KT analysed the transcripts. RA, DML, KT, CR, EJR, NO-P, KAF, JKD, and CAM contributed to the resource adaptation process. RA wrote the manuscript with contributions from all authors. RA, DML, KT, CR, EJR, NO-P, KAF, JKD, and CAM have reviewed and approved the final manuscript.
CAM leads on the development of PHE quick reference infection diagnostic guides for GPs; KF is the National Chlamydia Screening Programme (NCSP) Manager; and KD is the Director of the National Chlamydia Screening Programme (NCSP). No other staff declare competing interests.
Consent for publication
Not applicable as no personal information is provided in the manuscript.
Ethics approval and consent to participate
The 3Cs & HIV project is a service development programme that aims to support sexual health teams in Local Authorities (LA) improve general practice engagement using existing sexual health services and resources. After review, the Research Governance Coordinator for PHE confirmed that no ethical approvals were needed. Local research and development approvals were obtained for the qualitative interviews from West Midlands (Ref: COV210514), Devon and Exeter (Ref: VL/MC/R&D/CG), South London (Ref: 121512PC), Lincolnshire, Luton, Avon (Ref: 2014–027), York, North Yorkshire and Humber (Ref: 227). Informed verbal and written consent was obtained from the participants and they were given the opportunity to receive a transcript of the interview. A short code was allocated to each participant, so as to uphold anonymity of quotes used.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Allison, R., Lecky, D.M., Town, K. et al. Exploring why a complex intervention piloted in general practices did not result in an increase in chlamydia screening and diagnosis: a qualitative evaluation using the fidelity of implementation model. BMC Fam Pract 18, 43 (2017). https://doi.org/10.1186/s12875-017-0618-0
- Educational intervention
- General practice