A qualitative exploration of two risk calculators using video-recorded NHS health check consultations
BMC Family Practice volume 21, Article number: 250 (2020)
The aim of the study was to explore practitioner-patient interactions and patient responses when using QRISK®2 or JBS3 cardiovascular disease (CVD) risk calculators. Data were from video-recorded NHS Health Check (NHSHC) consultations captured as part of the UK RIsk COmmunication (RICO) study; a qualitative study of video-recorded NHSHC consultations from 12 general practices in the West Midlands, UK. Participants were those eligible for NHSHC based on national criteria (40–74 years old, no existing diagnoses for cardiovascular-related conditions, not on statins), and practitioners, who delivered the NHSHC.
NHSHCs were video-recorded. One hundred twenty-eight consultations were transcribed and analysed using deductive thematic analysis and coded using a template based around Protection Motivation Theory.
Key themes used to frame the analysis were Cognitive Appraisal (Threat Appraisal, and Coping Appraisal), and Coping Modes (Adaptive, and Maladaptive). Analysis showed little evidence of CVD risk communication, particularly in consultations using QRISK®2. Practitioners often missed opportunities to check patient understanding and encourage risk- reducing behaviour, regardless of the risk calculator used resulting in practitioner verbal dominance. JBS3 appeared to better promote opportunities to initiate risk-factor discussion, and Heart Age and visual representation of risk were more easily understood and impactful than 10-year percentage risk. However, a lack of effective CVD risk discussion in both risk calculator groups increased the likelihood of a maladaptive coping response.
The analysis demonstrates the importance of effective, shared practitioner-patient discussion to enable adaptive coping responses to CVD risk information, and highlights a need for effective and evidence-based practitioner training.
ISRCTN ISRCTN10443908. Registered 7th February 2017.
Cardiovascular disease (CVD) is the leading cause of death worldwide, accounting for one in four deaths in England . NHS Health Check (NHSHC) is a national programme designed to screen CVD risk, facilitate early diagnosis and reduce health inequalities . All eligible adults, aged 40–74 years, should be invited for NHSHC where CVD risk is assessed based on several risk factors (e.g., blood pressure and cholesterol). Best practice guidance suggests a patient should be given appropriate CVD risk management advice following effective risk communication . However, information on the nature and quality of the consultation is scarce. Insight is limited to patient and practitioner experiences , which do not provide a complete understanding of patient-practitioner interactions within the NHSHC.
Communicating risk is challenging  and differs according to patient understanding, numerical literacy, and personality traits . Further, emotional responses to risk and the resulting influence on health behaviour varies between patients [7,8,9,10]. If delivered sub optimally, risk communication can increase anxiety and reduce confidence in health professionals . Effective risk communication can improve knowledge, empower and create autonomy [12,13,14]. Within NHSHC, 10-year percentage risk is calculated and communicated to patients using a prediction algorithm, QRISK®2 [with current transference to QRISK®3 ], which is populated from new and pre-existing data within the patient’s record. However, most younger eligible adults are predisposed to a lower CVD risk which can lead to false reassurances [16, 17], misinterpretation [18,19,20,21,22], and poor patient recall and confusion . The 2014 JBS risk calculator  includes Heart Age [23,24,25,26, 27] and 10-year percentage risk, but primarily focuses on lifetime risk of CVD events through CVD event-free survival (Table 1). It also presents information using multiple visual displays (Table 1)  and a function to manipulate the scores to show how risk-factor modification affects overall risk (e.g., smoking cessation). Whilst there is some evidence to suggest that lifetime risk, Heart Age and visual displays may be more effective during the communication of risk [25, 26, 28,29,30,31,32,33,34,35], until recently, no research has compared the efficacy of JBS3 and QRISK®2 for communicating risk in NHSHC.
Patient-practitioner interactions are complex [36, 37], yet application of theories such as Protection Motivation Theory (PMT ;) have shown how fear of threat can translate in to health-protective behaviour . Within PMT, the intention to engage in health-protective behaviour is influenced by an individual’s cognitive appraisals (Fig. 1). CVD risk information presented in an NHSHC can feed into such appraisals, either threat appraisal (risk of CVD), or coping appraisal (consequences of undertaking positive behaviour change).
Threat appraisal focuses on the source of the threat (CVD risk) and evaluates the probability of a maladaptive response (i.e., behaviours that inhibit patients’ ability to adjust to the threat). It considers patients’ perceived severity of CVD risk, the consequences of CVD, perceived vulnerability to future CVD and intrinsic and extrinsic rewards for not addressing CVD risk [i.e., perceived benefits of not acting to manage or reduce risk (maladaptive response)]. Coping appraisal evaluates the adaptive coping responses available to the patient to deal with the threat (i.e., evaluation of ways to reduce CVD risk). This includes patients’ perceptions of self-efficacy to engage in adaptive coping, practitioners’ promotion of self-efficacy through individualisation, perceived response efficacy of adaptive coping, and response cost of adaptive coping (Fig. 1). Both are influenced by intrapersonal (e.g., prior experience of both positive (adaptive) and negative (maladaptive) behaviours) and environmental variables (e.g., persuasive communication) . For NHSHC, PMT highlights the practitioners’ key role in providing information on CVD risk whilst taking into account a patients’ experience, priorities and beliefs to encourage engagement in risk-reducing behaviours .
The RIsk COmmunication in NHSHC (RICO) study involved analysis of video-recorded NHSHC consultations . Analysis of quantitatively characterised content of consultations found that compared with JBS3 consultations, those using QRISK®2 were shorter, more verbally dominated by practitioners and involved less discussion of CVD risk . This provided the first insight from objective data on the nature and content of NHSHC consultations, with comparison between risk calculators. But the need for more in-depth qualitative analysis, to explore the quality of interactions around CVD risk and how this differs by CVD risk calculator, was clear. This paper uses deductive thematic analysis on a sample of video-recorded consultations, from the RICO study, which aimed to: explore how practitioners use QRISK®2 and JBS3 to communicate CVD risk in the consultation; explore how patients respond to risk information.
The RICO study sought to explore the perception and understanding of CVD risk from both patients and practitioners, when using the JBS3 or QRISK®2 calculator, the practitioners’ associated advice or offer of treatment and the patients’ response. Information regarding the overall study, including recruitment and data collection is available . In this report, we focus on qualitative deductive analysis of video-recorded NHSHC consultations.
Participants and recruitment
A detailed description of patient and public engagement along with participant and practice recruitment is available elsewhere . To summarise; data were collected from general practices (n = 12) located in the West Midlands of England (Jan-17 to Feb-19), supported by the Clinical Research Network West Midlands. Practices were matched in pairs, based on deprivation, and assigned to usual practice (communicated CVD risk using QRISK®2) or intervention (communicated CVD risk using JBS3). Two practices in the QRISK®2 group used Informatica (supplementary software within in the NHSHC template that includes Heart Age and risk manipulation similar to JBS3; Table 1); data were included in the analysis as this was felt representative of ‘usual care’. Quotations from the transcripts from these practices are referred to as ‘QRISK®2 + Informatica’. Only patients who were eligible for an NHSHC, based on national criteria, were included in the study . Postal invitations included a participant information sheet and were stratified based on gender, age and ethnicity for each practice. Practitioners were already employed by the practice (8 Health Care Assistants (HCAs), 6 Practice Nurses, 1 Sister) and all but one practitioner already had experience of delivering NHSHC as part of their job role (a HCA who was new to NHSHC delivery; 1–2 weeks prior to study commencement).
In total, 175 video-recorded NHSHCs were conducted (range 6.8 to 38 min), reduced to 173 following screening of data (JBS3 = 100; QRISK®2 = 73; practitioner error resulted in 2 exclusions). To define the sample for qualitative analysis, a further 21 Health Checks were excluded for reasons including: projected (not actual) risk score communicated (n = 7), no discussion of risk (n = 2), no communication of lifetime risk (n = 4), incorrect use of JBS3 (n = 6), insufficient use of English language (n = 2). Of the remaining sample (n = 154), 64 Health Checks included communication of CVD risk using QRISK®2. Therefore, 64 NHSHC using JBS3 were identified, matched on patients’ gender, ethnicity and CVD risk score (Table 2), giving a sample of 128 for analysis.
Practices video-recorded NHSHCs, communicating CVD risk using QRISK®2 or JBS3 (following both patient and practice consent). All consultation dialogue was transcribed verbatim.
Data were analysed using deductive thematic analysis [43, 44] using a coding template based around Protection Motivation Theory (PMT ;) (Supplementary Material 1). Each transcript was uploaded to QSR International’s NVivo 12 qualitative data analysis software . This allowed for interpretation of how QRISK®2 and JBS3 were used to communicate risk in the context of PMT components (e.g., verbal persuasion, influencing patient prior beliefs and priorities; and how patients respond, which will reflect the nature of their appraisal within the consultation).
Initially, 14 transcripts were inductively coded independently by two Caucasian female researchers, experienced in qualitative research, a senior researcher (LC; DPsych) and research associate (VR; MSc). The senior researcher (LC) had previous research experience related to children’s healthy eating whilst the research associate (VR) had previous research experience in risk communication in NHSHC. This was to check the application of PMT to NHSHC consultations and agree coding between the researchers. Following inductive coding, 13 new codes were added to the framework (e.g., medical history, clarification of results). The final version of the coding template shows how elements of the PMT were classified including code definitions and examples from the NHSHC consultations (Supplementary Material 2). The remaining 114 transcripts were individually coded by LC and VR; two in every 20 transcripts were independently dual-coded to check reliability using Kappa coefficients for each NVivo node within the PMT framework (i.e., 19th, 20th, 39th, 40th, 59th, 60th etc). Reliability ranged from .48 to .71 over the five reliability checks conducted, indicating fair to good reliability . Data saturation was considered reached at the point of completion of coding.
Subsequent analysis of codes was led by SF (Researcher; MSc) (supported by SG, CG, NE and VR) to identify codes for key elements of the PMT model, splitting the consultations into two groups (QRISK®2 and JBS3). Specific parts of transcripts that illustrated the practitioner communicating CVD risk to the patient and patient responses were identified. These related to Cognitive Appraisal (Threat Appraisal, and Coping Appraisal), and Coping Modes (Adaptive, and Maladaptive). The focus of the present analysis was the consultation time spent communicating CVD risk (across sample approximately 1.7 (±0.83) minutes) , to explore similarities and differences between the two calculators under investigation. Most patients said little in response to CVD risk information. Therefore, where there was evidence of two-way dialogue, we present quotations that best illustrate risk communication and subsequent patient response.
Deductive thematic analysis was conducted on 128 video-recorded NHSHC consultations. Patients were approximately matched by gender, age and ethnicity. Those in the QRISK®2 group were marginally younger (Table 2).
Results of the deductive thematic analysis demonstrate how practitioners communicated risk using either QRISK®2 or JBS3. They also present patients’ responses to the communication of risk, allowing for evaluation of the two calculators. Each quote is coded to denote which risk calculator was used, the consultation identifier, patient gender and age.
Threat appraisal was the most commonly identified element of the PMT model. It was observed in all consultations, although less frequently in JBS3 consultations (coded 584 times; average 9/consultation) compared to QRISK®2 consultations (coded 634 times; average 10/consultation).
Once presented with a QRISK®2 score, patients acknowledged their risk level, but their understanding of 10-year percentage risk was unclear. For example, one asked ‘is that percentage of risk alright?’. Generally, the risk score was acknowledged with a single word response, such as ‘yeah’ or ‘okay’, impeding practitioners’ ability to gauge patient understanding and classification of response for this analysis. Heart Age aided patient understanding of CVD risk, resulting in questions such as: “… so really what can I do about that? I mean I know it is all estimated.” Such questions reflected a level of understanding of the score and intention to engage in risk-reducing behaviour. Several patients expressed surprise at their risk. Below, the patient appeared to question how the score was calculated as they perceived themselves to be healthier than the outcome suggested, leading to some mistrust. They also made two references to being ‘fitter’ than the risk score indicated, which was not addressed by the practitioner:
P I thought I was fitter than that though.
HP (Laughter) You are doing good exercises,
P But I was fitter than that though …
HP OK, so the health years, so on average expect to survive is 80 for yourself without a heart attack or a stroke, yeah? And then your risk of a heart attack or stroke in the next 10 years is 15%, so you do need to look after yourself, because we would say that is a medium risk.
HP So wouldn’t say it is too high or low, but a medium to high.
HP OK, and then that’s what it looks like so from now until there, that’s the last one the chance of surviving without a heart attack.
P That’s estimated?
HP This is estimated, we don’t know what’s going to happen you might be even longer.
P So about 94 I might snuff it?
(JBS3, 11_028, Male, 58)
By overlooking the patient’s surprise and perhaps focusing on the process of NHSHC, the patient momentarily shut down until they were presented with their CVD event-free survival age. The concept, included within JBS3, prompted some misunderstanding among patients and practitioners. This was perceived by some patients as an estimate of life expectancy.
Practitioners provided little follow-up risk score explanation when using QRISK®2 or JBS3.
HP Right, this is the screening I was telling you about. I will just print that out for you. So your risk of any heart disease is 15%.
P Yeah, which is not very high.
HP It does increase with age. If it is above 10% we then pass it on for them to have a look at it and they will be able to decide when to have your next health check which should be 3 years or 1 year. Obviously next time you come in any results you’ve got in the red tend to up your risk and they tend to up your Heart Ageas well. So when you come in next time if your blood pressure is back down, and obviously it could be less so … Your Heart Age has come up as 66.
P Well I am 66 this year.
HP Yes, yes, so it is quite near isn’t it?
Yes. So, for example, if you were a smoker and that was in the red that would put your Heart Age at 75. So the only one we have got in the red really is that one cholesterol …
P It’s only marginal though isn’t it
(QRISK®2 + Informatica, 2_016, Male, 65)
Above, the patient was identified as medium-high risk, but the practitioner did not elaborate on the severity or implications, leaving the patient’s interpretation of their risk score as “not very high”. This was compounded when the patient received their Heart Age. The practitioner did not address the patient’s misinterpretation of the severity of their risk nor explain why their results are conflicting, again perhaps focussing more so on the consultation process than the patient. This led the patient to dismiss their elevated cholesterol as “only marginal”. The absence of active listening skills was recurrent across both groups making it difficult to gauge patient understanding.
Although limited, there was more evidence of active practitioner-patient engagement in conversation regarding threat of CVD in the JBS3 group following risk score manipulation (e.g., practitioners visually showed patients that a reduction in blood pressure, could lower their Heart Age):
HP … so obviously your blood pressure is not too bad, that is fine where it is at 128, but your cholesterol, so ideally we like that to be below 5. So if you could get it below 5, so lets put it down to 4.8, you can see that automatically that it brings your risk down to 1.8%
P Oh I see yes
HP … improves your life expectancy slightly, and probably brings your Heart Age down a year. So it is just you know showing that it can and obviously, the lower you can keep these factors that you influence, for longer, the better quality of life and life expectancy there is … your risk is going to increase slightly with age. So it is about trying to moderate those other factors.
P So what impact does exercise have on that?
HP It has quite a significant impact on your cholesterol, it does help your cholesterol a lot. We know that it helps because that increases your good cholesterol, which can help increase the balance so, that can help with it as well.
P So what’s the normal range that is seen for HDL cholesterol?
HP HDL can be anything from sort of 1.1 to about 2.5, you don’t get much over, I can’t say I have seen many, I have seen a few. But your cholesterol could be anything down to you know 3.5.
P OK and really bad would be?
HP 6 or 7’s, so would be sort of …
P Oh OK – so 5.6 is yeah it is edging up isn’t it?
(JBS3, 7_020, Male, 45)
The patient evaluated the threat and sought information to facilitate their appraisal. Whilst positive, this exchange again demonstrated misunderstanding of CVD event-free survival age as life expectancy, this time from the practitioner. The visual impact of demonstrating how CVD risk can be reduced through risk factor modification (e.g., cholesterol, smoking status) aided patient understanding and realistic threat appraisal. There were fewer examples of active engagement during discussion of the CVD risk score within QRISK®2 consultations, which may be due to the inability to show risk factor modification when using the calculator.
References to coping appraisal were more common among JBS3 (60, 94%) than QRISK®2 consultations (55, 86%). Communication of risk in JBS3 consultations were not observed in the same way as QRISK2; with most focussed on facilitators of adaptive coping (i.e., risk-reducing changes that patients could make):
HP Erm and then this gives you your healthy year’s outlook, so based on your current lifestyle your risk of a heart attack or a stroke in the next 10 years is coming out at 2.4%. We aim for peoples risk to be below 10% so that’s …
HP … absolutely fine and on average you expected to survive to an age of 84 without a heart attack or stroke, so brilliant. So as I say your blood pressure pretty good as it is you not going get that much lower.
HP Diet wise would you say you got a pretty good diet do you know the sorts of …
P We sort of grow our own vegetables and fruit and stuff like that …
P … so erm I mean we eat reasonably healthy.
(JBS3, 7_044, Female, 54)
Following communication of the risk score, the practitioner moved on to ways the patient could maintain a low risk through identification of eating behaviours, suggesting that whilst practitioners (from both groups) spent little time talking about the CVD risk score, the additional risk information available in JBS3 may have helped to facilitate more risk factor discussion between the patient and practitioner than when using QRISK®2.
Discussions around response costs for adaptive coping (i.e. perceived costs associated with a recommended behaviour) related to use of statins or blood pressure medication were only observed in seven JBS consultations (11%) and, not any QRISK®2 consultations.
HP Obviously we’ve tried them, and they haven’t agreed with you.
P I tried the ***17,34 statin
HP Yeah, and there are other statins we can discuss and obviously benefits of those they can reduce your cholesterol obviously and we can reduce your risk of cardiovascular disease so it might be worth having a think about and if you want to just discuss that further or a different type of statin …
P All they did was it affected my reflux and it made the reflux worse
P I was on that and an Aspirin – I did the aspirin first and then …
HP Yeah, but it was affecting you. I mean it might be worth a having another … err you know a think about whether you wanted to erm take that, because obviously it would lower your cholesterol, obviously add to a healthier heart erm and reduce that risk of cardiovascular disease, but then obviously we’ll not gonna push that onto you, err it is something you can talk to myself, one of the doctor’s once you have had time to think erm and they can advise or XXX the prescribing nurse, because they can prescribe, you know talk about you know what’s best, which statin would be best, and not all statins agree with everybody but there might be one out there that actually has a better erm compatibility with yourself OK?
HP How do you feel about what I have told you today?
P I would consider it.
(JBS3, 8_177, Male, 71)
Here, the patient’s prior engagement with statins as a response cost was discussed between the patient and the practitioner, leading to a re-evaluation of the medical intervention by the patient. However, the patient’s concern regarding their previous experience of taking statins was not well addressed. The practitioner appeared to interrupt the patient to repeat the benefits of statins. The perceived cost of taking statins also provided motivation to adopt risk-promoting behaviours:
HP But well done!
P I am pleased about that yes.
HP That’s really good, no I am very pleased with you because that’s really good. And where you were at 10% just before, it is now 5%, so you have halved the risk in that time. So that’s really good. So it shows it can be done.
P Yeah, yeah and that’s what I would rather do than taking tablets,
HP Of course
P I would rather think, no I know what’s wrong, I will deal with it in time.
(QRISK®2 + Informatica, 12_055, Female, 64)
In a previous NHSHC (conducted 5 years prior), the patient identified what was wrong and showed accountability for making health-related behavioural changes, “I will deal with it”. However, opportunities to discuss facilitators of adaptive coping were sometimes missed by practitioners:
HP I look at your [total: HDL cholesterol] ratio and your ratio is good. But just to keep a little eye on it, maybe they will test it again in a year’s time. You probably won’t be due this Health Check, because your risk is only 3%, which is low. It will increase as you age, so your Health Check wouldn’t be due again for 5 years, but you could probably have your cholesterol done in about a year, with you know normal bloods taken out of your arm. Erm your Heart Age, because you got such results in the green, your Heart Age has come up less than your actual age, but that’s with the 2 years added on from being an ex-smoker.
P So is it possible that I could get that even lower, if my cholesterol came down a lot.
HP Well we will have a look now, I will play about with it. So if you had never smoked at all, your Heart Age would be 45. If you were still smoking, it could be 51. So being an ex-smoker tends to add 2 years, so with your cholesterol, it could be brought down to 46.
P Massively yeah.
(QRISK®2 + Informatica, 2_077, Male, 48)
The patient above attempted to understand how their risk could be reduced. The practitioner did not engage with this to encourage the risk-reducing behaviour or discuss ways to reduce cholesterol. Rather, they proceeded to talk about the impact of previous smoking status (which is unmodifiable) on CVD risk. Whilst references to coping appraisal were more common among JBS3 consultations, again practitioners in both groups appeared to focus more on the consultation process than the patient.
Maladaptive coping was classified when the patient appeared to negatively engage in risk management discussion with the practitioner and was dismissive of suggestions (e.g., patient believes they have a sufficiently healthy lifestyle and dismisses discussion about change). As noted, patient responses to risk information were often limited to single words. Where context allowed, apparent non-engagement and minimal verbal responses from patients were also interpreted as maladaptive coping responses when the risk information communicated by the practitioner did not provoke a response from the patient (i.e., a monosyllabic response). Maladaptive coping was identified in 49 (77%) QRISK®2 consultations (coded 139 times; average 3/consultation), compared to 40 (62.5%) JBS3 consultations (coded 110 times; average 3/per consultation). Below, the practitioner briefly communicates QRISK®2 before moving on to Heart Age (using Informatica):
HP Yeah this is the screening I was telling you about. So, your risk is 9%
HP Which is your key risk for you over the heart disease and diabetes and stroke risk
P And heart disease
HP As you, as you age your risk does seem to increase, erm any results that you’ve got in the red tend to push up your Heart Age slightly
HP So if we can get the results out of the red and back into the green, that can reduce that one down
P Right OK
HP So for example, being an ex-smoker actually puts 2 years onto your Heart Age there.
HP So would be its 66 and it would be 66 if you never smoked at all.
HP Erm if you were still smoking it would be 73.
P Oh my gosh
HP Your Heart Age has come up as 71 – you are 69. Any results you have got in the red do tend to increase your Heart Age. It is just that one cholesterol one that was in the red.
(QRISK®2 + Informatica, 2_001, Female, 66)
Sometimes maladaptive responses to the 10-year percentage risk score could be prompted into a more positive response through communication of Heart Age. The brief exchange prior to the communication of Heart Age may have also suggested that the practitioner was less confident in discussing absolute risk, a recurrent observation. If practitioners cannot clearly explain the meaning of a patient’s percentage risk score to confer understanding, subsequent discussion/actions regarding risk management may be undermined.
Minimal engagement following communication of the risk score was also identified in JBS3 consultations:
HP OK. And your blood pressure being under 82 but that’s fine everything is OK with that. Now, on average what they’re saying is that your risk of a heart attack or stroke in the next 10 years is 15%, again, that is down to the fact that you smoke.
HP And to expect to survive till the age of 78 without a heart attack or a stroke OK. And if we have a look at the next, this one, just reiterates its this, but if I changed it to … say if you didn’t smoke OK and we went to the next your Heart Age would then become equal with your age.
P Hm hm
HP And your risks in … of a heart attack or stroke in the next 10 years comes down to 9.6% and your actual survival to the age of 83 without a heart attack or a stroke OK and that reiterates it in that as well.
P Hm hm
HP OK so that’s the difference.
P Hm hm
P Hm hm
HP OK. Erm
HP So it gives you food for thought.
P Hmm hmm. You haven’t told me anything I didn’t already know.
(JBS3, 1_181, Male, 65)
The practitioner did not encourage the patient to quit smoking nor did they explore any experience with previous attempts and therefore were unlikely to promote intention to change behaviour. With an added pressure of time within NHSHC consultations, adherence to the process of completing the NHSHC may result in patients being passive recipients of information. As shown above (and throughout), the practitioner delivered the information presented on the screen without asking questions to check understanding or provide context. This resulted in little response from the patient which may be indicative of deference to the practitioner’s health knowledge and is, again, evidence of power imbalance.
Negative engagement in discussion of risk factor management was also evident following the suggestion of statin use:
HP What we do tend to say if you risk is above 10%, obviously I don’t know whether the doctors have ever discussed a statin with you?
P I don’t see the point, I mean if I am going to live to 83, I am quite happy to live to 83.
HP So it’s just about being aware that we know that taking a statin can help reduce your overall risk, so it’s one that sort of we usually advise that …
P If we do this next time and I don’t know, it was 04 [last cholesterol check], and we are now in 2018, so what does that mean, it could be another 12 to 14 years [for the next Health Check]?
HP Well I do normally try and do these every 5 years, so yeah.
P So yes, if it is hugely worse
P … in 5 years, I will consider it.
(JBS3, 7_012, Male, 70)
Again, the patient misinterpreted CVD event-free survival age and suggested that their risk was not severe enough to consider medical intervention in the short-term; only if it was “hugely worse” in the next NHSHC. This was another example of a missed opportunity for the practitioner to question the patient’s understanding of their risk and potential false reassurance provided by the 10-year percentage risk score.
Adaptive coping was classified when the patient appeared to positively engage with discussion of interventions to manage CVD risk; apparently listened to and engaged in the consultation and accepted what was being said/suggested. Adaptive coping was identified in 58 QRISK®2 (91%) consultations with (310 codes; average 5/consultation) and 55 JBS3 (86%) consultations (328 codes; average 6/consultation). The frequency of occurrences overall and per consultation were similar between the two groups for adaptive coping in medical interventions [39 QRISK®2 (61%) consultations and 116 codes (average 3/consultation); 42 JBS3 (66%) consultations and 142 codes (average 3/consultation)] and lifestyle changes [11 QRISK®2 (17%) consultations and 15 codes (average 1/consultation); 20 JBS3 (31%) consultations and 32 codes (average 2/consultation)]. A number of patients showed intentions to change behaviour as a result of their CVD risk.
HP So your ratio is 3.5. So this is the screening I was telling you about. So your risk is 3%. That will increase as you age.
HP And obviously if we can, perhaps with your smoking, it has pushed your Heart Age up to 48, and your age is 41. Because that is the only result you have got in the red. Because all your other results are really good, they are in the green.
P They are really good, so I need to …
HP Yeah, so if you had never smoked at all, your Heart Age would be aged 40.
P I think I need to do something about that don’t I?
(QRISK®2 + Informatica, 2_122, Male, 41)
Here is another example of how Heart Age changed the way the patient responded to the information presented. Whilst a positive response was received, little time was allowed to respond before the practitioner moved on. Giving time for the patient to check their understanding with the practitioner may have provided opportunity for the patient to increase their confidence in actively engaging with coping behaviours. Another example of positive engagement during the discussion of risk was also identified in another practice:
HP OK that’s good. Err let’s see your key risk.
P If I know what weight so I can just try to change my life.
HP Yeah, yeah it would be good if you can cut down and, and lose a bit of the weight err what was it 13.8. So it’s only a little higher it should ideally be below 10% is what we want so 13.8 is a bit high but it is because of, because of your weight. OK you don’t smoke you don’t drink alcohol so that’ all good, but your waist is a bit big as well.
HP Your waist is erm it’s 112 let’s have a look.
P Around my tummy around here.
HP Yeah let’s have a look. So your waist is 44 in..
P And that’s this bit here.
(QRISK®2, 3_259, Male, 57)
The patient above engaged in the information presented about their risk and suggested a need for weight management, somewhat reinforced by the practitioner. However, the interaction was disjointed, which may be a result of the practitioner’s need to complete all elements of the NHSHC and attending to what the patient is saying, creating a barrier for adaptive coping. Whilst scarce, a successful strategy for supporting adaptive coping used by one practitioner was to ask the patient to reflect on the risk information they had received, prompting consideration of action needed:
HP So average survival free of heart attack or stroke is 84.1 years OK? So how do you feel about that?
P Oh I will make more of an effort to lose some weight.
(JBS3, 1_154, Female, 70)
The approach adopted by the practitioner encouraged the patient to express their immediate reaction to their CVD risk, which gave the patient time to evaluate their action and show intention to change their behaviour. This was a rare example of the PMT in action; showing connection between risk information and the patient’s intention to change her behaviour, helping to redress the power imbalance evident in most consultations across both groups. It also demonstrated the significant role the practitioner plays in ensuring risk communication is delivered effectively regardless of the risk calculator used.
We report the first qualitative data from 128 video-recorded NHSHCs to explore how practitioners use QRISK®2 and JBS3 to communicate CVD risk in the consultation, and how patients respond to risk information. An ecologically valid approach was used to compare usual practice (QRISK2) with use of JBS3 following basic introductory training to familiarise practitioners with the tool and features to use. This allowed a realistic study of how practitioners would use JBS3 if it was made available, without additional risk communication training, which is generally not provided for NHSHC practitioners [4, 47].
Main findings in relation to our aims were, first, that components of the PMT including threat appraisal, facilitators of and response costs to adaptive coping were coded more frequently in consultations using JBS3 (compared with QRISK2). This suggests that JBS3 may provide more opportunities to initiate risk factor discussion than QRISK2, possibly due to the risk factor modification function. Second, CVD event-free survival age communicated in JBS3, was misunderstood by both patients and practitioners. Third, patients presented with a QRISK®2 score acknowledged their risk level, but it was unclear whether they understood 10-year percentage risk (or trusted the basis and relevance to them). Visual presentations of risk and Heart age, found in JBS3 (not typically communicated within standard practice systems - although can be generated in QRISK®2), appeared more impactful and aided patient understanding, compared with QRISK®2. This is in line with evidence that Heart Age is easier to understand than 10-year percentage risk [29, 48] and visual displays are preferable for promoting risk-reducing behaviour .
Regardless of the risk calculator used and despite the recognised importance of risk communication in both the NHSHC best practice guidance  and competence framework , there was little discussion of CVD risk. This was particularly marked in QRISK®2 consultations. Practitioners often simply relayed the risk score, without discussing the implications of the risk for the patient or what they could do about it. Equally, most patients offered minimal responses to the risk information, often acknowledging with a single word. Practitioners may have avoided confirming patient understanding if they felt unable to explain the risk scores in more detail or the pressure of time may have prevented further exploration at the expense of the quality of risk communication. This supports evidence that patients and practitioners struggle to understand CVD risk and some practitioners lack confidence in communicating the risk score [4, 17, 19,20,21] leading to poor patient recall of CVD risk, confusion  and misunderstanding.
There was an apparent absence of active listening by practitioners who frequently missed cues from patients who were unclear about their risk score. Active listening involves making a conscious effort to focus on what is being said rather than passively ‘hearing’ the message, and leads to improved levels of patient satisfaction and greater adherence to treatment options . By not providing additional information to patients that would allow them to appraise their risk, practitioners are limiting the opportunity for patients to show intent to engage in risk reducing behaviours, thus encouraging a maladaptive coping response. Best practice guidance  recommends that practitioners use motivational interviewing (MI) to encourage adherence to recommended treatment . Motivational interviewing is a person-centred approach to promote discussion with patients to resolve ambivalence . There was little to no evidence of MI techniques in our 128 NHSHC consultations.
Limited patient responses and poor listening skills, leading to practitioner dominance, were inferred from quantitative analysis of the complete RICO study cohort [n = 173 ]. These were confirmed here, with evidence of missed opportunities to discuss patients’ intentions to change behaviour. Missing these opportunities risks undermining the purpose of the NHSHC; without discussion of intervention practitioners are unlikely to encourage patients to commit to engaging in risk-reducing behaviours. The demands on practitioners to complete all aspects of an NHSHC within a limited time could lead to prioritisation of process over patient engagement. The resulting practitioner-dominated consultations are less patient-centred, and would be expected to lead to low patient and practitioner satisfaction [53,54,55,56], and poor patient outcomes, such as adherence to clinical recommendations and health-promoting behaviour . Where there was talk of risk-reducing behaviour, JBS3 appeared more effective than QRISK®2 in promoting discussion of facilitators for adaptive coping, perhaps due to additional functionality (i.e., manipulation of risk). This suggests that other methods of communicating risk may be more suitable to promote discussion around risk-reducing behaviour.
Implications for practice
The NHSHC programme is an ambitious non-communicable disease prevention programme, the largest of its kind . An evidence-based review of NHSHC is underway to maximise the programme’s benefit in the next decade, with likely changes to the universal offer of in-person consultations in primary care . Whilst changes to delivery are inevitable, elements of the programme will still require practitioner-patient consultation. Our findings show that certain functions of JBS3 are useful for communicating CVD risk to patients, and also highlighted important implications for NHSHC practice in general:
There is a clear training need among NHSHC practitioners. There is an expectation that practitioners ‘should be trained in communicating the risk score and results to the client’ and that ‘methods, such as motivational interviewing techniques, should engage clients in person-centred conversations about their own reasons for change’  (p21). Yet it is difficult for practitioners to meet these requirements without necessary training and ongoing support. Here, these skills were generally not evident and we know from previous work that practitioners responsible for delivering NHSHC generally receive little (or no) training in CVD risk communication and motivational interviewing [22, 59, 60].
Alongside training, there is also a need to prioritise the quality of interaction over the process of the consultation. Increasing the overall appointment length or, perhaps more feasible, streamlining the components of NHSHC would give practitioners more time to engage patients in dialogue regarding their CVD risk and its management. The minimal response from patients during the NHSHC consultations made it difficult for us (and practitioners) to gauge patient understanding and intentions for health-promoting behaviour.
Positive outcomes were identified when practitioners checked patient understanding, relayed information in a way that was meaningful to the patient (e.g. Heart age) and asked for patient feedback around the CVD risk score. Practices included in the sample allocated 15–30 min per Health Check, but our quantitative evidence showed consultations lasted as little as 6.8 min . There is clearly a need to provide additional support for practitioners. Measures to make consultations more patient-focused and give practitioners the flexibility to allow engagement in dialogue should be explored.
Strengths and limitations
This is the first qualitative analysis to explore how risk is communicated and how patients respond during video-recorded NHSHC consultations, including comparison of QRISK®2 and JBS3 CVD risk calculators. Strengths include video-recording of NHSHCs across a diverse range of practices stratified by deprivation, with stratified sampling of patients, a comprehensive coding approach and a large sample (for qualitative analysis). Limitations are recognised:
The use of QRISK®2 + Informatica may have enhanced these consultations. To maintain ecological validity of ‘usual practice’, patients from these practices were included in the main analysis and has not altered our conclusions.
Incorrect use of JBS3 (e.g., including communication of CVD event-free survival) resulted in the exclusion of several consultations which may have biased our comparisons in favour of JBS3.
Sparse discussion specifically around the risk score and subsequent patient responses made it difficult to apply the PMT framework effectively (the theoretical framework required researchers to classify patient responses as either positive or negative). Thus, a third ‘neutral’ classification was added to the framework to account for monosyllabic responses (see Supplementary Material 2 for examples). Yet following the PMT, the new category still needed to be classified as one of the two coping modes (i.e., adaptive or maladaptive). Moreover, follow-up interviews with patients and practitioners as part of the RICO study, will be analysed to further explore their experiences, perceptions and understanding of CVD risk and related intentions.
Analysis of video-recorded NHSHC consultations showed sparse communication of CVD risk, particularly in consultations supported by QRISK®2. Where risk was communicated, patient responses were minimal and practitioners missed opportunities to check patient understanding and encourage risk-reducing behaviour. JBS3 appeared to better promote opportunities to initiate risk-factor discussion and Heart Age and visual representation of risk were more easily understood and impactful than QRISK®2. The apparent lack of effective CVD risk discussion in both groups resulted in misunderstandings, practitioner-dominated discussion and increased likelihood of a maladaptive coping response. The NHSHC programme is currently the largest CVD prevention initiative in England. Whilst an evidence-based review of NHSHC is underway , with likely changes to programme delivery, face to face consultations are necessary to deliver key elements of NHSHC. The analysis presented demonstrates the importance of effective, shared practitioner-patient discussion for enabling adaptive coping responses, only achievable through solid practitioner understanding of the nature of the information being shared and through effective training to deliver this information to patients .
Availability of data and materials
All data generated and analysed during the current study are not publicly available due to the confidential nature of participant transcript data, but are available from the corresponding author on reasonable request.
National Health Service
National Health Service Health Check
RIsk COmmunication Study
Protection Motivation Theory
Joint British Societies
Health Care Assistant
Public Health England. Health matters: preventing cardiovascular disease. Gov.uk. 2019 Available from: https://www.gov.uk/government/publications/health-matters-preventing-cardiovascular-disease. [cited 2020 Mar 29].
Department of Health. Putting prevention first. NHS Health Check: vascular risk assessment and management best practice guidance. London: Department of Health; 2009.
Public Health England. NHS Health Check: Best practice guidance. PHE Publ. 2017;3:1–76. Available from: https://www.healthcheck.nhs.uk/document.php?o=1472.
Usher-Smith J, Martin A, Harte E, MacLure C, Meads C, Saunders C, et al. NHS Health Check programme rapid evidence synthesis. 2017;(January). Available from: www.healthcheck.nhs.uk/document.php?o=1251.
Beswick A, Brindle P, Fahey T, Ebrahim S. A systematic review of risk scoring methods and clinical decision aids used in the primary prevention of coronary heart disease. R Coll Gen Pract [GRA]. 2008;4:105.
Edwards A, Elwyn G, Covey J, Matthews E, Pill R. Presenting risk information - A review of the effects of “framing”’ and other manipulations on patient outcomes. J Health Commun. 2001;6(1):61–82.
Gigerenzer G, Edwards A. Simple tools for understanding risks: from innumeracy to insight. BMJ Br Med J. 2003;327(7417):741–4.
Gigerenzer G, Gaissmaier W, Kurz-Milcke E, Schwartz LM, Woloshin S. Helping doctors and patients make sense of health statistics. Psychol Sci Public Interes Suppl. 2007;8(2):53–96.
Goodyear-Smith F, Arroll B, Chan L, Jackson R, Wells S, Kenealy T. Patients prefer pictures to numbers to express cardiovascular benefit from treatment. Ann Fam Med. 2008;6(3):213–7.
Thomson R, Edwards A, Grey J. Risk communication in the clinical consultation. Clin Med, J R Coll Phys London. 2005;5:465–9.
Ahmed H, Naik G, Willoughby H, Edwards AGK. Communicating risk. BMJ. 2012;344(jun18 1):e3996 Available from: http://www.bmj.com/cgi/doi/10.1136/bmj.e3996.
Barratt A, Edwards A, Trevena L, McCaffery A, Woloshin S, Bekker H, Timmermans D, Charvet A. 2004 International Patient Decision Aid Standards. Chapter 5: Presenting Probabilities; 2004.
Usher-Smith JA, Silarova B, Schuit E, Moons KGM, Griffin SJ. Impact of provision of cardiovascular disease risk estimates to healthcare professionals and patients: a systematic review. BMJ open. 2015;5:e008717.
Hippisley-Cox J, Coupland C, Vinogradova Y, Robson J, Minhas R, Sheikh A, et al. Predicting cardiovascular risk in England and Wales: prospective derivation and validation of QRISK2. BMJ England. 2008;336(7659):1475–82.
JBS3 Board. Joint British Societies’ consensus recommendations for the prevention of cardiovascular disease (JBS3). Heart. 2014;100(Suppl 2):ii1–ii67 Available from: http://heart.bmj.com/lookup/doi/10.1136/heartjnl-2014-305693.
Karmali KN, Lloyd-Jones DM. Adding a life-course perspective to cardiovascular-risk communication. Nat Rev Cardiol. 2013;10(2):111–5.
Edwards AGK, Evans R, Dundon J, Haigh S, Hood K, Elwyn GJ. Personalised risk communication for informed decision making about taking screening tests. Cochrane database Syst Rev England. 2006;4:CD001865.
Spiegelhalter D, Pearson M, Short I. Visualizing uncertainty about the future. Science (80- ). 2011;333(6048):1393–400.
Gigerenzer G, Hoffrage U. How to improve Bayesian reasoning without instruction: frequency formats. Psychol Rev. 1995;102(4):684–704.
Hoffrage U, Gigerenzer G. Using natural frequencies to improve diagnostic inferences. Acad Med. 1998;73(5):538–40.
Slovic P, Monahan J, MacGregor DG. Violence risk assessment and risk communication: the effects of using actual cases, providing instruction, and employing probability versus frequency formats. Law Hum Behav. 2000;24(3):271–96.
Usher-Smith JA, Harte E, Maclure C, Martin A, Saunders CL, Meads C, et al. Patient experience of NHS health checks: A systematic review and qualitative synthesis. BMJ Open. 2017;7(8):1–12.
Bonner C, Jansen J, Newell BR, Irwig L, Glasziou P, Doust J, et al. I Don’t Believe It, But I’d Better Do Something About It: Patient Experiences of Online Heart Age Risk Calculators. J Med Internet Res. 2014;16(5):e120. JMIR Publications Inc.
Reed JL, Prince SA, Cole CA, Fodor JG, Hiremath S, Mullen KA, et al. Workplace physical activity interventions and moderate-to-vigorous intensity physical activity levels among working-age women: a systematic review protocol. Syst Rev. 2014;3:147 Division of Prevention and Rehabilitation, University of Ottawa Heart Institute, 40 Ruskin Street, Ottawa, ON K1Y 4W7, Canada. email@example.com.
Soureti A, Hurling R, Murray P, van Mechelen W, Cobain M. Evaluation of a cardiovascular disease risk assessment tool for the promotion of healthier lifestyles. Eur J Cardiovasc Prev Rehabil. 2010;17(5):519–23 SAGE Publications.
Johns I, Moschonas KE, Medina J, Ossei-Gerning N, Kassianos G, Halcox JP. Risk classification in primary prevention of CVD according to QRISK2 and JBS3 ‘heart age’, and prevalence of elevated high-sensitivity C reactive protein in the UK cohort of the EURIKA study. Open Hear. 2018;5(2):e000849. Archives of Disease in childhood.
Wells S, Kerr A, Broadbent E, MacKenzie C, Cole K, McLachlan A. Does your heart forecast help practitioner understanding and confidence with cardiovascular disease risk communication? J Prim Heal Care. 2011;3(1):4–9.
Bonner C, Bell K, Jansen J, Glasziou P, Irwig L, Doust J, et al. Should heart age calculators be used alongside absolute cardiovascular disease risk assessment? BMC Cardiovasc Disord. 2018;18(1):1–8.
Hawking MKD, Timmis A, Wilkins F, Potter JL, Robson J. Improving cardiovascular disease risk communication in NHS health checks: a qualitative study. BMJ Open. 2019;9(8):e026058.
Waldron C-A, van der Weijden T, Ludt S, Gallacher J, Elwyn G. What are effective strategies to communicate cardiovascular risk information to patients? A systematic review. Patient Educ Couns. 2011;82(2):169–81 Available from: http://linkinghub.elsevier.com/retrieve/pii/S0738399110001849. Elsevier Ireland Ltd.
Bonner C, Jansen J, McKinn S, Irwig L, Doust J, Glasziou P, et al. Communicating cardiovascular disease risk: an interview study of General Practitioners’ use of absolute risk within tailored communication strategies. BMC Fam Pract. 2014;15(1):106 Available from: http://bmcfampract.biomedcentral.com/articles/10.1186/1471-2296-15-106.
Kulendrarajah B, Grey A, Nunan D. How effective are age’ tools at changing patient behaviour? A rapid review. BMJ Evidence-Based Med. 2020;25(2):68–72.
Lopez-Gonzalez AA, Aguilo A, Frontera M, Bennasar-Veny M, Campos I, Vicente-Herrero T, et al. Effectiveness of the heart age tool for improving modifiable cardiovascular risk factors in a southern European population: a randomized trial. Eur J Prev Cardiol. 2015;22(3):389–96 Available from: http://journals.sagepub.com/doi/10.1177/2047487313518479.
Manuel DG, Abdulaziz KE, Perez R, Beach S, Bennett C. Personalized risk communication for personalized risk assessment: real world assessment of knowledge and motivation for six mortality risk measures from an online life expectancy calculator. Informatics Heal Soc Care.; 2018;43(1):42–55. Available from: https://doi.org/10.1080/17538157.2016.1255632. Taylor & Francis.
Cobain, Mark, Fiumicelli G. Can heart age increase NHS Health Check uptake? Delivering an RCT in the London Borough of Bromley. 2015. Available from: http://www.healthcheck.nhs.uk/commissioners_and_healthcare_professionals/national_resources_and_training_development_tools/webinars/past_webinars/. [cited 2015 Oct 27].
Paskins Z, McHugh G, Hassell AB. Getting under the skin of the primary care consultation using video stimulated recall: a systematic review. BMC Med Res Methodol. 2014;14(1):101 BioMed Central Ltd.
Henry SG, Fetters MD. Video elicitation interviews: a qualitative research method for investigating physician-patient interactions. Ann Fam Med. 2012;10(2):118–25.
Floyd DL, Prentice-Dunn S, Rogers RW. A meta-analysis of research on protection motivation theory. J Appl Soc Psychol. 2000;30:407–29.
Plotnikoff RC, Rhodes RE, Trinh L. Protection motivation theory and physical activity: a longitudinal test among a representative population sample of Canadian adults. J Health Psychol. 2009;14(8):1119–34.
Gidlow CJ, Ellis NJ, Cowap L, Riley V, Crone D, Cottrell E, et al. A qualitative study of cardiovascular disease risk communication in NHS health check using different risk calculators: protocol for the RIsk COmmunication in NHS health check (RICO) study. BMC Fam Pract. 2019;20(1):1–10.
Gidlow CJ, Ellis NJ, Cowap L, Riley VA, Crone D, Cottrell E, et al. Quantitative examination of video-recorded NHS Health Checks: comparison of the use of QRISK2 versus JBS3 cardiovascular risk calculators. BMJ Open. 2020;10:e037790. https://doi.org/10.1136/bmjopen-2020-037790.
Public Health England. NHS Health Check Programme: Best practice guidance. London: PHE; 2013.
Braun V, Clarke V, Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.
Fereday J, Muir-Cochrane E. Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. Int J Qual Methods. 2006;(1):80–92.
Edwards-Jones A. Qualitative data analysis with NVIVO. J Educ Teach. 2014;40(2):193–5.
Everitt BS, Fleiss JL. Statistical Methods for Rates and Proportions. Biometrics. (2nd edition) New York: Wiley; 1981.
Riley VA, Gidlow C, Ellis NJ, Povey RJ, Barnes O, Clark-Carter D. Improving cardiovascular disease risk communication in the UK national health service health check programme. Patient Educ Couns. 2019;11(102):2016–23.
Bonner C, Bell K, Jansen J, Glasziou P, Irwig L, Doust J, et al. Should heart age calculators be used alongside absolute cardiovascular disease risk assessment? BMC Cardiovasc Disord. 2018;18(1):19.
Public Health England. NHS Health Check competence framework. 2015;(March).
McCabe C, Timmins F. Communication skills for nursing practice; 2013.
Levensky ER, Forcehimes A, O’Donohue WT, Beitz K. Motivational interviewing: an evidence-based approach to counseling helps patients follow treatment recommendations. Am J Nurs. 2007;(10):50–8; 58–9.
Glover M, McRobbie H. Smoking Cessation. Int Encycl Public Heal. 2008:3; 37–50 Available from: https://www.sciencedirect.com/science/article/pii/B9780123739605003518. Academic Press; [cited 2020 Apr 3].
Howie JG, Heaney DJ, Maxwell M. Measuring quality in general practice. Pilot study of a needs, process and outcome measure. Occas Pap R Coll Gen Pract. 1997;i-xii(75):1–32.
Pawlikowska T, Zhang W, Griffiths F, van Dalen J, van der Vleuten C. Verbal and non-verbal behavior of doctors and patients in primary care consultations - How this relates to patient enablement. Patient Educ Couns. 2012;86(1):70–6.
Roter DL, Stewart M, Putnam SM, Lipkin MJ, Stiles W, Inui TS. Communication patterns of primary care physicians. J Am Med Assoc. 1997;22-29;277(4):350–6.
Street RL, Makoul G, Arora NK, Epstein RM. How does communication heal? Pathways linking clinician-patient communication to health outcomes. Patient Educ Couns. 2009;74(3):295–301.
Doyle C, Lennox L, Bell D. A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ Open. 2013; 3:e001570.
Department of Health and Social Care. Advancing our health: prevention in the 2020s. London: Cabinet Office; 2019.
Riley VA, Gidlow C, Ellis NJ. Understanding implementation and uptake in the National Health Service Health Check Programme. Public Health.; 2018;8–11. Available from: https://doi.org/10.1016/j.puhe.2018.01.024. The Royal Society for Public Health.
Baessler F, Zafar A, Ciprianidis A, Wagner FL, Klein SB, Schweizer S, et al. Analysis of risk communication teaching in psychosocial and other medical departments. Med Educ Online. 2020;25(1):1746014. Available from: https://doi.org/10.1080/10872981.2020.1746014. Taylor & Francis.
The authors would like to acknowledge Clinical Research Network West Midlands colleagues for advice in developing protocols, and members of the PPG and the virtual PPI participants who informed study development.
This project is funded by the National Institute for Health Research HTA Programme (project number 15/170/02). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Ethics approval and consent to participate
The study was approved by the UK Health Research Authority Approval (HRA; 11/11/2017) and the London - Dulwich Research Ethics Committee (11/09/2017) (reference: 17/LO/1463). Written informed consent was obtained for all participants prior to taking part.
Consent for publication
Not applicable, as no identifiable material is included.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Riley, V., Ellis, N.J., Cowap, L. et al. A qualitative exploration of two risk calculators using video-recorded NHS health check consultations. BMC Fam Pract 21, 250 (2020). https://doi.org/10.1186/s12875-020-01315-6