Skip to main content

Factors associated with usability of the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet© among individuals with metabolic syndrome in primary care: a cross-sectional study

Abstract

Background

Self-management support has been recognized as one of the most essential elements of the Chronic Care Model (CCM). Inspired by the CCM, the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet© was developed to aid and sustain self-management among patients with metabolic syndrome (MetS) in primary care to prevent cardiovascular complications. However, the usability of this booklet among these patients is not known. Therefore, this study aimed to evaluate the usability of this self-management booklet and identify the factors associated with its usability among patients with MetS in primary care.

Methods

This cross-sectional study was conducted among patients with MetS attending a university primary care clinic in Selangor, Malaysia. The usability score was measured using a previously translated and validated EMPOWER-SUSTAIN Usability Questionnaire (E-SUQ) with a score of > 68 indicating good usability. Multiple logistic regressions determined the factors associated with its usability.

Results

A total of 391 patients participated in this study. More than half (61.4%) had a good usability score of > 68, with a mean (± SD) usability score of 72.8 (± 16.1). Participants with high education levels [secondary education (AOR 2.46, 95% CI 1.04, 5.83) and tertiary education (AOR 2.49, 95% CI 1.04, 5.96)], those who used the booklet at home weekly (AOR 2.94, 95% CI 1.63, 5.33) or daily (AOR 2.73, 95% CI 1.09, 6.85), and those who had social support to use the booklet (AOR 1.64, 95% CI 1.02, 2.64) were significantly associated with good usability of the booklet.

Conclusions

The usability of the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet© was good among patients with MetS in this primary care clinic, which supports its widespread use as a patient empowerment tool. The findings of this study also suggest that it is vital to encourage daily or weekly use of this booklet at home, with the support of family members. The focus should also be given to those with lower education to improve the usability of this booklet for this group of patients.

Peer Review reports

Background

Cardiovascular diseases (CVDs), namely, ischaemic heart disease and stroke, are the world's leading causes of death, accounting for a combined 15 million fatalities in 2019 [1]. The clustering of CVD risk factors in an individual gives rise to metabolic syndrome (MetS), which is characterized by the presence of central obesity, elevated blood pressure (BP), elevated plasma glucose, and dyslipidaemia [2]. Individuals with MetS are twice as likely as the general population to experience cardiovascular events [2]. MetS is estimated to affect 20–25% of the global adult population [3, 4]. In Malaysia, the prevalence of MetS among adults aged ≥ 30 years was found to be 43.4% [5]. Its rising prevalence is thought to be the driving force behind the CVD epidemic in Malaysia [6], where ischaemic heart disease and stroke have remained the principal causes of death over the last three decades [7].

The management of MetS is complex and requires self-management support, as advocated by the Chronic Care Model (CCM) [8]. This model identifies six interrelated components of a healthcare system, including community resources, health system organization, self-management support, delivery system design, decision support, and clinical information systems, with the primary objective of enhancing outcomes for chronic conditions, such as MetS [8, 9]. Among these components, self-management support has been recognized as one of the most essential elements of the CCM, as it has been proven to improve outcomes for various chronic conditions [10,11,12,13,14].

With this in mind, the EMPOWER-PAR study conducted by Ramli et al. in 2016 developed a self-management support tool named the EMPOWER-PAR Global Cardiovascular Risks Self-Management Booklet© as part of a multifaceted intervention based on the CCM [14]. The EMPOWER-PAR intervention has been proven to be effective in improving glycaemic control among patients with type 2 diabetes mellitus (T2DM) in primary care [14] and has also been proven to be effective in improving adherence to T2DM clinical practice guidelines (CPG) among primary care providers [15]. The booklet has recently been updated to become the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet© with additional content on weight management (diet and exercise) and smoking cessation [15]. The treatment targets were also updated in line with the Malaysian CPG on Primary and Secondary Prevention of Cardiovascular Disease 2017 [16]. Overall, the booklet was designed as an empowerment tool for patients to understand their conditions, risk factors, potential complications, control targets and how to self-manage their cardiovascular risks with the aim of preventing CVD complications.

Usability testing among the end users is a well-known concept in digital health evaluation [17]. Usability is defined as "the extent to which a product can be used by a specific user for a specific goal in a specific context or environment and provides a satisfying experience" [17]. Nevertheless, in the era of exponential growth in digital health, paper-based self-management tools such as this booklet remain relevant in managing patients with chronic conditions as these booklets are more accessible to a broader range of patients, including those who may not be technologically savvy or do not have access to advanced devices [18]. The EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet© is currently being distributed among patients with MetS in our primary care clinic so that they can be empowered to actively participate in managing their own health. However, the level of its usability and the factors associated with its usability were not known. Therefore, the objectives of this study were to evaluate the usability of this booklet and identify the factors associated with its usability among patients with MetS in our primary care clinic. The findings would be used to improve the content and acceptability of this booklet among our patients. Identifying the factors associated with its usability would allow us to target specific determinants, e.g., patient groups or characteristics, to improve its usability and plan for future intervention studies.

Methods

Study design and population

This cross-sectional study was conducted from September 2020 until June 2023, which included conceptualizing the study, conducting literature reviews, collecting data, analyzing the data and finalizing the manuscript. The study population was patients with MetS attending a university primary care clinic in Selangor, Malaysia.

Inclusion and exclusion criteria

This study included patients ≥ 18 years old who met all of the following criteria: fulfilled at least 3 out of 5 diagnostic criteria for MetS based on the Joint Interim Statement (JIS) 2009 definition; waist circumference (WC) using South Asian cut-points: male ≥ 90 cm or female ≥ 80 cm, blood pressure (BP): systolic BP ≥ 130 mmHg and/or diastolic BP ≥ 85 mmHg or on treatment for hypertension, fasting plasma glucose (FPG) ≥ 5.6 mmol/L or on treatment for elevated glucose, triglycerides (TG) ≥ 1.7 mmol/L or on treatment for TG, and high-density lipoprotein (HDL-c): male < 1.0 mmol/L or female < 1.3 mmol/L or on treatment for HDL-c [3], attended the university primary care clinic for ≥ 1 year, were able to read and understand the Malay language, had blood investigations FPG and fasting serum lipid (FSL) performed in the last 6 months and used the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet© for at least 6 months.

Patients who fulfilled any of the following criteria were excluded from the study: were receiving renal dialysis, presented with severe hypertension (systolic BP > 180 mmHg and/or diastolic BP > 110 mmHg) at recruitment, had secondary hypertension, were diagnosed with circulatory disorders requiring secondary care over the last year (e.g., acute coronary syndrome, stroke, transient ischaemic attacks, peripheral vascular disease), were pregnant, were diagnosed with malignancy (i.e., all types of cancers), had any form of mental disorders or cognitive impairments that affected the ability to answer the questionnaire (e.g., dementia, learning disability) and were not able to give written informed consent.

Variable definition

Household income per month (in Malaysian Ringgit [MYR]) was defined based on the Report of Household Income and Basic Amenities Survey 2019 by the Department of Statistics, Malaysia, as per the following: Bottom 40% (B40) < MYR4,850, Middle 40% (M40) MYR4,850–10,959, and Top 20% (T20) > MYR10,959 [19]. Active smokers were defined as those who currently smoke or have smoked any tobacco products within one year. Previous smokers were those who had stopped smoking for more than a year, and nonsmokers were defined as those who had never smoked. Body mass index (BMI) was defined based on the proposed classification of weight by BMI in adult Asians by the World Health Organization (WHO) as per the following: underweight < 18.5 kg/m2, normal 18.5–22.9 kg/m2, overweight 23–24.9 kg/m2, obese I 25–29.9 kg/m2, obese II ≥ 30 kg/m2 [20]. Hypertension (HTN) and diabetes mellitus (DM) were defined based on their clinician’s diagnosis and/or if patients were taking any antihypertensive or antidiabetic treatment (oral hypoglycemic agent, insulin), respectively.

In this study, the treatment targets for the participants were defined according to the Malaysian CPG on the Management of Type 2 Diabetes Mellitus (6th Edition) [21] and the CPG on the Management of Primary and Secondary Prevention of Cardiovascular Diseases [16], whereby BP of < 140/80 mmHg for DM patients and < 140/90 mmHg for non-DM patients, HDL-c of > 1.0 mmol/L for males and > 1.2 mmol/L for females, TG of ≤ 1.7 mmol/L, and low-density lipoprotein cholesterol (LDL-c) of ≤ 2.6 mmol/L were defined as well controlled [16, 21].

Study tool

The tool used to measure usability in this study was the EMPOWER-SUSTAIN Usability Questionnaire (E-SUQ), which is valid, reliable, and stable for measuring the usability of a self-management booklet among patients with MetS in primary care [22]. The E-SUQ is a 10-item questionnaire in the Malay language adapted from the System Usability Scale (SUS) questionnaire; therefore, its scoring system is similar to that of the SUS [23, 24]. The E-SUQ is provided in the Additional file 1. The score was calculated using a 5-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree). The item score on the positively phrased statements, i.e., odd-numbered questions, was subtracted by 1 (x−1), and the item score on the negatively phrased statements, i.e., even-numbered questions, was calculated by subtracting the score from 5 (5−x) [25]. The overall score was computed as the sum of all item scores multiplied by 2.5, which gave an overall score that ranged from 0 (extremely poor usability) to 100 (excellent usability). A score of > 68 indicates good usability, as recommended by the original author [23]. Permission to use the E-SUQ was obtained from the questionnaire developer.

Sampling frame and distribution of the booklet

The sampling frame was approximately 2000 patients with MetS attending the university primary care clinic. The EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet© was distributed to all patients with MetS attending this clinic between May 2020 and September 2021. The patients were counselled by the researcher to use the booklet to monitor their health at home and to bring the booklet to each follow-up appointment with their doctors. This is to ensure that patients had the booklet for at least six months before the study's recruitment and the collection of usability data. This booklet contained seven sections, as shown in Fig. 1.

Fig. 1
figure 1

The EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet©

Study conduct: recruitment and data collection procedures

Patient recruitment and data collection were conducted from July 2021 to September 2022. A trained research assistant recruited patients and collected the data to maintain a consistent method. Patients who had the booklet were consecutively identified on the day of their follow-up clinic appointment. They were approached in the nurse assessment room, given the study information sheet (containing background, purpose, benefit, study procedure, confidentiality status and contact information) and were invited to participate. Patients who verbally agreed to participate were screened for eligibility following the inclusion and exclusion criteria. Trained nurses measured WC, BMI and BP. The patient's medical history and blood investigations, which were required to diagnose MetS (FPG and FSL), were retrieved from the electronic medical record (EMR). Patients who fulfilled the eligibility criteria were recruited into the study, and written informed consent was obtained. Sociodemographic data, which included age, gender, marital status, education level, employment status, income and clinical factors such as self-reported health status and smoking status, were collected by trained research assistants.

Questionnaire administration

The E-SUQ was self-administered by the participants. Prior to the administration of the questionnaire, clear verbal instructions on how to complete the questionnaire were given to the participants. Participants were reminded to complete the questionnaire in approximately 20 minutes without referring to notes or family members. They were free to ask for clarification from the researcher at any time should any query arise. Once the questionnaire was completed, participants were requested to return it to the researcher, who checked it for completeness.

Sample size calculation

The sample size was calculated using OpenEpi, Version 3.01 [26], an open-source online calculator software using the Single Proportion Formula. As we did not find any published literature measuring the usability of a self-management booklet, the sample size for this study was calculated based on a study measuring the usability of a mobile app using the SUS questionnaire, i-Predi, where 65% of participants rated the app as having good usability [27]. With reference to this proportion of good usability, taking an α value of 0.05 with an absolute precision of 5%, the minimum required number of participants was 350. Considering a nonresponder and ineligibility rate of 10%, the study aimed to approach 385 patients.

Statistical analysis

The latest IBM SPSS Statistics Program Version 28 was used for data entry and statistical analysis [28]. The data quality was evaluated based on the percentage of missing data, and the formula recommended by the SUS author [25] was used to calculate the mean E-SUQ score. For categorical data, descriptive analysis was presented as frequency and percentage. Normally distributed continuous data were expressed as the mean with standard deviation (± SD), and nonnormally distributed data were expressed as the median with interquartile range (IQR). Simple logistic regression (SLogR) was performed to determine the association between the independent variables and the dependent variable, i.e., the  proportion of participants with good usability of the booklet (E-SUQ score value of > 68). Variables with a P value of < 0.25 from the SLogR were included in the multiple logistic regressions (MLogR) to determine the factors associated with good usability. A P value of < 0.05 was considered significant for MLogR.

Results

A total of 439 patients were approached and invited to participate. Of these, 391 (89%) patients were eligible and recruited into the study. The flowchart for the conduct of the study is shown in Fig. 2.

Fig. 2
figure 2

Flowchart of the study

Sociodemographic characteristics of the participants

Table 1 summarizes the sociodemographic characteristics of the participants in this study. The mean (± SD) age was 61.7 (± 8.9), ranging between 27 and 80 years old. Of the 391 participants, the majority were Malays (86.4%), married (87.0%), had a tertiary education (52.2%), were pensioners (50.6%), had < 4 household members (46.5%), and came from the bottom 40% household income group (60.6%). The gender distribution was almost equal (males 50.9% vs. females 49.1%).

Table 1 Sociodemographic characteristics of the participants, N = 391

Clinical characteristics of participants

Table 2 summarizes the clinical characteristics of the participants. Out of 391 participants, the majority never smoked cigarettes (75.7%), self-rated to have good health status (57.0%), were obese class II (45.5%), had abdominal obesity (85.2%), had DM (66.2%), had HTN (89.5%), and had uncontrolled systolic blood pressure (51.2%). The majority of them had controlled diastolic blood pressure (69.6%), controlled LDL-c (67.5%), controlled HDL-c (71.4%), controlled TG (72.6%), had all 5 MetS components (62.7%), and were on 4–6 medications (48.6%). The mean FPG was 6.54 (SD ± 1.85), and the mean total cholesterol (TC) was 4.46 (SD ± 1.05).

Table 2 Clinical characteristics of the participants, N = 391

Mean usability score and distribution of usability levels

Out of 391 participants, more than half (61.4%) of the participants reported a good usability score (score of > 68), as measured by the E-SUQ, as shown in Fig. 3. The mean usability score was 72.8 (SD ± 16.1).

Fig. 3
figure 3

Distribution of participants with good and poor usability levels

Distribution of participants’ responses toward the features of the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet©

Table 3 summarizes the distribution of participants’ responses regarding the features of the booklet. The majority of the participants concurred that they liked the physical appearance of the booklet in terms of size, design and typography. They also agreed that all seven sections of the booklet were easy to understand.

Table 3 Distribution of participants’ responses to the features of the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet©, N = 391

Distribution of participants’ responses toward doctors’ support in using the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet©

Table 4 summarizes the distribution of participants’ responses toward doctors’ support in using the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet©. More than half of the participants had one treating doctor (61.6%), and 88.5% of the participants were given explanations by the doctors on how to use the booklet, especially on their treatment targets (96.8%), investigation results (95.1%), home blood pressure monitoring (95.5%) and self-monitoring of blood sugar (94.4%).

Table 4 Distribution of participants’ responses to doctors’ support in using the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet©

Distribution of participants’ responses toward using the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet© at Home

Table 5 summarizes the distribution of participants’ responses toward using the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet© at home. Majority of the participants had utilized the booklet at home (75.7%), and 39.6% used the booklet weekly. Most patients utilized the booklet primarily to self-monitor their blood sugar (93.9%), followed by blood pressure (93.3%).

Table 5 Distribution of participants’ responses toward using the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet© at home

Distribution of participants’ responses toward social support in using the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet©

Out of 391 patients, 244 (62.4%) received social support from their family members and friends in using the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet©. Of those who received social support to use the booklet (n = 244), the majority of them received it from their spouses (71.3%) (Fig. 4).

Fig. 4
figure 4

Distributions of social support in using the booklet at home

Factors associated with usability of the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet©

Table 6 shows the results of the logistic regressions. A total of 15 variables had a P value of < 0.25 in the SLogR, and these variables were then included in the MLogR. These were being Malay (P = 0.050), being married (P = 0.026), having secondary education level (P = 0.011), having tertiary education level (P = 0.002), being in the M40 household income group (P = 0.022), being in the T20 household income group (P = 0.077), having moderate self-reported health status (P = 0.125), having good self-reported health status (P = 0.202), being overweight (P = 0.067), being obese class I (P = 0.117), having explanations given by doctor/s on how to use the booklet (P = 0.033), using the booklet at home monthly (P = 0.001), using the booklet at home weekly (P =  < 0.001), using the booklet at home daily (P = 0.004), and having social support to use the booklet (P = 0.001).

Table 6 Factors associated with usability of the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet©

From the MLogR, five variables were found to be significantly associated with the good usability of the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet© (P value < 0.05), namely, having secondary education level, tertiary education level, daily use of the booklet at home, weekly use of the booklet at home, and having social support to use the booklet. For those who had secondary education (AOR 2.46, 95% CI 1.04, 5.83) and tertiary education (AOR 2.49, 95% CI 1.04, 5.96), the odds of finding the booklet usable were more than double compared to those with low education levels (no formal education and primary school). Those who used the booklet weekly (AOR 2.94, 95% CI 1.63, 5.33) and daily (AOR 2.73, 95% CI 1.09, 6.85) at home had almost three times the odds of finding the booklet usable compared with those who did not use the booklet at home. For those who had social support to use the booklet, the odds of finding the booklet usable were almost twice as high (AOR 1.64, 95% CI 1.02, 2.64) compared with those who did not have social support. The other variables, i.e., being Malay, being married, having at least middle-class household income, having moderate and good self-reported health, being overweight and obese I, and having an explanation given by the doctor(s) regarding how to use the booklet, were adjusted as confounders.

Discussion

To the best of our knowledge, our study was the first in Malaysia to measure the usability of a self-management booklet in primary care. Most of the published research has evaluated the usability of electronic health interventions, such as mobile applications [18, 27, 29,30,31,32,33]. More than half (61.4%) of the patients with MetS in our study had a good usability score of > 68 as measured by the E-SUQ. The mean usability score among our patients was 72.8 (SD ± 16.1), which is comparable to the mean usability score found in our previous field-testing validation study (77.3 [SD ± 13.8]) [22]. This has proven that the usability of the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet© among patients with MetS in our primary care clinic is good [23]. However, a direct comparison with other studies evaluating the usability of a self-management booklet is difficult because there is no published literature in this area. Our findings can be compared to the usability of mobile apps using the SUS questionnaire, as numerous studies have been published in this field [18, 30, 34]. The mean usability score in our study was comparable to the mean usability scores found in two local studies, which were a mobile app for colorectal community education (72.9 [SD ± 11.5]) [31] and Gigiku Sihat, a mobile app for diet and dental hygiene (77.0 [SD ± 14.18]) [32]. The mean usability score in this study was also comparable to that in the study by Lim et al., measuring the usability of a self-management smartphone diary tool in patients with high cardiovascular risks (69.8 [SD ± 12.9]) [35].

The majority of participants agreed that they liked the physical appearance of the booklet, that all seven sections were simple to comprehend and that the majority of the doctors (88.5%) provided instructions on how to use the booklet. Nevertheless, only 75.7% used the booklet at home. Future studies should explore the barriers to using the booklet at home, as nearly a quarter of the patients in this study did not use the booklet to self-manage their conditions at home as intended.

Five factors were found to be significantly associated with the good usability of the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet© among individuals with MetS in our study, namely, those with high education levels (secondary and tertiary education), those who used the booklet daily or weekly at home, and those who had social support to use the booklet. Patients with higher education levels, secondary education (AOR 2.46, 95% CI 1.04, 5.83] and tertiary education (AOR 2.49, 95% CI 1.04, 5.96), had significantly higher odds of having good usability of the booklet compared to those with low education. This finding is consistent with several other studies [36, 37] showing that the mean usability scores of eHealth apps were significantly higher among patients with a higher level of education. These results may be attributable to the fact that those with a higher education level have more knowledge and greater access to the necessary information, and they are able to understand, memorize, and apply the information better than those with a lower level of education [38, 39].

Patients who used the booklet at home weekly (AOR 2.94, 95% CI 1.63, 5.33) or daily (AOR 2.73, 95% CI 1.09, 6.85) had significantly higher odds of having good usability of the booklet compared with those who did not use it at home. This finding is consistent with a usability study of a mobile app, DIABETEYAR, that assists diabetes patients in managing their self-care activities, in which the mean usability score was positively associated with increased weekly usage [36]. Therefore, healthcare professionals, especially primary care physicians, should encourage their patients to utilize the self-management booklet at home at least weekly to improve its usability.

Patients who received social support from their family members and friends had higher odds (AOR 1.64, 95% CI 1.02, 2.64) of having good usability of the booklet than those who did not receive social support. A review by Reiners et al. regarding factors influencing the use of eHealth in people with chronic diseases showed that including family members plays a crucial role in implementing and utilising eHealth [37]. Multiple-person households have been shown to positively influence the use of eHealth, where elderly individuals who struggle with technology are frequently assisted by family members [37]. Therefore, primary care physicians should promote participation and support from patients’ family members and friends to maximize the usability of this self-management booklet. Such activities will encourage patients to share their knowledge and skills in self-management of their condition with those around them.

Strengths and limitations

A major strength of this study is that it addresses the gap in the literature where research on the usability of a self-management booklet in primary care is nonexistent. Despite the rapid growth in digital health, paper-based self-management booklets remain relevant as they are more accessible to a broader range of patients, including those who might have difficulties handling digital technologies or have limited internet access [18]. Another strength of the study is that the data set is of high quality, as there were no missing values. Nonetheless, this study has several limitations. Firstly, this study may be susceptible to reporting bias, particularly obsequiousness bias. The participants may answer the questionnaire in a manner they believe would please their doctors, as this booklet serves as an interaction tool between them and their doctors to monitor the progress of their disease. Secondly, this study was conducted at a university primary care clinic where most participants were Malays. The Chinese and Indian ethnic groups were underrepresented in this study. Therefore, the findings may not be generalizable to other primary care clinics in Malaysia with a multiracial population. Thirdly, several variables included in the MLogR have an extreme proportion (> 80% in one group), such as ethnicity and education levels, and the confidence intervals are relatively wide. This may have an effect on the final model, and therefore the findings should be cautiously interpreted given this limitation. Finally, this study did not explore other potential factors or barriers that may affect the usability of a self-management booklet, such as health literacy and self-efficacy. Therefore, the result of the MLogR is limited to the variables included in this study and must be interpreted within the context of this study.

Implications for future research and clinical practice

The usability of the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet© among patients with MetS in our primary care clinic is established in this study, supporting its widespread utilization as an empowerment tool to aid productive interaction between doctors, nurses and patients with MetS. This joint health decision-making process will empower patients to improve their health outcomes, which will eventually prevent CVD complications such as heart attack and stroke. This study also established that five factors were significantly associated with the usability of the booklet. Primary care physicians should focus on those with lower education, as they may not understand the content of the booklet, as only those with higher education levels were found to have better usability of the booklet. Primary care physicians should also encourage their patients to utilize the self-management booklet at home at least weekly to improve its usability. Encouraging participation and support from patients’ family members and friends when using the booklet at home is also vital to maximizing its usability. Future research should also be conducted that includes other factors or barriers that may influence the usability of a self-management booklet, such as health literacy and self-efficacy. Future studies should also involve patients from various ethnic groups from other primary care clinics in Malaysia.

This booklet has recently been converted into a mobile app, and its development, design, utility and usability testing has been published elsewhere [40]. Further research will be conducted to evaluate this mobile app's effectiveness in changing lifestyle (diet and exercise) and improving clinical outcomes [15].

Conclusions

In conclusion, this study found that most patients with MetS had good usability of the self-management booklet. High education levels (secondary and tertiary education), using the booklet daily or weekly at home, and having social support to use the booklet were identified as significant factors of good usability. Despite its limitations, this study is the only one that has determined the usability of a self-management booklet and its associated factors among patients with MetS in the Malaysian primary care setting. The findings of this study support the widespread use of this booklet as an empowerment tool to aid productive interaction between primary care providers and patients with MetS. This patient-centered decision-making process will empower patients to improve their health outcomes, eventually preventing CVD complications. Focus should be given to those with lower education to improve the usability of the booklet in this group. Further research is needed to evaluate important factors influencing the usability of a self-management tool, such as health literacy and self-efficacy.

Availability of data and materials

Data are kept at the Department of Primary Care Medicine, Universiti Teknologi MARA, in Selangor, Malaysia. Data will be shared upon request and subject to data protection regulations.

Abbreviations

AOR:

Adjusted odd ratio

BMI:

Body mass index

BP:

Blood pressure

CCM:

Chronic Care Model

CI:

Confidence interval

CVD:

Cardiovascular diseases

DM:

Diabetes mellitus

E-SUQ:

EMPOWER—SUSTAIN Usability Questionnaire

FPG:

Fasting plasma glucose

FSL:

Fasting serum lipid

HDL-c:

High-density lipoprotein cholesterol

HTN:

Hypertension

LDL-c:

Low-density lipoprotein cholesterol

MetS:

Metabolic syndrome

MLogR:

Multiple logistic regressions

MYR:

Malaysian Ringgit

OR:

Odd ratio

SD:

Standard deviation

SLogR:

Simple logistic regression

SUS:

System Usability Scale

TC:

Total cholesterol

TG:

Triglycerides

WC:

Waist circumference

References

  1. Global Health Estimates 2019: Estimated deaths by age, sex, and cause: World Health Organization; 2020.

  2. O’Neill S, O’Driscoll L. Metabolic syndrome: a closer look at the growing epidemic and its associated pathologies. Obes Rev. 2015;16(1):1–12.

    Article  CAS  PubMed  Google Scholar 

  3. Alberti KG, Eckel RH, Grundy SM, Zimmet PZ, Cleeman JI, Donato KA, et al. Harmonizing the metabolic syndrome: a joint interim statement of the International Diabetes Federation Task Force on Epidemiology and prevention; National Heart, Lung, and Blood Institute; American Heart Association; World Heart Federation; International Atherosclerosis Society; and International Association for the Study of obesity. Circulation. 2009;120(16):1640–5.

    Article  CAS  PubMed  Google Scholar 

  4. Saklayen MG. The global epidemic of the metabolic syndrome. Curr Hypertens Rep. 2018;20(2):12.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Ramli AS, Daher AM, Nor-Ashikin MN, Mat-Nasir N, Ng KK, Miskan M, et al. JIS definition identified more Malaysian adults with metabolic syndrome compared to the NCEP-ATP III and IDF criteria. Biomed Res Int. 2013;2013:760963.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Ganapathy S, Jawahir S, Aris T, Ahmad N, Shauki N, Krishnan M, et al. NHMS 2019 - non-communicable diseases, risk factors and other health problems. 2020.

  7. Statistics on causes of death, Malaysia, 2021: Department of Statistics, Ministry of Economy, Malaysia; 2021.

  8. Bodenheimer T, Lorig K, Holman H, Grumbach K. Patient self-management of chronic disease in primary care. JAMA. 2002;288(19):2469–75.

    Article  PubMed  Google Scholar 

  9. Wagner EH. Chronic disease management: what will it take to improve care for chronic illness? Eff Clin Pract. 1998;1(1):2–4.

    CAS  PubMed  Google Scholar 

  10. Reynolds R, Dennis S, Hasan I, Slewa J, Chen W, Tian D, et al. A systematic review of chronic disease management interventions in primary care. BMC Fam Pract. 2018;19(1):11.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Baptista DR, Wiens A, Pontarolo R, Regis L, Reis WC, Correr CJ. The chronic care model for type 2 diabetes: a systematic review. Diabetol Metab Syndr. 2016;8:7.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Davy C, Bleasel J, Liu H, Tchan M, Ponniah S, Brown A. Effectiveness of chronic care models: opportunities for improving healthcare practice and health outcomes: a systematic review. BMC Health Serv Res. 2015;15:194.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Wagner EH, Austin BT, Davis C, Hindmarsh M, Schaefer J, Bonomi A. Improving chronic illness care: translating evidence into action. Health Aff (Millwood). 2001;20(6):64–78.

    Article  CAS  PubMed  Google Scholar 

  14. Ramli AS, Selvarajah S, Daud MH, Haniff J, Abdul-Razak S, Tg-Abu-Bakar-Sidik TM, et al. Effectiveness of the EMPOWER-PAR intervention in improving clinical outcomes of type 2 diabetes mellitus in primary care: a pragmatic cluster randomised controlled trial. BMC Fam Pract. 2016;17(1):157.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Daud MH, Ramli AS, Abdul-Razak S, Isa MR, Yusoff FH, Baharudin N, et al. The EMPOWER-SUSTAIN e-Health intervention to improve patient activation and self-management behaviours among individuals with metabolic syndrome in primary care: study protocol for a pilot randomised controlled trial. Trials. 2020;21(1):311.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Clinical Practice Guidelines on primary & secondary prevention of cardiovascular disease: health technology assessment section, medical development Division Ministry of Health, Malaysia.; 2017.

  17. Bevan N. International standards for HCI and usability. Int J Hum Comput Stud. 2001;55(4):533–52.

    Article  Google Scholar 

  18. Georgsson M, Staggers N. Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics. J Am Med Inform Assoc. 2015;23(1):5–11.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Household income and basic amenities survey report 2019: Department of Statistics, Malaysia; 2020.

  20. World Health Organization. Regional Office for the Western P. The Asia-Pacific perspective: redefining obesity and its treatment: Sydney: Health Communications Australia; 2000.

  21. Clinical Practice Guidelines: Management of type 2 diabetes mellitus: Ministry of Health Malaysia; 2020.

  22. Sahar NH, Badlishah-Sham SF, Ramli AS. Adaptation and psychometric validation of the EMPOWER-SUSTAIN Usability Questionnaire (E-SUQ) among patients with metabolic syndrome in primary care. Int J Environ Res Public Health. 2021;18(17).

  23. Brooke J. SUS: a retrospective. J Usability Stud. 2013;8:29–40.

    Google Scholar 

  24. Lewis J, Sauro J. Revisiting the factor structure of the system usability scale. J Usability Stud. 2017;12:183–92.

    Google Scholar 

  25. Brooke J. SUS-A quick and dirty usability scale. Usab Eval Indust. 1996;189(194):4–7.

    Google Scholar 

  26. Dean AG SK, Soe MM. OpenEpi: Open Source Epidemiologic Statistics for Public Health. updated 2013/04/06. Version 3.01. Available from: www.OpenEpi.com.

  27. Subramaniam S, Dhillon JS. Assessing the usability of a prediabetes self-care application: a multi-method approach. 2018.

  28. IBM SPSS Statistics for Windows. 28.0 ed. Armonk: IBM Corp: IBM Corp.; 2021.

  29. Gianfrancesco C, Darwin Z, McGowan L, Smith DM, Haddrill R, Carter M, et al. Exploring the feasibility of use of an online dietary assessment tool (myfood24) in women with gestational diabetes. Nutrients. 2018;10(9):1147.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Seely EW, Weitzman PF, Cortes D, Romero Vicente S, Levkoff SE. Development and feasibility of an app to decrease risk factors for type 2 diabetes in Hispanic women with recent gestational diabetes (Hola Bebé, Adiós diabetes): pilot pre-post study. JMIR Form Res. 2020;4(12):e19677.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Mohamad Marzuki MF, Yaacob NA, Bin Yaacob NM, Abu Hassan MR, Ahmad SB. Usable Mobile app for community education on colorectal cancer: development process and usability study. JMIR Hum Factors. 2019;6(2):e12103.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Akmal Muhamat N, Hasan R, Saddki N, Mohd Arshad MR, Ahmad M. Development and usability testing of mobile application on diet and oral health. PLoS ONE. 2021;16(9):e0257035.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  33. Kortum P, Sorber M. Measuring the usability of Mobile applications for phones and tablets. Int J Human-Comput Interact. 2015;31:518–29.

    Article  Google Scholar 

  34. Alfonsi JE, Choi EEY, Arshad T, Sammott SS, Pais V, Nguyen C, et al. Carbohydrate counting app using image recognition for youth with type 1 diabetes: pilot randomized control trial. JMIR Mhealth Uhealth. 2020;8(10):e22074.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Lim HM, Ng CJ, Abdullah A, Dalmazzo J, Lim WX, Lee KH, et al. Utility and usability evaluation of an information diary tool to measure health information access and exposure among patients with high cardiovascular risk. Front Publ Health. 2023;11:1132397.

  36. Janatkhah R, Tabari-Khomeiran R, Asadi-Louyeh A, Kazemnejad E. Usability of a disease management Mobile application as perceived by patients with diabetes. Comput Inform Nurs. 2019;37(8):413–9.

    PubMed  Google Scholar 

  37. Reiners F, Sturm J, Bouw LJW, Wouters EJM. Sociodemographic factors influencing the use of eHealth in people with chronic diseases. Int J Environ Res Public Health. 2019;16(4):645.

    Article  PubMed  PubMed Central  Google Scholar 

  38. LaMonica HM, English A, Hickie IB, Ip J, Ireland C, West S, et al. Examining internet and eHealth practices and preferences: survey study of Australian older adults with subjective memory complaints, mild cognitive impairment, or dementia. J Med Internet Res. 2017;19(10):e358.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Hofstede J, de Bie J, van Wijngaarden B, Heijmans M. Knowledge, use and attitude toward eHealth among patients with chronic lung diseases. Int J Med Inform. 2014;83(12):967–74.

    Article  CAS  PubMed  Google Scholar 

  40. Daud MH, Yusoff FH, Abdul-Razak S, Baharudin N, Mohamed-Yassin MS, Badlishah-Sham SF, et al. Design, development, utility and usability testing of the EMPOWER-SUSTAIN self-management Mobile app(©) among primary care physicians and patients with metabolic syndrome. Digit Health. 2023;9:20552076231176644.

    PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We thank Dr. Nurul Hidayatullaila Sahar for granting us permission to use the EMPOWER-SUSTAIN Usability Questionnaire (E-SUQ). We would also like to thank all the research assistants who assisted in the data collection for this study.

Funding

The authors disclosed receipt of the following financial support for the research and publication of this article: this study was funded by the Universiti Teknologi MARA (UiTM) internal research grant – Dana UiTM Cawangan Selangor-Centre of Excellence (DUCS-CoE), 600-UiTMSEL (PI. 5/4) (031/2022). The funding body did not play any role in the study's design, data collection, analysis, interpretation, or manuscript writing.

Author information

Authors and Affiliations

Authors

Contributions

ASR, NB, HAH, and MAZAH conceptualized and designed the study. ASR acquired the funding. ASR, NB, and HAH supervised and coordinated the study. MAZAH acquired the data. ASR, NB, HAH, and MAZAH analyzed and interpreted the data. MAZAH and ASR drafted the manuscript. MSMY, MHD, SFBS, and SAR critically revised the manuscript for important intellectual content. All authors have no competing interests and have read and approved the final version for submission. All authors contributed substantially to the intellectual contents, fulfilled the requirements for authorship of this manuscript and agreed to be accountable for all aspects of the work, including its accuracy and integrity.

Corresponding author

Correspondence to Anis Safura Ramli.

Ethics declarations

Ethics approval and consent to participate

The study was conducted according to the ICH Good Clinical Practice Guidelines, Malaysia Good Clinical Practice Guidelines and the Declaration of Helsinki and approved by the Research Ethics Committee of Universiti Teknologi MARA [600-TNCPI (5/1/6)/REC/05/2021 (MR/337)]. Permission to use the E-SUQ was obtained from the questionnaire developers. Written informed consent was obtained from the participants before they were recruited into the study. The study information sheet highlighted the participants' rights to participate anonymously and voluntarily, and withdraw from the study at any time without explanation or penalty.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

The EMPOWER-SUSTAIN Usability Questionnaire (E-SUQ©) Malay Version.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Abdul-Halim, M.A.Z., Baharudin, N., Abdul-Hamid, H. et al. Factors associated with usability of the EMPOWER-SUSTAIN Global Cardiovascular Risks Self-Management Booklet© among individuals with metabolic syndrome in primary care: a cross-sectional study. BMC Prim. Care 25, 51 (2024). https://doi.org/10.1186/s12875-024-02281-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12875-024-02281-z

Keywords