Skip to main content

Psychometric evaluation of the Arabic version of the 5-item Problem Areas in Diabetes (AR-PAID-5) scale

Abstract

Background

Screening for diabetes distress is recommended when caring for patients with type 2 diabetes mellitus (T2DM) in primary healthcare (PHC). The 5-item Problem Areas in Diabetes (PAID-5) scale is widely used to measure diabetes distress, but its Arabic validation studies are scarce, so this study was carried to assess the psychometric properties of the Arabic version of the PAID-5 (AR-PAID-5) in Egyptian PHC patients with T2DM.

Methods

We conducted a cross-sectional study including 260 participants from six rural PHC settings in Ismailia governorate, Egypt. Internal consistency using Cronbach’s α and one-month test-retest reliability using intraclass correlation coefficient (ICC) were investigated. Confirmatory factor analysis (CFA) was used to evaluate the one-factor structure of the AR-PAID-5. Correlations of the AR-PAID-5 with the Arabic versions of the 20-item Problem Areas in Diabetes (PAID), Patient Health Questionnaire 9 (PHQ-9), Generalized Anxiety Disorder 7 (GAD-7), 5-item World Health Organization Well-Being Index (WHO-5) scales and glycated hemoglobin (HbA1c) were investigated for supporting the convergent validity. Associations of the PAID-5 with sociodemographic, and clinical characteristics were assessed for demonstrating the discriminant validity. Criterion validity was also evaluated.

Results

There was a good internal consistency (α = 0.88) and a stable test-retest reliability (ICC = 0.74). The CFA confirmed the one-factor structure of the AR-PAID-5. Significant positive correlations existed between the AR-PAID-5 with diabetes distress evaluated by the Arabic version of the PAID (rho = 0.93, p < 0.001), depressive symptoms (PHQ-9) (rho = 0.56, p < 0.001), anxiety symptoms (GAD-7) (rho = 0.47, p < 0.001), emotional well-being (WHO-5) (rho = − 0.38, p < 0.001), and HbA1c (rho = 0.16, p = 0.003). A satisfactory discriminant validity, and an acceptable criterion validity were demonstrated.

Conclusions

The AR-PAID-5 scale is a reliable and valid tool that can be used for diabetes distress screening and in research in Arabic speaking PHC patients with T2DM.

Peer Review reports

Introduction

The International Diabetes Federation estimates the global diabetes prevalence to be 463 million people (9.3%) in 2019 [1]. There is a projected 96% increase in diabetes incidence in the Middle East and North Africa, from 55 million in 2019 to an estimated 108 million in 2045. Type 2 diabetes mellitus (T2DM) accounts for 90% of diabetes globally [2].

Physical activity, proper dosing of medication, and blood glucose level monitoring are important factors in the self-management of diabetes, and may pose a negative or otherwise burdensome emotional experience on some patients [3, 4]. This emotional burden that is associated with diabetes is termed diabetes distress [5]. Diabetes distress is one of the most prevalent (36%) and important psychosocial barriers to efficacious care for people with diabetes [6, 7]. Conclusions from a 6-month prospective study indicated that improving diabetes distress may improve diabetes quality of life in young women with diabetes [8].

The American Diabetes Association recommends assessment for symptoms of diabetes distress among diabetic patients using appropriate standardized and validated tools at their initial visit, at periodic intervals, and when there is a change in disease, treatment, or life circumstance [9]. Several psychometric scales have been developed to assist clinicians in ascertaining a patient’s diabetes distress. The most frequently used, diabetes-specific, and clinical-evidence based scales in determining diabetes distress are the 20-item PAID scale and 17-item Diabetes Distress Scale (DDS17) [5, 6, 10, 11]. PAID is a self-report survey consisting of a 20-item questionnaire rated from 1 being “Not a problem” to 4 being “Serious problem” [5]. This original PAID scale has demonstrated reliability and validity in the English-speaking population [12].

McGuire and colleagues developed psychometrically robust short versions of the PAID, PAID-5 and 1-item PAID (PAID-1). The PAID-5 is composed of five of the emotional-distress questions from the PAID-20 items (items 3, 6, 12, 16, and 19) while the PAID-1 is composed of item 12 from the PAID. The PAID-5 is reliable and valid tool, is useful in rapid screening, poses a lesser burden on patients [13], and is a widely used tool [6] despite the development of the 2-item DDS and the 4-item DDS [14].

As the burden of diabetes and utility of determining diabetes distress exists globally and across language, efforts have been made to translate and validate the PAID and associated shortened versions. The PAID and PAID-5 were translated into Korean (K-PAID and K-PAID-5). The short form K-PAID-5 performed better on psychometric evaluations (known-groups validity, internal-consistency, and test–retest reliability) than the K-PAID, and the authors conclude that the short form may be beneficial in imposing a minimum hardship on patients with diabetes [15].

The Norwegian translated version of the PAID-5 was demonstrated to be reliable and valid in assessing diabetes distress among people with both type 1 and type 2 diabetes [16]. The Turkish version of the PAID-5 demonstrated satisfactory convergent validity, but its reliability and discriminative validity were not reported (17). A telephone survey was conducted to evaluate the psychometric properties of the German multi-item instruments. Authors demonstrated a good internal reliability of the German PAID-5, and at least mediocre fit for a one-factor model, however convergent and discriminative validity were not evaluated [17].

Prior to this study, there was no Arabic short form of the PAID scale. Given the importance of ascertaining diabetes distress, and the predicted rise in diabetes in the Middle East, a translated, validated AR-PAID-5 is in order. As such, this study is the first to evaluate the psychometric properties of the AR-PAID-5 in PHC patients with T2DM in Egypt.

Methods

Design, sampling and setting

This cross-sectional study was conducted on a sample of patients with T2DM attending the PHC settings in Ismailia governorate, Egypt, between September 2020 and June 2021. A convenience sampling strategy was used to collect data from eligible patients in the 6 rural PHC settings affiliated with the Egypt’s Ministry of Health and Population. We used the Soper’s online calculator of sample size for structural equation models, to estimate the required sample size for a CFA model of one-latent and five observed variables, given that the PAID-5 has five items [18, 19]. A calculated sample size of 234 was large enough to detect an anticipated effect size of 0.061 [16] at 5% alpha error and 80% power of the study (additional 10% of the calculated sample size was added to compensate for dropout). Accordingly, the required sample size was 260 patients.

Patients aged 18 years or older were eligible to participate in this study if they had been diagnosed with T2DM for at least 1 year, and patients provided their informed consent to participate. Patients with gestational diabetes and those who were not able to give their informed consent due to serious mental illness or cognitive impairment were excluded. Data collection was performed using face-to-face interviews by the co-first author. To examine test-retest reliability of the AR-PAID-5 scale, data of the retest questionnaire were collected from 100 participants one-month after the first assessment.

Study measures and scales

The initial part of the study questionnaire included questions about sociodemographic and clinical characteristics including: age, gender, marital status, occupation, family income, duration of diabetes, treatment for diabetes, diabetes-related long-term complications (e.g. cardiovascular, cerebrovascular, retinopathy, nephropathy, neuropathy, or peripheral vascular complications), and smoking. Further parts of the study questionnaire included the Arabic versions of the following scales: PAID [5], PAID-5 [13], PHQ-9 [20, 21], GAD-7 [21, 22], and WHO-5 [23, 24].

The original PAID scale was developed in English and consisted of 20 items scored on a 5-point Likert scale, ranging from 0 to 4; where 0 = not a problem, and 4 = serious problem. The PAID gives a total score range of 0 to 100, by summing the 20 items’ responses and multiplying this sum by 1.25. The higher scores indicate greater diabetes-related emotional distress, with a score of ≥40 indicating severe emotional distress [25, 26]. The PAID-5 includes questions 3, 6, 12, 16 and 19 of the original PAID scale. PAID-5 gives a total score ranging from 0 to 20, with a score of ≥8 indicating high diabetes-related distress [13].

The Arabic version of the PAID (AR-PAID) was obtained from Joslin Diabetes center. We conducted a validation study of the Joslin’s AR-PAID on 200 patients with T2DM. Cronbach alpha was 0.96 and test-retest reliability demonstrated stability (ICC = 0.97) [27]. CFA demonstrated fit to the four-factor model of the Spanish PAID [28]. Convergent and discriminant validity were satisfactory displayed.

PHQ-9 is the depression module of the full PHQ. It consists of 9 items; each item is scored from 0 (not at all) to 3 (nearly every day), with a total score ranging from 0 to 27. A cut-off value ≥10 had a sensitivity of 88% and a specificity of 88% for major depression [20]. The Arabic version of the PHQ-9 (AR-PHQ-9) is available and showed satisfactory validity and reliability [21]. GAD-7 is the anxiety module of the full GAD consisting of 7 items. Each GAD’s item can be scored from 0 (not at all) to 3 (nearly every day), with a total score ranging from 0 to 21. A cut-off point ≥10 indicating GAD (sensitivity: 89%, specificity: 82%) [22]. The Arabic version of the GAD-7 (AR-GAD-7) is available with satisfactory validity and reliability [21].

WHO-5 is among the most widely used questionnaires assessing subjective psychological well-being [29]. It was originally presented at a WHO meeting in Stockholm in February 1998 as part of a project on the measurement of well-being in PHC patients [30] and was derived from the WHO-10 [23]. This scale only contains positively phrased items. The degree to which these feelings were present in the last 2 weeks is scored on a 6-point Likert-type scale ranging from 0 (not present) to 5 (constantly present). Item scores are summated and transformed to a 0–100 scale, multiplying the raw score by 4 [31]. A valid and reliable Arabic version of the WHO-5 (AR-WHO-5) was developed in an elderly population in Lebanon [24].

Anthropometric measurements including body weight (kg) and height (cm) were measured in all participants. Body mass index (BMI) was calculated as the body weight (in kg) divided by height in meters squared. Participants with BMI values ≥30 kg/m2 were categorized as obese, while BMI values of 25–29.9 were considered overweight. The most recent HbA1c values (less than 8 weeks prior or 12 weeks after interviewing the patient) were used. HbA1c values less than 7% and 7.5% were used to identify adult and older adult patients with good glycemic control, respectively [9].

Ethical consideration

The study procedures were approved by the Research Ethics Committee on Human Studies in accordance with the Declaration of Helsinki, at the Faculty of Medicine, Suez Canal University, Ismailia, Egypt under reference number 4277/2020. Informed consent was obtained from all participants. All methods were carried out in accordance with the Research Ethics Committee’s guidelines and regulations.

Statistical analysis

The Statistical Package for the Social Sciences (SPSS), version 25.0 (IBM Corporation, NY, USA) was used to perform all data management and analyses, while Mplus software, version 7.4 was used to conduct the confirmatory factor analysis (CFA) [32]. A significance level of 0.05 was used in all statistical analyses. All categorical variables were summarized as frequencies and percentages (%). The distributions of continuous variables were tested for normality with the Kolmogorov Smirnov test. Median and interquartile range were used for non-normally distributed variables.

The reliability of the AR-PAID-5 scale was assessed by internal consistency (Cronbach’s α) and the test-retest reliability (ICC). A CFA with robust weighted least squares estimator used to investigate the factor structure of the AR-PAID-5. Model fit was assessed by goodness-of-fit measures: ratio of Chi-square [χ2] value to the degrees of freedom [df] (CMIN/DF) and associated p values, goodness-of-fit index (GFI), comparative fit index (CFI), Tucker Lewis Index (TLI), root mean squared error of approximation (RMSEA) and standardized root mean square residual (SRMR). The model fit was considered acceptable if the following criteria were satisfied: CMIN/DF < 3, CFI ≥0.90, TLI ≥0.90, and RMSEA ≤0.08 [15, 33].

Convergent validity was assessed by Spearman’s Rank-Order Correlation (rho) between diabetes-related emotional distress (AR-PAID-5) and depressive symptoms (AR-PHQ-9), anxiety symptoms (AR-GAD-7) and the level of glycemic control (HbA1c). Correlation between the AR-PAID-5 and PAID scales was also investigated. According to Cohen’s conventions to interpret effect size, a correlation coefficient of < 0.30 is small/ weak, 0.30–0.49 moderate, and 0.50 or more is large/strong [34].

Discriminant validity was used to determine whether the AR-PAID-5 scale can differentiate between groups of patients with depression/anxiety symptoms, poor glycemic control as well as other demographic and clinical variables. Independent-samples Mann-Whitney and Kruskal Wallis test (Since these data were not normally distributed) were used to assess discriminant validity. Criterion validity was evaluated using receiver operating characteristic (ROC) curves with high diabetes-related distress as the external criterion met by a cut-off value of ≥33 on the PAID [13, 25]. Youden index-based optimal cut-off value for the AR-PAID-5 was identified along with its area under curve (AUC), sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPP).

Results

Descriptive statistics

This study included a sample of 260 patients with T2DM. The mean age of the patients was 48.3 years (±11.4 years) (range 25–80 years), and females constituted 56.5% of the sample. The majority were either married, divorced or widowed. About one-fourth of the sample were either illiterate or did not complete secondary education degree, while about half of the sample were either not employed or retired. The mean duration of T2DM was 7.8 years (±5.5 years) (range 1–30 years), with about one-third of less than 5-year duration. Two-thirds of patients were on oral hypoglycemic agents while 34.2% were on an insulin-containing regimen. Seventy patients (26.9%) had a single diabetes-related complication while 34.6% had two or more complications. The most frequent diabetes-related complications in our sample were: neuropathy (50.8%), retinopathy (38.1%), foot problems (30.4%), and nephropathy (24.2%). Other chronic comorbidities included obesity (32.7%), hypertension (20.8%), and dyslipidemia (8.1%). The mean HbA1c was 7.8% (±0.68%) (range 6–10.5%), with only 26 patients (10%) achieved the glycemic control target (Table 1).

Table 1 Patients’ demographic and clinical characteristics (N = 260)

Reliability of the AR-PAID-5: internal consistency and test-retest reliability

The means and standard deviations of the AR-PAID-5 items are described in Table 2. Inter-item correlations for the AR-PAID-5 scale ranged from 0.47 to 0.69, while item-to-total correlations ranged from 0.70 to 0.85. Cronbach’s α for the AR-PAID-5 scale was 0.88. The test-retest reliability of the AR-PAID-5 was measured in 100 patients who gave their repeated questionnaires, with an ICC of 0.74 (95% CI: 0.61–0.83, p < 0.001).

Table 2 Internal consistency and test-retest reliabilities of the AR-PAID-5

Validity of the AR-PAID-5

Construct validity: factor structure of the AR-PAID-5

A CFA was performed for the AR-PAID-5 and illustrated in Fig. 1 and Table 3. A hypothesized single-factor model was used for AR-PAID-5. The overall model fit, Chi-square was significant (χ2 = 11.5, df = 5, CMIN/DF = 2.3, p-value = 0.042), denoting that the model was not exactly fit. However, other model fit indices were excellent (CFI =0.987, TLI = 0.995, SRMR = 0.022 and RMSEA = 0.071). Factor loadings representing the hypothesized item-to-scale relationships were also satisfactory and statistically significant, and ranged from 0.767 to 0.992.

Fig. 1
figure 1

A Path diagram illustrating the factor structure of the AR-PAID-5 with item-specific factor loadings

Table 3 Factor loadings of the AR-PAID-5 from the confirmatory factor analysis (N = 260)

Convergent validity of the AR-PAID-5

There was a significant positive and strong correlation between the total scores of AR-PAID-5 and the AR-PAID (rho = 0.94, p < 0.001). Significant correlations also existed between all AR-PAID-5 items and the total AR-PAID; ranging from 0.72 to 0.84. Convergent validity of the AR-PAID-5 was also confirmed by a significant strong correlation with the AR-PHQ-9 scale for depression (rho = 0.56, p < 0.001), and a significant moderate correlation with the AR-GAD-7 scale for anxiety (rho = 0.47, p < 0.001). The AR-PAID-5 total score also demonstrated a significant moderate inverse correlation with the AR-WHO-5 (rho = − 0.38, p < 0.001). Higher scores on the AR-PAID-5 were associated with higher scores on the AR-PHQ-9 and AR-GAD-7 scales. Higher scores on the AR-PAID-5 were associated with lower scores on the AR-WHO-5. However, the AR-PAID-5 total score showed a weak significant correlation with HbA1c (rho = 0.16, p = 0.003), Table 4.

Table 4 Correlations between the AR-PAID-5 and the Arabic versions of the PAID, PHQ-9, GAD-7, WHO-5 and HbA1c (N = 260)

Discriminant validity of the AR-PAID-5

AR-PAID-5 scale discriminated well between diabetes-related emotional distress levels among patients with different demographic and clinical characteristics (Table 5). Female sex, older age, and longer disease duration were significantly associated with high scores on AR-PAID-5. Patients on an insulin-containing regimen had higher AR-PAID-5 scores, compared to patients on oral hypoglycemic agents.

Table 5 Associations between the AR-PAID-5 and patients’ sociodemographic and clinical characteristics (N = 260)

The number of diabetes-related complications was significantly and positively associated with AR-PAID-5 scores, where patients with single or multiple complications had higher scores than those with no complications. Furthermore, patients who had obesity, hypertension or dyslipidemia had significantly higher AR-PAID-5 scores compared to patients without these comorbidities. Nevertheless, there was no significant difference in AR-PAID-5 scores between patients with glycemic control and those uncontrolled (p = 0.768). Known-group validity was confirmed by the statistically significant differences in AR-PAID-5 score between patients with symptoms of depression/anxiety (i.e. PHQ-9/GAD-7 scores of ≥10); and poor wellbeing (i.e. WHO-5 wellbeing index ≤50).

Criterion validity: estimation of the AR-PAID-5 cut-off value for high diabetes-related emotional distress

Criterion validity of the AR-PAID-5 was assessed using ROC curve with high diabetes-related emotional distress as an external criterion met by a cut-off value ≥33 on PAID-20. AR-PAID-5 had an excellent diagnostic accuracy for high diabetes-related emotional distress, confirmed by an AUC value of 0.975 (95% CI: 0.95–0.99, p < 0.001), Fig. 2. A Youden index-based optimal cut-off value for the AR-PAID-5 score was ≥8 with a sensitivity of 88.4% (95% CI: 76.6–95.6), a specificity of 95.2% (95% CI: 91.3–97.7), a PPV of 82.1% (95% CI: 71.4–89.5) and a NPV of 97.1% (95% CI: 94.0–98.6).

Fig. 2
figure 2

Receiver Operating Characteristic (ROC) curve of the AR-PAID-5 for high diabetes-related emotional distress (N = 260)

Discussion

This was the first study to assess the psychometric properties of the AR-PAID-5 in primary care patients in the Middle East and North Africa region. The results of the present study show satisfactory psychometric properties of the AR-PAID-5 in PHC patients with T2DM. Our findings demonstrated good reliability, a satisfactory construct validity, a confirmed convergent validity, a well-discriminant validity, and a good criterion validity of the AR-PAID-5.

The AR-PAID-5 possesses good internal consistency, and a stable test-retest reliability. Our findings are in line with the internal consistency’s results of the original PAID-5, K-PAID-5, Norwegian PAID-5, and German PAID-5 studies, which demonstrated Cronbach’s α varying from 0.83 to 0.89. The test-retest reliability of our study is acceptable despite the fact that the ICC is less than the findings in previous studies (0.81–0.89) [15, 16], the test-retest reliability of the original PAID-5 and the German PAID-5 scales were not evaluated [13 18].

Our findings showed an excellent construct validity of the AR-PAID-5, the CFA verified the one factor structure of this scale with excellent goodness-of-fit measures, which is in congruence with measures seen in previous studies [13, 15, 16]. Our used CFA model did not need modification with covariance of errors while both of the Korean and Norwegian studies demonstrated excellent goodness-of-fit measures after model modification with the covariance of error terms between two items (item 3, and 6 items; 3 and 16, respectively) [15, 16]. In the Germany study, CFA showed mixed results of model fit, which did not fully confirm the one-factor structure of the original PAID-5 [13, 17].

In our study, the AR-PAID-5 total score correlated positively with symptoms of diabetes distress (AR-PAID) depressive symptoms (AR-PHQ-9), anxiety symptoms (AR-GAD-7), and HbA1c level, and negatively with emotional well-being, indicating a reasonable convergent validity. In the present study, correlation between the AR-PAID-5 score and the AR-PAID score was significantly positive and strong, this finding is similar to the reported findings in the original PAID-5 and the Norwegian version of the PAID-5 [13, 16].

Our study revealed a moderate positive correlation of the AR-PAID-5 total score with depressive symptoms. This finding supported the findings from the two previous validation studies of the PAID-5 [15, 16]. This finding is partially similar to the reported findings in other studies on the PAID, which showed moderate to strong positive correlations with different measures of depression [15, 35,36,37].

Our study also demonstrated a moderate positive correlation between the AR-PAID-5 total score and anxiety symptoms. This finding is congruent with findings of previous studies on the PAID scale [27, 38]. Snoek et al. reported that a bidirectional relationship between anxiety and diabetes distress seems to be present, but this issue has received very little attention. Anxiety symptoms are characterized by excessive worries and fear about several situations. Thus, it cannot be difficulty seen a phenomenological overlap with the concept of diabetes distress as captured with the PAID-5, with phrases like feeling scared, and worrying [39]. This is the first study to assess this relationship during validation process of the PAID-5 scale.

The present study found a moderate negative correlation between the AR-PAID-5 and the WHO-5 well-being index. McGuire et al. and Vislapuu et al. found weak negative correlations between these two questionnaires [13, 16]. Unsurprisingly, when diabetes stress symptoms increase well-being of the diabetic patients decreases [13, 16, 31].

Our results showed a weak positive correlation between the AR-PAID-5 total score and a higher HbA1c level. This finding is consistent with the previous studies on the PAID-5 [15, 16], and the PAID scales [12, 15, 17, 36, 39,40,41,42]. Furthermore, a previous study revealed that diabetes distress had a strong positive correlation with HbA1c.level among patients with T2DM, in which diabetes distress was evaluated by the DDS 17 scale [43]. Diabetes distress may have an adverse effect on HbA1c level through its contribution to impaired diabetes self-care behaviours, the presence of comorbid depression, and dysregulation of stress hormones [39].

The current study showed that the AR-PAID-5 scale is able to distinguish between patients’ diabetes distress with most of the demographic and clinical characteristics. Known-groups validity also revealed differences in the AR-PAID-5 score between patients with more or less depression/anxiety symptoms, and emotional well-being indicating discriminant validity. Hermanns et al. concluded that the PAID may be useful screening tool for diabetes distress and depression [25].

The present study showed that patients with poor glycemic control had higher diabetes distress scores than patients with good glycemic control, but association between diabetes distress and achieving glycemic control targets was non-significant. This may be related to the relative few numbers of patients, who achieved glycemic control targets.

The present study revealed that the AR-PAID-5 scale discriminated between groups, such as patients with and without, obesity, hypertension or dyslipidemia. The AR-PAID-5 scores were significantly associated with older age, longer disease duration, and number of diabetes-related complications.

The AR-PAID-5 total score was significantly associated with receiving insulin regimen. The Norwegian version of the PAID-5 have not significantly found associations with insulin alone, insulin with oral hypoglycemic agents or oral hypoglycemic agents alone. The relatively small sample size might be the reason of that study’s finding, in addition to the possibility of treatment type was not the main reason for participants’ diabetes distress [16]. Use of insulin therapy was significantly associated with the PAID score in previous studies [42, 44,45,46]. The negative emotional response of patients towards receiving insulin therapy through the course of diabetes is referred as insulin distress, which is not only a part of diabetes distress, but it is unique identity [47].

Female patients had significantly higher diabetes distress scores than male patients. McGuire et al. and Lee et al. found a similar finding [13, 15]. Vislapuu et al. found that female patients reported higher scores on the Norwegian version of the PAID-5 than male patients, but without a significant difference [16]. The vulnerability of females to diabetes distress might be related to socio-demographic, biological and cultural factors. The rising demands of diabetes self-care might be more challenging for women than man as they often have multiple child-rearing and household support roles and responsibilities in traditional societies [41]. Depression and anxiety among patients with T2DM also are associated with female gender and the existing of these psychological problems also is associated with increased symptoms of diabetes distress [39, 48, 49]. Increased attention and support for diabetes distress are recommended for females with T2DM [50].

The AR-PAID-5 scale has an acceptable criterion validity, achieving a sensitivity of 88.4%, a specificity of 95.2%, a PPV of 82.1%, and a NPV of 97.1% with cut-off value ≥8. The original PAID-5 has a sensitivity of 95% and a specificity of 89% [13].

Our study had some limitations. Lack of randomization may restrict generalization of the results, and this study included only patients with T2DM, so the results may be not generalized to patients with type 1 diabetes mellites (T1DM), thus further investigations on patients with T1DM is needed. Although the self-report method for assessing diabetes distress, depression, and anxiety can be a cost-effective and time-efficient specially at busy PHC facilities, we did not use this method of data collection as literacy rates in Egypt remain low. The PAID-5 items are obtained from the PAID. Therefore, the PAID is not an ideal external criterion for the PAID-5. A different questionnaire or a clinical interview would have been proper external criterions to classify groups with different amount of diabetes distress. The small number of patients with good glycemic control may lead to the inability of the AR-PAID-5 to confirm group-validity on achieving glycemic control targets. Also, the design of this study could not assess the responsiveness to change after interventions and needs further longitudinal study design to evaluate this. Finally recall bias during data collection may have occurred.

Conclusions

The AR-PAID-5 scale has been demonstrated to be a psychometrically sound tool among Egyptian PHC patients with T2DM, it demonstrated good reliability and validity, and can be used as a screening tool for diabetes-related emotional distress in Egyptian PHC patients with T2DM, and may be used in other Arabic speaking patients with T2DM. This Arabic version is also relevant for use in related research to diabetes distress in Egypt or other Arabic countries. This study paves the way for future studying AR-PAID-5 scale’s utility for screening of diabetes distress in type 1 diabetes mellitus, among adults and in clinical settings other than PHC.

Availability of data and materials

All data generated or analyzed during this study are included in this published article.

Abbreviations

AR-GAD-7:

Arabic version of the Generalized Anxiety Disorder 7

AR-PAID:

Arabic version of the Problem Areas in Diabetes

AR-PAID-5:

Arabic version of the 5-item Problem Areas in Diabetes

AR-PHQ-9:

Arabic version of the Patient Health Questionnaire 9

AR-WHO-5:

Arabic version of the 5-item World Health Organization Well-Being Index

AUC:

Area under curve

BMI:

Body Mass Index

CFA:

Confirmatory factor analysis

CFI:

Comparative fit index

CI:

Confidence interval

DDS17:

17-item Diabetes Distress Scale

DDS2:

2-item Diabetes Distress Scale

df:

Degrees of freedom

GAD-7:

Generalized Anxiety Disorder Scale 7

GFI:

Goodness-of-fit index

HbA1c:

Glycated hemoglobin

ICC:

Intraclass correlation coefficient

IQR:

Interquartile range

K-PAID:

Korean version of the Problem Areas in Diabetes

K-PAID-5:

Korean version of the 5-item Problem Areas in Diabetes

NPP:

Negative predictive value

PAID:

Problem Areas in Diabetes

PAID-1:

1-item Problem Areas in Diabetes

PAID-5:

5-item Problem Areas in Diabetes

PHC:

Primary Healthcare

PHQ-9:

Patient Health Questionnaire 9

PPV:

Positive predictive value

rho:

Spearman’s Rank-Order Correlation

RMSEA:

Root mean squared error of approximation

ROC:

Receiver operating characteristic

SD:

Standard deviation

SPSS:

Statistical Package for the Social Sciences

SRMR:

Standardized root mean square residual

T1DM:

Type 1 diabetes mellitus

T2DM:

Type 2 diabetes mellitus

TLI:

Tucker Lewis Index

WHO:

World Health Organization

WHO-5:

5-item World Health Organization Well-Being Index

χ2 :

Chi-square

CMIN/DF:

Ratio of Chi-square value to the degrees of freedom

References

  1. Saeedi P, Petersohn I, Salpea P, Malanda B, Karuranga S, Unwin N, et al. Global and regional diabetes prevalence estimates for 2019 and projections for 2030 and 2045: Results from the International Diabetes Federation Diabetes Atlas, 9th edition. Diabetes Res Clin Pract. 2019;157:107843. https://doi.org/10.1016/j.diabres.2019.107843.

    Article  PubMed  Google Scholar 

  2. International Diabetes Federation. IDF Diabetes Atlas. 9th ed. Brussels: International Diabetes Federation; 2019. Available at: https://www.diabetesatlas.org/upload/resources/material/20200302_133351_IDFATLAS9e-final-web.pdf.

    Google Scholar 

  3. Chamberlain JJ, Rhinehart AS, Shaefer CF Jr, Neuman A. Diagnosis and Management of Diabetes: synopsis of the 2016 American Diabetes Association standards of medical Care in Diabetes. Ann Intern Med. 2016;164(8):542–52. https://doi.org/10.7326/M15-3016.

    Article  PubMed  Google Scholar 

  4. American Diabetes Association. 5. Facilitating behavior change and well-being to improve health outcomes: standards of medical care in diabetes-2021. Diabetes Care. 2021;44(1):S53–72. https://doi.org/10.2337/dc21-S005.

    Article  Google Scholar 

  5. Polonsky WH, Anderson BJ, Lohrer PA, Welch G, Jacobson AM, Aponte JE, et al. Assessment of diabetes-related distress. Diabetes Care. 1995;18(6):754–60. https://doi.org/10.2337/diacare.18.6.754.

    Article  CAS  PubMed  Google Scholar 

  6. Perrin NE, Davies MJ, Robertson N, Snoek FJ, Khunti K. The prevalence of diabetes-specific emotional distress in people with type 2 diabetes: a systematic review and meta-analysis. Diabet Med. 2017;34(11):1508–20. https://doi.org/10.1111/dme.13448.

    Article  CAS  PubMed  Google Scholar 

  7. Skinner TC, Joensen L, Parkin T. Twenty-five years of diabetes distress research. Diabet Med. 2020;37(3):393–400. https://doi.org/10.1111/dme.14157.

    Article  CAS  PubMed  Google Scholar 

  8. Wang RH, Lin CC, Chen SY, Hsu HC, Huang CL. The impact of self-stigma, role strain, and diabetes distress on quality of life and glycemic control in women with diabetes: a 6-month prospective study. Biol Res Nurs. 2021;10998004211009606. https://doi.org/10.1177/10998004211009606.

  9. American Diabetes Association. Standards of medical care in diabetes—2020 abridged for primary care providers. Clin Diabetes. 2020;38(1):10–38. https://doi.org/10.2337/cd20-as01.

    Article  PubMed Central  Google Scholar 

  10. Vieta A, Badia X, Sacristán JA. A systematic review of patient-reported and economic outcomes: value to stakeholders in the decision-making process in patients with type 2 diabetes mellitus. Clin Ther. 2011;33(9):1225–45. https://doi.org/10.1016/j.clinthera.2011.07.013.

    Article  PubMed  Google Scholar 

  11. Polonsky WH, Fisher L, Earles J, Dudl RJ, Lees J, Mullan J, et al. Assessing psychosocial distress in diabetes: development of the diabetes distress scale. Diabetes Care. 2005;28(3):626–31. https://doi.org/10.2337/diacare.28.3.626.

    Article  PubMed  Google Scholar 

  12. Welch GW, Jacobson AM, Polonsky WH. The problem areas in diabetes scale. An evaluation of its clinical utility. Diabetes Care. 1997;20(5):760–6. https://doi.org/10.2337/diacare.20.5.760.

    Article  CAS  PubMed  Google Scholar 

  13. McGuire BE, Morrison TG, Hermanns N, Skovlund S, Eldrup E, Gagliardino J, et al. Short-form measures of diabetes-related emotional distress: the problem areas in diabetes scale (PAID)-5 and PAID-1. Diabetologia. 2010;53(1):66–9. https://doi.org/10.1007/s00125-009-1559-5.

    Article  CAS  PubMed  Google Scholar 

  14. Fisher L, Glasgow RE, Mullan JT, Skaff MM, Polonsky WH. Development of a brief diabetes distress screening instrument. Ann Fam Med. 2008;6(3):246–52. https://doi.org/10.1370/afm.842.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Lee EH, Lee YW, Lee KW, Kim YS, Nam MS. Measurement of diabetes-related emotional distress using the problem areas in diabetes scale: psychometric evaluations show that the short form is better than the full form. Health Qual Life Outcomes. 2014;12:142. https://doi.org/10.1186/s12955-014-0142-z.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Vislapuu M, Broström A, Igland J, Vorderstrasse A, Iversen MM. Psychometric properties of the Norwegian version of the short form of the problem areas in diabetes scale (PAID-5): a validation study. BMJ Open. 2019;9(2):e022903. https://doi.org/10.1136/bmjopen-2018-022903.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Stühmann LM, Paprott R, Heidemann C, Ziese T, Hansen S, Zahn D, et al. Psychometric properties of a nationwide survey for adults with and without diabetes: the “disease knowledge and information needs - diabetes mellitus (2017)” survey. BMC Public Health. 2020;20(1):192. https://doi.org/10.1186/s12889-020-8296-6.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Soper DS. A-priori sample size calculator for structural equation models [software], 2021. Available from https://www.danielsoper.com/statcalc.

    Google Scholar 

  19. Westland JC. Lower bounds on sample size in structural equation modeling. Electron Commer Res Appl. 2010;9(6):476–87.

    Article  Google Scholar 

  20. Kroenke K, Spitzer RL, Williams JB. Validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13. https://doi.org/10.1046/j.1525-1497.2001.016009606.x.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  21. AlHadi AN, AlAteeq DA, Al-Sharif E, Bawazeer HM, Alanazi H, AlShomrani AT, et al. An Arabic translation, reliability, and validation of patient health questionnaire in a Saudi sample. Ann General Psychiatry. 2017;16:32. https://doi.org/10.1186/s12991-017-0155-1.

    Article  Google Scholar 

  22. Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–7. https://doi.org/10.1001/archinte.166.10.1092.

    Article  PubMed  Google Scholar 

  23. Bech P, Gudex C, Staehr JK. The WHO (ten) well-being index: validation in diabetes. Psychother Psychosom. 1996;65:183–90. https://doi.org/10.1159/000289073.

    Article  CAS  PubMed  Google Scholar 

  24. Sibai AM, Chaaya M, Tohme RA, Mahfoud Z, Al-Amin H. Validation of the Arabic version of the 5-item WHO well being index in elderly population. Int J Geriatr Psychiatry. 2009;24(1):106–7. https://doi.org/10.1002/gps.2079.

    Article  PubMed  Google Scholar 

  25. Hermanns N, Kulzer B, Krichbaum M, Kubiak T, Haak T. How to screen for depression and emotional problems in patients with diabetes: comparison of screening characteristics of depression questionnaires, measurement of diabetes-specific emotional problems and standard clinical assessment. Diabetologia. 2006;49(3):469–77. https://doi.org/10.1007/s00125-005-0094-2.

    Article  CAS  PubMed  Google Scholar 

  26. Snoek FJ, Kersch NY, Eldrup E, Harman-Boehm I, Hermanns N, Kokoszka A, et al. Monitoring of individual needs in diabetes (MIND): baseline data from the cross-National Diabetes Attitudes, wishes, and needs (DAWN) MIND study. Diabetes Care. 2011;34(3):601–3. https://doi.org/10.2337/dc10-1552.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Sayed Ahmed HA, Mohamed SF, Elotla SF, Mostafa M, Shah J, Fouad AM. Psychometric properties of the Arabic version of the problem areas in diabetes scale in primary care. Front Public Health. 2022;10:843164. https://doi.org/10.3389/fpubh.2022.843164.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Beléndez M, Hernández-Mijares A, Marco J, Domínguez JR, Pomares FJ. Validation of the Spanish version of the problem areas in diabetes (PAID-SP) scale. Diabetes Res Clin Pract. 2014;106(3):e93–5. https://doi.org/10.1016/j.diabres.2014.09.012.

    Article  PubMed  Google Scholar 

  29. Topp CW, Østergaard SD, Søndergaard S, Bech P. The WHO-5 well-being index: a systematic review of the literature. Psychother Psychosom. 2015;84(3):167–76. https://doi.org/10.1159/000376585.

    Article  PubMed  Google Scholar 

  30. World Health Organization. Wellbeing measures in health care: the Depcare project: report on a WHO meeting Stockholm, Sweden 12–13 February 1998. København: World Health Organization Regional Office for Europe; 1998.

    Google Scholar 

  31. Hajos TR, Pouwer F, Skovlund SE, Den Oudsten BL, Geelhoed-Duijvestijn PH, Tack CJ, et al. Psychometric and screening properties of the WHO-5 Well-Being Index in adult outpatients with type 1 or type 2 diabetes mellitus. Diabet Med. 2013;30:e63–9. https://doi.org/10.1111/dme.12040.

    Article  CAS  PubMed  Google Scholar 

  32. Muthén LK, Muthén BO. Mplus user's guide: statistical analysis with latent variables, user’s guide. In: Muthén & Muthén; 2017. Available at: https://www.statmodel.com/download/usersguide/MplusUserGuideVer_8.pdf.

    Google Scholar 

  33. Jackson DL, Gillaspy JA, Purc-Stephenson R. Reporting practices in confirmatory factor analysis: an overview and some recommendations. Psychol Methods. 2009;14(1):6–23. https://doi.org/10.1037/a0014694.

    Article  PubMed  Google Scholar 

  34. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed: Routledge; 1988. https://doi.org/10.4324/9780203771587.

    Book  Google Scholar 

  35. Huis In’t Veld EM, Makine C, Nouwen A, Karşıdağ C, Kadıoğlu P, Karşıdağ K, et al. Validation of the Turkish version of the problem areas in diabetes scale. Cardiovasc Psychiatry Neurol. 2011;2011:315068. https://doi.org/10.1155/2011/315068.

    Article  Google Scholar 

  36. Reddy J, Wilhelm K, Campbell L. Putting PAID to diabetes-related distress: the potential utility of the problem areas in diabetes (PAID) scale in patients with diabetes. Psychosomatics. 2013;54:44–51. https://doi.org/10.1016/j.psym.2012.08.004.

    Article  PubMed  Google Scholar 

  37. van Bastelaar KM, Pouwer F, Geelhoed-Duijvestijn PH, Tack CJ, Bazelmans E, Beekman AT, et al. Diabetes-specific emotional distress mediates the association between depressive symptoms and glycaemic control in type 1 and type 2 diabetes. Diabet Med. 2010;27(7):798–803. https://doi.org/10.1111/j.1464-5491.2010.03025.x.

    Article  PubMed  Google Scholar 

  38. Fenwick EK, Rees G, Holmes-Truscott E, Browne JL, Pouwer F, Speight J. What is the best measure for assessing diabetes distress? A comparison of the problem areas in diabetes and diabetes distress scale: results from diabetes MILES-Australia. J Health Psychol. 2018;23(5):667–80. https://doi.org/10.1177/1359105316642006.

    Article  PubMed  Google Scholar 

  39. Snoek FJ, Bremmer MA, Hermanns N. Constructs of depression and distress in diabetes: time for an appraisal. Lancet Diabetes Endocrinol. 2015;3:450–60. https://doi.org/10.1016/S2213-8587(15)00135-7.

    Article  PubMed  Google Scholar 

  40. Sigurdardottir AK, Benediktsson R. Reliability and validity of the Icelandic version of the problem area in diabetes (PAID) scale. Int J Nurs Stud. 2008;45(4):526–33. https://doi.org/10.1016/j.ijnurstu.2006.10.008.

    Article  CAS  PubMed  Google Scholar 

  41. Graue M, Haugstvedt A, Wentzel-Larsen T, Iversen MM, Karlsen B, Rokne B. Diabetes-related emotional distress in adults: reliability and validity of the Norwegian versions of the problem areas in diabetes scale (PAID) and the diabetes distress scale (DDS). Int J Nurs Stud. 2012;49(2):174–82. https://doi.org/10.1016/j.ijnurstu.2011.08.007.

    Article  PubMed  Google Scholar 

  42. Papathanasiou A, Koutsovasilis A, Shea S, Philalithis A, Papavasiliou S, Melidonis A, et al. The problem areas in diabetes (PAID) scale: psychometric evaluation survey in a Greek sample with type 2 diabetes. J Psychiatr Ment Health Nurs. 2014;21(4):345–53. https://doi.org/10.1111/j.1365-2850.2012.01875.x.

    Article  CAS  PubMed  Google Scholar 

  43. Tol A, Baghbanian A, Sharifirad G, Shojaeizadeh D, Eslami A, Alhani F, et al. Assessment of diabetic distress and disease related factors in patients with type 2 diabetes in Isfahan: A way to tailor an effective intervention planning in Isfahan-Iran. J Diabetes Metab Disord. 2012;11(1):20. https://doi.org/10.1186/2251-6581-11-20.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Delahanty LM, Grant RW, Wittenberg E, Bosch JL, Wexler DJ, Cagliero E, et al. Association of diabetes-related emotional distress with diabetes treatment in primary care patients with type 2 diabetes. Diabet Med. 2007;24(1):48–54. https://doi.org/10.1111/j.1464-5491.2007.02028.x.

    Article  CAS  PubMed  Google Scholar 

  45. Stoop CH, Nefs G, Pop VJ, Wijnands-van Gent CJ, Tack CJ, Geelhoed-Duijvestijn PH, et al. Diabetes-specific emotional distress in people with type 2 diabetes: a comparison between primary and secondary care. Diabet Med. 2014;31(10):1252–9. https://doi.org/10.1111/dme.12472.

    Article  CAS  PubMed  Google Scholar 

  46. Kuniss N, Rechtacek T, Kloos C, Müller UA, Roth J, Burghardt K, et al. Diabetes-related burden and distress in people with diabetes mellitus at primary care level in Germany. Acta Diabetol. 2017;54(5):471–8. https://doi.org/10.1007/s00592-017-0972-3.

    Article  CAS  PubMed  Google Scholar 

  47. Kalra S, Bajaj S, Sharma SK, Priya G, Baruah MP, Sanyal D, et al. A Practitioner's toolkit for insulin motivation in adults with type 1 and type 2 diabetes mellitus: evidence-based recommendations from an international expert panel. Diabetes Ther. 2020;11(3):585–606. https://doi.org/10.1007/s13300-020-00764-7.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Fisher L, Skaff MM, Mullan JT, Arean P, Glasgow R, Masharani U. A longitudinal study of affective and anxiety disorders, depressive affect and diabetes distress in adults with type 2 diabetes. Diabet Med. 2008;25(9):1096–101. https://doi.org/10.1111/j.1464-5491.2008.02533.x.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  49. Fisher L, Mullan JT, Skaff MM, Glasgow RE, Arean P, Hessler D. Predicting diabetes distress in patients with type 2 diabetes: a longitudinal study. Diabet Med. 2009;26(6):622–7. https://doi.org/10.1111/j.1464-5491.2009.02730.x.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  50. Batais MA, Alfraiji AF, Alyahya AA, Aloofi OA, Almashouq MK, Alshehri KS, et al. Assessing the prevalence of diabetes distress and determining its psychosocial predictors among Saudi adults with type 2 diabetes: A cross-sectional study. Front Psychol. 2021;12:759454. https://doi.org/10.3389/fpsyg.2021.759454.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgments

We appreciate the primary care patients with T2DM who participated in this study.

Funding

Financial support was not obtained from any individual, institutions, agencies, drug industries or organizations.

Author information

Authors and Affiliations

Authors

Contributions

HASA commenced the idea of this study, participated in designing the study, wrote the manuscript draft, and approved the final version of manuscript. SFM participated in designing the study, collected the data, revised the manuscript, and approved the final version of manuscript. HASA and SFM contributed equally to this work and share first authorship. MM, and JS participated in designing the study, revised the manuscript, and approved the final version of manuscript. SFE participated in designing the study and analyzed the data, revised the manuscript, and approved the final version of manuscript. AS participated in designing the study, participated in writing introduction section, revised the manuscript, and approved the final version of manuscript. AMF designed this study, analyzed the data, revised the manuscript, supervised this research, and approved the final version of manuscript.

Corresponding author

Correspondence to Jaffer Shah.

Ethics declarations

Ethics approval and consent to participate

This study was part of a larger study, whose ethical approval was obtained from the Research Ethics Committee of Faculty of Medicine, Suez Canal University, Ismailia, Egypt (Ref No. 4277/2020). All participants provided informed consent prior to participating in the study. All methods were carried out in accordance with relevant guidelines and regulations. Written informed consent was obtained from all subjects and their legal guardian.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sayed Ahmed, H.A., Mohamed, S.F., Mostafa, M. et al. Psychometric evaluation of the Arabic version of the 5-item Problem Areas in Diabetes (AR-PAID-5) scale. BMC Prim. Care 23, 148 (2022). https://doi.org/10.1186/s12875-022-01758-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12875-022-01758-z

Keywords