Next Article in Journal
HPnet: Hybrid Parallel Network for Human Pose Estimation
Next Article in Special Issue
Habitual Physical Activity of People with or at Risk of Diabetes-Related Foot Complications
Previous Article in Journal
Fault Root Cause Tracking of the Mechanical Components of CNC Lathes Based on Information Transmission
Previous Article in Special Issue
A Wearable Insole System to Measure Plantar Pressure and Shear for People with Diabetes
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Sensors
Volume 23
Issue 9
10.3390/s23094423
sensors-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Validity and Reliability of Self-Reported Adherence to Using Offloading Treatment in People with Diabetes-Related Foot Ulcers

by
Anas Ababneh
1,2,*,
Kathleen Finlayson
2,3,
Helen Edwards
2,3,
David G. Armstrong
4,
Bijan Najafi
5,
Jaap J. van Netten
6,7,8 and
Peter A. Lazzarini
3,8,9
1
Faculty of Nursing, Applied Science Private University, Amman 11931, Jordan
2
School of Nursing, Queensland University of Technology, Brisbane, QLD 4059, Australia
3
Centre for Healthcare Transformation, Queensland University of Technology, Brisbane, QLD 4059, Australia
4
Keck School of Medicine, University of Southern California, Los Angeles, CA 90089, USA
5
Interdisciplinary Consortium on Advanced Motion Performance (iCAMP), Michael E. DeBakey Department of Surgery, Baylor College of Medicine, Houston, TX 77030, USA
6
Department of Rehabilitation Medicine, 1105 AZ Amsterdam UMC, University of Amsterdam, Meibergdreef 9, 1012 WX Amsterdam, The Netherlands
7
Amsterdam Movement Sciences, Ageing & Vitality and Rehabilitation and Development, 1105 AZ Amsterdam, The Netherlands
8
School of Public Health and Social Work, Queensland University of Technology, Brisbane, QLD 4059, Australia
9
Allied Health Research Collaborative, The Prince Charles Hospital, Brisbane, QLD 4032, Australia
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(9), 4423; https://doi.org/10.3390/s23094423
Submission received: 13 February 2023 / Revised: 6 April 2023 / Accepted: 27 April 2023 / Published: 30 April 2023
(This article belongs to the Special Issue Saving Limbs and Lives-Sensing and Monitoring Technologies for the Diabetic Foot)
Browse Figures
Review Reports Versions Notes

Abstract

:
Adherence to using offloading treatment is crucial to healing diabetes-related foot ulcers (DFUs). Offloading adherence is recommended to be measured using objective monitors. However, self-reported adherence is commonly used and has unknown validity and reliability. This study aimed to assess the validity and reliability of self-reported adherence to using removable cast walker (RCW) offloading treatment among people with DFUs. Fifty-three participants with DFUs using RCWs were included. Each participant self-reported their percentage adherence to using their RCW of total daily steps. Participants also had adherence objectively measured using dual activity monitors. After one week, a subset of 19 participants again self-reported their percentage adherence to investigate test–retest reliability. Validity was tested using Pearson’s r and Bland–Altman tests, and reliability using Cohen’s kappa. Median (IQR) self-reported adherence was greater than objectively measured adherence (90% (60–100) vs. 35% (19–47), p < 0.01). There was fair agreement (r = 0.46; p < 0.01) and large 95% limits of agreement with significant proportional bias (β = 0.46, p < 0.01) for validity, and minimal agreement for test–retest reliability (K = 0.36; p < 0.01). The validity and reliability of self-reported offloading adherence in people with DFU are fair at best. People with DFU significantly overestimate their offloading adherence. Clinicians and researchers should instead use objective adherence measures.

1. Introduction

Diabetes-related foot ulcers (DFUs) affect around 20 million people globally [1,2] and are responsible for high incidences of hospitalisations, amputations, disability, treatment costs, and premature death [1,3,4,5,6]. DFUs are typically caused by high plantar pressure in people with a loss of foot sensation from diabetes-related peripheral neuropathy [2].
International DFU guidelines have long concluded that offloading high plantar pressure from DFUs is crucial to healing people with DFU [7]. Non-removable offloading devices are recommended as the gold standard offloading treatment for people with DFU [8,9]. However, implementing non-removable offloading devices in clinical practice has been found to be challenging due to the technical skills required to customise non-removable offloading treatments, such as total contact casts [10,11,12,13], and people’s preferences for not using offloading devices all the time, such as when not bearing weight [10,12]. The second-choice recommended offloading treatments are removable offloading devices, such as removable cast walkers, which are more commonly used in clinical practice and offer very similar plantar pressure reductions to non-removable offloading devices [14]. However, although removable offloading devices offer similar plantar pressure reductions, they have been found to be much less effective at healing DFU due to people’s low adherence to using these removable devices [8,15,16]. Thus, adherence to using removable offloading devices has been highlighted in the latest international DFU guidelines as an important topic for future research [7].
Guidelines recommend using objective measures to assess adherence to offloading treatment in patients with DFU [7,17]. Examples of such measures include wearable activity monitors to measure the proportion of adherence to total weight-bearing activity [17,18], or temperature monitors to measure the proportion of adherence of total treatment time [19]. However, there are barriers to using these objective monitors, such as costs of monitors [20], privacy concerns [20,21], technical skills required to use [15,22], and limited battery power to use over long periods [23]. On the other hand, people’s self-reported adherence is more commonly used in clinical practice and research, as it has been shown to be quick, affordable, and easy to implement [24]. However, self-reported adherence measures have been shown to be unreliable compared to objectively measured adherence in other similar treatments, such as brace treatments for clubfoot or scoliosis [25,26,27].
To our knowledge, people’s self-reported adherence to offloading treatment among people with DFU has not been tested for validity or reliability. The assessment of validity and reliability of self-reported scales of offloading adherence should guide researchers to know whether they can rely on using self-reporting measures and potentially overcome the aforementioned challenges associated with objective measures of adherence. Furthermore, clinicians should be informed if they can use their patients’ self-reports of adherence as a valid source of assessing adherence to prescribed offloading treatments in clinical practice. Thus, this study aimed to assess the validity and reliability of self-reported adherence to using removable cast walker (RCW) offloading among people with DFUs.

2. Materials and Methods

2.1. Study Design and Settings

This was a secondary analysis of a larger multi-centre study with a cross-sectional design that aimed to examine adherence to wearing removable cast walkers (RCWs) [16]. Data were collected from three main referral diabetes-related foot clinics in Amman, Jordan, including (i) the National Centre for Diabetes, Endocrinology, and Genetics; (ii) Jordanian Royal Medical Services; and (iii) the Prince Hamza Hospital.

2.2. Participants

Eligible participants were adults (>18 years) with diabetes (type 1 or 2) and a plantar DFU, and had been using an RCW for at least four weeks prior to recruitment. A plantar DFU was defined as a full-thickness wound on the plantar surface of the foot in a person with diabetes [16,28]. Removable cast walkers were defined as prefabricated knee-high offloading devices that could be removed by the patient [7,16]. Participants were required to have used RCW for at least four weeks prior, to reduce any effect of initially elevated RCW adherence after receiving offloading treatment as previously identified [29]. Participants who were managed by non-removable offloading devices, unable to ambulate without a walking aid, or had cognitive impairment or illiteracy were excluded [16]. We used data from 53 eligible participants from a larger study who both self-reported adherence and had their adherence objectively measured to test validity [16,30]. The sample size calculation of the larger study was based on five factors, including a final multiple linear regression model with a minimum of 10 participants needed for each included factor and accounting for a 5–10% drop out rate (16). The original sample was considered large enough for this validity study, and a subset of 20 participants were asked to self-report adherence again at a second visit to test reliability based on sample size needed for appropriate interval estimation for Cohen’s kappa [31].

2.3. Variables Collected

The definitions for all variables collected have been previously detailed elsewhere [16]. Sociodemographic variables included age, gender, living arrangement, highest education level achieved, employment, and family income (in Jordanian Dinar (JOD)) [16,30]. Medical variables [16,30] included diabetes type, diabetes duration, body mass index (BMI), previous DFU history, current DFU duration, duration of offloading device use [32], peripheral neuropathy [28], peripheral artery disease (PAD) [28], foot deformities, amputations [28,33], DFU area [32], DFU infection, and DFU grade [34].

2.4. Outcome Measures

2.4.1. Self-Reported Adherence

Self-reported adherence to using RCW was measured by asking participants to estimate their adherence to using their RCW during total weight-bearing steps on a typical average day, by completing a 10-point visual analogue scale (VAS) converted to a percentage of adherence (0–100%) [30,35,36]. This self-reported adherence measure had been developed, tested for face validity, and translated into the Arabic language as previously detailed elsewhere [30] (see Supplementary Material File S1 for Arabic and English versions of the self-reported adherence measure).

2.4.2. Objective Adherence (Criterion Measure)

Objectively measured adherence to using RCW was measured using a validated dual-activity monitor method over one week [15]. Fitbit Flex© activity monitors were used, which have been shown to be valid and reliable among elderly populations to measure steps [37,38,39,40]. One Fitbit monitor was attached to the RCW to measure the steps when the RCW was used, and the other monitor was worn on the wrist by the study participants to measure their total steps [16]. Participants were instructed to wear wrist monitors at all times for the seven-day period, of which they were reminded daily via text or audio messaging [16]. Participants were concealed from the aim of the measurement to avoid biasing their natural adherence behaviour [17], and otherwise, they received usual adherence instructions from their treating clinicians [16]. After 1 week, monitors were returned, and the steps data were synchronised into 15 min activity units. Adherence to an activity unit was deemed when the activity monitor attached to the RCW recorded at least 50% of the steps recorded by the wrist monitor in the 15 min activity unit [15,16,17,41]. Objective adherence was then reported as the percentage of adherent activity units in the total activity units [15,16,41].

2.5. Procedure

At the initial study visit (baseline), all demographic and medical variables were collected, along with participants’ self-reported adherence. The activity monitors were then installed on participants to objectively measure adherence for the one-week period. The activity monitors were returned after one week at a second study visit during regular wound care follow up. At this second visit, the subset of 20 participants was selected by asking every 3rd participant to again self-report their adherence by completing the same aforementioned scale [16,30].

2.6. Statistical Analysis

Data analysis was conducted using SPSS 23.0 for Windows (IBM Corp, Armonk, NY, USA). Descriptive analysis included frequencies (proportions), mean (standard deviation (SD)), and median (interquartile range (IQR)). Wilcoxon signed ranks test was used to test the difference between nonparametric adherence outcomes. Pearson’s correlation (r) was used to test the strength of agreement for validity between self-reported adherence and objectively measured adherence outcomes, in which r > 0.75 was considered excellent; r = 0.50–0.75 was good; r = 0.25–0.49 was fair; and r < 0.25 was no agreement [42]. Bland–Altman plots were also used for validity to estimate if the differences between both measurements of adherence led to large mean and 95% limits of agreement and if there was any estimation bias during reporting different levels of adherence. Linear regression was further used to test the significance of the potential proportional bias between the mean difference between self-reported adherence and objective adherence and the mean of these two measurements [43]. Cohen’s kappa was used to reflect the self-reported test–retest reliability agreement in the subset. The Kappa values were considered no agreement in the range 0–0.20; minimal agreement 0.21–0.39; weak agreement 0.40–0.59; moderate agreement 0.60–0.79; strong agreement 0.80–0.90; and almost perfect agreement >0.90 [44].

3. Results

3.1. Characteristics

Table 1 displays the sociodemographic and medical characteristics of the 53 participants, including a mean (SD) age of 55 (10) years, 77% were male, 94% had type 2 diabetes, 91% had peripheral neuropathy, 26% had PAD, 30% had minor amputation(s), 51% had infected DFU, and 42% had deep DFU, and there was a median (IQR) duration of prior RCW use of 12 (4–32) weeks. Of the 20 participants selected in the subset and asked to test–retest self-reported adherence, 19 completed the self-reported adherence scale at the second visit (retest) and one missed completing the scale.

3.2. Adherence

Participants’ median (IQR) self-reported adherence at a baseline of 90% (60–100) was significantly higher than the objectively measured adherence of 35% (19–48) (z = 6.19, p < 001). There was no statistical difference between the median (IQR) self-reported adherence reported at the baseline visit (90% (60–100)) and the second visit in the subset of n = 19 participants (80% (70–100)) (z = −0.26, p = 0.80).

3.3. Validity

The self-reported adherence demonstrated only fair agreement with objectively measured adherence (r = 0.46; p < 0.05). Figure 1 displays a lower right skewing of self-reported adherence data when plotted against the objective adherence data, indicating an overestimation of self-reported adherence. Figure 2 displays a mean difference (95% limits of agreement) of 43.0% (3.6–89.6) between the self-reported and the objective adherence in the Bland–Altman plots, indicating large differences between self-reported and objective adherence. The linear regression model also identified a significant proportional bias for self-reported adherence (β = 0.46, p < 0.01), indicating a significant and systematic overestimation of the self-reported adherence to using RCW.

3.4. Reliability

The self-reported test–retest adherence measured at the first baseline visit and second visit in the subset of participants also demonstrated only minimal agreement (Kappa (SE) = 0.36 (0.12); p < 0.01).

4. Discussion

We tested the validity and reliability of self-reported adherence to using removable offloading treatment (RCW) among people with DFUs. We found a median self-reported adherence of 90% of daily steps, which was a significant overestimation in comparison to the 35% objectively measured adherence using dual-activity monitors. For validity, we found only fair agreement between self-reported adherence and objective measures and noticed a systematic bias towards higher self-reporting of adherence. The bias increased when reporting higher levels of adherence. This indicates that patients with DFUs are not able to accurately assess their offloading adherence. For test–retest reliability, we found minimal agreement between two self-reported adherence measures one week apart, indicating limited stability when patients self-report adherence. These findings suggest that current methods of self-reporting of offloading adherence by patients with DFUs have limited validity and reliability.
Our findings of a significant overestimation of adherence aligns with previous adherence studies in other conditions that compared self-reported and objective measurements, such as in clubfoot, cystic fibrosis, idiopathic scoliosis, and chronic knee pain [25,26,27,45,46]. Studies suggest that patients may overestimate their adherence to avoid conflicts with their clinicians [47], to be socially desirable (i.e., people like to be seen as ”good people”) [48], due to memory bias [24], or due to a distorted perception of adherence itself [49]. In the context of adherence to offloading treatment in people with DFU, a recent qualitative investigation by our group found that patients may overestimate their adherence due to a distorted perception of offloading adherence [30]. Patients considered that adherence to using offloading treatment was only required for weight-bearing activity outside the house or during the daytime, whereas they perceived using their offloading devices inside the house or during night-time when weight-bearing as not being part of adherence requirements [30]. Moreover, a recent qualitative meta-analysis demonstrated that patients with DFUs might not have adequate understandings regarding causation, timelines, and related consequences of DFUs, and this may also lead to a distorted perception of adherence, which may result in inaccurate estimation [50]. We recommend clinicians clarify with patients that total adherence means using their offloading treatment during any weight-bearing activity, outside or inside the house, especially as studies have shown that most weight-bearing activity in this population is performed inside the house [51]. However, while this hypothesis is plausible, further studies are needed to confirm if patients do have a distorted perception of adherence to using offloading or if other factors may be impacting their significant overestimation of adherence to offloading treatment.
Overall, estimating self-reported adherence to using the offloading device may be a challenging task for patients with DFU. The significant overestimation by patients found in this study is likely to mislead patients and clinicians as to the effectiveness of removable offloading treatments to heal DFUs. Therefore, when measuring adherence, we recommend clinicians and researchers do not use the current self-reported measures, and instead use recommended objective measures of offloading adherence [17,23], such as dual-activity monitors to measure adherence during weight-bearing activity [20] or the in-device temperature monitors to measure adherence during treatment time [19]. Furthermore, the recent incorporation of objective self-monitoring adherence technology within offloading devices (“smart offloading boots”) seems a promising option to provide patients and clinicians with objective real-time monitoring of adherence in the future [18]. This may result in adherence enforcement to using offloading treatment, which may positively contribute to enhanced adherence and in turn improved healing rates similar to those found in non-removable offloading devices. Such self-monitoring technology may also help researchers to examine other factors associated with adherence to offloading treatment among patients with DFUs. Otherwise, developing demonstrated valid and reliable self-reported measures of adherence to offloading treatment in the future would still be a valuable addition to the field, as self-reported measures have been found quick, affordable, and easy to implement.

Strengths and Limitations

The strengths of this study included comparing a self-reported method of reporting adherence typically used in clinical practice and research against a recommended validated objective dual activity monitor method in an appropriate sample to test validity and reliability. In addition, we used a minimum of four weeks’ prior experience of using RCW as an inclusion criterion to be more representative of the typical adherence behaviour patterns of patients with DFU [29]. However, the limitations of this study also need to be considered. First, there was a slight difference in the units of measurement used for the self-reported and objective adherence measures. The self-reported measure used the percentage of daily steps, while the objective measure used the percentage of daily activity units as recommended for objective adherence measures [15,17]. However, we consider that these slight differences in units should not have had any major impact on findings, as activity units are also made up of the percentage of steps using the offloading device per 15 min period, and as such, are a similar measure to the percentage of daily steps. Furthermore, it would be challenging for patients to understand and self-report adherence for daily activity units. Second, participants were asked to self-report their adherence for an average typical day, whereas the objective measure captured percentage adherence for a set one-week period. However, we included participants with at least four weeks of prior use of RCW treatment [29], and we chose the one-week period because four weekdays and one weekend day have been shown to be representative of average daily activity in physical activity studies [16,17,52,53,54], and thus we should have a representative sample of the true daily activity of a DFU population. Third, the sample size was based on the sample size calculations of our main study that used regression and not specifically for this analysis of validity and reliability [16]. Sample size calculations and potentially larger sample sizes are recommended for similar studies in the future. Last, there was a possibility of not wearing the wrist activity monitors; however, we attempted to minimise non-adherence of wearing wrist trackers via daily reminders to participants [16,30].

5. Conclusions

This study suggests that people with DFUs substantially overestimate their adherence to using offloading treatment compared to objective measures. In addition, we found only fair agreement at best to support the validity and reliability of self-reported adherence and significant proportional bias. Thus, it seems that self-reported adherence is not an accurate or reliable measure of actual adherence. We recommend that clinicians and researchers adopt objective measures to avoid misleading measurements of removable offloading adherence until improved self-reported measures are developed and tested in the future.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/s23094423/s1, Supplementary File S1 contains the Arabic and English versions of the self-reported adherence measure.

Author Contributions

Conceptualization, A.A., K.F., H.E., D.G.A., B.N., J.J.v.N. and P.A.L.; Methodology, A.A., K.F., H.E., D.G.A., B.N., J.J.v.N. and P.A.L.; Validation, A.A., K.F., H.E., D.G.A., B.N., J.J.v.N. and P.A.L.; Formal Analysis, A.A., K.F., J.J.v.N. and P.A.L.; Investigation, A.A., K.F., H.E. and P.A.L.; Resources A.A., K.F., H.E. and P.A.L.; Data Curation, A.A., K.F., H.E. and P.A.L.; Writing—Original Draft Preparation, A.A. and P.A.L.; Writing—Review and Editing, A.A., K.F., H.E., D.G.A., B.N., J.J.v.N. and P.A.L.; Visualization, A.A., K.F., H.E., D.G.A., B.N., J.J.v.N. and P.A.L.; Supervision, K.F., H.E., D.G.A., B.N., J.J.v.N. and P.A.L.; Project Administration, A.A. and P.A.L. All authors have read and agreed to the published version of the manuscript.

Funding

Financial support of a student allocation from QUT Health Research Services.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Office of Research Ethics and Integrity at the Queensland University of Technology, Australia (Approval No.1900000418), and each of the Institutional Review Board Committees at the National Centre for Diabetes, Endocrinology (No. 3266-9), Jordanian Royal Medical Services (No. T/F3/1-12689) and Prince Hamza Hospital (No. MH/32/2527).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data available on request due to privacy restrictions. The data presented in this study are available on request from the corresponding author.

Acknowledgments

A.A. acknowledges the Australian government research training program stipend (International) and QUT tuition fee sponsorship as this study has been undertaken in partial fulfilment of a Doctor of Philosophy. P.A.L. acknowledges support by an Australian National Health and Medical Research Council Early Career Fellowship (#1143435). D.G.A. acknowledges partial support by a United States National Institutes of Health, National Institute of Diabetes and Digestive and Kidney Diseases Award (#1R01124789-01A1).

Conflicts of Interest

A.A. had worked as a clinician at the NCDEG and this may be regarded as a potential conflict of interest. Otherwise, the authors declare no other relevant conflicts of interest.

References

  1. Zhang, Y.; Lazzarini, P.A.; McPhail, S.M.; van Netten, J.J.; Armstrong, D.G.; Pacella, R.E. Global disability burdens of diabetes-related lower-extremity complications in 1990 and 2016. Diabetes Care 2020, 43, 964–974. [Google Scholar] [CrossRef] [PubMed]
  2. Armstrong, D.G.; Boulton, A.J.; Bus, S.A. Diabetic foot ulcers and their recurrence. N. Engl. J. Med. 2017, 376, 2367–2375. [Google Scholar] [CrossRef] [PubMed]
  3. Quigley, M.; Morton, J.I.; Lazzarini, P.A.; Zoungas, S.; Shaw, J.E.; Magliano, D.J. Trends in diabetes-related foot disease hospitalizations and amputations in Australia, 2010 to 2019. Diabetes Res. Clin. Pract. 2022, 194, 110189. [Google Scholar] [CrossRef] [PubMed]
  4. Armstrong, D.G.; Swerdlow, M.A.; Armstrong, A.A.; Conte, M.S.; Padula, W.V.; Bus, S.A. Five year mortality and direct costs of care for people with diabetic foot complications are comparable to cancer. J. Foot Ankle Res. 2020, 13, 16. [Google Scholar] [CrossRef] [PubMed]
  5. Lazzarini, P.A.; Cramb, S.M.; Golledge, J.; Morton, J.I.; Magliano, D.J.; Van Netten, J.J. Global trends in the incidence of hospital admissions for diabetes-related foot disease and amputations: A review of national rates in the 21st century. Diabetologia 2022, 66, 267–287. [Google Scholar] [CrossRef] [PubMed]
  6. Zhang, Y.; Carter, H.E.; Lazzarini, P.A.; Cramb, S.; Pacella, R.; van Netten, J.J.; Cheng, Q.; Derhy, P.H.; Kinnear, E.M.; McPhail, S.M. Cost-effectiveness of guideline-based care provision for patients with diabetes-related foot ulcers: A modelled analysis using discrete event simulation. Diabet. Med. 2023, 40, e14961. [Google Scholar] [CrossRef]
  7. Bus, S.A.; Armstrong, D.G.; Gooday, C.; Jarl, G.; Caravaggi, C.; Viswanathan, V.; Lazzarini, P.A. Guidelines on offloading foot ulcers in persons with diabetes (IWGDF 2019 update). Diabetes/Metab. Res. Rev. 2020, 36 (Suppl. 1), e3274. [Google Scholar] [CrossRef]
  8. Lazzarini Jarl, G.; Gooday, C.; Viswanathan, V.; Caravaggi, C.F.; Armstrong, D.G.; Bus, S.A. Effectiveness of offloading interventions to heal foot ulcers in persons with diabetes: A systematic review. Diabetes/Metab. Res. Rev. 2020, 36 (Suppl. 1), e3275. [Google Scholar] [CrossRef]
  9. Boulton, A.; Armstrong, D.; Krisner, R.; Attinger, C.; Lavery, L.; Lipsky, B.; Mills, J.; Steinberg, J. Diagnosis and Management of Diabetic Foot Complications. ADA Clin. Compend. 2018, 2018, 1–20. [Google Scholar] [CrossRef]
  10. Fife, C.E.; Carter, M.J.; Walker, D.; Thomson, B.; Eckert, K.A. Diabetic foot ulcer off-loading: The gap between evidence and practice. Data from the US Wound Registry. Adv. Skin Wound Care 2014, 27, 310–316. [Google Scholar] [CrossRef]
  11. Wu, S.C.; Jensen, J.L.; Weber, A.K.; Robinson, D.E.; Armstrong, D.G. Use of pressure offloading devices in diabetic foot ulcers: Do we practice what we preach? Diabetes Care 2008, 31, 2118–2119. [Google Scholar] [CrossRef] [PubMed]
  12. Raspovic, A.; Landorf, K.B. A survey of offloading practices for diabetes-related plantar neuropathic foot ulcers. J. Foot Ankle Res. 2014, 7, 35. [Google Scholar] [CrossRef] [PubMed]
  13. Quinton, T.R.; Lazzarini, P.A.; Boyle, F.M.; Russell, A.W.; Armstrong, D.G. How do Australian podiatrists manage patients with diabetes? The Australian diabetic foot management survey. J. Foot Ankle Res. 2015, 8, 16. [Google Scholar] [CrossRef] [PubMed]
  14. Bus, S.A.; Van Netten, J.J.; Kottink, A.I.; Manning, E.A.; Spraul, M.; Woittiez, A.-J.; Van Baal, J.G. The efficacy of removable devices to offload and heal neuropathic plantar forefoot ulcers in people with diabetes: A single-blinded multicentre randomised controlled trial. Int. Wound J. 2017, 15, 65–74. [Google Scholar] [CrossRef] [PubMed]
  15. Crews Shen, B.-J.; Campbell, L.; Lamont, P.J.; Boulton, A.J.; Peyrot, M.; Kirsner, R.S.; Vileikyte, L. Role and determinants of adherence to off-loading in diabetic foot ulcer healing: A prospective investigation. Diabetes Care 2016, 39, 1371–1377. [Google Scholar] [CrossRef]
  16. Ababneh, A.; Finlayson, K.; Edwards, H.; Lazzarini, P.A. Factors associated with adherence to using removable cast walker treatment among patients with diabetes-related foot ulcers. BMJ Open Diabetes Res. Care 2022, 10, e002640. [Google Scholar] [CrossRef]
  17. Lazzarini, P.A.; Crews, R.T.; van Netten, J.J.; Bus, S.A.; Fernando, M.E.; Chadwick, P.J.; Najafi, B. Measuring Plantar Tissue Stress in People With Diabetic Peripheral Neuropathy: A Critical Concept in Diabetic Foot Management. J. Diabetes Sci. Technol. 2019, 13, 869–880. [Google Scholar] [CrossRef]
  18. Park, C.; Mishra, R.; Vigano, D.; Macagno, M.; Rossotti, S.; D’huyvetter, K.; Garcia, J.; Armstrong, D.G.; Najafi, B. Smart Offloading Boot System for Remote Patient Monitoring: Toward Adherence Reinforcement and Proper Physical Activity Prescription for Diabetic Foot Ulcer Patients. J. Diabetes Sci. Technol. 2022, 17, 42–51. [Google Scholar] [CrossRef]
  19. Bus, S.A.; Waaijman, R.; Nollet, F. New Monitoring Technology to Objectively Assess Adherence to Prescribed Footwear and Assistive Devices During Ambulatory Activity. Arch. Phys. Med. Rehabil. 2012, 93, 2075–2079. [Google Scholar] [CrossRef]
  20. Crews, R.T.; Armstrong, D.G.; Boulton, A.J. A method for assessing off-loading compliance. J. Am. Podiatr. Med. Assoc. 2009, 99, 100–103. [Google Scholar] [CrossRef]
  21. Crews, R.T.; Bowling, F.L.; Boulton, A.J. Controversies in off-loading: Should big brother be watching? Curr. Diabetes Rep. 2009, 9, 417–419. [Google Scholar] [CrossRef] [PubMed]
  22. Jarl, G.; Alnemo, J.; Tranberg, R.; Lundqvist, L.-O. Gender differences in attitudes and attributes of people using therapeutic shoes for diabetic foot complications. J. Foot Ankle Res. 2019, 12, 21. [Google Scholar] [CrossRef] [PubMed]
  23. Jarl, G. Methodological considerations of investigating adherence to using offloading devices among people with diabetes. Patient Prefer. Adherence 2018, 12, 1767–1775. [Google Scholar] [CrossRef] [PubMed]
  24. Stirratt, M.J.; Dunbar-Jacob, J.; Crane, H.M.; Simoni, J.M.; Czajkowski, S.; Hilliard, M.E.; Aikens, J.E.; Hunter, C.M.; Velligan, D.I.; Huntley, K.; et al. Self-report measures of medication adherence behavior: Recommendations on optimal use. Transl. Behav. Med. 2015, 5, 470–482. [Google Scholar] [CrossRef] [PubMed]
  25. Sangiorgio, S.N.; Ho, N.C.; Morgan, R.D.; Ebramzadeh, E.; Zionts, L.E. The objective measurement of brace-use adherence in the treatment of idiopathic clubfoot. JBJS 2016, 98, 1598–1605. [Google Scholar] [CrossRef]
  26. Morton, A.; Riddle, R.; Buchanan, R.; Katz, D.; Birch, J. Accuracy in the prediction and estimation of adherence to bracewear before and during treatment of adolescent idiopathic scoliosis. J. Pediatr. Orthop. 2008, 28, 336–341. [Google Scholar] [CrossRef]
  27. Nicolson, P.J.; Hinman, R.S.; Wrigley, T.V.; Stratford, P.W.; Bennell, K.L. Self-reported home exercise adherence: A validity and reliability study using concealed accelerometers. J. Orthop. Sport. Phys. Ther. 2018, 48, 943–950. [Google Scholar] [CrossRef]
  28. Van Netten, J.J.; Bus, S.A.; Apelqvist, J.; Lipsky, B.A.; Hinchliffe, R.J.; Game, F.; Rayman, G.; Lazzarini, P.A.; Forsythe, R.O.; Peters, E.J.G.; et al. Definitions and criteria for diabetic foot disease. Diabetes/Metab. Res. Rev. 2019, 36 (Suppl. 1), e3268. [Google Scholar] [CrossRef]
  29. Najafi, B.; Grewal, G.S.; Bharara, M.; Menzies, R.; Talal, T.K.; Armstrong, D.G. Can’t stand the pressure: The association between unprotected standing, walking, and wound healing in people with diabetes. J. Diabetes Sci. Technol. 2016, 11, 657–667. [Google Scholar] [CrossRef]
  30. Ababneh, A.N. Adherence to Wearing Removable Cast Walkers in Patients with Diabetes-Related Foot Ulcers: A Mixed Methods Investigation; Queensland University of Technology: Brisbane City, Australia, 2021. [Google Scholar]
  31. Blackman, N.J.M.; Koval, J.J. Interval estimation for Cohen’s kappa as a measure of agreement. Stat. Med. 2000, 19, 723–741. [Google Scholar] [CrossRef]
  32. Jeffcoate, W.J.; Bus, S.A.; Game, F.L.; Hinchliffe, R.J.; Price, P.E.; Schaper, N.C. Reporting standards of studies and papers on the prevention and management of foot ulcers in diabetes: Required details and markers of good quality. Lancet Diabetes Endocrinol. 2016, 4, 781–788. [Google Scholar] [CrossRef] [PubMed]
  33. Ababneh, A.; Bakri, F.G.; Khader, Y.; Lazzarini, P.; Ajlouni, K. Prevalence and Associates of Foot Deformities among Patients with Diabetes in Jordan. Curr. Diabetes Rev. 2020, 16, 471–482. [Google Scholar] [CrossRef] [PubMed]
  34. Armstrong, D.G.; Lavery, L.A.; Harkless, L.B. Validation of a diabetic wound classification system: The contribution of depth, infection, and ischemia to risk of amputation. Diabetes Care 1998, 21, 855–859. [Google Scholar] [CrossRef]
  35. Wewers, M.E.; Lowe, N.K. A critical review of visual analogue scales in the measurement of clinical phenomena. Res. Nurs. Health 1990, 13, 227–236. [Google Scholar] [CrossRef]
  36. Erb, S.; Letang, E.; Glass, T.; Natamatungiro, A.; Mnzava, D.; Mapesi, H.; Haschke, M.; Duthaler, U.; Berger, B.; Muri, L.; et al. A Simple Visual Analog Scale is a Valuable Tool to Assess Self-Reported Adherence in HIV-Infected Patients on Antiretroviral Treatment in a Resource-Limited Setting. J. AIDS Clin. Res. 2017, 8, 731. [Google Scholar] [CrossRef]
  37. Smith, J.D.; Guerra, G.; Burkholder, B.G. The validity and accuracy of wrist-worn activity monitors in lower-limb prosthesis users. Disabil. Rehabil. 2019, 42, 3182–3188. [Google Scholar] [CrossRef] [PubMed]
  38. Burton, E.; Hill, K.D.; Lautenschlager, N.T.; Thogersen-Ntoumani, C.; Lewin, G.; Boyle, E.; Howie, E. Reliability and validity of two fitness tracker devices in the laboratory and home environment for older community-dwelling people. BMC Geriatr. 2018, 18, 103. [Google Scholar] [CrossRef]
  39. Kooiman, T.J.; Dontje, M.L.; Sprenger, S.R.; Krijnen, W.P.; van der Schans, C.P.; de Groot, M. Reliability and validity of ten consumer activity trackers. BMC Sport. Sci. Med. Rehabil. 2015, 7, 24. [Google Scholar] [CrossRef]
  40. Diaz, K.M.; Krupka, D.J.; Chang, M.J.; Peacock, J.; Ma, Y.; Goldsmith, J.; Schwartz, J.E.; Davidson, K.W. Fitbit(R): An accurate and reliable device for wireless physical activity tracking. Int. J. Cardiol. 2015, 185, 138–140. [Google Scholar] [CrossRef]
  41. Armstrong, D.G.; Lavery, L.A.; Kimbriel, H.R.; Nixon, B.P.; Boulton, A.J. Activity patterns of patients with diabetic foot ulceration: Patients with active ulceration may not adhere to a standard pressure off-loading regimen. Diabetes Care 2003, 26, 2595–2597. [Google Scholar] [CrossRef]
  42. Portney, L.G.; Watkins, M.P. Foundations of Clinical Research: Applications to Practice; Pearson/Prentice Hall: Upper Saddle River, NJ, USA, 2009. [Google Scholar]
  43. Bland, J.M.; Altman, D.G. Measuring agreement in method comparison studies. Stat. Methods Med. Res. 1999, 8, 135–160. [Google Scholar] [CrossRef] [PubMed]
  44. McHugh, M.L. Interrater reliability: The kappa statistic. Biochem. Med. 2012, 22, 276–282. [Google Scholar] [CrossRef]
  45. Oates, G.R.; Stepanikova, I.; Rowe, S.M.; Gamble, S.; Gutierrez, H.H.; Harris, W.T. Objective versus self-reported adherence to airway clearance therapy in cystic fibrosis. Respir. Care 2019, 64, 176–181. [Google Scholar] [CrossRef] [PubMed]
  46. Daniels, T.; Goodacre, L.; Sutton, C.; Pollard, K.; Conway, S.; Peckham, D. Accurate assessment of adherence: Self-report and clinician report vs electronic monitoring of nebulizers. Chest 2011, 140, 425–432. [Google Scholar] [CrossRef] [PubMed]
  47. Vik, S.A.; Maxwell, C.J.; Hogan, D.B. Measurement, correlates, and health outcomes of medication adherence among seniors. Ann. Pharmacother. 2004, 38, 303–312. [Google Scholar] [CrossRef] [PubMed]
  48. Wagner, G.; Miller, L.G. Is the influence of social desirability on patients’ self-reported adherence overrated? JAIDS J. Acquir. Immune Defic. Syndr. 2004, 35, 203–204. [Google Scholar] [CrossRef]
  49. Heo, S.; Kim, J.; Shim, J.L.; Barbe, T.; Black, V.; Lee, M.O. Experiences of and factors associated with dietary sodium adherence in heart failure from patients’ and their caregivers’ perspectives: A qualitative study. Geriatr. Nurs. 2021, 42, 1190–1197. [Google Scholar] [CrossRef]
  50. Coffey, L.; Mahon, C.; Gallagher, P. Perceptions and experiences of diabetic foot ulceration and foot care in people with diabetes: A qualitative meta-synthesis. Int. Wound J. 2019, 16, 183–210. [Google Scholar] [CrossRef]
  51. Armstrong, D.G.; Abu-Rumman, P.L.; Nixon, B.P.; Boulton, A.J. Continuous activity monitoring in persons at high risk for diabetes-related lower-extremity amputation. J. Am. Podiatr. Med. Assoc. 2001, 91, 451–455. [Google Scholar] [CrossRef]
  52. Mignault, D.; St-Onge, M.; Karelis, A.D.; Allison, D.B.; Rabasa-Lhoret, R. Evaluation of the Portable HealthWear Armband: A device to measure total daily energy expenditure in free-living type 2 diabetic individuals. Diabetes Care 2005, 28, 225–227. [Google Scholar] [CrossRef]
  53. Van Remoortel, H.; Raste, Y.; Louvaris, Z.; Giavedoni, S.; Burtin, C.; Langer, D.; Wilson, F.; Rabinovich, R.; Vogiatzis, I.; Hopkinson, N.S. Validity of six activity monitors in chronic obstructive pulmonary disease: A comparison with indirect calorimetry. PLoS ONE 2012, 7, e39198. [Google Scholar] [CrossRef] [PubMed]
  54. van Schooten, K.S.; Rispens, S.M.; Elders, P.J.; Lips, P.; van Dieën, J.H.; Pijnappels, M. Assessing physical activity in older adults: Required days of trunk accelerometer measurements for reliable estimation. J. Aging Phys. Act. 2015, 23, 9–17. [Google Scholar] [CrossRef] [PubMed]
Sensors 23 04423 g001 550
Figure 1. Scatter plots depicting self-reported adherence percentage compared to the objectively measured adherence percentage to using RCW.
Figure 1. Scatter plots depicting self-reported adherence percentage compared to the objectively measured adherence percentage to using RCW.
Sensors 23 04423 g001
Sensors 23 04423 g002 550
Figure 2. Bland–Altman plot depicting the agreement between the self-reported and objectively measured adherence to wearing RCW using activity monitors. The dashed black line represents the mean difference between self-reported and objective adherence, and the orange dashed lines represent the upper and lower limits of agreement.
Figure 2. Bland–Altman plot depicting the agreement between the self-reported and objectively measured adherence to wearing RCW using activity monitors. The dashed black line represents the mean difference between self-reported and objective adherence, and the orange dashed lines represent the upper and lower limits of agreement.
Sensors 23 04423 g002
Table
Table 1. Participant sociodemographic and medical characteristics (number (%) or mean ± SD unless otherwise stated^).
Table 1. Participant sociodemographic and medical characteristics (number (%) or mean ± SD unless otherwise stated^).
Characteristics Total
Numbers53
Age (years)55.3 (9.9)
Males 41 (77.4%)
Living with family 49 (92.5%)
Secondary school education24 (45.3%)
Retired17 (32.1%)
Family income (JD) ^400 (300–712.5)
Type 2 DM50 (94.3%)
Duration of diabetes (years)17.7 (7.0)
HbA1c (%, mmol/L)8.9 (2.1)
BMI31 (6.5)
Daily steps (wrist activity monitor) ^ 2758.4 (1729–4676)
Neuropathy 48 (90.6%)
PAD 14 (26.4%)
Foot deformities38 (71.7%)
Minor amputations 16 (30.2%)
Major amputations 0 (0%)
History of previous ulceration35 (67.3%)
Duration of ulcer (weeks) ^16 (5.0–38)
Ulcer size (cm2) ^1.5 (0.5–6.0)
Deep ulcer (UTWCS Grade 2 or 3)22 (41.5%)
Ulcer infection27 (50.9%)
Duration of RCW (weeks) ^12 (4.0–32.0)
^ Displayed as median (IQR). Abbreviations: BMI: body mass index, CM: centimetre, DM: diabetes mellitus, JD: Jordanian Dinar (JOD), PAD: peripheral artery disease, RCW: removable cast walker, SD: standard deviation, UTWCS: University of Texas Wound Classification System.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ababneh, A.; Finlayson, K.; Edwards, H.; Armstrong, D.G.; Najafi, B.; van Netten, J.J.; Lazzarini, P.A. The Validity and Reliability of Self-Reported Adherence to Using Offloading Treatment in People with Diabetes-Related Foot Ulcers. Sensors 2023, 23, 4423. https://doi.org/10.3390/s23094423

AMA Style

Ababneh A, Finlayson K, Edwards H, Armstrong DG, Najafi B, van Netten JJ, Lazzarini PA. The Validity and Reliability of Self-Reported Adherence to Using Offloading Treatment in People with Diabetes-Related Foot Ulcers. Sensors. 2023; 23(9):4423. https://doi.org/10.3390/s23094423

Chicago/Turabian Style

Ababneh, Anas, Kathleen Finlayson, Helen Edwards, David G. Armstrong, Bijan Najafi, Jaap J. van Netten, and Peter A. Lazzarini. 2023. "The Validity and Reliability of Self-Reported Adherence to Using Offloading Treatment in People with Diabetes-Related Foot Ulcers" Sensors 23, no. 9: 4423. https://doi.org/10.3390/s23094423

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop