Next Article in Journal
Continuous Glucose Monitoring in Transient Neonatal Diabetes Mellitus—2 Case Reports and Literature Review
Previous Article in Journal
The Role of Transabdominal Ultrasound Elastography in Gastrointestinal Non-Liver Diseases: Current Application and Future Prospectives
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Comparison of Predictive Properties between Tools of Patient-Reported Outcomes: Risk Prediction for Three Future Events in Subjects with COPD

1
Visiting Researcher, National Center for Geriatrics and Gerontology, 7-430 Morioka-cho, Obu 474-8511, Japan
2
Clinic Nishimura, 4-3 Kohigashi, Kuri-cho, Ayabe 623-0222, Japan
3
Department of Respiratory Medicine, National Center for Geriatrics and Gerontology, 7-430 Morioka-cho, Obu 474-8511, Japan
4
Department of Nursing, National Center for Geriatrics and Gerontology, 7-430 Morioka-cho, Obu 474-8511, Japan
5
Data Research Section, Kondo P.P. Inc., 17-25, Shimizudani-cho, Tennoujiku, Osaka 543-0011, Japan
*
Author to whom correspondence should be addressed.
Diagnostics 2023, 13(13), 2269; https://doi.org/10.3390/diagnostics13132269
Submission received: 23 May 2023 / Revised: 1 July 2023 / Accepted: 3 July 2023 / Published: 4 July 2023
(This article belongs to the Section Pathology and Molecular Diagnostics)

Abstract

:
Background: Patient-reported outcome (PRO) measures must be evaluated for their discriminatory, evaluative, and predictive properties. However, the predictive capability remains unclear. We aimed to examine the predictive properties of several PRO measures of all-cause mortality, acute exacerbation of chronic obstructive pulmonary disease (COPD), and associated hospitalization. Methods: A total of 122 outpatients with stable COPD were prospectively recruited and completed six self-administered paper questionnaires: the COPD Assessment Test (CAT), St. George’s Respiratory Questionnaire (SGRQ), Baseline Dyspnea Index (BDI), Dyspnoea-12, Evaluating Respiratory Symptoms in COPD and Hyland Scale at baseline. Cox proportional hazards analyses were conducted to examine the relationships with future outcomes. Results: A total of 66 patients experienced exacerbation, 41 were hospitalized, and 18 died. BDI, SGRQ Total and Activity, and CAT and Hyland Scale scores were significantly related to mortality (hazard ratio = 0.777, 1.027, 1.027, 1.077, and 0.951, respectively). The Hyland Scale score had the best predictive ability for PRO measures, but the C index did not reach the level of the most commonly used FEV1. Almost all clinical, physiological, and PRO measurements obtained at baseline were significant predictors of the first exacerbation and the first hospitalization due to it, with a few exceptions. Conclusions: Measurement of health status and the global scale of quality of life as well as some tools to assess breathlessness, were significant predictors of all-cause mortality, but their predictive capacity did not reach that of FEV1. In contrast, almost all baseline measurements were unexpectedly related to exacerbation and associated hospitalization.

1. Introduction

The importance of patient-reported outcome (PRO) measures when evaluating healthcare delivery and conducting scientific investigations has grown substantially [1,2,3,4]. Chronic obstructive pulmonary disease (COPD) is considered a model for the evaluation of PRO measures [5,6]. Guyatt and colleagues first developed the Chronic Respiratory Disease Questionnaire (CRQ) in 1987 to measure the disease-specific quality of life of individuals with COPD [7]. The updated Global Initiative for Chronic Obstructive Lung Disease (GOLD, 2011) proposed that symptoms be evaluated as health status measures using the COPD Assessment Test (CAT) [8,9,10], one of the PRO measuring tools recommended in clinical practice according to the international document [11]. PRO measures are thus considered essential when assessing a patient’s COPD.
Health indicators, including PROs, can be discussed from three perspectives. First, they can differentiate between lesser and more severely ill patients (discriminatory quality). Second, they can measure the amount of change (an evaluative feature). Third, they can forecast future outcomes (predictive property). In the twentieth century, forced expiratory volume in one second (FEV1) and age were believed to be the strongest mortality predictors in subjects with COPD [12]. Subsequently, several predictors of mortality have emerged in the literature, including dyspnea, health status, exercise capacity, and physical activity [13,14,15,16]. Oga and colleagues reported that the St. George’s Respiratory Questionnaire (SGRQ) Total score was able to predict mortality for a period of up to five years, but CRQ scores were not associated with seven-year mortality [15,17]. As COPD is a progressive disease, it is important to consider future outcome predictors such as FEV1 and PRO measures when assessing disease severity, as these can be used to predict mortality.
We hypothesized that individual PRO measures had been independently based on specific conceptual frameworks and are not interchangeable, although several PRO tools aimed at subjects with COPD have been reported in the literature [4,18]. For example, the SGRQ and CAT were developed to measure COPD-specific health status [8,9,10,19], Evaluating Respiratory Symptoms in COPD (E-RS) focuses on respiratory symptoms [20,21], and Dyspnoea-12 (D-12) is targeted at breathlessness [22,23,24,25]. They have generally been administered to subjects with COPD individually or in combination when multifaceted analysis and evaluation of outcome markers is required. It remains unclear whether the currently used PRO measures can predict future outcomes for patients with COPD and whether or not the predictive properties are different from the perspective of individual conceptual frameworks. The purpose of this study was to examine the predictive properties of several different PRO measures in subjects with COPD and to investigate which of these measures best predicts mortality, acute exacerbation of COPD (AECOPD), and hospitalization due to AECOPD.

2. Methods

2.1. Participants

A total of 122 stable COPD patients were recruited from our outpatient clinic at the Department of Respiratory Medicine of the National Center for Geriatrics and Gerontology between April 2013 and April 2019 and followed up to December 2019 for a maximum of six and a half years. The criteria for inclusion were over 50 years old, former or current smokers with a cumulative smoking history of more than 10 pack-years, and chronic fixed airflow limitation (described elsewhere as a part of the hospital-based cohort study) [26]. The exclusion criteria included an exacerbation of COPD in the preceding three months.

2.2. Measurements

All eligible subjects completed lung function tests and PRO measurements at baseline on the same day. Participants were instructed to arrive at the study site at least 12 h after stopping bronchodilator use. During the visit, they were monitored by a physician while they inhaled long-acting bronchodilators and, more than 60 min later, underwent spirometry with the CHESTAC-8800 spirometer (Chest, Tokyo, Japan). The test was performed in the sitting position, and the highest values of the three measurements were analyzed. Residual volume was calculated using the closed-circuit helium method, and diffusing capacity for carbon monoxide (DLCO) was determined using the single-breath technique [27].
The survival of all registered subjects was assessed until mid-December 2019. For those who did not attend an outpatient clinic, telephone or postal contacts with families or primary health practitioners were used to obtain information on mortality. Those whom we could not reach were regarded as having withdrawn. The period from entry to the last participation or event was recorded for analysis. AECOPD was defined as a worsening of respiratory symptoms requiring treatment with systemic corticosteroids or antibiotics, or both [28].

2.3. Patient-Reported Measurements

Disease-specific health status was assessed with the CAT and SGRQ [8,9,10,19]. The CAT scores range from 0 to 40, with a score of zero indicating no impairment [8,9,10]. The SGRQ consists of 50 items, divided into three components: Symptoms, Activity and Impact, and the Total score is calculated [19]. Higher scores on the SGRQ indicate a more severely impaired health status. To assess the severity of breathlessness, we used the Baseline Dyspnea Index (BDI) and the Dyspnoea-12 (D-12) [22,23,24,29]. The BDI is composed of three categories: functional impairment, magnitude of task and magnitude of effort, rated by five grades from 0 (severe) to 4 (not impaired) for each [29]. The D-12 consists of 12 elements (7 physical and 5 emotional), and the D-12 Total scores range from 0 to 36, with higher scores denoting more severe dyspnea [22,23,24]. The total score of the E-RS indicates the severity of respiratory symptoms in general, where scores range from 0 to 40, with higher scores indicating more severe symptoms [20,21]. Three subscales are used to assess breathlessness (RS-Breathlessness), cough and sputum (RS-Cough and Sputum), and chest-related symptoms (RS-Chest Symptoms) [20,21]. Although E-RS is intended to be administered using accredited electronic devices, none were available in the Japanese version. Global health was also assessed using the Hyland Scale with scores ranging from 0 to 100, where 0 = ‘might as well be dead’ and 100 = ‘perfect quality of life’ [30]. All the validated Japanese versions were self-administered using a paper-based questionnaire under site supervision in the aforementioned order (in booklet form).

2.4. Statistical Methods

All results are expressed as mean ± standard deviation (SD). A p-value of less than 0.05 was considered statistically significant. Differences between groups were determined by the Steel–Dwass and Kruskal–Wallis tests. Univariate Cox proportional hazards analyses were performed to investigate the relationships between measurements at baseline and subsequent events. Results of regression analyses are presented in terms of hazard ratio (HR) with the corresponding 95% confidence intervals (CI). They were first calculated by actual measured value and further analyzed in a standardized format using a score to show HR for changes per SD. The C-index of an event prediction model is the property of correctly discriminating between event and non-event-onset individuals and is often used when comparing different measures, e.g., when comparing different models. The closer the value of the C index is to 1.0, the better the risk prediction.

3. Results

3.1. Subject Characteristics and Scores Obtained at Baseline

During the study period, 122 consecutive patients (113 men) with mild to very severe COPD, with a wide range of FEV1 values, were investigated. The mean age and FEV1 were 74.5 ± 6.4 years and 1.72 ± 0.54 L (68.8 ± 20.3% pred), respectively. Ninety-four were former smokers, and 28 were current smokers. Patient characteristics and the results of the pulmonary function tests at baseline are shown in Table 1. According to the classification of GOLD airflow limitation [11], 41 subjects (33.6%) were included in GOLD 1 (defined as FEV1 ≥ 80% predicted), 60 (49.2%) in GOLD 2 (50% ≤ FEV1 < 80% predicted), 14 (11.5%) in GOLD 3 (30% ≤ FEV1 < 50% predicted) and 7 (5.7%) in GOLD 4 (FEV1 < 30% predicted) (Table 2). The elderly population was more strongly represented than expected, and there were only a small number of patients with severe or very severe COPD.
Table 2 shows the distribution of the PRO scores obtained at baseline. Almost all scores were shifted toward the milder end of each scale. The best possible score (“floor effect”) was observed except on the SGRQ Total Score and the Hyland Scale, although the best possible score is the ceiling for the BDI. Most of the scores obtained from the PRO measuring tools deteriorated due to the severity of airflow limitation, with the exception of the D-12 Affective Score and E-RS Cough and Sputum.

3.2. Episodes Identified during Follow-Up Periods

Of the 122 enrolled patients, 18 (14.8%) were confirmed to have died during the follow-up period. The observed period for mortality was 43.0 ± 44.5 months, with a median of 21.6 months and a range of 4 to 74 months (1324.2 ± 1377.0 days with a range of 138 to 2281 days). An episode of exacerbation was identified in 66 of 117 available subjects (56.4%). The mean duration from entry to last attendance or the first episode of exacerbation was 21.5 ± 16.0 months, ranging from 0 to 74 months (669.3 ± 497.0 days with a range of 7 to 2273 days). Forty-one out of 119 available subjects (34.5%) were hospitalized for exacerbation at least once during the observation period with a mean of 30.5 ± 25.0 months ranging from 1 to 74 months (941.0 ± 761.0 days with a range of 54 to 2273 days).

3.3. Predictive Properties of Mortality

Table 3 shows the results of the univariate Cox proportional hazards model in analyzing the association of major clinical measures and scores obtained from PRO measures with mortality. Crude Cox regression analysis of the raw predictors revealed that HR was statistically significant for age, some of the physiological measures, including FVC, FEV1, FEV1/FVC, and DLco, and scores from some PRO measures such as the BDI, SGRQ Total and Activity, CAT, and Hyland Scale. This demonstrates that these PRO measures are all significant mortality predictors in stable COPD. In other words, health status, global quality of life scale, and some measurements of dyspnea are related to mortality.
It is advisable to strive for standardization of Cox regression analysis using actual measurements to compare variables with different units rather than crude Cox regression analysis of the raw predictors. HRs per SD are shown in Table 3, using the z-score transformation as a general standardization method (Table 3). On the other hand, C-index is often preferred to compare different event prediction models. Among the significant mortality predictors, the C-index for FEV1 was the highest at 0.733.
The comparison of the HR of mortality associated with significant PRO scores and established predictors of mortality, such as age and FEV1, is shown in Figure 1. How much risk increases for a 1 SD increase (+) or decrease (−) is indicated in the order of HR per SD change, that is, in the order of the largest change in mortality risk. This can be called a standardized illustration of the magnitude of the effect on mortality.
It is also known that the results of multivariate analysis based on the Cox proportional hazards model are unstable when there are fewer than 20 events, and since there were 18 deaths in the present study, fewer than 20, multivariate analysis was not performed.

3.4. Predictive Properties of AECOPD

HRs for much of the clinical information and physiological measures were statistically significant, revealing that the older the patient and the poorer their physiological measures, the greater the risk (Table 4). PaO2 and BMI, however, were not associated with a greater risk.
The majority of PRO tool scores were significantly associated with the first exacerbation, apart from the D-12 Affective score and RS-Cough and Sputum, which did not demonstrate a statistically significant predictive relationship. The highest C-index was 0.754 for FEV1. As previously described, Cox regression of standardized predictors with exacerbation is shown in Table 4, and the comparison of the HR of exacerbation associated with significant scores of PROs, age and FEV1 is illustrated in Figure 2.

3.5. Predictive Properties of the First Hospitalization Due to Acute Exacerbation

Statistically significant HRs were observed for all measures, apart from BMI and the D-12 Affective score, in relation to the first hospitalization caused by acute exacerbation. Table 5 and Figure 3 show the results of the univariate analysis based on the Cox proportional hazards model for the data obtained at baseline and the time to hospitalization for the first AECOPD. Almost all clinical, physiological, and PRO measurements obtained at baseline except for BMI and the D-12 Affective score were significant predictors of first hospitalization for exacerbation.

4. Discussion

The purpose of the current study was to determine whether PRO measures have risk-predictive ability. Six different PRO measures were examined for 14 scores, including subscales. For mortality, the SGRQ Total and CAT scores assess health status; the BDI score assesses dyspnea; the SGRQ Activity score assesses activity, one of the three components of health status; and the Hyland Scale score, a global score that is considered a very comprehensive assessment of health-related quality of life, were statistically significant predictors. Contrasting these five scores that were concluded to be significantly associated with mortality with the other nine scores for which no significant association could be found, it is necessary to consider the conceptual framework within which each of the scales was designed. The SGRQ Total, CAT scores, and the Hyland Scale score are considered to be a comprehensive overview of both health-related quality of life and health status. It is hypothesized that the importance of these prognostic factors is derived from the fact that these scores encapsulate essential information in a condensed form.
The BDI score, a measure of dyspnea, was a significant predictor of mortality in the current study. It has been suggested that the SGRQ Activity score is analogous to the activity of daily life and can be used to evaluate dyspnea [31]. Reports studying COPD-specific health status or health-related quality of life components have indicated that dyspnea is involved in 30–40% of scores [32]. Given the three positive scores, which are considered comprehensive representations of health status or health-related quality of life, this may reflect the assumption that dyspnea is a significant prognostic factor.
In contrast, the D-12 Total score and two of its subscales, which assess dyspnea, as well as the RS-Breathlessness score, a subscale of E-RS, were not shown to be significant predictors. Although it is not easy to measure the perception of breathlessness due to its sensory quality and affective components, it has been theorized that the D-12 attempts to scale breathlessness based on descriptions and to be a precise characterization of the sensory and affective dimensions of dyspnea. It has been reported that the BDI score was strongly significantly correlated with mortality, whereas the peak Borg score at the end of progressive cycle ergometry was not [33]. Thus, studies differ in their findings as to whether dyspnea is a statistically significant prognostic factor. When comparing patient-reported outcome tools, we must avoid simple summaries because the results depend not only on the underlying conceptual constructs but also on the measuring properties. In the present study, D-12 showed a highly skewed distribution of scores, which may have led to negative results. Nevertheless, the disparity in the forecasting ability of mortality between tools could have been the result of measuring properties.
The highest C-index for mortality predictors was FEV1, suggesting it is a better predictor of mortality than any of the PRO measures studied. Several factors have been reported to be better predictors of mortality than FEV1. In 2011, Waschki and colleagues discovered that physical activity is a better predictor of mortality than FEV1 and is the best predictor of all-cause mortality [16]. The C-index of FEV1 was 0.75 in their study, which is comparable to our own finding of 0.733. Furthermore, they reported that the C-index for both the SGRQ Total and Activity scores was 0.64 and 0.67, respectively, which corresponds to the findings of the present investigation and demonstrates their importance as predictors of mortality.
The PRO tool with the best predictive ability for mortality considered in this analysis was the Hyland Scale score. The C-index of the FEV1 and Hyland Scale scores showed that the former was higher than the latter. In some of the uncorrected measured HRs, Hyland Scale scores may have appeared to be more strongly associated with mortality, especially when examining p values. In other words, the prognostic ability of the two is considered to be very similar. In the previous literature, subtle differences in prognostic significance have been reported depending on the population and statistical methodology [16], and the present analysis does not necessarily place a lower value on the predictive value of PRO measures compared to FEV1. Therefore, it is not easy to discuss the relative merits of different indices in terms of risk-predictive ability. As some of the relevant indicators change, the corresponding assumptions about how much the prognosis will change must be compared, and it should always be debated what analysis and what assumptions are best, sometimes giving the impression that convenient methods of analysis are chosen according to the preferences of researchers. Several PRO measures were examined for their relationship to mortality, with positive scores on comprehensive measures of health status or health-related quality of life and scores related to dyspnea, while other PRO measures were negative. This negates the short-sighted notion that every PRO measure is predictive, and the constructs of each of the PRO tools will have to be fully considered.
This study also sought to determine the markers of clinically significant exacerbation and hospitalization [34,35,36]. We found that most of the clinical, physiological, and PRO measurements taken at the start were significant predictors of the first exacerbation and the first hospitalization caused by it, apart from BMI and the D-12 Affective score. PaO2 and RS-Cough and Sputum were significant hospitalization predictors but not exacerbation predictors. Some reports have indicated an association between specific indicators and the emergence of exacerbation, but, to our knowledge, there have been only a few studies to compare indicators at baseline as an exacerbation predictor. The abundance of risk predictors in a real-world clinical setting may be one of the important results of the present study. In other words, for COPD patients with lower performance on these measures, caution should be exercised as exacerbations are more likely to develop.
FEV1 was found to have the highest C-index in both analyses for predicting exacerbation and hospitalization. This analysis of various PRO measures concluded that the most commonly used FEV1 is superior for predicting the risk of AECOPD. The CAT is the PRO measure that is most frequently analyzed as a potential predictor of exacerbation. It has been reported to be capable of predicting exacerbation and hospitalization [37,38,39,40]. However, since the present study demonstrated that many PRO measurement tools could also predict exacerbation, care should be taken not to overemphasize the benefits of the CAT.
Some limitations of the present study should be mentioned. First, this single-center study was limited by the number of patients with COPD admitted to the study site. Although this is a potential weak point, it contains all patients with stable COPD seen in this hospital during the study period. It is possible, given the small sample size, that there was insufficient power to evaluate any association. Furthermore, because our study included predominantly men, generalizations of these results to women with COPD may be unwarranted. Since the numbers of women with COPD were, in fact, quite low in Japan, the study reflected the reality of clinical COPD in our population. Lastly, although the Hyland Scale score, that is, one of the global quality of life scales, topped the list of risk predictive ability for PRO tools, to the best of our knowledge, there have been no previous reports on the clinical importance of the global quality of life scale for COPD. Because it is so simple, we have used it routinely in our laboratory for many years. Its role in the medical care of patients with COPD is an important topic for further study.

5. Conclusions

For mortality, the SGRQ Total and CAT scores assess health status; the BDI score assesses dyspnea; the SGRQ Activity score assesses activity, one of the three components of health status; and the Hyland Scale score, a global score that is considered a very comprehensive assessment of the quality of life related to health, were statistically significant predictors. The Hyland Scale score had the highest risk predictive ability, but the C index did not reach the level of the most commonly used FEV1. Almost all clinical, physiological, and PRO measurements obtained at baseline were significant predictors of the first exacerbation and the first hospitalization for exacerbation, with a few exceptions. The results may depend not only on the underlying conceptual constructs but also on the measuring properties.

Author Contributions

K.N. (Koichi Nishimura)contributed, as the principal investigator, to the design and concept of the study, the analysis of the results, and the writing of the manuscript. M.K., R.S., M.M. and A.S. contributed to acquisition of data. K.N. (Kazuhito Nakayasu) contributed to the statistical analysis. All authors have read and agreed to the published version of the manuscript.

Funding

This study was partly supported by the Research Funding for Longevity Sciences (22-7) from the National Center for Geriatrics and Gerontology (NCGG), Japan.

Institutional Review Board Statement

The research was approved by the National Center for Geriatrics and Gerontology Institute’s Ethics Committee (No. 1138-3).

Informed Consent Statement

Written informed consent was obtained from all participants.

Data Availability Statement

Anonymized participant data will be available upon reasonable request to the corresponding author.

Acknowledgments

Hideki Kojima, a certified social worker, is acknowledged by the authors for his valuable aid in reaching out to the dropout participants.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kyte, D.; Duffy, H.; Fletcher, B.; Gheorghe, A.; Mercieca-Bebber, R.; King, M.; Draper, H.; Ives, J.; Brundage, M.; Blazeby, J.; et al. Systematic evaluation of the patient-reported outcome (PRO) content of clinical trial protocols. PLoS ONE 2014, 9, e110229. [Google Scholar] [CrossRef]
  2. Gnanasakthy, A.; Mordin, M.; Evans, E.; Doward, L.; DeMuro, C. A Review of Patient-Reported Outcome Labeling in the United States (2011–2015). Value Health 2017, 20, 420–429. [Google Scholar] [CrossRef] [Green Version]
  3. Chang, E.M.; Gillespie, E.F.; Shaverdian, N. Truthfulness in patient-reported outcomes: Factors affecting patients’ responses and impact on data quality. Patient Relat. Outcome Meas 2019, 10, 171–186. [Google Scholar] [CrossRef] [Green Version]
  4. Afroz, N.; Gutzwiller, F.S.; Mackay, A.J.; Naujoks, C.; Patalano, F.; Kostikas, K. Patient-Reported Outcomes (PROs) in COPD Clinical Trials: Trends and Gaps. Int. J. Chron. Obs. Pulmon. Dis. 2020, 15, 1789–1800. [Google Scholar] [CrossRef] [PubMed]
  5. Jones, P.; Harding, G.; Wiklund, I.; Berry, P.; Leidy, N. Improving the process and outcome of care in COPD: Development of a standardised assessment tool. Prim. Care Respir. J. 2009, 18, 208–215. [Google Scholar] [CrossRef] [PubMed]
  6. Jahagirdar, D.; Kroll, T.; Ritchie, K.; Wyke, S. Patient-reported outcome measures for chronic obstructive pulmonary disease: The exclusion of people with low literacy skills and learning disabilities. Patient 2013, 6, 11–21. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Guyatt, G.H.; Berman, L.B.; Townsend, M.; Pugsley, S.O.; Chambers, L.W. A measure of quality of life for clinical trials in chronic lung disease. Thorax 1987, 42, 773–778. [Google Scholar] [CrossRef] [Green Version]
  8. Jones, P.W.; Harding, G.; Berry, P.; Wiklund, I.; Chen, W.H.; Kline Leidy, N. Development and first validation of the COPD Assessment Test. Eur. Respir. J. 2009, 34, 648–654. [Google Scholar] [CrossRef] [Green Version]
  9. Jones, P.W.; Brusselle, G.; Dal Negro, R.W.; Ferrera, M.; Kardos, P.; Levy, M.L.; Perez, T.; Soler Cataluna, J.J.; van der Molen, T.; Adamek, L.; et al. Properties of the COPD assessment test in a cross-sectional European study. Eur. Respir. J. 2011, 38, 29–35. [Google Scholar] [CrossRef] [Green Version]
  10. Jones, P.W.; Tabberer, M.; Chen, W.H. Creating scenarios of the impact of COPD and their relationship to COPD Assessment Test (CAT) scores. BMC Pulm. Med. 2011, 11, 42. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  11. Vestbo, J.; Hurd, S.S.; Agusti, A.G.; Jones, P.W.; Vogelmeier, C.; Anzueto, A.; Barnes, P.J.; Fabbri, L.M.; Martinez, F.J.; Nishimura, M.; et al. Global Strategy for the Diagnosis, Management, and Prevention of Chronic Obstructive Pulmonary Disease: GOLD Executive Summary. Am. J. Respir. Crit. Care Med. 2013, 187, 347–365. [Google Scholar] [CrossRef] [PubMed]
  12. Anthonisen, N.R.; Wright, E.C.; Hodgkin, J.E. Prognosis in chronic obstructive pulmonary disease. Am. Rev. Respir. Dis. 1986, 133, 14–20. [Google Scholar] [CrossRef] [PubMed]
  13. Domingo-Salvany, A.; Lamarca, R.; Ferrer, M.; Garcia-Aymerich, J.; Alonso, J.; Felez, M.; Khalaf, A.; Marrades, R.M.; Monso, E.; Serra-Batlles, J.; et al. Health-related quality of life and mortality in male patients with chronic obstructive pulmonary disease. Am. J. Respir. Crit. Care Med. 2002, 166, 680–685. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Nishimura, K.; Izumi, T.; Tsukino, M.; Oga, T. Dyspnea is a better predictor of 5-year survival than airway obstruction in patients with COPD. Chest 2002, 121, 1434–1440. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Oga, T.; Nishimura, K.; Tsukino, M.; Sato, S.; Hajiro, T. Analysis of the factors related to mortality in chronic obstructive pulmonary disease: Role of exercise capacity and health status. Am. J. Respir. Crit. Care Med. 2003, 167, 544–549. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Waschki, B.; Kirsten, A.; Holz, O.; Muller, K.C.; Meyer, T.; Watz, H.; Magnussen, H. Physical activity is the strongest predictor of all-cause mortality in patients with COPD: A prospective cohort study. Chest 2011, 140, 331–342. [Google Scholar] [CrossRef] [PubMed]
  17. Oga, T.; Nishimura, K.; Tsukino, M.; Sato, S.; Hajiro, T.; Ikeda, A.; Mishima, M. Health status measured with the CRQ does not predict mortality in COPD. Eur. Respir. J. 2002, 20, 1147–1151. [Google Scholar] [CrossRef] [Green Version]
  18. Alma, H.; de Jong, C.; Tsiligianni, I.; Sanderman, R.; Kocks, J.; van der Molen, T. Clinically relevant differences in COPD health status: Systematic review and triangulation. Eur. Respir. J. 2018, 52, 1800412. [Google Scholar] [CrossRef] [Green Version]
  19. Jones, P.W.; Quirk, F.H.; Baveystock, C.M.; Littlejohns, P. A self-complete measure of health status for chronic airflow limitation. The St. George’s Respiratory Questionnaire. Am. Rev. Respir. Dis. 1992, 145, 1321–1327. [Google Scholar] [CrossRef]
  20. Leidy, N.K.; Murray, L.T.; Monz, B.U.; Nelsen, L.; Goldman, M.; Jones, P.W.; Dansie, E.J.; Sethi, S. Measuring respiratory symptoms of COPD: Performance of the EXACT- Respiratory Symptoms Tool (E-RS) in three clinical trials. Respir. Res. 2014, 15, 124. [Google Scholar] [CrossRef] [Green Version]
  21. Leidy, N.K.; Sexton, C.C.; Jones, P.W.; Notte, S.M.; Monz, B.U.; Nelsen, L.; Goldman, M.; Murray, L.T.; Sethi, S. Measuring respiratory symptoms in clinical trials of COPD: Reliability and validity of a daily diary. Thorax 2014, 69, 443–449. [Google Scholar] [CrossRef] [Green Version]
  22. Yorke, J.; Moosavi, S.H.; Shuldham, C.; Jones, P.W. Quantification of dyspnoea using descriptors: Development and initial testing of the Dyspnoea-12. Thorax 2010, 65, 21–26. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Yorke, J.; Swigris, J.; Russell, A.M.; Moosavi, S.H.; Ng Man Kwong, G.; Longshaw, M.; Jones, P.W. Dyspnea-12 is a valid and reliable measure of breathlessness in patients with interstitial lung disease. Chest 2011, 139, 159–164. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Yorke, J.; Armstrong, I. The assessment of breathlessness in pulmonary arterial hypertension: Reliability and validity of the Dyspnoea-12. Eur. J. Cardiovasc. Nurs. 2014, 13, 506–514. [Google Scholar] [CrossRef]
  25. Nishimura, K.; Oga, T.; Nakayasu, K.; Taniguchi, H.; Ogawa, T.; Watanabe, F.; Arizono, S.; Kusunose, M.; Sanda, R.; Shibayama, A.; et al. Comparison between tools for measuring breathlessness: Cross-sectional validation of the Japanese version of the Dyspnoea-12. Clin. Respir. J. 2021, 15, 1201–1209. [Google Scholar] [CrossRef] [PubMed]
  26. Kusunose, M.; Oga, T.; Nakamura, S.; Hasegawa, Y.; Nishimura, K. Frailty and patient-reported outcomes in subjects with chronic obstructive pulmonary disease: Are they independent entities? BMJ Open Respir. Res. 2017, 4, e000196. [Google Scholar] [CrossRef] [Green Version]
  27. Sasaki, H.; Nakamura, M.; Kida, K.; Kambe, M.; Takahashi, K.; Fujimura, M. Reference values for spirogram and blood gas analysis in Japanese adults. J. Jpn Respir. Soc. 2001, 39, S1–S17. [Google Scholar]
  28. Hurst, J.R.; Vestbo, J.; Anzueto, A.; Locantore, N.; Mullerova, H.; Tal-Singer, R.; Miller, B.; Lomas, D.A.; Agusti, A.; Macnee, W.; et al. Susceptibility to exacerbation in chronic obstructive pulmonary disease. N Engl. J. Med. 2010, 363, 1128–1138. [Google Scholar] [CrossRef] [Green Version]
  29. Mahler, D.A.; Weinberg, D.H.; Wells, C.K.; Feinstein, A.R. The measurement of dyspnea. Contents, interobserver agreement, and physiologic correlates of two new clinical indexes. Chest 1984, 85, 751–758. [Google Scholar] [CrossRef] [Green Version]
  30. Hyland, M.E.; Sodergren, S.C. Development of a new type of global quality of life scale, and comparison of performance and preference for 12 global scales. Qual Life Res. 1996, 5, 469–480. [Google Scholar] [CrossRef]
  31. Hajiro, T.; Nishimura, K.; Tsukino, M.; Ikeda, A.; Koyama, H.; Izumi, T. Analysis of clinical methods used to evaluate dyspnea in patients with chronic obstructive pulmonary disease. Am. J. Respir. Crit. Care Med. 1998, 158, 1185–1189. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Hajiro, T.; Nishimura, K.; Tsukino, M.; Ikeda, A.; Koyama, H.; Izumi, T. Comparison of discriminative properties among disease-specific questionnaires for measuring health-related quality of life in patients with chronic obstructive pulmonary disease. Am. J. Respir. Crit. Care Med. 1998, 157, 785–790. [Google Scholar] [CrossRef] [PubMed]
  33. Oga, T.; Nishimura, K.; Tsukino, M.; Hajiro, T.; Mishima, M. Dyspnoea with activities of daily living versus peak dyspnoea during exercise in male patients with COPD. Respir. Med. 2006, 100, 965–971. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Adibi, A.; Sin, D.D.; Safari, A.; Johnson, K.M.; Aaron, S.D.; FitzGerald, J.M.; Sadatsafavi, M. The Acute COPD Exacerbation Prediction Tool (ACCEPT): A modelling study. Lancet Respir. Med. 2020, 8, 1013–1021. [Google Scholar] [CrossRef] [PubMed]
  35. Groves, D.; Karsanji, U.; Evans, R.A.; Greening, N.; Singh, S.J.; Quint, J.K.; Whittaker, H.; Richardson, M.; Barrett, J.; Sutch, S.P.; et al. Predicting Future Health Risk in COPD: Differential Impact of Disease-Specific and Multi-Morbidity-Based Risk Stratification. Int. J. Chron. Obs. Pulmon. Dis. 2021, 16, 1741–1754. [Google Scholar] [CrossRef] [PubMed]
  36. Wang, J.M.; Han, M.K.; Labaki, W.W. Chronic obstructive pulmonary disease risk assessment tools: Is one better than the others? Curr. Opin. Pulm. Med. 2022, 28, 99–108. [Google Scholar] [CrossRef]
  37. Lee, S.D.; Huang, M.S.; Kang, J.; Lin, C.H.; Park, M.J.; Oh, Y.M.; Kwon, N.; Jones, P.W.; Sajkov, D. Investigators of the Predictive Ability of, C.A.T.i.A.E.o.C.S. The COPD assessment test (CAT) assists prediction of COPD exacerbations in high-risk patients. Respir. Med. 2014, 108, 600–608. [Google Scholar] [CrossRef] [Green Version]
  38. Garcia-Sidro, P.; Naval, E.; Martinez Rivera, C.; Bonnin-Vilaplana, M.; Garcia-Rivero, J.L.; Herrejon, A.; Malo de Molina, R.; Marcos, P.J.; Mayoralas-Alises, S.; Ros, J.A.; et al. The CAT (COPD Assessment Test) questionnaire as a predictor of the evolution of severe COPD exacerbations. Respir. Med. 2015, 109, 1546–1552. [Google Scholar] [CrossRef]
  39. Sloots, J.M.; Barton, C.A.; Buckman, J.; Bassett, K.L.; van der Palen, J.; Frith, P.A.; Effing, T.W. The predictive value of an adjusted COPD assessment test score on the risk of respiratory-related hospitalizations in severe COPD patients. Chron. Respir. Dis. 2017, 14, 72–84. [Google Scholar] [CrossRef] [Green Version]
  40. Jo, Y.S.; Yoon, H.I.; Kim, D.K.; Yoo, C.G.; Lee, C.H. Comparison of COPD Assessment Test and Clinical COPD Questionnaire to predict the risk of exacerbation. Int. J. Chron. Obs. Pulmon. Dis. 2018, 13, 101–107. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Comparison of the HR (hazard ratio) of mortality associated with significant scores from patient-reported outcome tools and established predictors of mortality such as age as well as FEV1.
Figure 1. Comparison of the HR (hazard ratio) of mortality associated with significant scores from patient-reported outcome tools and established predictors of mortality such as age as well as FEV1.
Diagnostics 13 02269 g001
Figure 2. Comparison of the HR (hazard ratio) of the first acute exacerbation of COPD associated with significant scores from patient-reported outcome tools and established predictors of exacerbation such as age as well as FEV1.
Figure 2. Comparison of the HR (hazard ratio) of the first acute exacerbation of COPD associated with significant scores from patient-reported outcome tools and established predictors of exacerbation such as age as well as FEV1.
Diagnostics 13 02269 g002
Figure 3. Comparison of the HR (hazard ratio) of the first hospitalization due to acute exacerbation of COPD associated with significant scores from patient-reported outcome tools and established predictors of the first hospitalization for exacerbation such as age as well as FEV1.
Figure 3. Comparison of the HR (hazard ratio) of the first hospitalization due to acute exacerbation of COPD associated with significant scores from patient-reported outcome tools and established predictors of the first hospitalization for exacerbation such as age as well as FEV1.
Diagnostics 13 02269 g003
Table 1. Patient characteristics in 122 subjects with COPD at baseline.
Table 1. Patient characteristics in 122 subjects with COPD at baseline.
MeanSDMax.Min.
Ageyears74.56.488.058.0
BMIkg/m222.53.131.614.0
Cumulative Smokingpack-years57.929.2204.010.0
FVCLiters3.080.765.341.35
FEV1Liters1.720.543.130.52
FEV1/FVC%55.811.169.922.4
RV/TLC 1%46.010.085.118.1
DLco 2mL/min/mmHg12.475.5437.321.94
PaO2 3mmHg78.78.6101.556.6
1 n = 121, 2 n = 120, 3 one patient receiving oxygen.
Table 2. Score distribution of questionnaires and comparison of scores obtained from patient-reported outcome measurements between GOLD 1, 2 and 3 + 4 groups classified by the severity of airflow limitation.
Table 2. Score distribution of questionnaires and comparison of scores obtained from patient-reported outcome measurements between GOLD 1, 2 and 3 + 4 groups classified by the severity of airflow limitation.
Patient-Reported
Outcomes
ItemsPossible
Score Range
Score DistributionGOLD 1 (N = 41)GOLD 2 (N = 60)GOLD 3 + 4 (N = 21)
(n)MeanSDMax.Min.MeanSDMeanSDMeanSD
D-12 Total Score120–361.62.815.00.00.9 ± 2.11.3 ± 2.2 §3.9 ± 4.2 ¶¶
D-12 Physical Score70–211.42.210.00.00.7 ± 1.41.2 ± 1.7 §3.4 ± 3.2 ¶¶
D-12 Affective Score50–150.20.95.00.00.1 ± 0.80.2 ± 0.70.5 ± 1.5
BDI Score30–129.32.312.04.010.2 ± 2.09.4 ± 2.3 §7.5 ± 2.2 ¶¶
E-RS Total Score 1110–405.55.424.00.03.5 ± 3.55.1 ± 5.0 §310.3 ± 6.5 ¶¶
E-RS Breathlessness50–172.43.315.00.01.0 ± 1.72.1 ± 2.8 §§56.1 ± 4.1 ¶¶
E-RS Cough and Sputum 230–112.01.77.00.01.7 ± 1.62.1 ± 1.8 42.1 ± 1.9
E-RS Chest Symptoms30–121.01.66.00.00.8 ± 1.40.8 ± 1.6 §52.0 ± 2.0
SGRQ Total Score500–10023.015.363.11.216.5 ± 10.421.8 ± 14.6 §§39.1 ± 14.7 ¶¶
SGRQ Symptoms80–10039.219.681.40.033.3 ± 17.037.1 ± 18.7 §§56.4 ± 17.9 ¶¶
SGRQ Activity160–10031.023.087.20.021.3 ± 19.129.4 ± 21.6 §§54.7 ± 17.3 ¶¶
SGRQ Impact260–10013.613.355.20.08.8 ± 8.413.0 ± 12.9 §24.8 ± 16.0 ¶¶
CAT Score80–409.06.727.00.07.1 ± 5.37.9 ± 6.1 §§15.5 ± 6.9 ¶¶
Hyland Scale Score10–10067.614.627.030.073.4 ± 12.068.1 ± 13.6 §55.0 ± 14.9 ¶¶
GOLD 2 vs. GOLD 3 + 4 (Steel–Dwass test), §§: p < 0.001, §: p < 0.01 GOLD 1 vs. GOLD 3 + 4 (Steel–Dwass test), ¶¶: p < 0.001, : p < 0.05 Kruskal–Wallis test for three groups yields significant differences (p < 0.001) except for D-12 Affective Score and E-RS Cough and Sputum. 1 n = 119, 2 n = 120, 3 n = 57, 4 n = 58, 5 n = 59.
Table 3. Univariate Cox proportional hazards analyses on the relationship between baseline measurements and mortality.
Table 3. Univariate Cox proportional hazards analyses on the relationship between baseline measurements and mortality.
Crude Cox Regression of
the Raw Predictors
Cox Regression of the
Standardized Predictors
Hazard Ratio (95% CI)p ValueC-IndexSDHazard Ratio (95% CI)
Age (years)1.099 (1.022–1.183)0.0110.6456.41.824 (1.146–2.904)
BMI (kg/m2)0.990 (0.843–1.162)0.9010.5623.10.969 (0.591–1.589)
Cumulative Smoking (pack-years)0.998 (0.984–1.012)0.8010.49829.20.949 (0.632–1.425)
FVC (Liters)0.495 (0.251–0.977)0.0430.6190.760.585 (0.348–0.982)
FEV1 (Liters)0.244 (0.096–0.615)0.0030.7330.540.464 (0.280–0.768)
FEV1/FVC (%)0.955 (0.920–0.992)0.0170.72611.10.602 (0.397–0.913)
RV/TLC (%) 11.015 (0.979–1.054)0.4160.61010.01.166 (0.806–1.686)
DLco (mL/min/mmHg) 20.863 (0.782–0.952)0.0030.6725.540.442 (0.256–0.764)
PaO2 (mmHg) 30.983 (0.931–1.038)0.5370.5718.60.863 (0.542–1.376)
D-12 Total Score1.011 (0.893–1.145)0.8590.6562.81.032 (0.729–1.462)
D-12 Physical Score1.070 (0.920–1.245)0.3800.6612.21.158 (0.835–1.606)
D-12 Affective Score0.435 (0.063–2.995)0.3970.5500.90.472 (0.083–2.690)
BDI Score0.777 (0.640–0.943)0.0110.6902.30.554 (0.352–0.872)
E-RS Total Score1.037 (0.972–1.108)0.2720.6115.41.219 (0.856–1.735)
RS-Breathlessness1.079 (0.974–1.195)0.1470.6033.31.281 (0.916–1.789)
RS-Cough and Sputum1.028 (0.791–1.336)0.8370.5281.71.048 (0.669–1.642)
RS-Chest Symptoms1.106 (0.872–1.404)0.4050.5831.61.179 (0.800–1.738)
SGRQ Total Score1.027 (1.002–1.052)0.0330.68315.31.499 (1.033–2.177)
SGRQ Symptoms1.024 (1.000–1.048)0.0530.66919.61.579 (0.994–2.507)
SGRQ Activity1.027 (1.007–1.046)0.0070.70623.01.832 (1.184–2.835)
SGRQ Impact1.016 (0.988–1.044)0.2740.62113.31.227 (0.850–1.771)
CAT Score1.077 (1.017–1.142)0.0110.6996.71.643 (1.118–2.418)
Hyland Scale Score0.951 (0.922–0.980)0.0010.69414.60.477 (0.304–0.750)
1 n = 121, 2 n = 120, 3 one patient receiving oxygen.
Table 4. Univariate Cox proportional hazards analyses on the relationship between baseline measurements and acute exacerbation of COPD.
Table 4. Univariate Cox proportional hazards analyses on the relationship between baseline measurements and acute exacerbation of COPD.
Crude Cox Regression of
the Raw Predictors
Cox Regression of the
Standardized Predictors
Hazard Ratio (95% CI)p ValueC-IndexSDHazard Ratio (95% CI)
Age (years)1.046 (1.001–1.093)0.0460.5786.41.331 (1.005–1.761)
BMI (kg/m2)0.936 (0.865–1.014)0.1040.5803.10.816 (0.638–1.043)
Cumulative Smoking (pack-years)0.996 (0.987–1.005)0.3570.53429.20.887 (0.689–1.144)
FVC (Liters)0.500 (0.344–0.725)<0.0010.6730.760.589 (0.444–0.783)
FEV1 (Liters)0.242 (0.144–0.410)<0.0010.7170.540.463 (0.348–0.615)
FEV1/FVC (%)0.951 (0.930–0.972)<0.0010.66111.10.573 (0.448–0.732)
RV/TLC (%) 11.039 (1.015–1.063)0.0010.64110.01.462 (1.160–1.844)
DLco (mL/min/mmHg) 20.924 (0.875–0.977)0.0050.6065.540.647 (0.478–0.877)
PaO2 (mmHg) 30.976 (0.949–1.004)0.0900.5738.60.812 (0.638–1.033)
D-12 Total Score1.087 (1.023–1.154)0.0070.6332.81.263 (1.066–1.496)
D-12 Physical Score1.160 (1.064–1.265)0.0010.6362.21.379 (1.143–1.663)
D-12 Affective Score1.105 (0.909–1.345)0.3160.5150.91.095 (0.917–1.306)
BDI Score0.816 (0.732–0.909)<0.0010.6642.30.621 (0.482–0.800)
E-RS Total Score1.087 (1.043–1.133)<0.0010.6385.41.571 (1.257–1.964)
RS-Breathlessness1.169 (1.094–1.250)<0.0010.6433.31.668 (1.343–2.073)
RS-Cough and Sputum1.151 (0.997–1.329)0.0540.5731.71.273 (0.996–1.627)
RS-Chest Symptoms1.172 (1.021–1.344)0.0240.5611.61.294 (1.035–1.620)
SGRQ Total Score1.029 (1.014–1.045)<0.0010.66015.31.551(1.230–1.954)
SGRQ Symptoms1.020 (1.007–1.034)0.0030.63019.61.483 (1.142–1.926)
SGRQ Activity1.019 (1.009–1.030)<0.0010.67123.01.555 (1.219–1.985)
SGRQ Impact1.027 (1.010–1.045)0.0020.60913.31.427(1.140–1.787)
CAT Score1.066 (1.027–1.106)0.0010.6246.71.525 (1.191–1.163)
Hyland Scale Score0.976 (0.958–0.994)0.0080.61114.60.698 (0.535–0.910)
1 n = 121, 2 n = 120, 3 one patient receiving oxygen.
Table 5. Univariate Cox proportional hazards analyses on the relationship between baseline measurements and hospitalization due to acute exacerbation of COPD.
Table 5. Univariate Cox proportional hazards analyses on the relationship between baseline measurements and hospitalization due to acute exacerbation of COPD.
Crude Cox Regression of
the Raw Predictors
Cox Regression of the
Standardized Predictors
Hazard Ratio (95% CI)p ValueC-IndexSDHazard Ratio (95% CI)
Age (years)1.074 (1.016–1.135)0.0120.6026.41.573 (1.105–2.238)
BMI (kg/m2)0.930 (0.834–1.037)0.1910.5613.10.799 (0.571–1.119)
Cumulative Smoking (pack-years)0.993 (0.983–1.004)0.2340.53229.20.823 (0.598–1.134)
FVC (Liters)0.391 (0.248–0.618)<0.0010.7080.760.489 (0.345–0.693)
FEV1 (Liters)0.168 (0.090–0.315)<0.0010.7540.540.379 (0.269–0.534)
FEV1/FVC (%)0.939 (0.915–0.964)<0.0010.69011.10.496 (0.371–0.661)
RV/TLC (%) 11.055 (1.027–1.085)<0.0010.71410.01.710 (1.300–2.249)
DLco (mL/min/mmHg) 20.885 (0.824–0.951)0.0010.6385.540.509 (0.342–0.756)
PaO2 (mmHg) 30.950 (0.916–0.985)0.0050.6038.60.643 (0.471–0.876)
D-12 Total Score1.135 (1.059–1.216)<0.0010.6982.81.426 (1.175–1.732)
D–12 Physical Score1.248 (1.128–1.381)<0.0010.7002.21.616 (1.298–2.012)
D–12 Affective Score1.200 (0.956–1.506)0.1150.5320.91.179 (0.961–1.447)
BDI Score0.745 (0.652–0.851)<0.0010.6992.30.503 (0.369–0.685)
E-RS Total Score1.135 (1.078–1.195)<0.0010.7015.41.977 (1.497–2.611)
RS–Breathlessness1.235 (1.139–1.34)<0.0010.6923.31.996 (1.532–2.601)
RS–Cough and Sputum1.255 (1.042–1.513)0.0170.6231.71.475 (1.072–2.030)
RS–Chest Symptoms1.276 (1.088–1.496)0.0030.6461.61.487 (1.147–1.929)
SGRQ Total Score1.043 (1.024–1.062)<0.0010.70215.31.909 (1.445–2.523)
SGRQ Symptoms1.031 (1.014–1.048)<0.0010.68419.61.804 (1.306–2.492)
SGRQ Activity1.030 (1.016–1.044)<0.0010.71223.01.966 (1.439–2.687)
SGRQ Impact1.040 (1.020–1.060)<0.0010.65313.31.677 (1.295–2.172)
CAT Score1.137 (1.085–1.191)<0.0010.7126.72.347 (1.721–3.202)
Hyland Scale Score0.966 (0.946–0.987)0.0020.62514.60.604 (0.442–0.826)
1 n = 121, 2 n = 120, 3 one patient receiving oxygen.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Nishimura, K.; Kusunose, M.; Sanda, R.; Mori, M.; Shibayama, A.; Nakayasu, K. Comparison of Predictive Properties between Tools of Patient-Reported Outcomes: Risk Prediction for Three Future Events in Subjects with COPD. Diagnostics 2023, 13, 2269. https://doi.org/10.3390/diagnostics13132269

AMA Style

Nishimura K, Kusunose M, Sanda R, Mori M, Shibayama A, Nakayasu K. Comparison of Predictive Properties between Tools of Patient-Reported Outcomes: Risk Prediction for Three Future Events in Subjects with COPD. Diagnostics. 2023; 13(13):2269. https://doi.org/10.3390/diagnostics13132269

Chicago/Turabian Style

Nishimura, Koichi, Masaaki Kusunose, Ryo Sanda, Mio Mori, Ayumi Shibayama, and Kazuhito Nakayasu. 2023. "Comparison of Predictive Properties between Tools of Patient-Reported Outcomes: Risk Prediction for Three Future Events in Subjects with COPD" Diagnostics 13, no. 13: 2269. https://doi.org/10.3390/diagnostics13132269

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop