Next Article in Journal
A Longitudinal Assessment of Substance Use Treatment during the COVID-19 Pandemic Using Staff and Service Data
Previous Article in Journal
Obliterative Endotheliitis Leading to Cystic Lung Necrosis in Severe COVID-19 during the First Wave of the Pandemic
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

External Validation of the ImAgeS Risk Score for Mortality in Hospitalized Kidney Transplant Recipients with COVID-19: A Retrospective Observational Study

by
Josipa Domjanović
1,
Tea Domjanović Škopinić
2,
Tea Gamberažić Kirevski
3 and
Andrija Matetic
2,4,*
1
Department of Nephrology, University Hospital of Split, 21000 Split, Croatia
2
Department of Cardiology, University Hospital of Split, 21000 Split, Croatia
3
Department of Anesthesiology, University Hospital of Split, 21000 Split, Croatia
4
School of Medicine, University of Split, 21000 Split, Croatia
*
Author to whom correspondence should be addressed.
BioMed 2023, 3(2), 207-216; https://doi.org/10.3390/biomed3020018
Submission received: 6 March 2023 / Revised: 20 March 2023 / Accepted: 21 March 2023 / Published: 4 April 2023

Abstract

:
Background: Timely recognition of high-risk individuals with novel Coronavirus disease (COVID-19) is important. Yet, validated risk scores for kidney transplant recipients with COVID-19 are lacking. The present study aimed to externally validate the novel ImAgeS risk score in this population. Methods: A retrospective analysis of 65 kidney transplant recipients with COVID-19 was conducted. A robust external validation of the novel ImAgeS risk score with respect to 30-day all-cause mortality was performed using regression analysis, discrimination and calibration methods. Results: An overall mortality rate during the study follow-up was 18.5% (N = 12). The ImAgeS risk score showed a statistically significant association with 30-day all-cause mortality (HR 1.04 95% CI 1.00–1.08, p =  0.040). This risk score demonstrated a modest, statistically significant discrimination of all-cause mortality (AUC of 0.679 (95% CI 0.519–0.840, p = 0.027). The calibration of the model was acceptable with a Hosmer-Lemeshow value of 3.74, Harrell’s C concordance index of 0.699 and Somers’ D of 0.397. Conclusions: The ImAgeS risk score demonstrated a significant association with 30-day all-cause mortality in kidney transplant recipients with COVID-19. The model showed modest discrimination and satisfactory calibration, confirming the findings from the computational study. Further studies are needed to determine the utility of the ImAgeS score in this high-risk population.

1. Introduction

The novel Coronavirus disease (COVID-19) has had a major impact on global health, leading to high morbidity and mortality, particularly in patients with chronic diseases [1,2,3]. Solid organ transplant recipients, such as kidney transplant recipients, represent a delicate population with complex pathophysiologic interactions and dependence on routine healthcare [1,2,3,4]. The importance of timely recognition of high-risk individuals in this setting is emphasized to guide management and prevent adverse outcomes [4].
Previous studies have reported immense COVID-19-associated mortality in kidney transplant recipients [3,4,5,6,7,8,9] because of various underlying mechanisms [10,11,12,13,14,15,16,17], warranting measures to improve the clinical decision-making process. Risk stratification is the method of evaluating the risk factors and patient characteristics to guide their management. In the context of kidney transplant recipients with COVID-19, risk stratification is particularly important because these individuals are at increased risk of severe disease. Furthermore, this population is quite heterogenous warranting measures to recognize individuals with increased risk of adverse outcomes. Despite this, validated and specific risk scores for kidney transplant recipients with COVID-19 are sparsely available in the literature.
Recently, de Andrade et al. have developed a novel clinical risk score (ImAgeS) using the data from a Brazilian cohort of kidney transplant recipients with COVID-19. This score proved to have satisfactory discrimination and prediction of mortality [4], but external validation has been warranted. This study aimed to expand the existing evidence by externally validating a novel ImAgeS risk score with respect to 30-day mortality in kidney transplant recipients with COVID-19.

2. Materials and Methods

2.1. Study Design and Patients

This observational retrospective study included 65 eligible kidney transplant recipients who were treated for COVID-19 at the University Hospital of Split in the period from August 2020 to March 2022. All included patients underwent reverse transcription-polymerase chain reaction (RT-PCR) testing (from nasopharyngeal and oropharyngeal swabs) to confirm acute COVID-19. Prior to study inclusion, all candidates underwent a detailed assessment of the study inclusion and exclusion criteria.
Exclusion criteria were age < 18 years, incomplete medical documentation, and loss of follow-up. The initial patient screening included a total of 67 patients, and due to incomplete medical documentation, the study eligibility was confirmed in a total of 65 patients (Supplementary Figure S1). The patients that were found not eligible were assessed after the end of the study follow-up, and there were no fatal events in these two patients. This observational study was reported according to the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) recommendations (Supplementary File S2).

2.2. Ethical and Institutional Considerations

The study was performed in agreement with the principles of Good Clinical Practice, following the ethical standards and amendments of the Declaration of Helsinki. The study protocol was approved by the Medical Research Ethical Committee of the University Hospital of Split, Croatia (No. 2181-147-01/06). Informed consent was obtained from all patients before enrolment in the study.

2.3. ImAgeS Risk Score and Data Collection

The novel ImAgeS risk score was recently developed by de Andrade et al. in a large cohort of Brazilian kidney transplant recipients with COVID-19 [4]. This pivotal study evaluated the predictors of 28-day mortality to develop an online multi-component calculator (i.e., ImAgeS risk score) that consists of different clinical variables. It includes baseline patient characteristics (age, body mass, body height, sex, race, smoking history, creatinine, specific comorbidities), chronic immunosuppression therapy (steroids, antimetabolites and mammalian target of rapamycin (mTOR) inhibitors), and COVID-19-related symptoms (anosmia, headache, coryza, dyspnea and duration of symptoms). Specific comorbidities from the risk score are pre-existent diabetes mellitus, arterial hypertension and cardiovascular disease.
The ImAgeS risk score was initially developed in a cohort of kidney transplant recipients and was thereafter internally validated in a similar cohort, during which it demonstrated good discrimination and calibration. Finally, an easy-to-use web application was computed. A total score was expressed as the probability (%) and relative risk of 28-day mortality.

2.4. Data Collection

Baseline characteristics were collected at the time of hospital admission, including age, mean blood pressure (MBP), peripheral oxygen blood saturation (SpO2), comorbidities, laboratory parameters (white blood cell, hemoglobin, platelets, C-reactive protein, estimated glomerular filtration rate, D-dimer), transplantation-related data (transplant duration, immunosuppressive therapy) and COVID-19-related data (clinical picture, vaccination status, therapy). It was collected using the electronic database and hospital reports. MBP was calculated using the sum of 1/3 systolic blood pressure and 2/3 diastolic blood pressure. Laboratory analysis was performed under routine hospital laboratory standards.

2.5. Aims and Outcomes

A primary outcome was an association between the ImAgeS score and 30-day mortality, including discrimination and calibration. The secondary outcome included an exploratory analysis of the baseline patient characteristics across the median categories of the ImAgeS score. Finally, we aimed to evaluate the association between selected patient characteristics and all-cause mortality.

2.6. Statistical Analysis

Continuous data were presented as median (interquartile range [IQR]) and analyzed using the Kruskal Wallis test, while categorical variables were expressed as numbers (percentages) and analyzed using the Chi-squared test. Descriptive statistics across the ImAgeS risk score quantiles were performed for exploratory purposes.
To determine the relationship between ImAgeS risk score and 30-day mortality, Cox proportional hazard regression analysis was performed. The results were presented as a hazard ratio (HR) and 95% confidence intervals (CI). The risk score was evaluated as a continuous variable, and the results refer to a 1-unit change of risk score on a continuous scale. The results of this analysis allow for insights into the association between ImAgeS risk score and mortality.
In addition, the performance of the ImAgeS risk score was assessed using the receiver operating characteristic (ROC) and area under the curve (AUC). A better performance (diagnostic accuracy) of the risk score is defined by a higher AUC value and a ROC curve that is closer to the top-left corner of the graph. Finally, the Hosmer-Lemeshow goodness-of-fit test, Somers’ D and Harrell’s C concordance index, and calibration plots were used to determine the calibration and goodness-of-fit of the models.
Finally, binomial multivariable logistic regression was conducted to determine the association between selected patient characteristics and all-cause mortality. The number of variables was restricted to prevent overfitting of the model.
A two-sided p-value of <0.05 was considered significant. P-values were not adjusted for multiple tests and should be interpreted as exploratory only. Statistical data analysis was carried out using a Statistical Package for the Social Sciences (SPSS) software (IBM Corp., New York, NY, USA; version 20) and Stata software (StataCorp, College Station, TX, USA; version 17).

3. Results

3.1. Exploratory Analysis

The study analysis included data on 65 patients. The baseline characteristics of the study sample are presented in Table 1. An exploratory analysis evaluating descriptive patient characteristics across the ImAgeS score quantiles showed that there were not statistically significant between-group differences, except for younger age (50 vs. 62 years, p = 0.001) and higher estimated glomerular filtration rate (66.7 vs. 36.0 mL/min/1.73 m2, p = 0.042) in patients with lower ImAgeS score (Table 1). There was no statistically significant difference in the comorbidities across the groups, including arterial hypertension, diabetes mellitus, chronic heart failure, active smoking, atrial fibrillation, prior acute myocardial infarction, prior cerebrovascular accident, peripheral artery disease, and chronic obstructive pulmonary disease/asthma. Importantly, there was no difference in vaccination status, oxygen supplementation, utilization of remdesivir, and corticosteroid therapy between the study groups (p > 0.05) (Table 1). Finally, there was no difference in the duration of follow-up (Table 1).

3.2. ImAgeS Risk Score and 30-Day Mortality

The overall mortality rate during the study follow-up was 18.5% (N = 12). The ImAgeS risk score showed a statistically significant association with 30-day all-cause mortality (HR 1.04 95% CI 1.00–1.08, p =  0.040) (Table 2).
Furthermore, the ImAgeS risk score demonstrated modest, statistically significant discrimination of all-cause mortality (AUC of 0.679 (95% CI 0.519–0.840, p = 0.027) (Figure 1 and Supplementary Table S2).
When evaluating the association of patient characteristics and all-cause mortality, there was no statistically significant association among the selected variables, such as age, sex, arterial hypertension, diabetes mellitus, chronic heart failure and transplant duration (Supplementary Table S3).

3.3. Calibration

The calibration of the ImAgeS risk score model was acceptable with a Hosmer-Lemeshow value of 3.74, Harrell’s C concordance index of 0.699 and Somers’ D of 0.397 (Table 2). This was confirmed by a calibration plot (Supplementary Figure S2).

4. Discussion

To the best of our knowledge, this is the first external validation study of the ImAgeS risk score that was developed on a Brazilian cohort of kidney transplant recipients with COVID-19. The high-risk profile of kidney transplant recipients and the lack of specific risk stratification tools mandate further validation of the ImAgeS score. There are several important findings of this study. First, the high mortality rates of kidney transplant recipients due to COVID-19 are consistent with previous literature. Second, the ImAgeS risk score showed a statistically significant association with 30-day all-cause mortality, including modest but significant discrimination. Finally, the calibration of the model was acceptable. These findings confirm the initial reports from the internal validation cohort, suggesting that the ImAgeS risk score could aid in the clinical decision-making process. Risk stratification is a critical component of the care of kidney transplant recipients with COVID-19. By identifying patients at the highest risk of severe disease and mortality, clinicians could tailor their care to improve outcomes.
The impaired prognosis of kidney transplant recipients with COVID-19 has been attributed to various factors. Chronic immunosuppression carries a consequently higher risk of co-infections [5,10,11,12]. Recent transplantation has been previously associated with higher infection rates and the severe disease form, suggesting that a stronger level of immunosuppression mediates worse outcomes [4,13]. Another well-known complication of immunosuppression is lymphopenia which proved as an independent predictor of COVID-19-associated mortality in the general population [4,14,15,16,17]. Other important features likely contribute to the advanced risk of this population, such as kidney dysfunction, dependency on routine healthcare, polypharmacy, and frailty. The heterogeneity of this patient population further aggravates the clinical decision-making process and warrants better risk stratification.
Up to this moment, many risk scores have been investigated in the general population of COVID-19 patients [18,19,20,21,22,23,24], but only a few have been studied in the setting of kidney transplant recipients with COVID-19. A close author group recently evaluated different laboratory-derived biomarkers in assessing 30-day mortality risk in a small population of kidney transplant recipients [7]. Additionally, the CROW-65 risk score demonstrated acceptable calibration and discrimination in these patients, but further evaluation in a larger cohort was warranted [8]. The predictive ability of several other clinical risk scores was recently evaluated in a cohort of 57 kidney transplant recipients treated in the intensive care unit for severe COVID-19. The analysis encompassed SOFA, SAPS 3, and APACHE IV scores, while only the APACHE IV showed good performance [25].
Andrade et al. has recently developed the ImAgeS risk score to predict mortality in kidney transplant recipients with COVID-19, which can be used to identify high-risk patients [4]. External validation of this risk score was crucial to ensure its accuracy and reliability in predicting risk. Having in mind that the ImAgeS score includes clinical parameters available at hospital admission, this risk score could aid physicians in the decision-making process at the time of the first clinical assessment [4].
The ImAgeS risk score includes relevant parameters for kidney transplant recipients, such as chronic immunosuppressive therapy, specifically the use of steroids, antimetabolite (mycophenolate/azathioprine) and mTOR inhibitors [4]. Available literature suggests that patients treated with mTOR inhibitors may sustain a milder form of COVID-19 due to the potential antiviral effects of this drug family [4,13,26]. Additionally, according to de Andrade et al., patients with mTOR inhibitors in chronic immunosuppressive therapy have lower ImAgeS scores and are, therefore, at a lower risk of mortality [4]. There is evidence in the literature suggesting that the PI3K/Akt/mTOR pathway could be one of the potential pathophysiologic pathways of COVID-19. Therefore, affecting that pathway could downregulate inflammatory response and affect the course of COVID-19 [27,28]. On the other hand, patients receiving antimetabolite had a higher risk of worse outcomes which could be attributed to drug-induced lymphopenia, which is a recognized contributor to COVID-19-associated mortality [4,14,15,29]. In this study, there was no statistically significant difference in chronic immunosuppressive therapy between patients with lower and higher ImAgeS risk scores.
Kidney dysfunction has been associated with mortality in the overall COVID-19 population, with a doubled risk of death in patients with eGFR < 30 mL/min/1.73 m2 compared to patients with eGFR > 60 mL/min/1.73 m2 [2]. Furthermore, Bajpai et al. reported a statistically significant association between eGFR levels and survival amongst kidney transplant recipients with COVID-19 [30]. Worse baseline graft function in kidney transplant recipients is a well-known predictor of worse outcomes. Importantly, this clinical factor is included in the ImAgeS risk score [4]. Similar results were reported in our cohort with higher eGFR in patients with higher ImAgeS scores than in those with lower ImAgeS scores.
Another important characteristic that showed an association with adverse outcomes in previous studies is age. There are a lot of reports about the more severe clinical picture in elderly patients, including higher mortality rates [31,32,33,34,35]. When comparing patients with lower and higher ImAgeS scores, similar results were reported in our study, with elderly patients having higher ImAgeS scores. Increasing age is associated with frailty, higher comorbidity burden, and increased susceptibility to co-infections, all of which mediate adverse outcomes. Therefore, age represents an important component of the ImAgeS risk score, although this study did not show an independent association of age with mortality.
Furthermore, there was no significant difference in comorbidities between patients with lower and higher ImAgeS risk scores in this study. This is in contrast with available literature where patients with severe disease form more often had comorbidities, such as diabetes, arterial hypertension and cardiovascular disease [32,33], and often higher mortality rates [34]. This may be a consequence of the specificity of kidney transplant recipients and indicates that other patient characteristics are more important for their prognosis.
This study was conducted across a relatively wide time frame during which therapeutic strategies for COVID-19 have evolved, with different vaccination types becoming available worldwide. Global vaccination has reduced the infection rate and disease severity, but its effects inevitably vary across different patient populations [36]. Kidney transplant recipients exhibit a low response to the messenger ribonucleic acid (mRNA) vaccine, warranting improved risk stratification and management strategies for this fragile population [37,38,39]. It is important to emphasize that there was no significant difference between patients with lower and higher ImAgeS risk scores regarding vaccination status in this study.
Having in mind that this risk score has previously shown a satisfactory prediction of mortality in the pivotal study, it could be expected that an association between the ImAgeS risk score and mortality was confirmed in this external validation study. However, different effect sizes should be acknowledged and interpreted regarding the differences between these studies. The value of the ImAgeS risk score should be investigated in further studies.
This study could have several clinical implications. First, it reintroduces this potentially useful risk score to the clinicians. Risk stratification can help guide decisions about hospitalization, monitoring, and treatment for kidney transplant recipients with COVID-19. It can also allow less resource utilization and improved outcomes. Second, the inclusion of different variables that are both widely available and clinically relevant to kidney transplant recipients is particularly important for everyday practice. Having in mind the burden of the COVID-19 pandemic on healthcare systems, focused interventions in high-risk individuals could be both patient-centered and resource-saving. For example, patients at higher risk may require more frequent monitoring of their oxygen levels, kidney function, and immune status, as well as closer observation for signs of progression to severe disease [40]. In addition, these patients may benefit from more aggressive treatment strategies, such as early initiation of antiviral therapy or the use of monoclonal antibodies. Nevertheless, a cautious approach is necessary as there may be important geographical and population differences that could interfere with the performance of the ImAgeS risk score, and the limited sample size of the external validation cohort could interfere with its clinical application. The predictability, calibration, and discrimination of the ImAgeS risk score should be further validated in different geographic areas using sufficiently powered cohorts.
This study has several limitations. First, a relatively small sample size from a single center can affect study strength. The observed effect size was mild, which could be mediated by a limited sample size. Second, the COVID-19 management algorithms have changed throughout the study, which could potentially affect the prognosis of the cohort. Third, the observational retrospective nature of the study has certain inherent drawbacks, including the possibility of selection bias. The fourth, single-center analysis could also support selection bias. Importantly, any causal inferences could not be determined with this study. Finally, due to short-term follow-up, it can’t be used for assessment of long-term prognosis in this patient population.

5. Conclusions

In conclusion, the ImAgeS risk score showed a statistically significant association with 30-day all-cause mortality in kidney transplant recipients with COVID-19, including modest discrimination and satisfactory calibration, confirming the findings from the computational study. Further studies are needed to determine the utility of the ImAgeS score in this high-risk population.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/biomed3020018/s1, Supplementary File S1, which contains Supplementary Tables: Supplementary Table S1: Relevant characteristics of the study sample; Supplementary Table S2: ROC curve analysis of ImAgeS risk score with 30-day post-discharge mortality; Supplementary Table S3: Association of different patient characteristics with 30-day post-discharge mortality; Supplementary Figure S1: Flow diagram; Supplementary Figure S2: Calibration plot; Supplementary File S2: STROBE checklist of the study.

Author Contributions

Conceptualization, A.M. and J.D.; methodology, A.M.; software, A.M.; validation, T.D.Š. and T.G.K.; formal analysis, A.M.; investigation, J.D.; resources, J.D.; data curation, J.D.; writing—original draft preparation, J.D.; writing—review and editing, J.D., T.D.Š., T.G.K. and A.M.; visualization, T.D.Š.; supervision, A.M.; project administration, T.G.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was performed in agreement with the principles of Good Clinical Practice, following the ethical standards and amendments of the Declaration of Helsinki. The study protocol was approved by the Medical Research Ethical Committee of the University Hospital of Split, Croatia (No. 2181-147-01/06).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The datasets used and/or analyzed during the current study are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Gao, Y.-D.; Ding, M.; Dong, X.; Zhang, J.-J.; Kursat Azkur, A.; Azkur, D.; Gan, H.; Sun, Y.-L.; Fu, W.; Li, W.; et al. Risk factors for severe and critically ill COVID-19 patients: A review. Allergy 2021, 76, 428–455. [Google Scholar] [CrossRef]
  2. Williamson, E.J.; Walker, A.J.; Bhaskaran, K.; Bacon, S.; Bates, C.; Morton, C.E.; Curtis, H.J.; Mehrkar, A.; Evans, D.; Inglesby, P.; et al. Factors associated with COVID-19-related death using OpenSAFELY. Nature 2020, 584, 430–436. [Google Scholar] [CrossRef] [PubMed]
  3. Udomkarnjananun, S.; Kerr, S.J.; Townamchai, N.; Susantitaphong, P.; Tulvatana, W.; Praditpornsilpa, K.; Eiam-Ong, S.; Avihingsanon, Y. Mortality risk factors of COVID-19 infection in kidney transplantation recipients: A systematic review and meta-analysis of cohorts and clinical registries. Sci. Rep. 2021, 11, 20073. [Google Scholar] [CrossRef]
  4. Modelli de Andrade, L.G.; de Sandes-Freitas, T.V.; Requião-Moura, L.R.; Viana, L.A.; Cristelli, M.P.; Garcia, V.D.; Alcântara, A.L.C.; Esmeraldo, R.D.M.; Filho, M.A.; Pacheco-Silva, A.; et al. Development and validation of a simple web-based tool for early prediction of COVID-19-associated death in kidney transplant recipients. Am. J. Transplant. 2022, 22, 610–625. [Google Scholar] [CrossRef]
  5. Raja, M.A.; Mendoza, M.A.; Villavicencio, A.; Anjan, S.; Reynolds, J.M.; Kittipibul, V.; Fernandez, A.; Guerra, G.; Camargo, J.F.; Simkins, J.; et al. COVID-19 in solid organ transplant recipients: A systematic review and meta-analysis of current literature. Transplant. Rev. 2021, 35, 100588. [Google Scholar] [CrossRef]
  6. Dessie, Z.G.; Zewotir, T. Mortality-related risk factors of COVID-19: A systematic review and meta-analysis of 42 studies and 423,117 patients. BMC Infect. Dis. 2021, 21, 855. [Google Scholar] [CrossRef] [PubMed]
  7. Domjanović, J.; Škopinić, T.D.; Radić, J.; Luketin, M.; Jeličić, I.; Matetic, A. Performance of Derived Laboratory Biomarkers with Regard to 30-Day Mortality in Kidney Transplant Recipients with COVID-19. Life 2022, 12, 2068. [Google Scholar] [CrossRef] [PubMed]
  8. Domjanović, J.; Matetic, A.; Kramarić, D.B.; Škopinić, T.D.; Škaro, D.B.; Delić, N.; Runjić, F.; Jeličić, I. Association of the novel CROW-65 risk score and mortality in hospitalized kidney transplant recipients with COVID-19: A retrospective observational study. Wien. Klin. Wochenschr. 2022, 134, 842–849. [Google Scholar] [CrossRef]
  9. Kremer, D.; Pieters, T.T.; Verhaar, M.C.; Berger, S.P.; Bakker, S.J.L.; van Zuilen, A.D.; Joles, J.A.; Vernooij, R.W.; van Balkom, B.W. A systematic review and meta-analysis of COVID-19 in kidney transplant recipients: Lessons to be learned. Am. J. Transplant. 2021, 21, 3936–3945. [Google Scholar] [CrossRef]
  10. Caillard, S.; Chavarot, N.; Francois, H.; Matignon, M.; Greze, C.; Kamar, N.; Gatault, P.; Thaunat, O.; Legris, T.; Frimat, L.; et al. Is COVID-19 infection more severe in kidney transplant recipients? Am. J. Transplant. 2021, 21, 1295–1303. [Google Scholar] [CrossRef]
  11. Mahalingasivam, V.; Craik, A.; Tomlinson, L.A.; Ge, L.; Hou, L.; Wang, Q.; Yang, K.; Fogarty, D.G.; Keenan, C. A Systematic Review of COVID-19 and Kidney Transplantation. Kidney Int. Rep. 2021, 6, 24–45. [Google Scholar] [CrossRef]
  12. COVID-19 in Solid Organ Transplant Recipients: Initial Report from the US Epicenter—Pereira—2020—American Journal of Transplantation—Wiley Online Library n.d. Available online: https://onlinelibrary.wiley.com/doi/10.1111/ajt.15941 (accessed on 10 May 2022).
  13. Pinchera, B.; Spirito, L.; Ferreri, L.; Rocca, R.L.; Celentano, G.; Buonomo, A.R.; Foggia, M.; Scotto, R.; Federico, S.; Gentile, I.; et al. SARS-CoV-2 in Kidney Transplant Patients: A Real-Life Experience. Front. Med. 2022, 9, 864865. [Google Scholar] [CrossRef] [PubMed]
  14. Richardson, S.; Hirsch, J.S.; Narasimhan, M.; Crawford, J.M.; McGinn, T.; Davidson, K.W.; Barnaby, D.P.; Becker, L.B.; Chelico, J.D.; Cohen, S.L.; et al. Presenting Characteristics, Comorbidities, and Outcomes Among 5700 Patients Hospitalized With COVID-19 in the New York City Area. JAMA 2020, 323, 2052–2059. [Google Scholar] [CrossRef] [PubMed]
  15. Finelli, C.; Parisi, S. The clinical impact of COVID-19 epidemic in the hematologic setting. Adv. Biol. Regul. 2020, 77, 100742. [Google Scholar] [CrossRef] [PubMed]
  16. Garbo, R.; Valent, F.; Gigli, G.L.; Valente, M. Pre-Existing Lymphopenia Increases the Risk of Hospitalization and Death after SARS-CoV-2 Infection. Infect. Dis. Rep. 2022, 14, 20–25. [Google Scholar] [CrossRef]
  17. Zhao, Q.; Meng, M.; Kumar, R.; Wu, Y.; Huang, J.; Deng, Y.; Weng, Z.; Yang, L. Lymphopenia is associated with severe coronavirus disease 2019 (COVID-19) infections: A systemic review and meta-analysis. Int. J. Infect. Dis. 2020, 96, 131–135. [Google Scholar] [CrossRef]
  18. Kılınç Toker, A.; Çelik, İ.; Toker, İ.; Eren, E. Quick COVID-19 Severity Index, CURB-65 and Quick SOFA Scores Comparison in Predicting Mortality and Risk Factors of COVID-19 Patients. Arch. Iran. Med. 2022, 25, 443–449. [Google Scholar] [CrossRef]
  19. Raj, K.; Mahajan, P.; Watts, A.; Aedma, S.; Jose, J.A.; Pillai, K.J.; Rizkalla, A.; Sharma, S.; Upadhyay, R.; Dhobale, S.; et al. Independent Predictors of Mortality in COVID-19 Myocardial Injury: The Role of Troponin Levels, GRACE Score, SOFA Score, and TIMI Score. Cureus 2022, 14, e32082. [Google Scholar] [CrossRef]
  20. Yang, Z.; Hu, Q.; Huang, F.; Xiong, S.; Sun, Y. The prognostic value of the SOFA score in patients with COVID-19: A retrospective, observational study. Medicine 2021, 100, e26900. [Google Scholar] [CrossRef]
  21. Liang, W.; Liang, H.; Ou, L.; Chen, B.; Chen, A.; Li, C.; Li, Y.; Guan, W.; Sang, L.; Lu, J.; et al. Development and Validation of a Clinical Risk Score to Predict the Occurrence of Critical Illness in Hospitalized Patients With COVID-19. JAMA Intern. Med. 2020, 180, 1081–1089. [Google Scholar] [CrossRef]
  22. Burdick, H.; Lam, C.; Mataraso, S.; Siefkas, A.; Braden, G.; Dellinger, R.P.; McCoy, A.; Vincent, J.-L.; Green-Saxena, A.; Barnes, G.; et al. Prediction of respiratory decompensation in COVID-19 patients using machine learning: The READY trial. Comput. Biol. Med. 2020, 124, 103949. [Google Scholar] [CrossRef] [PubMed]
  23. Ena, J.; Segura-Heras, J.V.; Fonseca-Aizpuru, E.M.; López-Reboiro, M.L.; Gracia-Gutiérrez, A.; Martín-Oterino, J.A.; Diez-Canseco, A.M.-U.; Pérez-García, C.; Ramos-Rincón, J.; Gómez-Huelgas, R. Derivation and validation of a risk score for admission to the Intensive Care Unit in patients with COVID-19. Rev. Clin. Esp. 2022, 222, 1–12. [Google Scholar] [CrossRef] [PubMed]
  24. Bennouar, S.; Bachir Cherif, A.; Kessira, A.; Bennouar, D.-E.; Abdi, S. Development and validation of a laboratory risk score for the early prediction of COVID-19 severity and in-hospital mortality. Intensiv. Crit. Care Nurs. 2021, 64, 103012. [Google Scholar] [CrossRef]
  25. Peruzzo, M.B.; Requião-Moura, L.; Nakamura, M.R.; Viana, L.; Cristelli, M.; Tedesco-Silva, H.; Medina-Pestana, J. Predictive ability of severity scores and outcomes for mortality in kidney transplant recipients with coronavirus disease 2019 admitted to the intensive care unit: Results from a Brazilian single-center cohort study. J. Bras. Nefrol. 2022, 44, 383–394. [Google Scholar] [CrossRef] [PubMed]
  26. Zheng, Y.; Li, R.; Liu, S. Immunoregulation with mTOR inhibitors to prevent COVID-19 severity: A novel intervention strategy beyond vaccines and specific antiviral medicines. J. Med. Virol. 2020, 92, 1495–1500. [Google Scholar] [CrossRef]
  27. Basile, M.S.; Cavalli, E.; McCubrey, J.; Hernández-Bello, J.; Muñoz-Valle, J.F.; Fagone, P.; Nicoletti, F. The PI3K/Akt/mTOR pathway: A potential pharmacological target in COVID-19. Drug Discov. Today 2022, 27, 848–856. [Google Scholar] [CrossRef]
  28. Abu-Eid, R.; Ward, F.J. Targeting the PI3K/Akt/mTOR pathway: A therapeutic strategy in COVID-19 patients. Immunol. Lett. 2021, 240, 1–8. [Google Scholar] [CrossRef]
  29. Henry, B.; Cheruiyot, I.; Vikse, J.; Mutua, V.; Kipkorir, V.; Benoit, J.; Plebani, M.; Bragazzi, N.; Lippi, G. Lymphopenia and neutrophilia at admission predicts severity and mortality in patients with COVID-19: A meta-analysis. Acta Biomed. 2020, 91, e2020008. [Google Scholar] [CrossRef]
  30. Bajpai, D.; Deb, S.; Bose, S.; Gandhi, C.P.; Modi, T.; Katyal, A.; Saxena, N.; Patil, A.; Patil, S.; Thakare, S.; et al. Clinical Course and Outcomes of COVID-19 in Kidney Transplant Recipients. Indian J. Nephrol. 2022, 32, 467–475. [Google Scholar] [CrossRef]
  31. Ou, M.; Zhu, J.; Ji, P.; Li, H.; Zhong, Z.; Li, B.; Pang, J.; Zhang, J.; Zheng, X. Risk factors of severe cases with COVID-19: A meta-analysis. Epidemiol. Infect. 2020, 148, e175. [Google Scholar] [CrossRef]
  32. Hu, J.; Wang, Y. The Clinical Characteristics and Risk Factors of Severe COVID-19. Gerontology 2021, 67, 255–266. [Google Scholar] [CrossRef]
  33. Figliozzi, S.; Masci, P.G.; Ahmadi, N.; Tondi, L.; Koutli, E.; Aimo, A.; Stamatelopoulos, K.; Dimopoulos, M.; Caforio, A.L.P.; Georgiopoulos, G. Predictors of adverse prognosis in COVID-19: A systematic review and meta-analysis. Eur. J. Clin. Investig. 2020, 50, e13362. [Google Scholar] [CrossRef] [PubMed]
  34. Schold, J.D.; King, K.L.; Husain, S.A.; Poggio, E.D.; Buccini, L.D.; Mohan, S. COVID-19 mortality among kidney transplant candidates is strongly associated with social determinants of health. Am. J. Transplant. 2021, 21, 2563–2572. [Google Scholar] [CrossRef] [PubMed]
  35. Zhou, F.; Yu, T.; Du, R.; Fan, G.; Liu, Y.; Liu, Z.; Xiang, J.; Wang, Y.; Song, B.; Gu, X.; et al. Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: A retrospective cohort study. Lancet 2020, 395, 1054–1062. [Google Scholar] [CrossRef] [PubMed]
  36. Inchingolo, A.D.; Malcangi, G.; Ceci, S.; Patano, A.; Corriero, A.; Vimercati, L.; Azzollini, D.; Marinelli, G.; Coloccia, G.; Piras, F.; et al. Effectiveness of SARS-CoV-2 Vaccines for Short- and Long-Term Immunity: A General Overview for the Pandemic Contrast. Int. J. Mol. Sci. 2022, 23, 8485. [Google Scholar] [CrossRef] [PubMed]
  37. Sanders, J.-S.F.; Bemelman, F.J.; Messchendorp, A.L.; Baan, C.C.; van Baarle, D.; van Binnendijk, R.; Diavatopoulos, D.A.; Frölke, S.C.; Geers, D.; GeurtsvanKessel, C.H.; et al. The RECOVAC Immune-response Study: The Immunogenicity, Tolerability, and Safety of COVID-19 Vaccination in Patients With Chronic Kidney Disease, on Dialysis, or Living with a Kidney Transplant. Transplantation 2022, 106, 821–834. [Google Scholar] [CrossRef] [PubMed]
  38. Caillard, S.; Thaunat, O. COVID-19 vaccination in kidney transplant recipients. Nat. Rev. Nephrol. 2021, 17, 785–787. [Google Scholar] [CrossRef]
  39. Sakuraba, A.; Luna, A.; Micic, D. A Systematic Review and Meta-Analysis of Serologic Response following Coronavirus Disease 2019 (COVID-19) Vaccination in Solid Organ Transplant Recipients. Viruses 2022, 14, 1822. [Google Scholar] [CrossRef]
  40. Balzanelli, M.G.; Distratis, P.; Aityan, S.K.; Amatulli, F.; Catucci, O.; Cefalo, A.; De Michele, A.; Dipalma, G.; Inchingolo, F.; Lazzaro, R.; et al. An Alternative “Trojan Horse” Hypothesis for COVID-19: Immune Deficiency of IL-10 and SARS-CoV-2 Biology. Endocr. Metab. Immune Disord. Drug Targets 2022, 22, 1–5. [Google Scholar] [CrossRef]
Figure 1. Receiver operating characteristics of the risk score.
Figure 1. Receiver operating characteristics of the risk score.
Biomed 03 00018 g001
Table 1. Baseline characteristics of the study sample (explorative analysis).
Table 1. Baseline characteristics of the study sample (explorative analysis).
VariablesStudy
Sample
(N = 65)
Lower ImAgeS
Score
(N = 32)
Higher ImAgeS
Score
(N = 33)
p-Value *
Age (years)57 (45–66)50 (26–61)62 (51–68)0.001
Mean blood
pressure (mmHg)
95 (91–105)92 (86–99)99 (87–107)0.644
SpO2 (%)96 (95–96)96 (94–97)96 (91–97)0.587
Transplant
duration (years)
8 (2–11)8 (1–10)8 (2–14)0.415
Single vaccination dose3 (4.6%)3 (12.0%)0 (0.0%)0.080
Double vaccination dose11 (16.9%)5 (18.5%)6 (20.7%)0.838
Follow-up (days)38 (35–42)40 (36–43)38 (27–45)0.415
Comorbidities
Arterial hypertension53 (81.5%)28 (87.5%)25 (75.8%)0.223
Diabetes mellitus18 (27.7%)7 (21.9%)11 (33.3%)0.302
Chronic heart failure5 (7.7%)2 (6.3%)3 (9.1%)0.667
Active smoking5 (7.7%)4 (12.5%)1 (3.0%)0.152
Atrial fibrillation7 (10.8%)5 (15.6%)2 (6.1%)0.214
Prior AMI7 (10.8%)2 (6.3%)5 (15.2%)0.247
Prior CVI6 (9.2%)3 (9.4%)3 (9.1%)0.968
PAD10 (15.4%)4 (12.5%)6 (18.2%)0.526
COPD/asthma4 (6.2%)2 (6.3%)2 (6.1%)0.975
Laboratory parameters
WBC (×109/L)6.5 (5.3–8.9)5.5 (5.4–6.3)7.5 (4.4–9.5)0.728
Hgb (g/L)128.5
(125.0–134.3)
132.0
(125.0–134.1)
126.0
(114.0–133.2)
0.126
Platelets (×103/L)240.1 (198.0–262.3)191.1 (180.3–245.4)257.0 (224.6–275.5)0.865
CRP (mmol/L;
maximal values)
72.6 (34.8–121.8)72.6 (22.1–51.3)72.7 (47.3–122.3)0.639
eGFR (mL/min/1.73 m2)44.5 (24.8–63.8)66.7 (20.8–77.8)36.0 (25.3–53.2)0.042
D-dimers (mmol/L)0.8 (0.6–1.7)0.8 (0.4–1.3)0.8 (0.6–2.5)0.278
Chronic immunosuppressive therapy
Mycophenolate
Mofetil
58 (89.2%)28 (87.5%)30 (90.9%)0.658
Azathioprine1 (1.5%)1 (3.1%)0 (0.0%)0.306
Cyclosporine20 (30.8%)8 (25.0%)12 (36.4%)0.321
Tacrolimus36 (55.4%)20 (62.5%)16 (48.5%)0.256
Everolimus8 (12.3%)4 (12.5%)14 (12.1%)0.963
Sirolimus3 (4.6%)1 (3.1%)2 (6.1%)0.573
Prednisone65 (100.0%)32 (100.0%)33 (100.0%)/
COVID-19 related therapy
Convalescent plasma6 (9.2%)1 (3.1%)5 (15.2%)0.094
Casirivimab/Imdevimab2 (3.1%)1 (3.1%)1 (3.0%)0.982
Remdesivir44 (67.7%)20 (62.5%)24 (72.7%)0.378
Oxygen
therapy
24 (36.9%)10 (31.3%)14 (42.4%)0.351
Data are expressed as number (percent) or median (interquartile range). * Comparison of groups based on the median. Abbreviations: AMI—acute myocardial infarction; COPD—chronic obstructive pulmonary disease; CRP—C-reactive peptide; CVI—cerebrovascular incident; eGFR—estimated glomerular filtration rate; Hgb—hemoglobin; PAD—peripheral arterial disease; WBC—white blood cells.
Table 2. Association of ImAgeS risk score with 30-day post-discharge mortality (Cox proportional hazards logistic regression analysis).
Table 2. Association of ImAgeS risk score with 30-day post-discharge mortality (Cox proportional hazards logistic regression analysis).
Variables30-Day Post-Discharge Mortality
HR
(95% CI)
p-Value *Harrell’s C Concordance IndexSomers’
D
Hosmer-Lemeshow Test
ImAgeS
risk score
1.04 (1.01–1.08)0.0400.6990.3973.74
* Cox proportional hazards logistic regression analysis. Note: ImAgeS—novel clinical risk score.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Domjanović, J.; Domjanović Škopinić, T.; Gamberažić Kirevski, T.; Matetic, A. External Validation of the ImAgeS Risk Score for Mortality in Hospitalized Kidney Transplant Recipients with COVID-19: A Retrospective Observational Study. BioMed 2023, 3, 207-216. https://doi.org/10.3390/biomed3020018

AMA Style

Domjanović J, Domjanović Škopinić T, Gamberažić Kirevski T, Matetic A. External Validation of the ImAgeS Risk Score for Mortality in Hospitalized Kidney Transplant Recipients with COVID-19: A Retrospective Observational Study. BioMed. 2023; 3(2):207-216. https://doi.org/10.3390/biomed3020018

Chicago/Turabian Style

Domjanović, Josipa, Tea Domjanović Škopinić, Tea Gamberažić Kirevski, and Andrija Matetic. 2023. "External Validation of the ImAgeS Risk Score for Mortality in Hospitalized Kidney Transplant Recipients with COVID-19: A Retrospective Observational Study" BioMed 3, no. 2: 207-216. https://doi.org/10.3390/biomed3020018

Article Metrics

Back to TopTop