Next Article in Journal
A Comparison of 68Ga-PSMA PET/CT-Based Split Renal Function with 99mTc-MAG3 Renography in Patients with Metastatic Castration-Resistant Prostate Carcinoma Treated with 177Lu-PSMA
Previous Article in Journal
Comparison of Transoral and Transcervical Ultrasonography with MRI for the Diagnostic Work-Up of Oropharynx Tumors: A Protocol for a Multicenter Clinical Trial (SPOTUS)
Previous Article in Special Issue
Artificial Intelligence Image Recognition System for Preventing Wrong-Site Upper Limb Surgery
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Deep Learning-Based Prediction Model for Gait Recovery after a Spinal Cord Injury

1
Korea University Research Institute for Medical Bigdata Science, Korea University, Seoul 02841, Republic of Korea
2
AI Center, Korea University Anam Hospital, Korea University College of Medicine, Seoul 02841, Republic of Korea
3
School of Health and Environmental Science, Korea University College of Health Science, Seoul 02841, Republic of Korea
*
Authors to whom correspondence should be addressed.
Diagnostics 2024, 14(6), 579; https://doi.org/10.3390/diagnostics14060579
Submission received: 13 December 2023 / Revised: 19 February 2024 / Accepted: 5 March 2024 / Published: 8 March 2024
(This article belongs to the Special Issue Artificial Intelligence in Orthopedic Surgery and Sport Medicine)

Abstract

:
Predicting gait recovery after a spinal cord injury (SCI) during an acute rehabilitation phase is important for planning rehabilitation strategies. However, few studies have been conducted on this topic to date. In this study, we developed a deep learning-based prediction model for gait recovery after SCI upon discharge from an acute rehabilitation facility. Data were collected from 405 patients with acute SCI admitted to the acute rehabilitation facility of Korea University Anam Hospital between June 2008 and December 2022. The dependent variable was Functional Ambulation Category at the time of discharge (FAC-DC). Seventy-one independent variables were selected from the existing literature: basic information, International Standards for Neurological Classification of SCI scores, neurogenic bladders, initial FAC, and somatosensory-evoked potentials of the lower extremity. Recurrent neural network (RNN), linear regression (LR), Ridge, and Lasso methods were compared for FAC-DC prediction in terms of the root-mean-squared error (RMSE). RNN variable importance, which is the RMSE gap between a complete RNN model and an RNN model excluding a certain variable, was used to evaluate the contribution of this variable. Based on the results of this study, the performance of the RNN was far better than that of LR, Ridge, and Lasso. The respective RMSEs were 0.3738, 2.2831, 1.3161, and 1.0246 for all the participants; 0.3727, 1.7176, 1.3914, and 1.3524 for those with trauma; and 0.3728, 1.7516, 1.1012, and 0.8889 for those without trauma. In terms of RNN variable importance, lower-extremity motor strength (right and left ankle dorsiflexors, right knee extensors, and left long toe extensors) and the neurological level of injury were ranked among the top five across the boards. Therefore, initial FAC was the seventh, third, and ninth most important predictor for all participants, those with trauma, and those without trauma, respectively. In conclusion, this study developed a deep learning-based prediction model with excellent performance for gait recovery after SCI at the time of discharge from an acute rehabilitation facility. This study also demonstrated the strength of deep learning as an explainable artificial intelligence method for identifying the most important predictors.

1. Introduction

A spinal cord injury (SCI) can be defined as “damage to any part of the spinal cord or nerves at the end of the spinal canal” [1]. This is a common factor in permanent alterations in body functions below the damaged position. This results from damage to the spinal cord or surrounding bones and tissues. The degree of disability is determined by the degree and location of an injury. Damage to the upper spinal cord can lead to impairment of the limbs and body. Damage to the lower spinal cord can result in leg and lower body impairment. Complete recovery is difficult once an injury has occurred [2]. Global incidence, prevalence, and years of life lost due to disability from an SCI were 0.9 million cases, 20.6 million cases, and 6.2 million years, respectively, in 2019 [3]. The mean age of patients with SCI increased from 28.3 years in 1978 to 37.1 years in 2008 in the United States. The disease burden is higher in the elderly because of health issues. As life expectancy increases, the risk factors of falls, osteoporosis, and spinal stenosis increase [3], and medical costs are also high. The medical cost for a quadriplegic patient aged 25 years is estimated to be USD 5.16 million in the United States. Finally, the socioeconomic burden is significant for patients and their families alike [4]. Gait dysfunction is a crucial sequela, and recovery of walking ability is a high priority for patients with SCI in terms of both physical independence and self-esteem [5].
In this context, predicting gait recovery after an SCI during the acute rehabilitation phase is of paramount importance in designing rehabilitation strategies. For individuals who are expected to recover sufficiently with independent gait function, rehabilitation approaches mainly focus on using restorative techniques, such as endurance training, balance training, and lower-extremity strengthening, to promote neuroplasticity and enhance independent gait. In contrast, for individuals with limited potential for neurorecovery, there is more emphasis on compensatory techniques, such as wheelchair mobility or bed transfer [6]. Additionally, prediction of gait function is important when establishing a discharge plan. Based on their functional independence, patients are transferred to a subacute inpatient rehabilitation facility or discharged and allowed to return home. However, previous studies on the prediction of walking ability after an SCI have some limitations. First, most studies have focused on the effects of individual factors that influence walking recovery. For example, a review article stated that the American Spinal Injury Association Impairment Scale (AIS) score at admission, age, etiology, sex, evoked potentials, and magnetic resonance imaging findings, such as the presence and size of hemorrhages, were found to be important prognostic factors for walking ability [7]. However, few studies have considered the interaction between each factor and optimized modeling by considering the confounding factors between each variable. Second, previous prediction-modeling studies focused on final gait function when neurological recovery reached a plateau. In a representative study by Van Middendorp et al., a clinical prediction rule was developed based on age and clinical neurological parameters, such as motor and sensory scores, to predict the probability of walking independently after a one-year traumatic SCI [8]. Other studies combining neurophysiological data have also attempted to predict gait function at six months or one year after SCI prognosis and recovery among patients with ischemic and traumatic SCIs [9,10].
Artificial intelligence (AI) has surpassed conventional statistical approaches in terms of performance measures for predicting various disease conditions. However, limited AI studies have been conducted on this topic. Only one recent review summarized the recent applications of machine learning in the clinical diagnosis, prognostication, and management of acute traumatic SCIs [11]. Thirteen original studies were selected according to the following eligibility criteria: (1) having a dependent variable consisting of functional ability after an acute SCI; (2) reporting interventions using a decision tree, tree ensemble (random forest and boosting), support vector machine, artificial neural networks, and/or convolutional neural networks; (3) reporting outcomes of accuracy and F1 score (harmonic mean of sensitivity and specificity); (4) having a publication year of 2010 or later; and (5) being published in the English language. Among the 13 AI articles, only 3 studies were conducted to predict ambulatory function. One study compared the performances of unsupervised machine learning and logistic regression in the prognosis of walking ability [12]. Another study used a regression tree model to predict functional outcomes after traumatic SCI. [13]. Only one deep learning study has attempted to quantify radiographic characteristics by using a convolutional neural network to stratify neurological prognosis [14].
Recurrent neural networks (RNNs) have been widely adopted in sequential data research, including for prediction [15]. However, to the best of our knowledge, no studies are available on the application of an RNN in this direction. The primary purpose of this study was to develop a deep learning-based prediction model for gait recovery after SCI at discharge from an acute rehabilitation facility. Furthermore, we explored the important variables that were highly correlated with gait prognosis using a deep learning approach.

2. Methods

2.1. Participants

Data were obtained from electronic medical records of 427 patients with acute SCI who were admitted to the acute rehabilitation facility of Korea University Anam Hospital between June 2008 and December 2022. Demographic data and study variables were retrospectively reviewed. From the data set, we extracted data of all adult patients (≥18 years) with acute SCI, including cauda equina syndrome. Finally, patients with complete medical information on the study variables were included. Children and adolescents with SCI and those with missing data were excluded. Finally, data from 405 participants were analyzed. This study was approved by the Institutional Review Board of Korea University Anam Hospital (2022AN0473). Requirement for informed consent was waived by the institutional review board.

2.2. Variables

The dependent variable was the Functional Ambulation Category at the time of discharge (FAC-DC), a clinical indicator of six-level walking ability in terms of independence from physical support (where “0” indicates “no independence” and “5” indicates “complete independence”) [16]. Seventy-one independent variables were selected from the existing literature [16,17,18,19] (Table 1): (1) basic information (8 predictors), i.e., age, elderly (≥65 years) (yes vs. no), gender (female), period of acute care (days), period of rehabilitation (days), SCI etiology (traumatic vs. non-traumatic), cardiovascular disease (yes vs. no), and diabetes mellitus (yes vs. no); (2) all the neurological information entered on the International Standards for Neurological Classification of SCI Worksheet (60 predictors), that is, damaged part (C, T, L, and cauda equina), the neurological level of injury (cervical, thoracic, lumbar, or cauda equina), AIS (A, B, C, D, and E), injury completeness (yes vs. no), 4 motor scores (left or right upper or lower extremity), 4 sensory scores (light touch or pin prick, left or right), 10 lower-extremity strength values of each myotome, 18 light touch scores of each dermatome, 18 pin prick scores of each dermatome, voluntary anal contraction (yes vs. no), and deep anal pressure; and (3) three other predictors, including neurogenic bladder (yes vs. no), initial FAC, and somatosensory evoked potential (SSEP) of lower extremity (normal, prolonged/shallow, and not available). All independent variables were recorded within the first three days after admission to the rehabilitation ward.

2.3. Analysis

The RNN (long short-term memory), linear regression (LR), Ridge, and Lasso were compared for the prediction of FAC-DC. The RNN has one long short-term memory layer with tangent hyperbolic as an activation function, sigmoid as a recurrent activation function, a dropout of 0.0, a recurrent dropout of 0.0, and a time step of 1. Other hyper-parameters were Adam as an optimizer, an epoch number of 100, and a batch size of 30. Data from 405 participants were divided into training and validation sets in a 75:25 ratio (304 vs. 101 observations). A criterion used for validating the models trained was the root-mean-squared error (RMSE), that is, the root for the average of the squares of errors among 101 observations. RNN variable importance, which is the RMSE gap between a complete RNN model and an RNN model excluding a certain variable, was used to evaluate the contribution of variables. For example, we assume that the RNN variable importance of the ankle dorsiflexor, Rt, is 0.0044. This indicates that the inclusion of the variable ankle dorsiflexion, Rt, in the RNN reduces the RMSE of the model by 0.0044. A random split and analysis were repeated ten times, and the average was used for external validation. Different seed numbers were used for different runs; however, the default parameters remained the same throughout the random splits and analyses. Regarding statistical power, the RMSE over the standard deviation can be considered equivalent to the inverse of the power in the case of the RNN for the prediction of a continuous variable. Python 3.52 (Centrum voor Wiskunde en Informatica, Amsterdam, The Netherlands) was used for analysis in August 2023.

3. Results

3.1. Descriptive Statistics

The medical records of 405 adult patients with acute SCI were reviewed retrospectively. Descriptive statistics for continuous variables and their correlations with the FAC-DC are presented in Table 1. The proportions of those with categorical characteristics were as follows: elderly status (49%, 197), female sex (36%, 146), trauma (43%, 175), hypertension (48%, 195), diabetes (27%, 109), voluntary anal contraction (78%, 315), deep anal pressure (85%, 346), neurogenic bladder (57%, 229), and abnormal somatosensory evoked potential of lower extremity (79%, 169 for prolonged or shallow and 153 for no response). Likewise, 39, 21, 68, 275, and 2 participants had AIS levels of A, B, C, D, and E, respectively. Neurological levels C5 and C4 corresponded to the greatest number of participants (76 and 73, respectively). In the correlation analysis, initial FAC and lower-extremity motor strength were highly correlated with FAC-DC; the correlations of FAC-DC with ankle dorsiflexor, right knee extensor, left long toe extensor, and initial FAC were 0.62, 0.63, 0.62, 0.62, and 0.74, respectively. Therefore, age and the period of acute care before rehabilitation were negatively correlated with FAC-DC, suggesting that older age and delayed rehabilitation negatively impact prognosis.

3.2. Model Peformance

Based on these results, we presumed that the initial FAC and lower-extremity strength significantly affected gait recovery at discharge. Therefore, four scenarios were considered for a more detailed analysis: (1) initial FAC included and four motor scores (upper or lower extremity, left or right) included; (2) initial FAC excluded and four motor scores included; (3) initial FAC included and two motor scores (upper extremity, left or right) excluded; and (4) initial FAC included and four motor scores excluded. Therefore, we tried to analyze the impact of initial FAC by comparing scenarios (1) and (2) and of lower-extremity strength by comparing scenarios (3) and (4).
The performance of the RNN exceeded that of LR, Ridge, and Lasso across all scenarios. For example, the respective RMSEs averaged over ten runs in the first scenario (main scenario) were 0.3738, 2.2831, 1.3161, and 1.0246 for all the participants; 0.3727, 1.7176, 1.3914, and 1.3524 for those with trauma; and 0.3728, 1.7516, 1.1012, and 0.8889 for those without trauma (Table 2). The presence or absence of independent variables (initial FAC and lower-extremity strength) did not have a significant effect on model performance.

3.3. Vairable Importance

The top 20 significant predictors of the FAC-DC are presented in Table 3 and Figure 1, Figure 2 and Figure 3. In terms of RNN variable importance, ankle dorsiflexors, right knee extensors, left long toe extensors, and neurological level of injury were ranked among the top five across the board in all the patient groups. Initial FAC was the seventh, third, and ninth most important predictor for all participants, those with trauma, and those without trauma, respectively. Demographic features such as age, period of acute care before rehabilitation, and duration of rehabilitation were also selected as important variables. Additionally, the results of the electrophysiologic study (SSEP) also significantly impacted gait prognosis in both the traumatic and non-traumatic SCI groups.

4. Discussion

Predicting gait recovery after an SCI during the acute rehabilitation phase is of paramount importance in designing rehabilitation strategies. However, to date, few studies have been conducted on this topic. In this study, we developed a deep learning-based prediction model with excellent performance for gait recovery after an SCI at the time of discharge from an acute rehabilitation facility. This study also demonstrated the strength of deep learning as an explainable artificial intelligence method for identifying the most important predictors. The performance of the RNN was far better than that of LR, Ridge, and Lasso, and the respective RMSEs were 0.3738, 2.2831, 1.3161, and 1.0246 for all the participants; 0.3727, 1.7176, 1.3914, and 1.3524 for those with trauma; and 0.3728, 1.7516, 1.1012, and 0.8889 for those without trauma. In terms of RNN variable importance, lower-extremity motor strength (both ankle dorsiflexors, right knee extensor, and left long toe extensor) and neurological level of injury were among the top five predictors for all the groups. The initial FAC ranked seventh, third, and ninth for all the participants, those with trauma, and those without trauma, respectively.
The accurate prediction of prognosis for a certain disease or trauma has been one of the main goals of rehabilitation medicine. For this reason, many studies have been conducted to evaluate prognostic factors of various functional outcomes such as AIS, Barthel Index, Spinal Cord Independence Measure, and respiratory dysfunction [20,21,22]. However, there has been a lack of research on developing prediction models that integrate such predictors. Only one study developed a user-friendly clinical prediction rule that can predict the long-term probability of walking independently on the basis of age and clinical parameters such as motor and sensory scores [8]. One of the main reasons for this dearth is that the traditional statistical methods have some limitations with respect to dealing with larger numbers of predictors that are rather complex and have nonlinear relationships within datasets. To overcome such disadvantages, AI has also been recently applied in the predictive modeling of various outcomes (e.g., quality of life, duration of opioid prescription and duration of intensive care unit stay or mortality) after SCI [23,24,25]. According to a recent review published in 2022, only three published articles report the use of a machine learning approach or image-based deep learning analysis for gait prediction [11]. More recently, another study was published that established machine learning models for predicting spinal cord independence measures using features present at the time of rehabilitation admission. The cited study was a retrospective study with clinical data on 210 patients with SCI. They used RMSE and mean absolute error to assess model performance and concluded that the random forest model was superior in the training group, while a stacked generalization model better predicted spinal cord independence measure in the testing group [26]. However, to the best of our knowledge, no study has been conducted using RNN to predict functional status at discharge from an acute rehabilitation hospital for patients with SCI.
This study has several clinical implications. First, this study focused on deep learning as a strong foundation for a decision support system for gait recovery after SCI. Based on the results of a recent review [11], different machine learning methods are appropriate for different tasks in the clinical diagnosis, prognostication, and management of acute traumatic SCI, namely, the ensemble tree in the case of numeric data (accuracy 81.1%), and the convolutional neural network in the case of image data. However, to the best of our knowledge, no studies have been conducted on the application of an RNN in this direction. As described above, the performance of the RNN surpassed that of LR, Ridge, and Lasso by a large margin across the board. To the best of our knowledge, this study is the first to be conducted in this manner, and further studies are required on this topic. Second, this study validated the existing literature on the important roles of lower-extremity motor scores, neurological level of injury, and initial FAC as major predictors of gait recovery after SCI [27,28,29,30,31,32,33]. As explained above, the variable importance values of lower-extremity motor strength and neurological level of injury were among the top five for all groups. Additionally, the ranking of the initial FAC was seventh, third, and ninth for all the participants and those with and without trauma, respectively. Third, the rehabilitation period was found to have a strong association with gait recovery, emphasizing the importance of rehabilitation. Fourth, the effects of light touch and pin-prick sensory scores on gait recovery were not significant at discharge in this study, even though these effects were significant one year after an SCI in a previous study [8]. One possible explanation for this discrepancy is that this study focused on gait recovery at discharge, whereas the previous study focused on gait recovery during the chronic phase. Further examination of this topic is needed for the effective management of gait recovery after SCI.
Despite its clinical implications, this study has some limitations. First, it did not consider multimodal deep learning. Combining deep learning models for image, text, and numeric data is expected to significantly improve model performance. Secondly, the scope of this study did not include explainable reinforcement learning [34]. This cutting-edge approach has been popular in finance because of its realistic assumptions and excellent performance [35]. Its popularity has spread to areas such as diagnostic automation and treatment recommendations in healthcare [36]. However, little analysis has been conducted on explainable reinforcement learning, warranting further investigation. Finally, the proposed model was not externally validated. We concluded that the sample size was not large enough to construct a validation set. Instead, we used internal validation with data splitting. Further study with external validation set is needed to advance this prediction model.

5. Conclusions

Despite these limitations, this study developed a deep learning-based prediction model with excellent performance for gait recovery after an SCI at the time of discharge from an acute rehabilitation facility. Additionally, this study demonstrates the strength of deep learning as an explainable artificial intelligence method for identifying the most important predictors. By precisely predicting gait function, this study will aid in personalizing rehabilitative care for patients with acute SCI.

Author Contributions

H.-J.Y. and K.-S.L. designed the study. H.-J.Y., K.-S.L., B.K., C.-W.Y. and C.-W.K. collected, analyzed, and interpreted the data. H.-J.Y., K.-S.L., B.K., C.-W.Y. and C.-W.K. wrote and reviewed the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2022R1I1A1A01059442) and (2) the Korea Health Industry Development Institute grant (Korea Health Technology R&D Project) funded by the Ministry of Health and Welfare of South Korea (No. HI22C1302). The funders had no role in the design of this study; the collection, analysis, and interpretation of the data; or the writing and review of the manuscript.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board of Korea University Anam Hospital (2022AN0473).

Informed Consent Statement

Patient consent was waived by the institutional review board since this study was retrospective study.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors on request.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Mayo Clinic. Spinal Cord Injury. Updated on 2 October 2021. Available online: https://www.mayoclinic.org/diseases-conditions/spinal-cord-injury/symptoms-causes/syc-20377890 (accessed on 1 November 2023).
  2. National Institute of Health. Spinal Cord Injury. Updated on 20 January 2023. Available online: https://www.ninds.nih.gov/health-information/disorders/spinal-cord-injury (accessed on 1 November 2023).
  3. Ding, W.; Hu, S.; Wang, P.; Kang, H.; Peng, R.; Dong, Y.; Li, F. Spinal cord injury: The global incidence, prevalence, and disability From the Global Burden of Disease Study 2019. Spine 2022, 47, 1532–1540. [Google Scholar] [CrossRef]
  4. Kim, H.K.; Leigh, J.H.; Choi, Y.; Lee, J.H.; Bang, M.S. Spinal cord injury fact sheet in Korea. Ann. Rehabil. Med. 2023, 47, 4–10. [Google Scholar] [CrossRef]
  5. Kawanishi, C.Y.; Greguol, M. Physical activity, quality of life, and functional autonomy of adults with spinal cord injuries. Adapt. Phys. Act. Q. 2013, 30, 317–337. [Google Scholar] [CrossRef]
  6. Burns, A.S.; Marino, R.J.; Kalsi-Ryan, S.; Middleton, J.W.; Tetreault, L.A.; Dettori, J.R.; Mihalovich, K.E.; Fehlings, M.G. Type and timing of rehabilitation following acute and subacute spinal cord injury: A systematic review. Glob. Spine J. 2017, 7, 175S–194S. [Google Scholar] [CrossRef] [PubMed]
  7. Scivoletto, G.; Tamburella, F.; Laurenza, L.; Torre, M.; Molinari, M. Who is going to walk? A review of the factors influencing walking recovery after spinal cord injury. Front. Hum. Neurosci. 2014, 8, 141. [Google Scholar] [CrossRef] [PubMed]
  8. van Middendorp, J.J.; Hosman, A.J.; Donders, A.R.; Pouw, M.H.; Ditunno, J.F., Jr.; Curt, A.; Geurts, A.C.; Van de Meent, H.; EM-SCI Study Group. A clinical prediction rule for ambulation outcomes after traumatic spinal cord injury: A longitudinal cohort study. Lancet 2011, 377, 1004–1010. [Google Scholar] [CrossRef] [PubMed]
  9. Hupp, M.; Pavese, C.; Bachmann, L.M.; Koller, R.; EMSCI Study Group; Schubert, M. Electrophysiological multimodal assessments improve outcome prediction in traumatic cervical spinal cord injury. J. Neurotrauma 2018, 35, 2916–2923. [Google Scholar] [CrossRef] [PubMed]
  10. Iseli, E.; Cavigelli, A.; Dietz, V.; Curt, A. Prognosis and recovery in ischaemic and traumatic spinal cord injury: Clinical and electrophysiological evaluation. J. Neurol. Neurosurg. Psychiatry 1999, 67, 567–571. [Google Scholar] [CrossRef] [PubMed]
  11. Dietz, N.; Vaitheesh Jaganathan Alkin, V.; Mettille, J.; Boakye, M.; Drazin, D. Machine learning in clinical diagnosis, prognostication, and management of acute traumatic spinal cord injury (SCI): A systematic review. J. Clin. Orthop. Trauma 2022, 35, 102046. [Google Scholar] [CrossRef]
  12. DeVries, Z.; Hoda, M.; Rivers, C.S.; Maher, A.; Wai, E.; Moravek, D.; Stratton, A.; Kingwell, S.; Fallah, N.; Paquet, J.; et al. Development of an unsupervised machine learning algorithm for the prognostication of walking ability in spinal cord injury patients. Spine J. 2020, 20, 213–224. [Google Scholar] [CrossRef]
  13. Facchinello, Y.; Beauséjour, M.; Richard-Denis, A.; Thompson, C.; Mac-Thiong, J.M. Use of regression tree analysis for predicting the functional outcome after traumatic spinal cord injury. J. Neurotrauma 2021, 38, 1285–1291. [Google Scholar] [CrossRef] [PubMed]
  14. McCoy, D.B.; Dupont, S.M.; Gros, C.; Cohen-Adad, J.; Huie, R.J.; Ferguson, A.; Duong-Fernandez, X.; Thomas, L.H.; Singh, V.; Narvid, J.; et al. Talbott. Convolutional neural network–based automated segmentation of the spinal cord and contusion injury: Deep learning biomarker correlates of motor impairment in acute spinal cord injury. Am. J. Neuroradiol. 2019, 40, 737–744. [Google Scholar] [PubMed]
  15. Yu, Y.; Si, X.; Hu, C.; Zhang, J. A review of recurrent neural networks: LSTM cells and network architectures. Neural Comput. 2019, 31, 1235–1270. [Google Scholar] [CrossRef] [PubMed]
  16. Holden, M.K.; Gill, K.M.; Magliozzi, M.R.; Nathan, J.; Piehl-Baker, L. Clinical gait assessment in the neurologically impaired. Reliability and meaningfulness. Phys. Ther. 1984, 64, 35–40. [Google Scholar] [CrossRef] [PubMed]
  17. Wilson, J.R.; Cadotte, D.W.; Fehlings, M.G. Clinical predictors of neurological outcome, functional status, and survival after traumatic spinal cord injury: A systematic review. J. Neurosurg. Spine 2012, 17 (Suppl. S1), 11–26. [Google Scholar] [CrossRef] [PubMed]
  18. Wilson, J.R.; Grossman, R.G.; Frankowski, R.F.; Kiss, A.; Davis, A.M.; Kulkarni, A.V.; Harrop, J.S.; Aarabi, B.; Vaccaro, A.; Tator, C.H.; et al. A clinical prediction model for long-term functional outcome after traumatic spinal cord injury based on acute clinical and imaging factors. J. Neurotrauma 2012, 29, 2263–2271. [Google Scholar] [CrossRef]
  19. Rupp, R.; Biering-Sørensen, F.; Burns, S.P.; Graves, D.E.; Guest, J.; Jones, L.; Read, M.S.; Rodriguez, G.M.; Schuld, C.; Tansey-Md, K.E.; et al. International Standards for Neurological Classification of Spinal Cord Injury: Revised 2019. Top. Spinal Cord Inj. Rehabil. 2021, 27, 1–22. [Google Scholar] [CrossRef]
  20. Wasiak, K.; Frasuńska, J.; Tarnacka, B. Can the Initial Parameters of Functional Scales Predict Recovery in Patients with Complete Spinal Cord Injury? A Retrospective Cohort Study. Diagnostics 2024, 14, 129. [Google Scholar] [CrossRef]
  21. Sharif, S.; Ali, M.Y.J. Outcome prediction in spinal cord injury: Myth or reality. World Neurosurg. 2020, 140, 574–590. [Google Scholar] [CrossRef]
  22. Hirota, R.; Terashima, Y.; Ohnishi, H.; Yamashita, T.; Yokogawa, N.; Sasagawa, T.; Kato, S. Prognostic factors for respiratory dysfunction for cervical spinal cord injury and/or cervical fractures in elderly patients: A multicenter survey. Glob. Spine J. 2024, 14, 101–112. [Google Scholar] [CrossRef]
  23. Khan, O.; Badhiwala, J.H.; Wilson, J.R.F.; Jiang, F.; Martin, A.R.; Fehlings, M.G. Predictive Modeling of Outcomes After Traumatic and Nontraumatic Spinal Cord Injury Using Machine Learning: Review of Current Progress and Future Directions. Neurospine 2019, 16, 678–685. [Google Scholar] [CrossRef] [PubMed]
  24. Fallah, N.; Noonan, V.K.; Waheed, Z.; Rivers, C.S.; Plashkes, T.; Bedi, M.; Etminan, M.; Thorogood, N.P.; Ailon, T.; Chan, E.; et al. Development of a machine learning algorithm for predicting in-hospital and 1-year mortality after traumatic spinal cord injury. Spine J. 2022, 22, 329–336. [Google Scholar] [CrossRef] [PubMed]
  25. Fan, G.; Yang, S.; Liu, H.; Xu, N.; Chen, Y.; He, J.; Su, X.; Pang, M.; Liu, B.; Han, L.; et al. Machine Learning-based Prediction of Prolonged Intensive Care Unit Stay for Critical Patients with Spinal Cord Injury. Spine 2022, 47, E390–E398. [Google Scholar] [CrossRef] [PubMed]
  26. Kato, C.; Uemura, O.; Sato, Y.; Tsuji, T. Functional Outcome Prediction After Spinal Cord Injury Using Ensemble Machine Learning. Arch. Phys. Med. Rehabil. 2024, 105, 95–100. [Google Scholar] [CrossRef] [PubMed]
  27. Bransford, R.J.; Chapman, J.R.; Skelly, A.C.; VanAlstyne, E.M. What do we currently know about thoracic spinal cord injury recovery and outcomes? A systematic review. J. Neurosurg. Spine 2012, 17 (Suppl. S1), 52–64. [Google Scholar] [CrossRef] [PubMed]
  28. Nevin, A.N.; Steenson, J.; Vivanti, A.; Hickman, I.J. Investigation of measured and predicted resting energy needs in adults after spinal cord injury: A systematic review. Spinal Cord 2016, 54, 248–253. [Google Scholar] [CrossRef]
  29. AlHuthaifi, F.; Krzak, J.; Hanke, T.; Vogel, L.C. Predictors of functional outcomes in adults with traumatic spinal cord injury following inpatient rehabilitation: A systematic review. J. Spinal Cord Med. 2017, 40, 282–294. [Google Scholar] [CrossRef] [PubMed]
  30. Noller, C.M.; Groah, S.L.; Nash, M.S. Inflammatory stress effects on health and function after spinal cord injury. Top. Spinal Cord Inj. Rehabil. 2017, 23, 207–217. [Google Scholar] [CrossRef]
  31. Ikpeze, T.C.; Mesfin, A. Spinal cord injury in the geriatric population: Risk factors, treatment options, and long-term management. Geriatr. Orthop. Surg. Rehabil. 2017, 8, 115–118. [Google Scholar] [CrossRef]
  32. Yue, J.K.; Winkler, E.A.; Rick, J.W.; Deng, H.; Partow, C.P.; Upadhyayula, P.S.; Birk, H.S.; Chan, A.K.; Dhall, S.S. Update on critical care for acute spinal cord injury in the setting of polytrauma. Neurosurg. Focus 2017, 43, e19–e28. [Google Scholar] [CrossRef]
  33. Green, B.N.; Johnson, C.D.; Haldeman, S.; Griffith, E.; Clay, M.B.; Kane, E.J.; Castellote, J.M.; Rajasekaran, S.; Smuck, M.; Hurwitz, E.L.; et al. A scoping review of biopsychosocial risk factors and co-morbidities for common spinal disorders. PLoS ONE 2018, 13, e0197987–e0198015. [Google Scholar] [CrossRef] [PubMed]
  34. Silver, D.; Huang, A.; Maddison, C.J.; Guez, A.; Sifre, L.; van den Driessche, G.; Schrittwieser, J.; Antonoglou, I.; Panneershelvam, V.; Lanctot, M.; et al. Mastering the game of Go with deep neural networks and tree search. Nature 2016, 529, 484–489. [Google Scholar] [CrossRef] [PubMed]
  35. Hambly, B.; Xu, R.; Yang, H. Recent advances in reinforcement learning in finance. arXiv 2022, arXiv:2112.04553. [Google Scholar]
  36. Yu, C.; Liu, J.; Nemati, S. Reinforcement learning in healthcare: A survey. arXiv 2020, arXiv:1908.08796. [Google Scholar] [CrossRef]
Figure 1. Recurrent neural network variable importance: 405 participants.
Figure 1. Recurrent neural network variable importance: 405 participants.
Diagnostics 14 00579 g001
Figure 2. Recurrent neural network variable importance: 175 participants (Trauma: Yes).
Figure 2. Recurrent neural network variable importance: 175 participants (Trauma: Yes).
Diagnostics 14 00579 g002
Figure 3. Recurrent neural network variable importance: 230 participants (Trauma: No).
Figure 3. Recurrent neural network variable importance: 230 participants (Trauma: No).
Diagnostics 14 00579 g003
Table 1. Descriptive statistics and FAC-DC predictor correlation. Legend: The correlations of FAC_DC with right ankle dorsiflexor, left ankle dorsiflexor, right knee extensor, left long toe extensor, and initial FAC were 0.62, 0.63, 0.62, 0.62, and 0.74, respectively. Neurological levels of injury C5 and C4 had the greatest numbers of participants, i.e., 76 and 73.
Table 1. Descriptive statistics and FAC-DC predictor correlation. Legend: The correlations of FAC_DC with right ankle dorsiflexor, left ankle dorsiflexor, right knee extensor, left long toe extensor, and initial FAC were 0.62, 0.63, 0.62, 0.62, and 0.74, respectively. Neurological levels of injury C5 and C4 had the greatest numbers of participants, i.e., 76 and 73.
VariableMin25%50%75%MaxSDCorrelation
FAC_DC012451.71.00
Age385264749815.8−0.03
Period—Acute Care0173813310,642945.2−0.09
Period—Rehab020273334934.0−0.13
Motor-UER0172425256.50.30
Motor-UEL0172325256.70.32
Motor-LER071922258.80.64
Motor-LEL081822258.70.64
Sensory-LTR23244555612.00.38
Sensory-LTL23245555612.50.36
Sensory-PPR03345565613.10.40
Sensory-PPL03245565613.20.37
Hip flexor,_Rt.023451.70.65
Knee extensor,_Rt.024551.80.62
Ankle dorsiflexor,_Rt.014451.90.62
Long toe extensor,_Rt.013451.80.61
Ankle plantarflexor,_Rt.024551.80.61
Hip flexor,_Lt.023451.70.66
Knee extensor,_Lt.024551.80.63
Ankle dorsiflexor,_Lt.014451.90.63
Long toe extensor,_Lt.014451.80.62
Ankle plantarflexor,_Lt.024551.80.61
LT_L1_Rt011220.60.44
LT_L2_Rt011220.60.44
LT_L3_Rt011220.60.43
LT_L4_Rt011220.60.45
LT_L5_Rt011220.60.42
LT_S1_Rt011220.60.44
LT_S2_Rt011220.70.45
LT_S3_Rt011220.70.45
LT_S4-5_Rt011220.70.43
LT_L1_Lt011220.70.41
LT_L2_Lt011220.70.41
LT_L3_Lt011220.70.40
LT_L4_Lt011220.70.42
LT_L5_Lt011220.70.39
LT_S1_Lt011220.70.42
LT_S2_Lt011220.70.42
LT_S3_Lt011220.70.40
LT_S4-5_Lt011220.70.38
PP_L1_Rt011220.70.43
PP_L2_Rt011220.70.45
PP_L3_Rt011220.70.46
PP_L4_Rt011220.70.46
PP_L5_Rt011220.70.45
PP_S1_Rt011220.70.47
PP_S2_Rt011220.70.47
PP_S3_Rt011220.70.46
PP_S4-5_Rt011220.70.44
PP_L1_Lt011220.70.42
PP_L2_Lt011220.70.42
PP_L3_Lt011220.70.45
PP_L4_Lt011220.70.45
PP_L5_Lt011220.70.43
PP_S1_Lt011220.70.45
PP_S2_Lt011220.70.45
PP_S3_Lt011220.70.44
PP_S4-5_Lt011220.70.42
Initial FAC001251.40.74
Note: LEL/LER—Lower Extremity, Left or Right; Lt—Left; LT—Light Touch; PP—Pin Prick; Rt—Right; UEL/UER—Upper Extremity, Left or Right.
Table 2. Model Performance: Root-mean-squared error averaged over 10 Runs. Legend: The performance of the recurrent neural network far exceeded that of LR, Ridge, and Lasso across the board. For example, their respective root-mean-squared errors in the first scenario (main scenario) were: 0.3738, 2.2831, 1.3161, and 1.0246 for all participants; 0.3727, 1.7176, 1.3914, and 1.3524 for those with trauma; and 0.3728, 1.7516, 1.1012, and 0.8889 for those with non-traumatic SCI.
Table 2. Model Performance: Root-mean-squared error averaged over 10 Runs. Legend: The performance of the recurrent neural network far exceeded that of LR, Ridge, and Lasso across the board. For example, their respective root-mean-squared errors in the first scenario (main scenario) were: 0.3738, 2.2831, 1.3161, and 1.0246 for all participants; 0.3727, 1.7176, 1.3914, and 1.3524 for those with trauma; and 0.3728, 1.7516, 1.1012, and 0.8889 for those with non-traumatic SCI.
All Participants
(n = 405)
Participants with Traumatic SCI
(n = 175)
Participants with Non-Traumatic SCI
(n = 230)
FAC IncludedMotor Included
RNN 0.37380.37270.3728
Linear Regression 2.38311.71761.7516
Ridge 1.31611.39141.1012
Lasso 1.02461.35240.8889
FAC ExcludedMotor Included
RNN 0.37270.37270.3732
Linear Regression 2.29522.19611.5994
Ridge 1.43871.60061.2638
Lasso 1.11071.60581.1576
FAC IncludedMotor Upperexcluded
RNN 0.37320.37270.3731
Linear Regression 1.98111.62661.9296
Ridge 1.22871.35261.1840
Lasso 1.03871.25260.9177
FAC IncludedMotor Excluded
RNN 0.37270.37270.3728
Linear Regression 1.20741.62941.8930
Ridge 1.15061.33831.1870
Lasso 1.05681.22580.9178
Note: Bold indicates Main Scenarios; FAC—Functional Ambulation Category; RNN—Recurrent Neural Network.
Table 3. Recurrent neural network variable importance. Legend: In terms of recurrent neural network variable importance, right ankle dorsiflexor, left ankle dorsiflexor, right knee extensor, left long toe extensor, and the neurological level of injury ranked among the top 5 across the board. Indeed, the initial functional ambulation category was the 7th, 3rd, and 9th most important predictor for all participants, those with trauma, and those without trauma, respectively.
Table 3. Recurrent neural network variable importance. Legend: In terms of recurrent neural network variable importance, right ankle dorsiflexor, left ankle dorsiflexor, right knee extensor, left long toe extensor, and the neurological level of injury ranked among the top 5 across the board. Indeed, the initial functional ambulation category was the 7th, 3rd, and 9th most important predictor for all participants, those with trauma, and those without trauma, respectively.
VariableAll Participants
(n = 405)
Participants with Traumatic SCI (n = 175)Participants with Non-Traumatic SCI (n = 230)
VIRankingVIRankingVIRanking
Age0.0018130.0046180.012413
Period—Acute Care0.0010200.0039200.005920
Period—Rehab0.002960.013350.016111
AIS0.0013150.0045190.009918
NLI0.003250.018710.02397
Sensory-PPR0.0011180.0074140.010317
Sensory-PPL0.0021120.0049170.017410
Hip flexor, Rt.0.0011180.0102120.011314
Knee extensor, Rt.0.003440.012780.02533
Ankle dorsiflexor, Rt.0.004410.017720.03291
Long toe extensor, Rt.0.002380.0112100.02504
Ankle plantarflexor, Rt.0.0018130.0101130.008719
Hip flexor, Lt.0.002380.012490.02288
Knee extensor, Lt.0.0022100.0105110.015212
Ankle dorsiflexor, Lt.0.004230.014540.02622
Long toe extensor, Lt.0.004320.013350.02465
Ankle plantarflexor, Lt.0.0013150.0061160.010816
Neurogenic Bladder0.0022100.013070.02446
Initial FAC0.002370.016530.01779
SSEP-Lower0.0012170.0062150.011115
Note: AIS—American Spinal Injury Association Impairment Scale; NLI—Neurological Level of Injury; PPR/PPL—Pin Prick, Left/Right; FAC—Functional Ambulation Category; SSEP—Lower Somatosensory Evoked Potential of Lower Extremity; VI—Variable Importance.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Yoo, H.-J.; Lee, K.-S.; Koo, B.; Yong, C.-W.; Kim, C.-W. Deep Learning-Based Prediction Model for Gait Recovery after a Spinal Cord Injury. Diagnostics 2024, 14, 579. https://doi.org/10.3390/diagnostics14060579

AMA Style

Yoo H-J, Lee K-S, Koo B, Yong C-W, Kim C-W. Deep Learning-Based Prediction Model for Gait Recovery after a Spinal Cord Injury. Diagnostics. 2024; 14(6):579. https://doi.org/10.3390/diagnostics14060579

Chicago/Turabian Style

Yoo, Hyun-Joon, Kwang-Sig Lee, Bummo Koo, Chan-Woo Yong, and Chae-Won Kim. 2024. "Deep Learning-Based Prediction Model for Gait Recovery after a Spinal Cord Injury" Diagnostics 14, no. 6: 579. https://doi.org/10.3390/diagnostics14060579

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop