Next Article in Journal
Enhanced Integrity of White Matter Microstructure in Mind–Body Practitioners: A Whole-Brain Diffusion Tensor Imaging Study
Previous Article in Journal
Polymorphisms in Oxytocin and Vasopressin Receptor Genes as a Factor Shaping the Clinical Picture and the Risk of ASD in Males
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Machine Learning-Based Routine Laboratory Tests Predict One-Year Cognitive and Functional Decline in a Population Aged 75+ Years

1
Faculdade de Farmácia, Universidade Federal de Minas Gerais, Belo Horizonte 31270-901, MG, Brazil
2
Instituto de Ciências Exatas, Universidade Federal de Minas Gerais, Belo Horizonte 31270-901, MG, Brazil
3
Faculdade de Medicina, Universidade Federal de Minas Gerais, Belo Horizonte 31270-901, MG, Brazil
4
Hospital das Clínicas (EBSERH), Universidade Federal de Minas Gerais, Belo Horizonte 31270-901, MG, Brazil
5
Faculdade Santa Casa BH, Belo Horizonte 30110-005, MG, Brazil
*
Author to whom correspondence should be addressed.
Brain Sci. 2023, 13(4), 690; https://doi.org/10.3390/brainsci13040690
Submission received: 18 February 2023 / Revised: 30 March 2023 / Accepted: 15 April 2023 / Published: 20 April 2023
(This article belongs to the Section Neurodegenerative Diseases)

Abstract

:
Background: Cognitive and functional decline are common problems in older adults, especially in those 75+ years old. Currently, there is no specific plasma biomarker able to predict this decline in healthy old-age people. Machine learning (ML) is a subarea of artificial intelligence (AI), which can be used to predict outcomes Aim: This study aimed to evaluate routine laboratory variables able to predict cognitive and functional impairment, using ML algorithms, in a cohort aged 75+ years, in a one-year follow-up study. Method: One hundred and thirty-two older adults aged 75+ years were selected through a community-health public program or from long-term-care institutions. Their functional and cognitive performances were evaluated at baseline and one year later using a functional activities questionnaire, Mini-Mental State Examination, and the Brief Cognitive Screening Battery. Routine laboratory tests were performed at baseline. ML algorithms—random forest, support vector machine (SVM), and XGBoost—were applied in order to describe the best model able to predict cognitive and functional decline using routine tests as features. Results: The random forest model showed better accuracy than other algorithms and included triglycerides, glucose, hematocrit, red cell distribution width (RDW), albumin, hemoglobin, globulin, high-density lipoprotein cholesterol (HDL-c), thyroid-stimulating hormone (TSH), creatinine, lymphocyte, erythrocyte, platelet/leucocyte (PLR), and neutrophil/leucocyte (NLR) ratios, and alanine transaminase (ALT), leukocyte, low-density lipoprotein cholesterol (LDL-c), cortisol, gamma-glutamyl transferase (GGT), and eosinophil as features to predict cognitive decline (accuracy = 0.79). For functional decline, the most important features were platelet, PLR and NLR, hemoglobin, globulin, cortisol, RDW, glucose, basophil, B12 vitamin, creatinine, GGT, ALT, aspartate transferase (AST), eosinophil, hematocrit, erythrocyte, triglycerides, HDL-c, and monocyte (accuracy = 0.92). Conclusions: Routine laboratory variables could be applied to predict cognitive and functional decline in oldest-old populations using ML algorithms.

1. Introduction

Population aging is a worldwide phenomenon [1]. An aging process free of any cognitive, behavioral, and motor impairment allows for better integration of older adults in society. However, aging is associated with the occurrence of disabilities, partly due to chronic-degenerative conditions such as dementia [2,3].
Dementia is a term that encompasses a particular group of symptoms, including difficulties with memory, language, problem solving, and other skills that affect an individual’s ability to perform routine activities [4]. Nevertheless, a significant amount of the older adult population is affected by age-related cognitive and functional decline, regardless of dementia [5].
Machine learning (ML) is a subarea of artificial intelligence (AI) applied in many technological fields, including healthcare. ML uses training inputs and outputs to generate a function that can be used to predict outcomes in other inputs. The application of ML in the prediction of dementia may provide an advantage to health care by promoting a better understanding of the pathophysiology of the disease and a more accurate diagnosis [6,7].
Currently, there is no specific plasma biomarker able to predict cognitive or functional decline in healthy old-age people and cerebrospinal fluid markers are only measured when dementia is suspected. Conversely, routine laboratory tests are accessible for these populations and are applied habitually to the elderly. The hypothesis is that routine laboratory tests could predict impairment in a population that is most likely to present cognitive and functional decline (75+ years) using ML models, which could detect complex patterns and interactions between these biomarkers. As a result, the ML algorithm selected a total of 20 laboratory variables that are able to predict cognitive and functional decline in the oldest population. The data suggest that alterations in laboratory variables may be associated with an individual’s cognitive and functional status and ML models could find the best combination of these routine blood exams, which is not possible in a univariate analysis. As far as we know, there has been no study investigating routine laboratory markers as predictors of cognitive and functional decline in an older adult population.

2. Material and Methods

2.1. Characteristics of the Population

The participants were selected from the Pietà study, a population-based research project conducted in Caeté City, Southeast Brazil [3]. Individuals aged 75+ years, which are most likely to have decreased cognitive and functional capacity due to age, were actively searched through community-health public-program agents or in long-term-care institutions, as well as announcements on local radio and newspapers [8].
Functional assessments of the subjects were carried out by the functional activities questionnaire (FAQ) [9], while cognitive performance was evaluated through brief cognitive tests, including the Mini-Mental State Examination and the Brief Cognitive Screening Battery [10]. Functional and cognitive tests were applied twice (2008 and 2009), with a one-year interval, and normalized by schooling level (Z score). The Z scores derived from each cognitive test were used to calculate a global cognitive score (GCS) [11]. The baseline characteristics of this population were described elsewhere [3]. No participant presented cognitive or functional impairment at the baseline.
According to the mathematical difference between GCS or FAQ scores obtained in 2008 and 2009, the subjects were then categorized into two groups: decliners, who showed a short-term cognitive or functional decline after one-year follow up (negative score); and nondecliners, those who demonstrated short-term stability or even improvement (positive score) in cognitive or functional abilities after one year.
The study was approved by the Ethics Committee of the Federal University of Minas Gerais, Brazil and all participants or their legally acceptable representatives signed the written informed consent.

2.2. Biochemical Analysis

Blood samples were collected from the participants, after fasting for 12 h, for routine laboratory tests at the baseline. The variables that composed the dataset were: complete blood count (CBC), triglycerides, red blood cell distribution width (RDW), high-density lipoprotein cholesterol (HDL-c), low-density lipoprotein cholesterol (LDL-c), neutrophil-lymphocyte ratio (NLR), platelet-lymphocyte ratio (PLR), fasting glucose, aspartate transaminase (AST), alanine transaminase (ALT), creatinine, albumin, globulin, cortisol, B12 vitamin, thyroid-stimulating hormone (TSH) and gamma-glutamyl transferase (GGT).
The blood count was performed on ABX Pentra Horiba® (Madrid, Spain). The lipid profile was analyzed with Super Class—Labtest® (Lagoa Santa, Brazil) equipment. The other parameters were determined using DPC Bayer (Whippany, NJ, USA) or VITROS OrthoClinical Diagnostics® (Singapure City, Singapure), following the manufacturer’s recommendations.

2.3. Data Analysis

For the characterization of the population and individual analysis of the variables, the normality was verified by the Shapiro–Wilk test. Differences between the groups were evaluated using Student’s t-Test. Statistical analyses were conducted using SPSS software version 21 (New York City, NY, USA). Any p values < 0.05 were considered significant.
In order to predict cognitive and functional decline, three supervised-learning algorithms were applied: random forest, XGBoost, and support vector machine (SVM). Random forest and XGBoost are a combination of models that aim to generate prediction models through a set of data interconnected by decision trees. The combination of the average results of these links determines the class of results that better matches the outcome. Random forest trains each tree independently, based on a random sampling of the data, while XGBoost builds the trees sequentially, in which each new tree corrects the errors of the previous one, improving the accuracy of the final results. SVM uses binary classification methods that list the variables based on their probability to present a high grade of significance for the model. SVM is based on the geometric properties of the data; through a kernel function, the data are mapped to a multidimensional space to seek a hyperplane that better divides the classes [12].
For the application of the models, a Scikit-Learn was performed, using Python software version 3.6.9 (Wilmington, DE, USA). We used the following steps:
Step 1: Data preparation. The preprocessing step included standardization of the units of measurement and class balancing. In order to reduce the bias caused by unbalanced classes, the SMOTE oversampling technique was used for training data, in which the synthetic samples of the minority class were created using the k-nearest neighbors of an instance (k = 3). The number of results generated was the value enough to match both groups;
Step 2: Model training. All of the features (laboratory tests) were used for iterative training. In this step, features were replaced continuously in order to optimize the model hyperparameters and reduce prediction errors. To establish the best classification algorithm, 90% of the data set was selected randomly as training and the remaining 10% was used for the testing set. Different values of the number of estimators and depth of the tree for the random forest and XGBboost algorithms and different cost values and kernel functions for SVM were tested (Supplementary Material—Table S1) in order to maximize the area under the ROC curve (AUROC) and the accuracy and to avoid sampling bias or data overfitting. The AUROC was calculated by varying the decision threshold and then measuring the false-positive and true-positive rates for each of them [13,14];
Step 3. Internal model validation. The models were trained with cross-validation k fold (k = 5). The data set was subdivided into k folds, and, at each time, k-1 folds were used for training and the rest for validation (Figure 1).
In addition, in order to estimate the performance of each classifier, the accuracy, sensitivity, and specificity were evaluated. A feature selection was implemented to identify the most relevant subset of variables for predicting cognitive and functional decline [13], based on the number of times that a variable was assessed by the algorithm decision. The information about the variables used by the model was assessed by the Shapley additive explanations (SHAP) [15], an effective model interpretation that helps to better understand the relationship between variables. The effect of each variable was calculated by the distance from the original prediction. A mean of absolute distances for each individual was used to generate a ranked list of variables according to the effect on outcome predictions for all subjects. A negative distance was obtained if the individual had a value that reduces the risk of cognitive/functional impairment compared to the average risk of the population studied, while a positive distance was obtained when the risk in favor of cognitive/functional decline was higher than the population evaluated. An average of absolute distances between variables was used to generate a ranking list according to the effect on the decline prediction.

3. Results

3.1. Model Performance

Of the 132 participants, who were predominantly low-educated rural individuals, the mean age was 79.52 ± 4.26 years old and 51 were male. Cognitive and functional declines were observed in 53% and 36% of the participants, respectively, after the one-year follow up. Age and gender frequency were not different between the groups (p > 0.05) (Table 1).
The univariate comparisons of the variables between the groups are shown in the Supplementary Material—Table S2. Individuals with functional decline presented lower leukocyte values and PLR, but higher lymphocyte values and ALT levels compared to nondecliners (p < 0.05). For cognitive impairment, no difference was observed between the groups (all p > 0.05). Only 16% of the individuals presented both cognitive and functional declines; therefore, it was not possible to evaluate them separately.
Comparing the three models, random forest and XGBoost showed the best performance to predict cognitive decline (accuracy = 0.79 for both) when compared to the SVM model (accuracy = 0.71). For functional decline, random forest presented higher accuracy (0.92) when compared to the XGBoost and SVM models (0.83 and 0.71, respectively), in addition to higher sensitivity and specificity values (Supplementary Material—Table S3). Accordingly, random forest presented better prediction performance in both groups, in addition to allowing for the setting of the variables of major importance for the models.

3.2. One-Year Follow-Up Cognitive Decline Predicted by the Random Forest Model

The random forest model presented an AUROC of 0.625 for the prediction of cognitive decline (Figure 2).
The importance of the feature of each variable within the model was estimated using the SHAP algorithm. For each individual, the effect of the absence of the variable was calculated using the distance from the original prediction. A negative distance was obtained if the individual had a value that reduced the risk of cognitive impairment compared to the average risk of the population studied and a positive distance was obtained when the risk in favor of cognitive decline was higher than the population evaluated. An average of absolute distances between variables was used to generate a ranking list according to the effect on the decline prediction.
The SHAP algorithm showed that in decreasing order of importance, triglycerides, glucose, hematocrit, RDW, albumin, hemoglobin, globulin, HDL, TSH, creatinine, lymphocyte, erythrocyte, PLR and NLR, ALT, leukocyte, LDL, cortisol, GGT, and eosinophil were the variables considered most important for the model. Values below zero on the X axis tended to contribute to cognitive stability, while values above zero tended to contribute to cognitive decline after one year. The red color indicated higher values of the variable and the blue color indicated lower values of the variable. Considering the 10 variables with greater feature values (Y axis), higher triglycerides, RDW, albumin, and creatinine levels, as well as lower glucose, hematocrit, hemoglobin, globulin, HDL, and TSH levels are associated with cognitive decline (Figure 3).

3.3. One-Year Follow-Up Functional Decline Predicted by the Random Forest Model

The AUROC for the prediction of functional decline by the random forest model was 0.778 (Figure 4).
The feature importance of each variable within the model was also estimated using the SHAP algorithm. The variables in decreasing order of importance were platelet, PLR and NLR, hemoglobin, globulin, cortisol, RDW, glucose, basophil, B12 vitamin, creatinine, GGT, ALT, AST, eosinophil, hematocrit, erythrocyte, triglycerides, HDL, and monocyte. Similar to the previous interpretation, values below zero on the X axis tended to contribute to the nonfunctional decline. Values above zero were associated with functional decline in a one-year follow up. The red color indicates higher values and the blue color indicates lower values for the variable. The 10 variables with higher feature values (Y axis) related to functional decline were higher hemoglobin levels and lower platelet-lymphocyte and neutrophil-lymphocyte ratios, platelet, globulin, cortisol, RDW, glucose, basophil, and vitamin B12 levels (Figure 5).

4. Discussion

The final model selected a total of 20 variables that are able to predict cognitive and functional decline in a nondementia oldest-old population, with an accuracy of 0.79 and 0.92, respectively. Currently, the results of state-of-the-art studies with mild cognitive impairment (MCI) patients undergoing neuroimaging tests showed that the best-performing method reached an accuracy from 0.42 to 0.63 [16,17].
In the present study, regarding red-blood-cell parameters, lower values were observed for hematocrit and hemoglobin and higher values for RDW, among the 10 most important variables for cognitive decline, which sets up a tendency to anemia. Erythrocyte counts also showed lower values in those with cognitive decline but did not appear among the 10 most important variables. Anemia is quite common in older adults, with a prevalence of 11% in people aged 65+ years and many studies support this comorbidity as a significant risk factor for dementia [18,19], with an evident reflex on iron metabolism and other nutrients and, ultimately, a consequent increase in RDW [20]. Low cerebral hemoglobin associated with low oxygen levels can damage neurons and, consequently, lead to cognitive impairment.
Concerning the number of lymphocytes, contradictory results have been reported in patients with Alzheimer’s disease (AD). The results did not indicate a reduced number of lymphocytes in patients who progressed to cognitive decline after one year of follow up, but an increase in functional decliners. No significant difference in the distribution of total lymphocytes between AD patients and healthy individuals was found in a previous study [21], though the decrease in the number of lymphocytes in AD is frequently reported [22,23]. This contradictory finding raises the need to further investigate the role of the lymphocyte in cognitive/functional decline.
NLR and PLR are useful and low-cost biomarkers related to peripheral systemic inflammation [24] and integrate information from two leukocyte subtypes and platelets. In the present study, NLR was not elevated, but PLR was shown to be reduced in functional decline. It is known that an increase in the neutrophil count is often associated with the occurrence, progression, and severity of inflammation, while a decrease in lymphocyte count, as part of the regulatory immune barrier, is associated with the body’s response to stress [23]. Conversely, nutritional deficiencies, such as B12 deficiency, which is relatively common in older adults, can reduce the number of blood cells, including neutrophils [25]. A lower number of platelets was found only in individuals who presented functional decline after one year of follow-up.
Most studies suggesting that peripheral leukocytes may be biomarkers for AD are opposed by others that show null effects or contrary results [26]. In this study, lower leukocyte count was associated with cognitive decline in SHAP, though with functional decline only in the univariate analysis. A possible explanation would be the loss of telomeric DNA from hematopoietic progenitor cells with aging. This finding implies that stem cell collections from an older patient may have compromised replicative capacity with a reduced response to hematopoietic growth factors [18].
After a year of follow up, the model showed that a reduced number of eosinophils may be associated with cognitive decline. On the other hand, in functional decline, a greater number of eosinophils and a decrease in the number of both basophils and monocytes were observed. Although the role of eosinophils in this context is not clear, it is known that basophils contain histamine, which has an anti-inflammatory character acting as a neurotransmitter in the central nervous system. However, the influence of AD on the number and function of basophils has remained elusive [19]. Concerning monocytes, it has been reported that this leukocyte plays a critical role in the pathogenesis of AD [27]. The model showed that in those who progressed to functional decline, monocytes were found to be less in number.
Higher TG levels were the most important variable associated with cognitive decline in the model. Higher concentrations of plasma TG have been associated with an increased risk of non-AD dementia and ischemic stroke in other community-based epidemiological studies [28]. Bernath et al. [29] showed that long-chain, polyunsaturated fatty-acid-containing TGs (PUTGs) were significantly associated with MCI and AD. In addition, PUTG component scores were significantly associated with early-AD biomarkers, including hippocampal volume and entorhinal cortical thickness measured using MRI scans. Interestingly, although included in the final model, TG levels did not show relevance in the individual analysis of functional decline.
Lower HDL-c levels were associated with both cognitive and functional decline. HDL-c and APOE have been associated with brain function, dementia, and AD in observational studies, mainly due to the apolipoproteins involved in the deposition and clearance of β-amyloid, a causal factor for neurodegeneration [30]. Larger studies indicate that plasma levels of HDL-c are inversely associated with the risk of dementia [30]. In our previous study, we also showed that lower HDL-c levels were independently associated with MCI and dementia when compared to controls in the Pietà study [31].
It was reported that brain insulin resistance or brain insulin reduction can accelerate AD pathologies such as neurofibrillary tangles and Aβ deposition [32], mainly mediated by insulin-like growth-factor (IGF) signaling, which can regulate the expression of tau protein and its phosphorylation [32]. Variable glucose levels did not show a linear relationship with cognitive or functional decline in the model, suggesting that its interaction with other peripheral markers could modulate the impairment in this older group.
Many reports have shown that hypo-albuminemia (malnutrition) is associated with cognitive dysfunction [33,34]. It is also known that serum albumin is one of the most potent Aβ sequestering systems, which binds 90–95% of the Aβ in blood plasma [35]. However, lower albumin levels did not play an important role in cognitive decline since higher levels were observed in the model after one year of follow up. The hypothesis is that the increase in albumin levels could be related to a release toward the bloodstream in order to maintain the dynamic equilibrium of Aβ between the brain and blood plasma, as Aβ is increased in several dementia conditions [36].
Similarly, lower globulin levels were associated with cognitive and functional impairment in the model. Contrary to other results, increased globulin levels were shown to be associated with chronic subclinical inflammation commonly observed in dementia processes [37]. However, Dodel et al. [38] showed, in a clinical trial, that intravenous immunoglobulins might reduce the speed of metabolic decline in the medial temporal lobe in patients with AD, suggesting the beneficial effect of globulin on cognition and function in patients with dementia diseases.
GGT levels were reduced in both groups with cognitive or functional decline. Although related to the use of medications, low GGT levels do not represent important clinical variables. However, it is necessary to highlight that higher ALT levels related to cognitive impairment in the SHAP model and to functional decline in the univariate analysis as well as higher AST levels related to functional decline, were observed in the model. In fact, liver dysfunction is associated with the development of dementia, in addition to cardiovascular disease and insulin resistance. Through disruptions in glucose and lipid metabolism, key physiological functions of the liver also occur in the dementia process [39,40]. Nevertheless, Nho et al. [41] observed that increased AST to ALT ratio values and lower levels of ALT showed a significant association with reduced brain glucose metabolism, particularly in the orbitofrontal cortex and temporal lobes, areas of the brain implicated in memory and executive function.
The creatinine levels showed a complex profile since higher levels were observed in cognitive decline and lower levels in functional impairment. Impaired kidney function may cause damaging effects on the brain by inducing cognitive impairment [42] and increasing the risk of dementia [43]. Impaired kidney function may cause vascular disease-related cerebral pathology, disturbances in water and electrolyte balance, vascular tone, oxidative stress response, and cytokine production, factors involved in cerebrovascular injury. However, in a follow up of 11.6 years from the Rotterdam Study including 69,790 people, impaired kidney function evaluated by estimated glomerular filtration rates (based on creatinine) was not related to a higher risk of dementia [44]. In addition, two baselines from the Atherosclerosis Risk in Communities (ARIC) Study, including 9967 participants aged 54 to 74 years, showed that lower estimated glomerular filtration rate (eGFR) based on cystatin C or β2-microglobulin, but not creatinine was associated with dementia [45]. Nevertheless, creatinine was noted to be a significant predictor of acute kidney injury in multiple studies that utilized ML models, showing that creatinine, a nonexpensive and accessible biomarker, could be applied to evaluate kidney function using algorithms [46,47,48].
Lower TSH levels are classically associated with dementia, corroborating the findings in the model. Cardiovascular risk factors may mediate the association between thyroid function and the development of dementia through vascular brain damage. Analyses were performed within the Rotterdam Study, comparing the TSH and free thyroxine levels with dementia [49]. Lower TSH levels were associated with higher dementia risk, independent of cardiovascular risk factors. Furthermore, the 10-year dementia risk decreased from 15% to 10% with higher TSH in older women and higher TSH was associated with better global-cognitive scores. Using random forest regression, Santhanam et al. (2022) observed that log TSH was a significant copredictor of fluid intelligence, a mental health parameter, in female young adults [50]. Another study showed that random forest performed the best to predict individuals with normal, high, and low levels of TSH, using ethnicity, free T4, anti-thyroid peroxidase (TPO) antibodies, free T3, body mass index (BMI), age, and anti-TPO as the most important feature in classifying TSH [51].
Our previous studies showed that the elevation in cortisol concentrations is associated with MCI and dementia, independent of APOE genotypes [31,52]. Differentially, the model did not show elevated cortisol levels in both cognitive and functional decline. Accordingly, Gil-Bea et al. also did not find higher concentrations of cortisol in individuals with MCI, mild AD dementia, or in the controls, suggesting that the increase in cortisol levels is not an initial event in dementia. Probably, elevated cortisol levels would be related to the progression of the established disease and would have no prognostic value, since the enhanced concentrations occur due to the loss of hypothalamus–pituitary–adrenal axis inhibition when there is already hippocampal damage [52,53]. Therefore, the results suggest that at the beginning of a cognitive and functional decline, cortisol levels are not elevated; however, they may increase as the disease progresses. The majority of studies, including ML, evaluated cortisol levels as an outcome, not a feature [54]. However, few studies included cortisol levels in ML algorithms able to predict different diseases, such as mental disorders [55], stress and dietary intake [56], and quality of life [57].
There is some expectation about the use of ML in laboratory medicine; however, there are some concerns that should be addressed, such as data quality, mainly missing data and label error; the cost of the computational infrastructure and the individuals with expertise to develop machine-learning algorithms, as well as ML standardization and regulation required for quality guarantee. At this time, best practices for the clinical validation of ML algorithms should be widely discussed [58,59].
It is important to recognize the limitations of the present study, such as the small sample size for each group and the cross-sectional measure of blood-based biomarkers. Although several drugs, hypertension, and diabetes mellitus frequencies were not different between the two groups, they may have interfered with the variables analyzed. Therefore, some apparent contradictory findings might be related to the fact that cognitive and functional impairment are heterogeneous entities since a clinical continuum from subjective decline to AD was observed in the dementia group. Although an external validation was not performed, an internal validation with accurate prediction was applied.

5. Conclusions

The results suggest that routine laboratory tests present a good accuracy to predict cognitive and functional decline in an oldest-old population using ML models.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/brainsci13040690/s1, Table S1: Set of hyperparameters for each algorithm. Table S2: Routine laboratory variables measured at baseline in cognitive/functional decliners and non-decliners. Table S3: Performance of Machine Learning models applied in the study.

Author Contributions

Conceptualization, K.B.G.; methodology, K.B.G., R.G.P., A.A.B. and W.M.J.; software, K.B.G., R.G.P. and A.A.B.; validation, K.B.G.; formal analysis, K.B.G. and R.G.P.; investigation, K.B.G.; resources, P.C.; data curation, K.B.G., H.C.G., E.d.P.F.R., A.L.T., M.T.B., M.d.G.C. and P.C.; writing—original draft preparation, K.B.G. and M.d.G.C.; writing—review and editing, E.d.P.F.R., A.L.T. and P.C.; project administration, A.L.T., M.T.B. and P.C.; funding acquisition, P.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Fundação de Amparo à Pesquisa do Estado de Minas Gerais (FAPEMIG).

Institutional Review Board Statement

The study was approved by the Ethics Committee of the Federal University of Minas Gerais, Brazil (ETIC 126/07). The study was conducted in accordance with the Declaration of Helsinki.

Informed Consent Statement

All participants or their legally acceptable representatives signed the written informed consent.

Data Availability Statement

The data that support the findings of this study are available on request from the corresponding author, K.B.G.

Acknowledgments

M.d.G.C., P.C. and K.B.G. are grateful to CNPq Research Fellowship (PQ).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Health Organization. Global Brief for World Health Day. Available online: https://www.afro.who.int/publications/good-health-adds-life-years (accessed on 22 September 2020).
  2. Stephens, C.E.; Evans, L.K.; Bradway, C.; Buckwalter, K. Challenges in Aging, Dementia, and Mental Health: New Knowledge and Energy to Inform Solutions. J. Am. Geriatr. Soc. 2018, 66, S1–S3. [Google Scholar] [CrossRef] [PubMed]
  3. Caramelli, P.; Barbora, M.T.; Sakurai, E.; dos Santos, E.L.; Beato, R.G.; Machado, J.C.B.; Guimarães, H.C.; Teixeira, A.L.; Pietá Study Group. The Pietà study: Epidemiological investigation on successful brain aging in Caeté (MG), Brazil. Methods and baseline cohort characteristics. Arq. Neuropsiquiatr. 2011, 69, 579–584. [Google Scholar] [CrossRef] [PubMed]
  4. Alzheimer’s Disease. Alzheimer’s Disease Fact and Figures. Available online: https://www.alz.org/alzheimers-dementia/facts-figures (accessed on 22 September 2020).
  5. Juan, S.M.A.; Adlard, P.A. Ageing and Cognition. Subcell Biochem. 2019, 91, 107–122. [Google Scholar] [PubMed]
  6. Merkin, A.; Krishnamurthi, R.; Medvedev, O.N. Machine learning, artificial intelligence and the prediction of dementia. Curr. Opin. Psychiatry 2022, 35, 123–129. [Google Scholar] [CrossRef]
  7. Chang, C.H.; Lin, C.H.; Lane, H.Y. Machine Learning and Novel Biomarkers for the Diagnosis of Alzheimer’s disease. Int. J. Mol. Sci. 2021, 22, 2761. [Google Scholar] [CrossRef]
  8. Resende, E.P.F.; Costa-Silva, L.; Carmona, K.C.; Machado, T.H.; Machado, J.C.B.; Guimarães, H.C.; Barbosa, M.T.; Teixeira, A.L.; Souza, L.C.; Caramelli, P. Ischemic cerebrovascular burden evaluated by magnetic resonance imaging in an elderly Brazilian community: The Pietà study. Neurological. Sci. 2016, 1, 30–34. [Google Scholar] [CrossRef]
  9. Pfeffer, R.I.; Kurosaki, T.T.; Harrah, C.H., Jr.; Chance, J.M.; Filos, S. Measurement of functional activities in older adults in the community. J. Gerontol. 1982, 3, 323–329. [Google Scholar] [CrossRef]
  10. Nitrini, R.; Lefevre, B.H.; Mathias, S.C.; Caramelli, P.; Carrilho, P.E.; Sauaia, N.; Massad, E.; Takiguti, C.; Silva, I.O.; Porto, C.S.; et al. Testes neuropsicologicos de aplicação simples para o diagnostico de demência [Neuropsychological tests of simple application for the diagnosis of dementia]. Arq. Neuropsiquiatr. 1994, 52, 457–465. [Google Scholar] [CrossRef]
  11. Fraga, V.G.; Guimarães, H.C.; Lara, V.P.; Teixeira, A.L.; Barbosa, M.T.; Carvalho, M.G.; Caramelli, P.; Gomes, K.B. TGF-β1 Codon 10 T>C Polymorphism Influences Short-Term Functional and Cognitive Decline in Healthy Oldest-Old Individuals: The Pietà Study. J. Alzheimers Dis. 2015, 48, 1077–1081. [Google Scholar] [CrossRef]
  12. Araújo, D.C.; Veloso, A.A.; Gomes, K.B.; Suza, L.C.; Ziviani, N.; Caramelli, P.; Alzheimer’s Disease Neuroimaging Initiative. A Novel Panel of Plasma Proteins Predicts Progression in Prodromal Alzheimer’s Disease. J. Alzheimers Dis. 2022, 88, 549–561. [Google Scholar] [CrossRef]
  13. Bucholc, M.; Ding, X.; Wang, H.; Glass, D.H.; Wang, H.; Prasad, G.; Maguire, L.P.; Bjourson, A.J.; McClean, P.L.; Todd, S.; et al. A practical computerized decision support system for predicting the severity of Alzheimer’s disease of an individual. Expert Syst. Appl. 2019, 15, 57–171. [Google Scholar] [CrossRef] [PubMed]
  14. Barber, D. Bayesian Reasoning and Machine Learning; Cambridge University Press: Cambridge, UK, 2012. [Google Scholar]
  15. Lundberg, S.M.; Lee, S. A Unified Approach to Interpreting Model Predictions. Adv. Neural Inf. Process. Syst. 2017, 30, 1–10. [Google Scholar]
  16. Bron, E.E.; Smits, M.; Van Der Flier, W.M.; Vrenken, H.; Barkhof, F.; Scheltens, P.; Papma, J.M.; Steketee, R.M.E.; Orellana, C.M.; Meijboom, R.; et al. Standardized evaluation of algorithms for computer-aided diagnosis of dementia based on structural MRI: The CAD Dementia challenge. NeuroImage 2015, 111, 579. [Google Scholar] [CrossRef] [PubMed]
  17. Amoroso, N.; Diacono, D.; Fanizzi, A.; Rocca, M.; Monaco, A.; Lombardi, A.; Guaragnella, C.; Bellotti, R.; Tangaro, S.; Alzhimer’s Disease Neuroimaging Initiative. Deep learning reveals Alzheimer’s disease onset in MCI subjects: Results from an international challenge. J. Neurosci. Methods 2018, 15, 3–9. [Google Scholar] [CrossRef] [PubMed]
  18. Berkahn, L.; Keating, A. Hematopoiesis in the elderly. Hematology 2004, 9, 159–163. [Google Scholar] [CrossRef]
  19. Song, C.; Vandewoude, M.; Stevens, W.; Clerck, L.; Planken, M.V.; Whelan, A.; Anisman, H.; Dossche, A.; Maes, M. Alterations in immune functions during normal aging and Alzheimer’s disease. Psychiatry Res. 1999, 85, 71–80. [Google Scholar] [CrossRef]
  20. Salvagno, G.L.; Sanchis-Gomar, F.; Picanza, A.; Lippi, G. Red blood cell distribution width: A simple parameter with multiple clinical applications. Crit. Rev. Clin. Lab. Sci. 2015, 52, 86–105. [Google Scholar] [CrossRef]
  21. Dysken, M.W.; Minichiello, M.D.; Hill, J.L.; Skare, S.; Little, J.T.; Molchan, S.E.; Sunderland, T. Distribution of peripheral lymphocytes in Alzheimer patients and controls. J. Psychiatr. Res. 1992, 26, 213–218. [Google Scholar] [CrossRef]
  22. Shad, K.F.; Aghazadeh, Y.; Ahmad, S.; Kress, B. Peripheral markers of Alzheimer’s disease: Surveillance of white blood cells. Synapse 2013, 67, 541–543. [Google Scholar] [CrossRef]
  23. Dong, X.; Nao, J.; Shi, J.; Zheng, D. Predictive Value of Routine Peripheral Blood Biomarkers in Alzheimer’s Disease. Front. Aging Neurosci. 2019, 11, 332. [Google Scholar] [CrossRef]
  24. Kuyumcu, M.E.; Yesil, Y.; Oztürk, Z.A.; Kizilarslanoglu, C.; Etgul, S.; Halil, M.; Ulger, Z.; Cankurtaran, M.; Ariogul, S. The evaluation of neutrophil-lymphocyte ratio in Alzheimer’s disease. Dement. Geriatr. Cogn. Disord. 2012, 34, 697410. [Google Scholar] [CrossRef]
  25. Failace, R. Hemograma [Blood Count], 6th, ed.; Revista da Associação Médica Brasileira: São Paulo, Brazil, 2015; Volume 63, p. 463. [Google Scholar]
  26. Rezai-Zadeh, K.; Gate, D.; Szekely, C.A.; Town, T. Can peripheral leukocytes be used as Alzheimer’s disease biomarkers? Expert Rev. Neurother. 2009, 9, 1623–1633. [Google Scholar] [CrossRef] [PubMed]
  27. Gu, B.J.; Huang, X.; Ou, A.; Rembach, A.; Fowler, C.; Avula, P.K.; Horton, A.; Doecke, J.D.; Villemagne, V.L.; Macaulay, S.L.; et al. Innate phagocytosis by peripheral blood monocytes is altered in Alzheimer’s disease. Acta Neuropathol. 2016, 132, 377–389. [Google Scholar] [CrossRef]
  28. Nordestgaard, L.T.; Christoffersen, M.; Afzal, S.; Nordestgaard, B.G.; Tybjaerg-Hansen, A.; Frikke-Schmidt, R. Triglycerides as a shared risk factor between dementia and atherosclerotic cardiovascular disease: A study of 125 727 individuals. Clin. Chem. 2021, 8, 245–255. [Google Scholar] [CrossRef] [PubMed]
  29. Bernath, M.M.; Bhattacharyya, S.; Nho, K.; Barupal, D.K.; Fiehn, O.; Baillie, R.; Risacher, S.L.; Arnold, M.; Jacobson, T.; Trojanowski, J.Q.; et al. Serum triglycerides in Alzheimer disease: Relation to neuroimaging and CSF biomarkers. Neurology 2020, 94, e2088–e2098. [Google Scholar] [CrossRef]
  30. Koch, M.; Jensen, M. HDL-cholesterol and apolipoproteins in relation to dementia. Curr. Opin. Lipidol. 2016, 2, 76–87. [Google Scholar] [CrossRef] [PubMed]
  31. Lara, V.P.; Caramelli, P.; Teixeira, A.L.; Barbosa, M.T.; Carmona, K.C.; Guimarães, H.C.; Carvalho, M.G.; Fernandes, A.P.; Gomes, K.B. Cortisol, HDL-c, VLDL-c, and APOE Polymorphisms as Laboratorial Parameters Associated to Cognitive Impairment No Dementia (CIND) and Dementia. J. Clin. Lab. Anal. 2016, 30, 374–380. [Google Scholar] [CrossRef] [PubMed]
  32. Hossain, M.S.; Oomura, Y.; Fujino, T.; Akashi, K. Glucose signaling in the brain and periphery to memory. Neurosci. Biobehav. Rev. 2020, 110, 100–113. [Google Scholar] [CrossRef]
  33. Llewellyn, D.J.; Langa, K.M.; Friedland, R.P.; Lang, I.A. Serum albumin concentration and cognitive impairment. Curr. Alzheimer Res. 2010, 7, 91–96. [Google Scholar] [CrossRef] [PubMed]
  34. Kim, T.S.; Pae, C.U.; Yoon, S.J.; Jang, W.; Lee, N.J.; Kim, J.J.; Lee, S.J.; Lee, C.L.; Paik, I.H.; Lee, C.U. Decreased plasma antioxidants in patients with Alzheimer’s disease. Int. J. Geriatr. Psychiatry 2006, 21, 344–348. [Google Scholar] [CrossRef]
  35. Kim, J.W.; Byun, M.S.; Lee, J.H.; Yi, D.; Jeon, S.Y.; Sohn, B.K.; Lee, J.Y.; Shin, S.A.; Kim, Y.K.; Kang, K.M.; et al. Serum albumin and beta-amyloid deposition in the human brain. Neurology 2020, 18, e815–e826. [Google Scholar] [CrossRef] [PubMed]
  36. Zlokovic, B.V. Clearing amyloid through the blood-brain barrier. J. Neurochem. 2004, 89, 807–811. [Google Scholar] [CrossRef] [PubMed]
  37. Maeda, S.; Takeya, Y.; Oguro, R.; Akasaka, H.; Ryuno, H.; Kabayama, M.; Yokoyama, S.; Nagasawa, M.; Fujimoto, T.; Takeda, M.; et al. Serum albumin/globulin ratio is associated with cognitive function in community-dwelling older people: The Septuagenarians, Octogenarians, Nonagenarians Investigation with Centenarians study. Geriatr. Gerontol. Int. 2019, 19, 967–971. [Google Scholar] [CrossRef] [PubMed]
  38. Dodel, R.; Rominger, A.; Bartenstein, P.; Barkhof, F.; Blennow, K.; Forster, S.; Winter, Y.; Bach, J.P.; Popp, J.; Alferink, J.; et al. Intravenous immunoglobulin for treatment of mild-to-moderate Alzheimer’s disease: A phase 2, randomised, double-blind, placebo-controlled, dose-finding trial. Lancet Neurol. 2013, 12, 233–243. [Google Scholar] [CrossRef]
  39. Bedogni, G.; Gastaldelli, A.; Tiribelli, C.; Agosti, F.; De Col, A.; Fessehatsion, R.; Sartorio, A. Relationship between glucose metabolism and non-alcoholic fatty liver disease severity in morbidly obese women. J. Endocrinol. Investig. 2014, 37, 739–744. [Google Scholar] [CrossRef]
  40. Perla, F.M.; Prelati, M.; Lavorato, M.; Visicchio, D.; Anania, C. The role of lipid and lipoprotein metabolism in non-alcoholic fatty liver disease. Children 2017, 4, E46. [Google Scholar] [CrossRef]
  41. Nho, K.; Kueider-Paisley, A.; Ahmad, S.; MahamoudianDehkordi, S.; Arnold, M.; Risacher, S.; Louie, G.; Blach, C.; Baillie, R.H.X. Association of Altered Liver Enzymes with Alzheimer Disease Diagnosis, Cognition, Neuroimaging Measures, and Cerebrospinal Fluid Biomarkers. JAMA 2019, 3, e197978. [Google Scholar] [CrossRef]
  42. Shen, Z.; Ruan, Q.; Yu, Z.; Sun, Z. Chronic kidney disease-related physical frailty and cognitive impairment: A systemic review. Geriatr. Gerontol. Int. 2017, 17, 529–544. [Google Scholar] [CrossRef] [PubMed]
  43. Deckers, K.; Camerino, I.; van Boxtel, M.P.; Verhey, F.R.; Irving, K.; Brayne, C.; Kivipelto, M.; Starr, J.M.; Yaffe, K.; Leeuw, P.W.; et al. Dementia risk in renal dysfunction: A systematic review and meta-analysis of prospective studies. Neurology 2017, 351, 198–208. [Google Scholar] [CrossRef]
  44. Koop-Nieuwelink, C.; Sedaghat, S.; Mutlu, U.; Licher, S.; Franco, O.H.; Ikram, M.A.; Geerlings, M.I.; Ikram, M.K.; Bos, D. Kidney Function and the Risk of Stroke and Dementia: The Rotterdam Study. J. Alzheimers Dis. 2019, 67, 821–826. [Google Scholar] [CrossRef]
  45. Scheppach, J.B.; Coresh, J.; Wu, A.; Gottesman, R.F.; Mosley, T.H.; Knopman, D.; Grams, M.E.; Sharrett, A.R.; Koton, S. Albuminuria and estimated GFR as risk factors for dementia in midlife and older age: Findings from the Aric study. Am. J. Kidney Dis. 2020, 76, 775–783. [Google Scholar] [CrossRef]
  46. Xuan, S.; Xinyan, L.; Fei, L.; Chunting, W. Comparison of machine learning and logistic regression models in predicting acute kidney injury: A systematic review and meta-analysis. Int. J. Med. Inform. 2021, 151, 104484. [Google Scholar]
  47. Thottakkara, P.; Ozrazgat-Baslanti, T.; Hupf, B.; Rashidi, P.; Pardalos, P.; Momcilovic, P.; Bihorac, A. Application of machine learning techniques to high-dimensional clinical data to forecast postoperative complications. PLoS ONE 2016, 11, e0155705. [Google Scholar] [CrossRef]
  48. Xiang, Y.; Yuwei, J.; Mengjie, H. Machine learning for acute kidney injury: Changing the traditional disease prediction model. Front. Med. 2023, 10, 1050255. [Google Scholar]
  49. Chaker, L.; Wolters, F.J.; Bos, D.; Korevaar, T.I.; Hofman, A.; Lugt, A.; Koudstaal, P.J.; Franco, O.H.; Dehghan, A.; Vernooij, M.W.; et al. Thyroid function and the risk of dementia: The Rotterdam Study. Neurology 2016, 87, 1688–1695. [Google Scholar] [CrossRef] [PubMed]
  50. Santhanam, P.; Nath, T.; Lindquist, M.; Cooper, D.S. Relationship between TSH Levels and Cognition in the Young Adult: An Analysis of the Human Connectome Project Data. J. Clin. Endocrinol. Metab. 2022, 107, 1897–1905. [Google Scholar] [CrossRef]
  51. Santhanam, P.; Nath, T.; Mohammad, F.; Ahima, R.S. Artificial intelligence may offer insight into factors determining individual TSH level. PLoS ONE 2020, 15, e0233336. [Google Scholar] [CrossRef]
  52. Lara, V.P.; Caramelli, P.; Teixeira, A.L.; Barbosa, M.T.; Carmona, K.C.; Carvalho, M.G.; Fernandes, A.P.; Gomes, K.B. High cortisol levels are associated with cognitive impairment no-dementia (CIND) and dementia. Clin. Chim. Acta 2013, 23, 18–22. [Google Scholar] [CrossRef]
  53. Gil-Bea, F.; Aisa, B.; Solomon, A.; Solas, M.; Mugueta, M.C.; Winblad, B.; Kivipelto, M.; Cedazo-Mínguez, A.; Ramírez, M.J. HPA axis dysregulation associated to apolipoproteína E4 genotype in Alzheimer’s disease. J. Alzheimers Dis. 2010, 22, 829–838. [Google Scholar] [CrossRef] [PubMed]
  54. Westerink, J.; Rajae-Joordens, R.; Ouwerkerk, M.; Dooren, M.; Jelfs, S.; Denissen, A.J.; Vries, E.P.; Ee, R. Deriving a cortisol-related stress indicator from wearable skin conductance measurements: Quantitative model & experimental validation. Front. Comput. Sci. 2020, 2, 39. [Google Scholar]
  55. Chen, S.; Chen, G.; Li, Y.; Yue, Y.; Zhu, Z.; Li, L.; Jiang, W.; Shen, Z.; Wang, T.; Hou, Z.; et al. Predicting the diagnosis of various mental disorders in a mixed cohort using blood-based multi-protein model: A machine learning approach. Eur. Arch. Psychiatry Clin. Neurosci. 2022, 25, 1–11. [Google Scholar] [CrossRef] [PubMed]
  56. Pearlmutter, P.; DeRose, G.; Samson, C.; Linehan, N.; Cen, Y.; Begdache, L.; Won, D.; Koh, A. Sweat and saliva cortisol response to stress and nutrition factors. Sci. Rep. 2020, 10, 19050. [Google Scholar] [CrossRef] [PubMed]
  57. Crumpei-Tanasă, I.; Crumpei, I. A Machine Learning Approach to Predict Stress Hormones and Inflammatory Markers Using Illness Perception and Quality of Life in Breast Cancer Patients. Curr. Oncol. 2021, 28, 3150–3171. [Google Scholar] [CrossRef] [PubMed]
  58. Rabbani, N.; Kim, G.; Suarez, C.; Chen, J. Applications of machine learning in routine laboratory medicine: Current state and future directions. Clin. Biochem. 2022, 103, 1–7. [Google Scholar] [CrossRef]
  59. Baxi, V.; Edwards, R.; Montalto, M.; Saha, S. Digital pathology and artificial intelligence in translational medicine and clinical practice. Mod. Pathol. 2022, 35, 23–32. [Google Scholar] [CrossRef]
Figure 1. Diagram showing the dataset analysis. First, models from the random combination of 90% of all variables were performed. Then, for the models with better accuracy, cross validation was applied: the data from all patients were divided by 5; 4 folds were used for training and the last fold was used for testing—this process was repeated five times. The final model was tested with 10% of the data. All the metrics are reported as the average of these tests. Gray rectangle: test folder.
Figure 1. Diagram showing the dataset analysis. First, models from the random combination of 90% of all variables were performed. Then, for the models with better accuracy, cross validation was applied: the data from all patients were divided by 5; 4 folds were used for training and the last fold was used for testing—this process was repeated five times. The final model was tested with 10% of the data. All the metrics are reported as the average of these tests. Gray rectangle: test folder.
Brainsci 13 00690 g001
Figure 2. Area under the ROC curve for the prediction of cognitive decline.
Figure 2. Area under the ROC curve for the prediction of cognitive decline.
Brainsci 13 00690 g002
Figure 3. SHAP value for the random forest model regarding cognitive decline. Values below 0 on the X axis tend to not decline and values above 0 tend to show cognitive decline. The red color indicates the greater value of the variable, and the blue color indicates the lower value.
Figure 3. SHAP value for the random forest model regarding cognitive decline. Values below 0 on the X axis tend to not decline and values above 0 tend to show cognitive decline. The red color indicates the greater value of the variable, and the blue color indicates the lower value.
Brainsci 13 00690 g003
Figure 4. Area under the ROC curve for the prediction of functional decline.
Figure 4. Area under the ROC curve for the prediction of functional decline.
Brainsci 13 00690 g004
Figure 5. SHAP value for the random forest model regarding functional decline. Values below 0 on the X axis tend to not decline and values above 0 tend to cognitive decline. The red color indicates the greater value of the variable and the blue color indicates the lower value.
Figure 5. SHAP value for the random forest model regarding functional decline. Values below 0 on the X axis tend to not decline and values above 0 tend to cognitive decline. The red color indicates the greater value of the variable and the blue color indicates the lower value.
Brainsci 13 00690 g005
Table 1. Demographic characteristics of the population and cognitive/functional performance in 2008–2009.
Table 1. Demographic characteristics of the population and cognitive/functional performance in 2008–2009.
CharacteristicPopulation Evaluated (n = 132)
Age 79.52 ± 4.26
Male/Female51/81
Cognitive decliners (n,%)70, 53%
Functional decliners (n,%)47, 36%
GSC score 2008 −1.73 ± 3.92
GSC score 2009 −2.15 ± 4.75
GSC score between 2008 and 2009−0.41 ± 3.22
FAQ score 2008 1.57 ± 3.12
FAQ score 2009 3.23 ± 5.14
FAQ score between 2008 and 20091.66 ± 4.69
Functional Activities Questionnaire—FAQ, Global Cognitive Score—GCS. Values are expressed as mean ± standard deviation. Negative score: decliner; positive score: nondecliner.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Gomes, K.B.; Pereira, R.G.; Braga, A.A.; Guimarães, H.C.; Resende, E.d.P.F.; Teixeira, A.L.; Barbosa, M.T.; Junior, W.M.; Carvalho, M.d.G.; Caramelli, P. Machine Learning-Based Routine Laboratory Tests Predict One-Year Cognitive and Functional Decline in a Population Aged 75+ Years. Brain Sci. 2023, 13, 690. https://doi.org/10.3390/brainsci13040690

AMA Style

Gomes KB, Pereira RG, Braga AA, Guimarães HC, Resende EdPF, Teixeira AL, Barbosa MT, Junior WM, Carvalho MdG, Caramelli P. Machine Learning-Based Routine Laboratory Tests Predict One-Year Cognitive and Functional Decline in a Population Aged 75+ Years. Brain Sciences. 2023; 13(4):690. https://doi.org/10.3390/brainsci13040690

Chicago/Turabian Style

Gomes, Karina Braga, Ramon Gonçalves Pereira, Alexandre Alberto Braga, Henrique Cerqueira Guimarães, Elisa de Paula França Resende, Antônio Lúcio Teixeira, Maira Tonidandel Barbosa, Wagner Meira Junior, Maria das Graças Carvalho, and Paulo Caramelli. 2023. "Machine Learning-Based Routine Laboratory Tests Predict One-Year Cognitive and Functional Decline in a Population Aged 75+ Years" Brain Sciences 13, no. 4: 690. https://doi.org/10.3390/brainsci13040690

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop