Next Article in Journal / Special Issue
Pregnancy in Chronic Kidney Disease
Previous Article in Journal
PTEN, MMP2, and NF-κB and Regulating MicroRNA-181 Aggravate Insulin Resistance and Progression of Diabetic Nephropathy: A Case-Control Study
Previous Article in Special Issue
miR-148b as a Potential Biomarker for IgA Nephropathy
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Salt Reduction Using a Smartphone Application Based on an Artificial Intelligence System for Dietary Assessment in Patients with Chronic Kidney Disease: A Single-Center Retrospective Cohort Study

1
Department of Nephrology, Tokyo Shinagawa Hospital, 6-3-22 Higashiooi, Shinagawa-ku, Tokyo 140-8522, Japan
2
Division of Nephrology, Kidney Clinic Setagaya, 4-2-11 Minamikayasuyama, Setagaya-ku, Tokyo 157-0062, Japan
3
Department of Endocrinology, Metabolism and Nephrology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo 160-8582, Japan
*
Author to whom correspondence should be addressed.
Kidney Dial. 2023, 3(1), 139-151; https://doi.org/10.3390/kidneydial3010012
Submission received: 4 October 2022 / Revised: 22 February 2023 / Accepted: 14 March 2023 / Published: 16 March 2023

Abstract

:
This study evaluated the clinical usefulness of an artificial intelligence-powered smartphone application in reducing the daily salt intake of patients with chronic kidney disease (CKD). This study included 35 patients with CKD who were classified into app users (i.e., 13 outpatients who used the app for 3 months and whose salt intake was evaluated before and after using the app) and app nonusers (i.e., 22 outpatients not using the application; their salt intake was similarly evaluated). The primary outcome was estimated as salt intake after 3 months of using the application and at a 6-month follow-up. Linear mixed model analysis revealed that app users had a significant decrease in estimated salt intake after 3 months (−2.12 g/day; 95% CI, −4.05 to −0.19; p = 0.03) compared with app nonusers but not after 6 months (−0.96 g/day; 95% CI, −3.13 to 1.20; p = 0.38). App users showed a significant decrease in body mass index at 3 months (−0.42 kg/m2 [95% CI, −0.78 to −0.049; p = 0.03]) and 6 months (−0.65 kg/m2 [95% CI, −1.06 to −0.24; p = 0.002]). The application promoted short-term reduction in salt intake. These results provide a strong rationale for future trials.

1. Introduction

Salt restriction in patients with chronic kidney disease (CKD) is important in reducing hypertension, CKD progression, cardiovascular events, and all-cause mortality [1,2,3]. The Japanese Society of Nephrology recommends limiting salt intake to 3–6 g/day [4]; however, encouraging salt restriction without the patients’ knowledge of their actual intake is difficult. In this regard, a questionnaire survey of Japanese hypertensive patients could show the salt intake of salt-conscious patients was only about 1 g/day lower than that of non-salt-conscious patients [5]. Likewise, another study reported that only about 10% of the population among Japanese hypertensive patients had achieved an average salt intake of less than 6 g/day [6].
Therefore, it was hypothesized that the “visualization” of salt intake would be useful to reduce it in patients, having already previously shown that feedback of estimated salt intake from spot urine at every outpatient visit in CKD patients can help them limit their salt intake [7]. The effectiveness of spot urine-guided salt reduction was also described in cardiology outpatients during a short follow-up period [8]. These interventions, however, can only be carried out on an outpatient basis, that is, once a month at most. Therefore, we focused on the artificial intelligence (AI)-based function for meal image analysis using deep learning with neural networks (https://dl.sony.com accessed on 6 September 2022), which calculates the calories and nutrients of a dish via a picture alone, ideally promoting patient awareness regarding their daily salt intake. Moreover, the number of patients using their smartphones, in addition to the smartphone applications targeting patients, has been on the rise, and the use of AI complements/enhances smartphone applications.
This retrospective cohort study aimed to verify the usefulness of a smartphone application, Gohan Coach, developed and brought to market by Kirin Holdings (Tokyo, Japan). The company considered the app to still be in the validation stage and that it was therefore too early to distribute widely for a fee. A test operation period with free usage of the app was provided to patients referred by a limited number of medical institutions, including our clinic. The present study was conducted during this test operation period. The app has an AI-based meal image analysis function based on a validated web application program interface (API) and was the only app that supported Japanese with similar functions to goFOODTM, which was validated for clinical use but does not support Japanese [9]. The accuracy of the analysis was further enhanced by the function that allowed manual input of the information by users, including the amounts and the kinds of food and seasonings consumed. This study evaluated the importance of these functions in reducing salt intake, urinary protein excretion, blood pressure (BP), and body weight (BW) or body mass index (BMI).

2. Materials and Methods

2.1. Study Design and Population

The present study and its protocols were reviewed and approved by the ethics committee of Kitasato University Hospital (Approved number: 20075) and are in accordance with the principles of the Declaration of Helsinki. This was a single-center, retrospective cohort study in which longitudinal changes in clinical parameters, including estimated salt intake, were compared between two groups: patients who used the app and those who did not.
We assessed the eligibility of all stable patients with CKD who were not receiving renal replacement therapy at our clinic during the trial period of the app, i.e., August 2019 to December 2019 (n = 314; Figure 1a). In the present study, we defined CKD as an eGFR (<60 mL/min/1.73 m2) and/or markers of kidney damage, including proteinuria, urine sediment abnormalities (including hematuria), and structural abnormalities. In the clinic, CKD outpatients are essentially followed every 3 months, and we strongly asked patients to perform periodical 24 h urine collection to estimate their salt intake. During this period, the patients in the clinic could use the app for free for 3 months. We recruited patients who wanted to use the smartphone application on a clinical basis in August 2019 (not all patients were necessarily recommended the use of the application directly by their doctors), the first month of the trial period of the app. These patients were also asked to perform 24 h urine collection for biochemical tests as much as possible immediately before and after app use to evaluate the clinical usefulness of the app. As such, all the patients in the app user group started using the app in August or September 2019 and stopped using the app in November or December 2019. Additionally, salt intake in the app user group was assessed immediately before and after the 3-month use of the app (n = 13; Figure 1b). Conversely, the app nonuser group included patients who did not use the smartphone application and those whose salt intake was estimated at the two outpatient visits conducted during the study period (n = 22). It was likely that only a small percentage of the patients, who did not use the app, performed 24 h urine collection during daily clinical practice, given the constraints associated with the collection as well as the additional charges at our clinic (around ¥3000). We assumed that the patients would be able to follow the 24 h urine collection method when using the app as described above, which might have led to the small number of patients choosing to use the app.
Due to the retrospective design of this study, written informed consent to use the application was not obtained. The use of the app by patients was optional. Patients aged <20 years (n = 7) and who did not visit a doctor (e.g., those who sought vaccination) between August 2019 and December 2019 (n = 15) were excluded as the minimum required clinical data could not be obtained.

2.2. Outcome Measures and Data Collection

The primary study outcome was change in estimated salt intake assessed with 24 h urine collection. Secondary outcomes were urinary protein excretion, BP, BW, BMI, and estimated glomerular filtration rate (eGFR).
Although 24 h urine collection has been the gold standard for evaluating salt intake, it has limitations including its complexity, difficulty in performing repeated assessments, and the need for assessment of 24 h creatinine excretion to ensure the validity of urine collection, as described in the Scientific Statement of the Japanese Society Hypertension [10]. The Society also describes two methods for 24 h urine collection: (1) whole-urine collection; and (2) collection using a partition cup (Urinemate P, Sumitomo Bakelite Co., Ltd., Tokyo, Japan). The latter requires a rather complex procedure, whereas the collecting container allows collection outside the home. In this retrospective study, we performed urine collection using a partition cup, with all recruited patients receiving a detailed explanation of the method, and performed 24 h urine collection using the method at least once prior to the commencement of the study. Although we were unable to strictly and prospectively ensure the accuracy of 24 h urinary collection, the accuracy of 24 hr urine collection was assessed by each physician. First, the start and end time points of urine collection were determined to confirm that the duration of urine collection was 24 h and that patients did not miss collecting any urine samples. Second, each physician ensured that the variation in 24 h urinary creatinine excretion and its deviation from the estimated 24 h creatinine excretion was limited to 0.2 g/day [11,12].
In addition, the following demographic data were collected at the time of the first estimation of salt intake (baseline) from medical records according to age, sex, the primary disease for CKD, CKD stage, comorbidities, and the use of antihypertensive drugs. BP was measured twice in a relaxed seated position using an automated device, and the mean BP for each participant was thus used for the analysis. Additionally, BW (kg), height (m), and BMI (kg/m2) were collected as anthropometric data.
As biochemical data, serum total protein (g/dL), albumin (g/dL), hemoglobin (mg/dL), sodium (mEq/L), potassium (mEq/L), urea nitrogen (mg/dL), creatinine (mg/dL), uric acid (mg/dL), low-density lipoprotein cholesterol (mg/dL), high-density lipoprotein cholesterol (mg/dL), and triglyceride (mg/dL) levels were measured from blood samples. eGFRs were calculated using three-variable Japanese equations, which used serum creatinine levels [13]. The salt intake (g/day) and protein excretion (g/day) estimates were obtained from 24 h urine samples.

2.3. Intervention and Follow-Up

Gohan Coach was developed to provide services tailored to the individual circumstances of the patients, with the patients’ goal to more easily and naturally perform their dietary management, which plays a key role in disease management. Patients in the app user group recorded the contents of each meal on the app and were critiqued weekly, through automatically generated feedback from the application, on their estimated salt, protein, and total energy intake, the target intakes of which were based on guidelines for CKD stage and the presence of diabetes [4,14] (Figure 2). Patients first took a photo of their dishes, which the AI automatically analyzes for the nutrient content. This AI-based meal image analysis function was based on the web API “Calorie Check API” (https://iot.sonynetwork.co.jp/service/caloriecheck/ accessed on 6 September 2022, in Japanese). Calorie Check API was developed by Sony Network Communications Inc. (Tokyo, Japan), which has been conducting research and development on machine learning since before 2000 and has created its own unique meal image analysis technology. The meal content is analyzed for nutrient information derived from a food composition database of about 110,000 items (https://www.eatsmart.co.jp/service/ accessed on 6 September 2022, in Japanese) provided by Eat Smart, Inc. (Tokyo, Japan). Subsequently, the menu, ingredients, and amount are displayed on the Gohan Coach app. Considering that it is impossible (1) to grasp the amount of food and (2) determine the differences in seasoning from meal images alone, a function that enables patients to modify the information manually if necessary was added to Gohan Coach. Therefore, the accuracy of the output data mostly depends on the accuracy of the patients’ inputs. Theoretically, the nutrients and calories, including salt content, in the meals should be accurate, provided that the meal information is properly entered in the app. Based on the results of each registration (numerical values), an algorithm-based critique and feedback report, specifically on the salt, energy, and protein content, is provided. This algorithm itself is not AI-based but generates a feedback report in response to changes from the previous week in the parameters determined from the data entered by the patients, such as salt intake, calories, BP, and BW, or based on a comparison with individual target values of the parameters. This feedback was sent to the patients on a weekly basis (e.g., the salt intake was lower than that of last week, but did not reach the target value of 6 g/day) (Figure 2). Instructions on how to use the application were given only during the outpatient visit when the patients started using the app, according to the manufacturer’s instructions.
Only the patients in the app user group used the application for the 3 months between the first (0 month/baseline) and second (3 months/intervention phase) salt intake assessments performed at the corresponding outpatient visit. The patients in the app user group did not receive any interventions such as seeing a nutritionist outside the service of the application. The patients in the app nonuser group received the usual care from nephrologists with instructions on salt reduction (as did the case group) but did not receive intervention from nutritionists (Figure 1b). Furthermore, patients in both the app user and nonuser groups were followed up until the next outpatient visit (6 months from the baseline/maintenance phase). Measurements of BP and anthropometric and biochemical data were repeated at the 3-month and 6-month milestones.

2.4. Statistical Analyses

As this study was a retrospective study rather than a prospective study, a definitive sample size calculation was not performed. Instead, an a priori power analysis was performed as follows: the effect size was 1.05, which was calculated from the difference in salt intake between groups in a randomized controlled trial assessing the effectiveness of sodium restriction in patients with CKD [15] and from the standard deviation (SD) of the estimated salt intake determined according to the results of the control and intervention groups in a Japanese cohort [7]. In the present study, 13 and 22 patients were enrolled in the app user and app nonuser groups, respectively. We determined that the a priori statistical power of the study was 0.83, which was calculated using G*Power for Mac (ver. 3.1.9.4) [16] with a two-tailed significance value of 0.05 and an effect size of 1.05.
All continuous variables are expressed as means ± SD after confirming their normality by using the Shapiro–Wilk test, and binary variables are expressed as numbers with percentages. The unpaired Student’s t-test (continuous variables) and Fisher’s exact test (binary variables) were used to compare the parameters between the groups. Additionally, the paired t-test was performed to compare continuous variables within each group.
For the pivotal analysis of this study, we primarily analyzed the effect of the study group over time using linear mixed models to assess the association of the use of Gohan Coach with the primary and secondary outcomes [15,17] considering the potential differences in the characteristics between the app user and app nonuser groups and missing data at 6 months. These models included the following fixed effects: group, time (baseline and 3 and 6 months), age, sex, and baseline eGFR, given the well-accepted and reported notion that age, sex, and eGFR affect sodium intake [18,19]. Models were additionally adjusted for the baseline value of each dependent variable so that the estimates presented would be more precise. An interaction term was also included as a fixed effect, time × group, which indicated the effect of the study group over time, and the models included the number of participants as a random effect.
The SPSS software for Mac (ver. 26; IBM Corp., New York, NY, USA) was used to perform all statistical analyses, and p < 0.05 indicated statistical significance.

3. Results

3.1. Baseline Characteristics

Table 1 summarizes the baseline clinical characteristics of the study participants and the comparison between the app user and the nonuser groups according to their respective interventions of the Gohan Coach application (Table 1). There were no statistically significant differences in demographic, anthropometric, and biochemical data between the groups.
Among the patients who used the application, age, sex, BW, eGFR, and BP did not significantly vary between patients who did not perform urine collection (n = 2, 1 male, 50.0 ± 8.5 years) and those who did (app user group). Patients who did not perform the 24 h urinary collection were excluded from the analysis, regardless of whether they were app users or nonusers.
As indicated in the inclusion criteria, all participants were followed up at 3 months with a 24 h urine collection. However, several patients refused to perform 24 h urine collection (n = 6) and/or to visit the clinic partly because of the coronavirus disease 2019 pandemic (n = 2) at 6 months. Eventually, 12 patients in the app user group and 17 patients in the nonuser group were followed up until 6 months. No patients died, were transferred to other clinics, or changed their antihypertensive agents during the follow-up period.
Based on the login records of the 11 patients, 7 used the app for the entire 3 months, 2 used it for 2–3 months, and 2 used it for only ≤2 months. Additionally, among the eight patients who set behavioral goals as a purpose for using the application, seven achieved them using the app. Analyses were performed for all patients, comparing the app user group with the app nonuser group, without considering adherence and achievement of goals. There were no questions or complaints regarding the usability of the app from study participants, although we did not quantitatively assess the usability of the app with scientifically validated tools.

3.2. Within-Group Comparison on Salt Reduction

The results of the intra-group comparisons on the primary outcome are shown in Table 2 (baseline and 3 months) and Table S1 (baseline and 6 months). Estimated salt intake tended to decrease from baseline to 3 months in the app user group (p = 0.09), but no difference was observed between baseline and 6 months. Three-month changes in estimated salt intake were −1.17 ± 2.31 g/day and 0.96 ± 2.57 g/day in the app user group and nonuser group, respectively, and the effect size was calculated as 0.87. Using this effect size, an error of 0.05, and the sample size of the present study, the post hoc power of the unpaired t-test was calculated as 0.68.
Linear mixed models confirmed that the estimated salt intake with the estimated marginal mean in the app user group changed from 8.29 ± 0.56 g/day at baseline to 7.12 ± 0.56 g/day at 3 months and 7.95 ± 0.63 g/day at 6 months, whereas 7.70 ± 0.43, 8.65 ± 0.43, and 8.32 ± 0.57 g/day were registered in the nonuser group, respectively (Figure 3). Furthermore, although the app user group demonstrated a mean change of −2.12 g/day (95% confidence interval [CI], −4.05 to −0.19; p = 0.03) in estimated salt intake at 3 months as compared with the app nonuser group, the significant difference diminished at 6 months, which is the maintenance phase (−0.96 g/day [95% CI, −3.13 to 1.20; p = 0.38]).

3.3. Within-Group Comparisons on Secondary Outcomes

From baseline to 3 months in the app user group, urinary protein, MBP, BW, and BMI tended to decrease (p = 0.07, 0.07, 0.08, and 0.07, respectively), whereas diastolic BP (DBP) significantly decreased (p = 0.03) (Table 2). However, BW and BMI significantly increased (p = 0.02 for both), whereas eGFR significantly decreased (p = 0.01), from baseline to 6 months in the app nonuser group (Table S1).
The app user group showed a trend to decrease in the mean change in the urinary protein of −0.23 g/day (95% CI, −0.46 to 0.0026; p = 0.05) at 3 months, which persisted at 6 months (−0.27 g/day; 95% CI, −0.55 to 0.0052; p = 0.05) (Table 3). Diastolic and mean BP also tended to decrease with the intervention at 3 months [−7.60 mmHg (95% CI, −15.62 to 0.41; p = 0.06) and −7.57 mmHg (95% CI, −15.32 to 0.18; p = 0.06), respectively], but the impact of these changes decreased at 6 months [−5.98 mmHg (95% CI, −15.35 to 3.38; p = 0.21) and −4.50 mmHg (95% CI, −13.61 to 4.61; p = 0.33), respectively]. BW (−0.42 kg/m2; 95% CI, −0.78 to −0.049; p = 0.03) and BMI (−1.06 kg; 95% CI, −2.05 to −0.059; p = 0.04) significantly decreased in the app user group at 3 months, which persisted at 6 months (BW: −0.65 kg/m2) (95% CI, −1.06 to −0.24; p = 0.002) and BMI: −1.75 kg (95% CI, −2.89 to −0.61; p = 0.003).

4. Discussion

Apart from the importance of salt restriction in patients with CKD [1,2,3], the evaluation of their salt intake and the patients’ education in salt restriction is left to each medical facility, requiring continuous efforts and the precious time of medical staff and facilities. Even though several trials evaluating various interventions to reduce patients’ salt intake were able to demonstrate that these interventions were effective in reducing the patient’s salt intake by approximately 2 g/day in a relatively short period [15,17,20,21,22], these salt-reducing effects are proved to diminish after long-term tracking, even in highly motivated patients who are willing to participate in clinical trials [15,17,20], making it easy to understand how difficult it is to instruct patients how to reduce their salt intake in a daily clinical practice context. Meanwhile, our groups and other groups have raised the relevance of visualizing salt intake by providing frequent feedback on salt intake estimates during outpatient visits [7,8]. It is therefore desirable to create and use a uniform salt restriction tool that includes the visualization of salt intake so as to improve the efficiency and the quality of daily clinical practices.
In the present study, we focused on Gohan Coach, a smartphone application with AI-based image recognition systems that estimates the amount of nutrients such as salt in each meal and that provides an algorithm that provides weekly critiques of meals based on the estimated nutrient content. As many Japanese foods are seasoned with salt, soy sauce, or soybean paste, we believe that dietary sodium restriction is particularly challenging for Japanese people who are not aware of their actual salt intake. A previous Japanese study reported that awareness of the need for salt restriction led to only approximately a 1 g/day reduction in urinary salt excretion [5]. A separate Japanese study reported that only around 10% of patients achieved an average urinary salt excretion of less than 6 g/day [6]. Based on these findings, we previously posited that “visualization” of salt intake has utility in reducing salt intake in patients with CKD [7], and such an application allows patients to be aware of their daily estimated salt intake in a timely manner and to receive feedback on their diet on a weekly basis, which is more frequent than can be provided on an outpatient basis. In contrast, the impact of app use on salt reduction was not sustained at the 6-month follow-up visit after the end of the 3-month period of app use, as described in previous trials [15,17]. Further studies are warranted to examine whether continued use of the app or transition to other interventions at the end of the period of app use lead to sustained salt intake reductions.
In contrast to the app user group, salt intake, urinary protein, BP, and BW with BMI in the app nonuser group were maintained or slightly increased from baseline to 3 and 6 months after, which occurred during the transition from the warm (baseline) to cold (3 and 6 months) season in Japan. A similar seasonal pattern, especially an increase in the intake or urinary excretion of salt, from warm to cold seasons, had been well documented in CKD patients and in healthy individuals [23,24,25]. Simultaneously, a slight increase in salt intake from baseline to 3 months in the app nonuser group suggested that the instruction related to salt reduction, provided during daily clinical practice was extremely inadequate, which is the reason why several trials with various interventions have aimed to reduce the patients’ salt intake [15,17,20,21,22]. The decrease in urinary protein and BW with BMI persisted during the maintenance period after the patients had finished using the application, and the extent of reduction in estimated salt intake and BP were attenuated as they were in previous trials [15,17,20], indicating that the app or other interventions to reduce salt intake were effective in the short term but might prove insufficient for promoting behavioral change in the long term. Although a BP drop of approximately −7.50 mmHg at 3 months in this study was relatively high, the BP variation among patients and the small sample size contributed to the lack of statistically significant changes between the groups. While similar discrepancies were admitted in the previous trial, it is difficult to determine for certain the reason for this discrepancy, in which decreases in urinary protein excretion and BW persisted after the intervention in spite of a disappearance of the salt reduction effect [15]. Given that our application automatically estimates the amount of salt and calories in every meal and sends feedback on the data to the patients, the patients using the application likely consequently reduced both their calorie and salt intakes, which would have contributed to the decreases in BW and BMI [26]. From these results regarding dietary habit modifications, salt reduction is expected to be more difficult to sustain than calorie restriction. In addition to salt intake, being overweight is closely associated with proteinuria and CKD progression [27,28], so the maintenance of the reduction in urinary protein admitted in our study and in the previous trial might be due to the sustained decrease in BW and BMI. The decreases in BW in the app user group at 3 and 6 months are comparable to that of a previous trial on salt reduction [15]; however, the clinical significance of such decreases in BW with BMI observed in this study, which did not necessarily include obese patients, remains uncertain and should be investigated in future studies.
Nowadays, the number of patients using their smartphones is on the rise, and we can expect a corresponding increase in the number of smartphone applications targeting patients with CKD [29]. Two small observational studies suggested the feasibility, acceptability, and clinical usefulness of a smartphone-based self-management system in patients with advanced CKD [30] and remote dietary counseling by means of smartphone applications in patients with mild CKD [31], respectively. Although the patients included in these studies were relatively young with a mean age of approximately 60 years, the findings of the present study corroborate the results of these studies. However, the “digital divide” is an issue that cannot be ignored in healthcare, and it is important to take human factors into account when assessing the utility of smartphone applications [32]. Accordingly, the usefulness and feasibility of smartphone applications, particularly among elderly patients, remain unclear. Further studies should aim to include more diverse patient populations that include a greater proportion of elderly patients.
This study has several limitations. First, this was a retrospective study. Although adjustments were made for several baseline parameters in clarifying the usefulness of Gohan Coach, the presence of various biases was unavoidable. Although no significant differences in background characteristics were observed between the two groups, this perceived balance may have been due to the small sample size. At the same time, all selected patients in both the app user and nonuser groups, who performed troublesome 24 h urine collection during daily clinical practice throughout the study period, had undergone 24 h urine collection at least once prior to the start of the study. Therefore, potential confounders, including treatment adherence, might also be similar between the two groups. Moreover, the patients’ satisfaction with the app, trust, and implementation of the app’s recommendations are important aspects for analyzing the effects of the app. Unfortunately, we did not obtain the data systematically. Second, this pilot study was conducted in a single center with a small sample size, which might lead to the lack of significant changes in some of the parameters, such as urinary protein and BPs. Actually, a post hoc power analysis for the unpaired t-test to compare the 3-month change in estimated salt intake (the primary outcome) between the groups was calculated as 0.68, which indicated insufficient power (<0.80) to overcome the risk of type II error. In addition, the number of subjects was too small to represent CKD patients. Third, long-term follow-up is necessary to demonstrate the impact of the application on cardiovascular events or mortality, but not on the surrogate markers that include estimates of salt intake. Finally, due to the nature of this retrospective study, the frequency of using the application as well as the amount of protein intake that can be estimated from 24 h urine collection was evidently unavailable. Furthermore, at this time, the AI-based meal image analysis function of the application is unable to estimate the amount of food consumed or the amount of seasoning used. Therefore, the accuracy of the estimated salt intake and other data mostly depended on the accuracy of patients’ inputs. Although this manual modification function would improve the accuracy of those estimations, it could simultaneously make the analysis and the results of this study more subjective. Despite these limitations on the use of the application, we found significant differences in the analyses of the parameters of interest.

5. Conclusions

We demonstrated the potential utility of the smartphone application with an AI-based image recognition system Gohan Coach in the short-term reduction of estimated salt intake, urinary protein excretion, diastolic and mean BP, and BW with BMI. These results provide a strong rationale for a randomized controlled trial in the future.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/kidneydial3010012/s1, Table S1: Within-Group Comparisons of Parameters Between Baseline and at 6 Months.

Author Contributions

A.Y. and K.U. designed the study and wrote the initial draft of the manuscript. A.Y. and S.S. contributed to data collection. K.U. contributed to the analysis and interpretation of data. S.S. supervised the manuscript. All authors have approved the final version of the manuscript and agree to be accountable for all aspects of the work as well as ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

This study and all its protocols were reviewed and approved by the ethics committee of Kitasato University Hospital (Approved number: 20075). The approving body waived the need for written informed consent for this sturdy due to its retrospective design.

Informed Consent Statement

Informed consent for participation in this study was obtained in the form of an opt-out method on the website, given the retrospective design of the study.

Data Availability Statement

All data generated or analyzed during this study have been included in this article and its supplementary file.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Mente, A.; O’Donnell, M.J.; Rangarajan, S.; McQueen, M.J.; Poirier, P.; Wielgosz, A.; Morrison, H.; Li, W.; Wang, X.; Di, C.; et al. Association of urinary sodium and potassium excretion with blood pressure. N. Engl. J. Med. 2014, 371, 601–611. [Google Scholar] [CrossRef] [Green Version]
  2. O’Donnell, M.; Mente, A.; Rangarajan, S.; McQueen, M.J.; Wang, X.; Liu, L.; Yan, H.; Lee, S.F.; Mony, P.; Devanath, A.; et al. Urinary sodium and potassium excretion, mortality, and cardiovascular events. N. Engl. J. Med. 2014, 371, 612–623. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. He, J.; Mills, K.T.; Appel, L.J.; Yang, W.; Chen, J.; Lee, B.T.; Rosas, S.E.; Porter, A.; Makos, G.; Weir, M.R.; et al. Urinary sodium and potassium excretion and CKD progression. J. Am. Soc. Nephrol. 2016, 27, 1202–1212. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Japanese Society of Nephrology. Essential points from evidence-based clinical practice guidelines for chronic kidney disease 2018. Clin. Exp. Nephrol. 2019, 23, 1–15. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Ohta, Y.; Tsuchihashi, T.; Ueno, M.; Kajioka, T.; Onaka, U.; Tominaga, M.; Eto, K. Relationship between the awareness of salt restriction and the actual salt intake in hypertensive patients. Hypertens. Res. 2004, 27, 243–246. [Google Scholar] [CrossRef] [Green Version]
  6. Ohta, Y.; Tsuchihashi, T.; Onaka, U.; Eto, K.; Tominaga, M.; Ueno, M. Long-term compliance with salt restriction in Japanese hypertensive patients. Hypertens. Res. 2005, 28, 953–957. [Google Scholar] [CrossRef] [Green Version]
  7. Uchiyama, K.; Yanai, A.; Ishibashi, Y. Spot urine-guided salt reduction in chronic kidney disease patients. J. Ren. Nutr. 2017, 27, 311–316. [Google Scholar] [CrossRef]
  8. Hirota, S.; Sadanaga, T.; Mitamura, H.; Fukuda, K. Spot urine-guided salt reduction is effective in Japanese cardiology outpatients. Hypertens. Res. 2012, 35, 1069–1071. [Google Scholar] [CrossRef] [Green Version]
  9. Lu, Y.; Stathopoulou, T.; Vasiloglou, M.F.; Pinault, L.F.; Kiley, C.; Spanakis, E.K.; Mougiakakou, S. goFOODTM: An Artificial Intelligence System for Dietary Assessment. Sensors 2020, 20, 4283. [Google Scholar] [CrossRef]
  10. Tsuchihashi, T.; Kai, H.; Kusaka, M.; Kawamura, M.; Matsuura, H.; Miura, K.; Ando, K.; Maruyama, S.; Hayabuchi, H.; Takagi, Y.; et al. [Scientific statement] Report of the Salt Reduction Committee of the Japanese Society of Hypertension (3) Assessment and application of salt intake in the management of hypertension. Hypertens. Res. 2013, 36, 1026–1031. [Google Scholar] [CrossRef]
  11. Tanaka, T.; Okamura, T.; Miura, K.; Kadowaki, T.; Ueshima, H.; Nakagawa, H.; Hashimoto, T. A simple method to estimate populational 24-h urinary sodium and potassium excretion using a casual urine specimen. J. Hum. Hypertens. 2002, 16, 97–103. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Uchiyama, K.; Kitayama, C.; Yanai, A.; Ishibashi, Y. The effect of trichlormethiazide in autosomal dominant polycystic kidney disease patients receiving tolvaptan: A randomized crossover controlled trial. Sci. Rep. 2021, 11, 17666. [Google Scholar] [CrossRef] [PubMed]
  13. Matsuo, S.; Imai, E.; Horio, M.; Yasuda, Y.; Tomita, K.; Nitta, K.; Yamagata, K.; Tomino, Y.; Yokoyama, H.; Hishida, A.; et al. Revised equations for estimated gfr from serum creatinine in Japan. Am. J. Kidney Dis. 2009, 53, 982–992. [Google Scholar] [CrossRef] [PubMed]
  14. Araki, E.; Goto, A.; Kondo, T.; Noda, M.; Noto, H.; Origasa, H.; Osawa, H.; Taguchi, A.; Tanizawa, Y.; Tobe, K.; et al. Japanese clinical practice guideline for diabetes 2019. Diabetol. Int. 2020, 11, 165–223. [Google Scholar] [CrossRef]
  15. Meuleman, Y.; Hoekstra, T.; Dekker, F.W.; Navis, G.; Vogt, L.; van der Boog, P.J.M.; Bos, W.J.W.; van Montfrans, G.A.; van Dijk, S.; ESMO Study Group. Sodium restriction in patients with CKD: A randomized controlled trial of self-management support. Am. J. Kidney Dis. 2017, 69, 576–586. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Faul, F.; Erdfelder, E.; Lang, A.G.; Buchner, A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods 2007, 39, 175–191. [Google Scholar] [CrossRef]
  17. Humalda, J.K.; Klaassen, G.; de Vries, H.; Meuleman, Y.; Verschuur, L.C.; Straathof, E.J.M.; Laverman, G.D.; Bos, W.J.W.; van der Boog, P.J.M.; Vermeulen, K.M.; et al. A self-management approach for dietary sodium restriction in patients with CKD: A randomized controlled trial. Am. J. Kidney Dis. 2020, 75, 847–856. [Google Scholar] [CrossRef]
  18. Mozaffarian, D.; Fahimi, S.; Singh, G.M.; Micha, R.; Khatibzadeh, S.; Engell, R.E.; Lim, S.; Danaei, G.; Ezzati, M.; Powles, J.; et al. Global sodium consumption and death from cardiovascular causes. N. Engl. J. Med. 2014, 371, 624–634. [Google Scholar] [CrossRef] [Green Version]
  19. Cirillo, M.; Bilancio, G.; Cavallo, P.; Palladino, R.; Terradura-Vagnarelli, O.; Laurenzi, M. Sodium intake and kidney function in the general population: An observational, population-based study. Clin. Kidney. J. 2020, 14, 647–655. [Google Scholar] [CrossRef]
  20. Cook, N.R.; Kumanyika, S.K.; Cutler, J.A.; Whelton, P.K.; Trials of Hypertension Prevention Collaborative Research Group. Dose–response of sodium excretion and blood pressure change among overweight, nonhypertensive adults in a 3-year dietary intervention study. J. Hum. Hypertens. 2005, 19, 47–54. [Google Scholar] [CrossRef] [Green Version]
  21. de Vries, L.V.; Dobrowolski, L.C.; van den Bosch, J.J.; Riphagen, I.J.; Krediet, C.T.; Bemelman, F.J.; Bakker, S.J.; Navis, G. Effects of dietary sodium restriction in kidney transplant recipients treated with renin-angiotensin-aldosterone system blockade: A randomized clinical trial. Am. J. Kidney Dis. 2016, 67, 936–944. [Google Scholar] [CrossRef] [PubMed]
  22. Sacks, F.M.; Svetkey, L.P.; Vollmer, W.M.; Appel, L.J.; Bray, G.A.; Harsha, D.; Obarzanek, E.; Conlin, P.R.; Miller, E.R.; Simons-Morton, D.G.; et al. Effects on blood pressure of reduced dietary sodium and the dietary approaches to stop hypertension (DASH) diet. N. Engl. J. Med. 2001, 344, 3–10. [Google Scholar] [CrossRef]
  23. Shahar, D.R.; Froom, P.; Harari, G.; Yerushalmi, N.; Lubin, F.; Kristal-Boneh, E. Changes in dietary intake account for seasonal changes in cardiovascular disease risk factors. Eur. J. Clin. Nutr. 1999, 53, 395–400. [Google Scholar] [CrossRef] [Green Version]
  24. Wu, Z.; Lan, S.; Chen, C.; Zhang, X.; Zhang, Y.; Chen, S. Seasonal Variation: A Non-negligible Factor Associated with Blood Pressure in Patients Undergoing Hemodialysis. Front. Cardiovasc. Med. 2022, 9, 820483. [Google Scholar] [CrossRef]
  25. Zhu, Z.; Wu, C.; Luo, B.; Zang, J.; Wang, Z.; Guo, C.; Jia, X.; Wang, W.; Shen, X.; Lu, Y.; et al. The Dietary Intake and Its Features across Four Seasons in the Metropolis of China. J. Nutr. Sci. Vitaminol. 2019, 65, 52–59. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Mihara, Y.; Kado, H.; Yokota, I.; Shiotsu, Y.; Sonomura, K.; Kusaba, T.; Hatta, T.; Matoba, S.; Tamagaki, K. Rapid weight loss with dietary salt restriction in hospitalized patients with chronic kidney disease. Sci. rep. 2019, 9, 8787. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Palaniappan, L.; Carnethon, M.; Fortmann, S.P. Association Between microalbuminuria and the metabolic syndrome: NHANES III. Am. J. Hypertens. 2003, 16, 952–958. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Chagnac, A.; Weinstein, T.; Korzets, A.; Ramadan, E.; Hirsch, J.; Gafter, U. Glomerular hemodynamics in severe obesity. Am. J. Physiol. Ren. Physiol. 2000, 278, F817–F822. [Google Scholar] [CrossRef] [Green Version]
  29. Singh, K.; Diamantidis, C.J.; Ramani, S.; Bhavsar, N.A.; Mara, P.; Warner, J.; Rodriguez, J.; Wang, T.; Wright-Nunes, J. Patients’ and nephrologists’ evaluation of patient-facing smartphone apps for CKD. Clin. J. Am. Soc. Nephrol. 2019, 14, 523–529. [Google Scholar] [CrossRef] [Green Version]
  30. Ong, S.W.; Jassal, S.V.; Miller, J.A.; Porter, E.C.; Cafazzo, J.A.; Seto, E.; Thorpe, K.E.; Logan, A.G. Integrating a smartphone-based self-management system into usual care of advanced CKD. Clin. J. Am. Soc. Nephrol. 2016, 11, 1054–1062. [Google Scholar] [CrossRef] [Green Version]
  31. Chang, A.R.; Bailey-Davis, L.; Hetherington, V.; Ziegler, A.; Yule, C.; Kwiecen, S.; Graboski, E.; Melough, M.M.; Collins, C.; Anderson, C. Remote dietary counseling using smartphone applications in patients with stages 1–3a chronic kidney disease: A mixed methods feasibility study. J. Ren. Nutr. 2020, 30, 53–60. [Google Scholar] [CrossRef] [PubMed]
  32. Vasiloglou, M.F.; van der Horst, K.; Stathopoulou, T.; Jaeggi, M.P.; Tedde, G.S.; Lu, Y.; Mougiakakou, S. The Human Factor in Automated Image-Based Nutrition Apps: Analysis of Common Mistakes Using the goFOOD Lite App. JMIR Mhealth Uhealth 2021, 9, e24467. [Google Scholar] [CrossRef] [PubMed]
Figure 1. The flowchart of (a) the recruitment process and (b) the study process.
Figure 1. The flowchart of (a) the recruitment process and (b) the study process.
Kidneydial 03 00012 g001
Figure 2. The flow of how to use the artificial intelligence-powered smartphone application, Gohan Coach. (1) The patients take a picture of their dishes. (2) Artificial intelligence automatically analyzes the meal from the photo. The meal content can be manually modified by the patients themselves as necessary and recorded. (3) The meal content is then linked to the amount of nutrients indicated in a food composition database. Then, the amount and ingredients are manually changed as necessary by the patients and recorded. Therefore, the accuracy of the output data mostly depends on the accuracy of patients’ inputs. (4) Based on the information registered for each meal (numerical values), algorithm-based feedback specifically reports on the salt, energy, and protein intakes; blood pressure; and body weight. This algorithm generates a feedback report in response to certain changes in those parameters recorded in the previous week as determined from the data input by the patients or as compared with the individual target values of the parameters. A weekly report is created and sent to the patients.
Figure 2. The flow of how to use the artificial intelligence-powered smartphone application, Gohan Coach. (1) The patients take a picture of their dishes. (2) Artificial intelligence automatically analyzes the meal from the photo. The meal content can be manually modified by the patients themselves as necessary and recorded. (3) The meal content is then linked to the amount of nutrients indicated in a food composition database. Then, the amount and ingredients are manually changed as necessary by the patients and recorded. Therefore, the accuracy of the output data mostly depends on the accuracy of patients’ inputs. (4) Based on the information registered for each meal (numerical values), algorithm-based feedback specifically reports on the salt, energy, and protein intakes; blood pressure; and body weight. This algorithm generates a feedback report in response to certain changes in those parameters recorded in the previous week as determined from the data input by the patients or as compared with the individual target values of the parameters. A weekly report is created and sent to the patients.
Kidneydial 03 00012 g002
Figure 3. Salt intake estimated by 24 h urine collection at baseline after the use of the Gohan Coach application (3 months) and during the maintenance phase (6 months). * p value = 0.03 versus control group. Error bars represent standard error of mean.
Figure 3. Salt intake estimated by 24 h urine collection at baseline after the use of the Gohan Coach application (3 months) and during the maintenance phase (6 months). * p value = 0.03 versus control group. Error bars represent standard error of mean.
Kidneydial 03 00012 g003
Table 1. Baseline characteristics of the study population and a comparison between the app user and app nonuser groups.
Table 1. Baseline characteristics of the study population and a comparison between the app user and app nonuser groups.
VariablesTotal
(n = 35)
App Nonuser Group
(n = 22)
App User Group
(n = 13)
p Valuet Value
Age (years)60.5 ± 15.063.3 ± 15.955.8 ± 12.70.151.47
Male/female21/14 (60/40%)13/9 (59/41%)8/5 (62/38%)1
Body weight (kg)65.6 ± 15.064.2 ± 15.768.1 ± 13.90.46−0.75
Body mass index (kg/m2)24.0 ± 3.823.6 ± 3.824.8 ± 3.80.35−0.95
CKD stages
211 (31%)8 (36%)3 (23%)0.43
3a11 (31%)6 (27%)5 (38%)0.71
3b3 (9%)1 (5%)2 (15%)0.54
410 (29%)7 (32%)3 (23%)0.71
Comorbidity
Hypertension26 (74%)16 (73%)10 (77%)1
Diabetes13 (37%)9 (41%)4 (31%)0.72
Cardiovascular disease3 (9%)2 (9%)1 (8%)1
Arrythmia5 (14%)4 (18%)1 (8%)0.63
Cerebrovascular disease0 (0%)0 (0%)0 (0%)1
Malignancy0 (0%)0 (0%)0 (0%)1
Use of antihypertensive drugs
Calcium channel blocker13 (37%)7 (32%)6 (46%)0.48
RAS inhibitor18 (51%)11 (50%)7 (54%)1
Diuretics2 (6%)0 (0%)2 (15%)0.13
Number of prescribed antihypertensive drugs
015 (42%)10 (45%)5 (38%)0.74
18 (23%)6 (27%)2 (13%)0.68
211 (31%)6 (27%)5 (38%)0.71
31 (3%)0 (0%)1 (7%)0.37
Systolic blood pressure (mmHg)132.0 ± 14.6132.4 ± 12.6131.4 ± 18.10.850.19
Diastolic blood pressure (mmHg)76.9 ± 12.075.7 ± 9.578.8 ± 15.60.47−0.74
Mean blood pressure (mmHg)95.3 ± 11.094.6 ± 8.296.4 ± 15.00.66−0.45
Total protein (g/L)7.2 ± 0.47.1 ± 0.47.3 ± 0.40.08−1.81
Albumin (g/dL)4.3 ± 0.34.2 ± 0.34.4 ± 0.20.07−1.90
Hemoglobin (g/dL)13.2 ± 1.713.2 ± 1.913.2 ± 1.410.0027
Sodium (mEq/L)141.3 ± 1.9141.6 ± 1.6140.8 ± 2.30.261.14
Potassium (mEq/L)4.1 ± 0.54.0 ± 0.54.2 ± 0.40.46−0.74
Urea nitrogen (mg/dL)22.0 ± 13.822.2 ± 13.221.7 ± 15.20.920.10
Creatinine (mg/dL)1.36 ± 0.751.35 ± 0.761.38 ± 0.760.91−0.12
eGFR (mL/min/1.73 m2)50.9 ± 23.452.3 ± 24.448.7 ± 22.30.670.43
Low-density lipoprotein cholesterol (mg/dL)99.5 ± 29.498.9 ± 26.8100.5 ± 34.60.88−0.16
High-density lipoprotein cholesterol (mg/dL)62.9 ± 20.364.9 ± 22.560.8 ± 18.50.620.50
Triglyceride (mg/dL)131.7 ± 56.6128.9 ± 59.3136.5 ± 53.80.71−0.38
Estimated salt intake (g/day)7.86 ± 2.707.26 ± 2.578.87 ± 2.710.09−1.76
Urinary protein (g/day)0.54 ± 0.830.48 ± 0.670.63 ± 1.060.61−0.52
Continuous variables are expressed as mean ± standard deviation and binary variables as numbers (percentage). Abbreviations: CKD, chronic kidney disease; RAS, renin-angiotensin system; eGFR, estimated glomerular filtration rate.
Table 2. Within-group comparisons of parameters obtained at baseline and after 3 months.
Table 2. Within-group comparisons of parameters obtained at baseline and after 3 months.
App User GroupApp Nonuser Group
Baseline (0 Months)3 Monthsp Value0 Months3 Monthsp Value
Estimated salt intake (g/day)8.87 ± 2.717.71 ± 2.810.097.26 ± 2.578.21 ± 3.210.1
Urinary protein (g/day)0.63 ± 1.060.41 ± 0.810.070.47 ± 0.670.49 ± 0.650.83
Systolic blood pressure (mmHg)131.9 ± 18.1127.2 ± 14.80.23132.4 ± 12.6135.6 ± 9.20.18
Diastolic blood pressure (mmHg)78.8 ± 15.673.9 ± 14.40.0375.7 ± 9.578.4 ± 10.50.23
Mean blood pressure (mmHg)96.4 ± 15.091.7 ± 13.50.0794.6 ± 8.297.5 ± 7.80.18
Body weight (kg)68.1 ± 13.967.3 ± 14.40.0864.2 ± 15.764.4 ± 15.20.51
Body mass index (kg/m2)24.8 ± 3.824.5 ± 4.00.0723.6 ± 3.823.7 ± 3.70.4
eGFR (mL/min/1.73 m2)48.7 ± 22.248.1 ± 22.20.7152.3 ± 24.452.2 ± 24.70.43
Data are expressed as mean ± standard deviation. eGFR, estimated glomerular filtration rate.
Table 3. Linear Mixed-Effects Model for the use of the Gohan Coach Smartphone Application.
Table 3. Linear Mixed-Effects Model for the use of the Gohan Coach Smartphone Application.
App User Group *App Nonuser Group *Effect of Intervention
0 Months3 Months6 Months0 Months3 Months6 MonthsΔ0−3 mop
Value
Δ0−6 mop
Value
Estimated salt intake (g/day)8.29 ± 0.567.12 ± 0.567.95 ± 0.637.70 ± 0.438.65 ± 0.438.32 ± 0.57−2.12 ± 0.960.03−0.96 ± 1.080.38
Urinary protein (g/day)0.56 ± 0.080.34 ± 0.080.26 ± 0.090.57 ± 0.060.58 ± 0.060.55 ± 0.08−0.23 ± 0.120.05−0.27 ± 0.140.05
Systolic blood pressure (mmHg)132.0 ± 3.2127.7 ± 3.2131.1 ± 4.1132.0 ± 2.5135.3 ± 2.5132.7 ± 3.3−7.5 ± 5.40.17−1.6 ± 6.30.8
Diastolic blood pressure (mmHg)78.1 ± 2.373.2 ± 2.376.8 ± 2.976.5 ± 1.879.2 ± 1.881.2 ± 2.4−7.6 ± 4.00.06−6.0 ± 4.70.21
Mean blood pressure (mmHg)96.1 ± 2.391.4 ± 2.394.9 ± 2.995.0 ± 1.897.8 ± 1.898.3 ± 2.4−7.6 ± 3.90.06−4.5 ± 4.60.33
Body weight (kg)63.9 ± 1.463.0 ± 1.463.3 ± 1.464.9 ± 1.165.1 ± 1.166.0 ± 1.2−1.1 ± 0.50.04−1.8 ± 0.60.003
Body mass index (kg/m2)24.1 ± 0.123.8 ± 0.123.9 ± 0.124.1 ± 0.124.2 ± 0.124.5 ± 0.1−0.4 ± 0.20.03−0.7 ± 0.20.002
eGFR (mL/min/1.73 m2)49.4 ± 0.948.8 ± 0.947.6 ± 0.949.5 ± 0.749.0 ± 0.746.8 ± 0.9−0.1 ± 1.60.960.8 ± 1.40.56
* Estimated marginal mean and standard error. Effect of interaction term time × group with standard error. Abbreviations: eGFR, estimated glomerular filtration rate; Δ0−3 mo, change between 0 and 3 months; Δ0−6 mo, change between 0 and 6 months.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Yanai, A.; Uchiyama, K.; Suganuma, S. Salt Reduction Using a Smartphone Application Based on an Artificial Intelligence System for Dietary Assessment in Patients with Chronic Kidney Disease: A Single-Center Retrospective Cohort Study. Kidney Dial. 2023, 3, 139-151. https://doi.org/10.3390/kidneydial3010012

AMA Style

Yanai A, Uchiyama K, Suganuma S. Salt Reduction Using a Smartphone Application Based on an Artificial Intelligence System for Dietary Assessment in Patients with Chronic Kidney Disease: A Single-Center Retrospective Cohort Study. Kidney and Dialysis. 2023; 3(1):139-151. https://doi.org/10.3390/kidneydial3010012

Chicago/Turabian Style

Yanai, Akane, Kiyotaka Uchiyama, and Shinya Suganuma. 2023. "Salt Reduction Using a Smartphone Application Based on an Artificial Intelligence System for Dietary Assessment in Patients with Chronic Kidney Disease: A Single-Center Retrospective Cohort Study" Kidney and Dialysis 3, no. 1: 139-151. https://doi.org/10.3390/kidneydial3010012

Article Metrics

Back to TopTop