Next Article in Journal
Epilepsy in Mitochondrial Diseases—Current State of Knowledge on Aetiology and Treatment
Next Article in Special Issue
Adipose Tissue Immunomodulation and Treg/Th17 Imbalance in the Impaired Glucose Metabolism of Children with Obesity
Previous Article in Journal
Resilience Against COVID-19: How Italy Faced the Pandemic in Pediatric Orthopedics and Traumatology
Previous Article in Special Issue
Self-Reported Physical Fitness in Children and Adolescents with Obesity: A Cross-Sectional Analysis on the Level of Alignment with Multiple Adiposity Indexes
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Multidisciplinary Approach for Hypothalamic Obesity in Children and Adolescents: A Preliminary Study

1
Pediatric Endocrinology Unit, Regina Margherita Children’s Hospital, University of Turin, 10126 Turin, Italy
2
Postgraduation School of Pediatrics, University of Turin, 10126 Turin, Italy
3
SUISM, University of Turin, 10126 Turin, Italy
4
Dietetic and Clinical Nutrition Unit, Regina Margherita Children’s Hospital, 10126 Turin, Italy
5
Clinical Psychology, Regina Margherita Children’s Hospital, 10126 Turin, Italy
*
Author to whom correspondence should be addressed.
Children 2021, 8(7), 531; https://doi.org/10.3390/children8070531
Submission received: 11 May 2021 / Revised: 15 June 2021 / Accepted: 19 June 2021 / Published: 22 June 2021

Abstract

:
Hypothalamic obesity (HO) is delineated by an inexorable weight gain in subjects with hypothalamic disorder (congenital or acquired). The aim of the present study was to evaluate the effect of a multidisciplinary approach on weight trend and metabolic outcome in children and adolescents with hypothalamic disease who were overweight or obese. Thirteen patients (aged 8.1–16.1 years) received a personalized diet, accelerometer-based activity monitoring, and psychological assessment. Height, weight, body mass index (BMI), and serum metabolic parameters were assessed at baseline (T0) and after six months (T1). Metformin was introduced at T1 in four subjects who were then re-evaluated after six months (T2). At T1, weight gain was significantly reduced compared with T0 (0.29 ± 0.79 kg/month vs. 0.84 ± 0.55 kg/month, p = 0.03), and weight standard deviation score (SDS) and BMI SDS did not change significantly, as serum metabolic parameters. The four subjects treated with metformin showed a reduction of weight SDS and BMI SDS at T2. In conclusion, patients treated with our multidisciplinary approach showed, after 6 months, favorable results characterized by decreased weight gain and stabilization of weight SDS and BMI SDS in a condition usually characterized by inexorable weight gain. However, further analysis, larger cohorts, and longer follow-up are needed to confirm these preliminary data.

Graphical Abstract

1. Introduction

Hypothalamic obesity (HO) is a serious and heterogeneous disease related to several conditions, such as hypothalamic damage caused by tumors (e.g., craniopharyngioma, glioma, germinoma, hamartoma) and/or their treatment, inflammatory diseases (e.g., sarcoidosis, tuberculosis, histiocytosis, encephalitis), trauma, neurosurgery, cerebral aneurysm, single-gene mutations (e.g., leptin, leptin receptor, CART, POMC), rare congenital disorders with midline malformations (e.g., septo-optic dysplasia, mutations of the LHX3 gene), genetic syndromes (e.g., Prader Willi syndrome, Bardet-Biedl syndrome), and the use of psychotropic drugs (e.g., antidepressants, mood stabilizers, antipsychotics) [1,2,3].
The presence of HO may be considered if the following criterion is met: evidence of a pathologic process injuring the hypothalamus with obesity that develops subsequently to or in association with that injury [4]. In general, the weight gain pattern in HO patients is characterized by sudden onset and rapid acceleration after hypothalamic damage [4].
The rapid and continuous weight gain in HO is the result of multifactorial pathogenetic mechanisms [4,5,6,7,8]. The hypothalamus regulates body weight by balancing food intake, energy expenditure, and body energy stores; it receives afferent messages from adipose tissue, the gastrointestinal tract, liver, and pancreatic beta cells, and sends efferent messages to the same organs, as well as to the muscles and is linked through direct synaptic connections to appetite-regulating regions of the brain, such as the limbic system [1]. Several nuclei in the medial hypothalamus are key regulators of satiety and energy expenditure. The nuclei that seem most commonly implicated in HO are the arcuate nucleus, the paraventricular nucleus, the ventromedial nucleus, the dorsomedial nucleus, and the dorsal hypothalamic area [7]. HO may also be accompanied by a series of hormonal alterations due to imbalance of hypothalamic-pituitary function, such as a reduced secretion of growth hormone, gonadotropin, and thyroid-stimulating hormone and/or an impaired circadian rhythm that exerts a huge influence on the metabolic state. Furthermore, reduced physical activity related to possible coexistent disabilities (e.g., visual and neuromotor impairment) significantly decreases energy expenditure. Finally, a low-resting metabolic rate and autonomic imbalance are also common findings in this condition [9,10,11,12].
Abdominal obesity, associated with dyslipidemia, hyperinsulinemia caused by insulin resistance, and elevated blood pressure, which are all known markers of the metabolic syndrome in adulthood, may therefore be present in these patients and contribute to an increased risk of cardiovascular disorders and long-term mortality [13,14,15].
Patients with HO are usually refractory to lifestyle changes programs aimed at caloric restriction and increased physical activity [8]. Extreme hyperphagia has been noted as a hallmark of HO, but obesity can develop even in the absence of hyperphagia [4].
There is no standard pharmacological intervention that has consistently been shown to have a positive effect in these complicated-to-manage patients. Due to the rarity of HO and the objective difficulties in testing new drugs in the pediatric age, few reports or clinical studies on its treatment in children and adolescents have been reported so far. These studies are small and limited by significant side effects or have shown only limited or no effects. Most show that HO is often intractable and mostly resistant to classical approaches based on diet and physical activity [8].
Regarding hyperinsulinism, typically present in HO, treatment with octreotide was initially suggested [16], but this has shown significant side effects (particularly diarrhea and abdominal discomfort) and unclear benefits [7]. Combined therapy of diazoxide and metformin has also been proposed, with reduction of weight gain and BMI [17], but this study had limitations due to the small sample size and the significant adverse events encountered (gastrointestinal symptoms, peripheral edema, elevated liver enzymes). The combination of metformin and fenofibrate in one study did not improve weight or BMI [18]. Considering the energy expenditure, tri-iodothyronine (T3) has been tested [19] but even this therapeutic option does not appear to be effective [20]. Based on the observation that patients with HO have impaired sympathoadrenal activation and epinephrine production, it has been suggested that this disorder may be treated with amphetamine derivatives and CNS stimulants, particularly with dexamphetamine [21,22,23], as well as caffeine and ephedrine [24]; such drugs have been shown to have a positive impact on weight gain, BMI, physical activity, and daytime wakefulness in a number of cases, although all of these treatments need further studies to be validated. Studies on the administration of glucagon-like peptide-1 receptor agonist (GLP-1 RA) have shown varying degrees of success [25,26], while methionine aminopeptidase 2 [27] was successful in lowering body weight, but dosing was discontinued early due to venous thrombotic events. Recently, oxytocin has shown potential benefits for the treatment of obesity and has been proposed for HO [28], also in combination with naltrexone [29]. Bariatric surgery in adolescents with primary obesity is usually considered a last resort and is rarely performed. HO is a rare form of obesity and, although there is the possibility of considering pediatric bariatric surgery as a therapeutic option for adolescents [1], surgical experience in pediatric HO is virtually non-existent, the long-term effects can be questioned, and serious complications can occur after surgery, so its risk-benefit ratio must be considered with great caution [8]. In a recent long-term outcome study in severe early-onset obesity due to genetic mutations in the leptin-melanocortin signaling cascade, patients initially experienced weight loss after bariatric surgery, but this was followed by substantial weight regain [30].
The aim of our study was to evaluate the efficacy of a multidisciplinary approach, which includes endocrine care of affected subjects together with a dietary intervention, a physical exercise program, a psychological assessment with standardized scales, and, in a selected cohort of patients, a drug treatment with metformin (which was proposed by several authors for primary obesity [31]).
Although HO is often frustratingly refractory to lifestyle interventions, a healthy diet should always be encouraged [4]. The role of exercise (particularly in cases without neuromotor impairment) is also crucial and can help counteract the impaired sympatho-adrenal activation in HO [4]; in the study, we introduced an accelerometer-based activity monitor, previously utilized to estimate the physical activity of HO subjects [10], not only to assess the amount of daily movement, but also with a motivation role for patients and their family, giving them a tool to quantify the results of their day-to-day commitment.
There are few studies on lifestyle and dietary intervention in pediatric HO [8] and many of them have not reported any improvement in weight trend. Considering the absence of a pharmacological treatment of clear and proven efficacy, in this preliminary study we proposed a multidisciplinary approach with a simple and defined therapeutic pathway, defining the role of the different specialists, to help clinicians in the follow up of these patients.

2. Materials and Methods

2.1. Inclusion Criteria

Thirteen children and adolescents with hypothalamic disease, 5 males and 8 females aged between 8.1 to 16.1 years (mean 12.2), were enrolled at the Pediatric Endocrinology Unit of Regina Margherita Children’s Hospital in Turin (Italy), where they were already on endocrinological follow-up (mean follow-up of 6.7 years for patients with tumors of the hypothalamic-pituitary area and from birth for patients with congenital pathology). In all subjects, brain MRI evidenced hypothalamic damage.
The inclusion criteria were age >8 years at the start of the study and overweight or obese, with weight and BMI worsening with standard care. Overweight and obese were defined according to the BMI standards proposed by Cole et al. [32], which are based on and linked to the corresponding adult BMI cut-offs (25 and 30 kg/m2 for overweight and obese, respectively).

2.2. Study Design

The study included four consecutive steps.
First step: start of the multidisciplinary treatment (time-point T0).
The study involved different specialists: a pediatric endocrinologist, a pediatric diabetologist with experience in the management of obesity, a dietician, and a psychologist and graduate in motor and sport sciences.
All of the visits and exams were performed in a single day and in the presence of the parents.
At initial evaluation, weight gain in the 6 months prior to enrollment, height, weight, and BMI were recorded. Height, weight, and BMI were also reported as standard deviation score (SDS) for age and sex. Height was measured to the nearest 0.1 cm with a calibrated stadiometer and body weight was evaluated to the nearest 0.1 kg using a calibrated scale.
Blood exams were performed to evaluate serum glucose, insulin, HOMA (Homeostatic Model Assessment) index [33], triglycerides, total cholesterol, and HDL cholesterol, in addition to routine hormone tests to assess the adequacy of ongoing replacement therapy.
The pediatric endocrinologist evaluated the patients and hormone tests and established hormone replacement therapy.
The pediatric diabetologist with experience in the management of obesity examined the patients and evaluated the metabolic analyses, as well as the presence of any additional complications of obesity.
The dietary assessment, aimed to investigate micronutrients and macronutrients intake, was performed combining two methods: the 24-h dietary recall, a structured interview intended to capture detailed information on all foods and beverages consumed by the respondent in the past 24 h, and the 3-day dietary records, with self-reported food diaries (the latter method provides more data, but has limitations mainly due to the tendency of subjects to report food consumption close to those which are socially desirable). The dietician evaluated any differences in terms of caloric intake obtained from the two different methods and developed a personalized diet for each patient, considering the nutritional history and the caloric requirement based on resting energy expenditure and physical activity.
A psychological assessment was performed by the psychologist using Vineland Adaptive Behavior Scales [34], a standardized assessment tool which utilizes a semi-structured interview to evaluate individuals from birth to adulthood in their functional personal and social abilities and produces standard scores in four domains, i.e., communication, daily living skills, socialization, and motor skills. In addition to age-equivalent scores for the raw domain scores, the measure also yields an overall Adaptive Behavior Composite Standard score. It allows for the identification of the strengths and weaknesses of the subject in specific areas of adaptive behavior, favoring the planning of individual educational or rehabilitative interventions.
To plan physical activity, the history of motor activity was evaluated, also considering the visual or neuromotor deficit of some patients.
At the end of this first phase, the multidisciplinary team provided the families with a final report including the result of the visits, analyses, and dietary and lifestyle indications, and provided them with an accelerometer-based activity tool (MyWellness Key, Technogym, Cesena, Italy) for daily monitoring of physical exercise (number of movements per day with a goal of 500 movements). It is a portable device with an accelerometer that can be worn by the patient and can be used to monitor physical activity, measuring the duration and intensity of movement during normal daily life. The purpose of the device, in addition to monitoring the patient’s daily physical activity, was motivational; every time the child reached the predetermined number of movements, a “+” sign appeared on the device screen, which indicated the good work done, motivating them to increase the activity.
After one month, a second multidisciplinary visit was carried out with patients and parents to reinforce the lifestyle change, motivate the patients in the continuation of their programs, highlight any difficulties in relation to the diet, and evaluate the first data and the correct use and functioning of the accelerometer-based activity monitor.
Second step: endpoint assessment (time-point T1).
Therapeutic effectiveness was evaluated 6 months after T0 (time-point T1), with another multidisciplinary control.
We defined the achievement of at least one of following criteria as a response to treatment:
  • reduction of weight SDS for age and sex [35]
  • reduction of BMI SDS for age and sex [35]
  • reduction in weight gain compared to the previous 6 months
  • improvement of the HOMA index.
Third step: pharmacological treatment with Metformin at T1 in patients aged >10 years old plus at least one of the following criteria:
  • severe/morbid obesity (according to Cole’s standards, based on BMI 35 at age 18 [32]);
  • serum insulin levels >30 mUI/L
  • HOMA index >4
  • weight gain after six months of multidisciplinary treatment plus HOMA index >3
To minimize gastrointestinal side effects, metformin was started at a dose of 250 mg twice daily over 10 days, then increased to 500 mg twice daily.
Fourth step: endpoint assessment (time-point T2).
Therapeutic efficacy of metformin, added to lifestyle changes, was evaluated after six months and included the same criteria for time-point T1.
The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of Regina Margherita Children Hospital (protocol number 0072684). Informed consent was obtained from parents and, when possible (considering visual and neuromotor impairment in some cases), from patients involved in the study.

2.3. Statistical Analysis

Statistical analysis was performed by SPSS V.27. Continuous variables were expressed as mean and SDS. The paired two-tailed t-test was used to compare variables measured in the same subject at different time-points, while the independent t-test was used for statistical analysis between different groups of subjects at the same time-point.
Partial correlation was used to explore the relationship between perceived control of internal states (measured by the Perceived Stress scale), controlling for sex and age. Preliminary analyses were performed to ensure no violation of the assumptions of normality, linearity, and homoscedasticity.

3. Results

The study included eight patients with parasellar tumors (five craniopharyngiomas, three hypothalamic astrocytomas) and five patients with congenital midline malformations (four septo- optic dysplasia, one LHX3 mutation).
All subjects presented with endocrine dysfunction. In particular, 12 had multiple pituitary deficiency requiring hormone replacement therapy, 1 subject had multiple hypopituitarism and precocious puberty (patient 7), and 1 subject (patient 8) had precocious puberty and syndrome of inappropriate antidiuresis (SIAD).
All patients were taking an appropriate dose of hormone replacement treatment with good hormonal control during the course of the study.
The main clinical and auxological data at T0 are reported in Table 1.
At T0, nine patients were obese and four were overweight according to Cole’s standard [32].
All 13 subjects received the personalized diet and psychological assessment.
The average caloric intake of the diets administered was 1525 kcal/day, ranging from 1300 to 1700 kcal/day; the average caloric intake per kg was 27.0 kcal/kg, ranging from 45.9 kcal/kg to 12.8 kcal/kg (Table 2).
Of the subjects, 10 out of 13 regularly utilized the accelerometer-based activity tool for physical exercise monitoring (three patients reported technical problems with the device).
Analyzing daily physical exercise (number of movements per day) through the accelerometer-based activity tool from T0 to T1, 50% of patients reached the goal of an average of 500 movements per day (<500 was considered “low active”). The average of the corresponding calculated daily energy consumption (which is related to the number of daily movements performed and is influenced by the subject’s body weight) was 196.4 kcal/day, ranging from 100 kcal/day to 322 kcal/day (Table 2).
Psychological assessment with Vineland Adaptive Behavior Scales showed an equivalent age lower below the mean age (12.2 years) in our population for all the abilities. Specifically, it indicated an average age of 3.7 years for motor skills, 7.6 years for daily skills (including eating, dressing, personal hygiene, housework, etc.), and 8.4 and 8.5 years for socialization and communication, respectively (Figure 1).
All 13 patients completed the assessment at T1.
The main clinical and laboratory results at T0 and T1 are shown in Table 3.
At T1, the main effect was observed for weight gain, which was significantly reduced compared with T0 (0.29 ± 0.79 kg/month vs. 0.84 ± 0.55 kg/month, p = 0.03) (Figure 2). In particular, weight gain decreased in 9/13 subjects from T0 to T1.
At T1, weight SDS decreased in 9/13 subjects and BMI SDS in 8/13 compared with T0, but the overall result did not show a statistically significant difference from T0 to T1 for these parameters.
The analyses were then stratified by disease (tumors vs. congenital disease), age (<12 vs. ≥12 years, which represents the average age of the subjects examined), and sex (male or female).
Males showed a greater reduction of BMI from T0 to T1 than females (−0.24 ± 0.29 vs. +0.01 ± 0.11, p = 0.04), while there were no significant differences when comparing patients with tumors with those with congenital diseases, nor by stratifying the subjects by age; a better response was recorded in children <12 years, but without statistical significance.
Considering the greater reduction of BMI in males and since the participants age range was very large, we evaluated the possible effect of sex and age on the overall results. When we compared the change in the Pearson R correlation coefficient from zero order (BMI T0 and T1 not controlled: r = 0.982, p < 0.001) to whole model (controlled for sex and age: r = 0.989, p < 0.001), we found a very low effect of sex and age on the relationship of BMI values and we can conclude that they have no significant effect on two-times repeated BMI measurements. Analogues results were obtained for weight (zero order correlation r = 0.977, p < 0.01; for sex and age r = 0.978, p < 0.001) and weight gain (zero order correlation r = 0.350, p = 0.241; whole model corrected for sex and age r = 0.304, p = 0.363). The same analyses led to the same results considering sex and age separately on BMI, weight, and weight gain.
Serum insulin levels, HOMA index, triglycerides, total cholesterol, and HDL cholesterol did not change significantly from T0 to T1 (Table 4).
Four patients proceeded to T2, starting metformin treatment (250 mg twice daily over 10 days, then increased to 500 mg twice daily) at T1, according to the aforementioned criteria. Patients and their parents reported regular assumption of therapy.
These patients showed reduction of weight, weight SDS, and BMI SDS from T1 to T2 (Table 4).
As regards the HOMA index, the reduction was more relevant from T0 to T1 than from T1 to T2; after the introduction of metformin, 3/4 subjects showed a slight further reduction. The other metabolic parameters (insulin, triglycerides, total cholesterol, HDL cholesterol) did not show a clear trend.
The limited number of subjects treated with metformin did not allow for statistical analysis. No liver or gastrointestinal dysfunction or other side effects were reported during treatment with metformin.

4. Discussion

Children and adolescents with hypothalamic diseases often develop severe organic obesity, which can worsen their metabolic profile and lead to increased morbidity and mortality, resulting in reduced quality of life. Clinical management of HO is extremely difficult due to lack of response to lifestyle modification and the absence of clearly effective treatments. Furthermore, the experiences in the treatment of HO in the pediatric population are nowadays particularly limited [7].
Among the causes of HO in the literature, as in our study, the most extensively documented in children and young adults is that linked to craniopharyngioma, from the tumor itself or as a sequela of treatment. Craniopharyngioma is a nonglial intracranial tumor of the sellar and/or parasellar region that represents 1.2–4.0% of all childhood intracranial tumors [37]. Survival rates range from 91 to 98%, but the quality of survival is often compromised due to proximity to optical, pituitary, and hypothalamic structures, resulting in loss of vision and endocrinopathies. Most (85–95%) of patients with craniopharyngioma suffer from multiple hypothalamic-pituitary deficiencies, as well as cerebrovascular problems and neurologic and neurocognitive dysfunction. Obesity and eating disorders, correlated with the degree and extent of hypothalamic damage, are observed in 40–50% of children with craniopharyngioma, resulting in reduced energy expenditure and increased risks of metabolic syndrome, cardiovascular disease including sudden death events, multisystem morbidity, and even mortality in these patients [37].
Our study also included cases of HO following astrocytoma, the most frequent cerebral tumor in the pediatric age, occurring in subjects with septo-optic dysplasia, a rare condition defined by variable combination of dysgenesis of midline brain structures including optic nerve hypoplasia and hypothalamic-pituitary dysfunction often associated with a wide variety of cerebral malformations of cortical development, and a child with causative mutation in the LHX3 gene.
The usual cornerstone of obesity treatment is a lifestyle changes program aimed at caloric restriction and increased physical activity and, although HO can seem frustratingly refractory to such measures, as confirmed by the few studies on lifestyle and dietary intervention in pediatric HO [8], a healthy diet and exercise must absolutely be encouraged [4], also considering the absence of pharmacologic treatments with evident and proven benefits.
We described our multidisciplinary approach, defining the role of the different specialists of the multidisciplinary team and proposing the use of a qualitative/quantitative psychological assessment with Vineland Adaptive Behavior Scales and of an accelerometer-based activity monitor to reinforce the motivation for daily activity.
Disabilities and motor impairments, also identified by the psychological evaluation with Vineland Adaptive Behavior Scales in our study, can reduce physical activity and adherence to the clinical indications. The application of this scale can improve the knowledge of specific patient limits or strengths to better plan approaches and directions, including physical activity.
The main goals of the study were to reduce weight gain, weight SDS, or BMI SDS and to counteract metabolic derangement, particularly hyperinsulinemia. Our approach aimed at improving the adherence of patients and their families to the multidisciplinary therapeutic strategies and at implementing the collaboration of different medical professionals. In pediatric HO, environmental factors are more controlled by adult family members and the family context plays a fundamental role in the process of treating childhood obesity.
Our approach has shown that organized, low-intensity care without frequent hospitalizations, but with periodic outpatient checkups and some additional resources can achieve significant results, particularly by reducing weight gain without further weight gain SDS and BMI SDS in a condition characterized by relentless weight gain, as shown in several studies [8].
We obtained a statistically significant reduction in weight gain over a 6-month follow-up period, with substantial stabilization of weight SDS and BMI SDS; at T1, compared with T0, weight SDS and BMI SDS decreased in most of the subjects even if with overall results were not statistically significant.
The reduction in weight gain was a certification of patients and family members adherence to the proposed program; at the same time, the partial results of physical exercise and an equivalent lower average age in all skills reflect the presence of important physical and intellectual disabilities that can reduce the possibility of practicing physical activity, which is a major factor accounting for obesity in HO patients [10] and requires significant motivation from patients and families, which we have tried to increase with the use of a digital device.
Considering the etiology of the hypothalamic damage and the age and sex of the patients, we did not find substantial differences between subjects with congenital or acquired diseases, while we found a better response in younger males, a category that itself may be more interested in physical activity changes and in the use of technological devices. In general, our result highlighted the importance of early combined prevention and assessment of obesity in pediatric patients with hypothalamic disorders, but considering the small number of subjects in the different subpopulations, we cannot obtain certain answers nor find a clear explication on the different responses in males compared to females.
In four patients with more severe conditions or without improvement after the 6-month non-pharmacological multidisciplinary approach, metformin was introduced, yielding a reduction in weight, weight SDS, and BMI SDS and no clear effects on HOMA and other metabolic indexes. Given the small number of subjects, we cannot draw conclusions on the effect of metformin, but with this preliminary study we propose its use in selected cases to evaluate its effectiveness on a larger case series.
The rationale for the use of metformin in HO is supported by the role of hyperinsulinemia in the inhibition of the sympathetic nervous system, beside the classical insulin resistance arising from the worsening obesity. Recent data indicate that a proper balance of the autonomic nervous system is crucial for metabolism; it is well known that adipose tissue is richly innervated by sympathetic nerve fibers that control lipolysis, and it now appears that lipogenesis is also controlled by parasympathetic innervation of adipose tissue originating from separate sympathetic and parasympathetic neurons in the periventricular nucleus and suprachiasmatic nucleus [37,38]. The relationship between hyperinsulinism and HO was deeply investigated, and it was postulated that ventromedial nucleus (VMH) lesions lead to autonomic imbalance from disinhibited or increased vagal tone with hyperinsulinemia as the result of overactive vagal transmission, and that these events are major contributors to the pathogenesis of HO. Supporting these theories, studies on rats demonstrated that rodents with VMH lesions developed signs of decreased sympathetic nervous system function and hyperinsulinemia even in the absence of hyperphagia or obesity, and pancreatic vagotomy prevented the exaggerated secretion of glucose-stimulated insulin in VMH lesioned rats; furthermore, higher-fasting insulin levels were detected among patients with HO compared with individuals with a common diet [4,39,40,41].
In HO, treatment with octreotide, a somatostatin-5 receptor agonist on the beta-cell, which is coupled to and inhibits the voltage-gated calcium channel, has shown discordant results and its use is limited by the frequent abdominal side effect [7]. The use of metformin has been proposed in combination with diazoxide [17], in a study with a small sample size and notable adverse events, and with fenofibrate, without the improvement of weight or BMI in 22 subjects [18].
In patients with primary obesity, metformin is frequently used to reduce weight, BMI, and insulin resistance and to counteract the complications associated with obesity, such as type-2 diabetes mellitus, metabolic syndrome, cardiovascular diseases, and liver diseases. It has been associated with weight loss, possibly due to a combination of its inhibition of gluconeogenesis, increased peripheral glucose utilization, increased fat oxidation in skeletal muscles, and inhibition of lipid synthesis in the liver, though its pharmacokinetics are not completely understood [42]. A recent meta-analysis [31] evaluating several studies in children and adults found a greater reduction in BMI in overweight or obese patients taking metformin than in controls in more than half the studies, and progression toward T2DM was significantly reduced in adults using metformin. The effects of metformin on weight/BMI varied, with smaller reductions in children than in adults, and the authors supposed that this could be related to differences in adherence, daily dosage, and insulin status.
In our study, the limited number of subjects treated with metformin did not allow for definitive conclusions on the effects of metformin on weight trend; two patients improved in terms of weight and BMI from T0 to T1, while all four patients improved the same two parameters together with insulin resistance with the addition of metformin from T1 to T2. Regarding the assessment of insulin resistance, the HOMA index was used because it compares favorably with other models and has the advantage of requiring a single plasma sample for insulin and glucose, while the gold-standard glucose clamp technique is far more invasive; however, it should be considered that the HOMA index has some limitations, since it is poorly reproducible, insulin secretion is pulsatile, and cut-off values differ by races, ages, and sexes, for which several different parameters were proposed to evaluate insulin resistance [43,44,45].
Our pilot study had different limitations: small sample, large age range, lack of a control group and short follow-up, and potential interference of other hormone treatments being taken by the participants.
Therefore, further standardized clinical studies in the pediatric age are needed to indicate the real efficacy of this approach in the HO population, in which clinicians are faced with considerable hormonal, metabolic, and care complexity.
In absence of an effective pharmacological treatment, a multidisciplinary lifestyle intervention remains the initial cornerstone of HO treatment, reconsidering the objectives in the light of progress, encouraging physical activity, and adherence to dietary advice and evaluating the specific characteristics of the individual over time.

5. Conclusions

We proposed a multidisciplinary approach with low intensity care which, in our study, led to the reduction of weight gain after 6 months in a condition usually considered inexorable in terms of gaining body weight and without pharmacologically effective treatment. This pilot study provided preliminary data which support the utility of studies with larger populations and longer follow-ups based on this approach. We also introduced the use of a qualitative/quantitative psychological assessment with Vineland Adaptive Behavior Scales to better assess patient limitation and strength and a device to monitor and reinforce motivation in daily activity and proposed the use of metformin treatment in selected cases.
The experiences in the treatment of HO in the pediatric population are, nowadays, particularly limited and we believe this experience, further ongoing to gather longer-term follow-up data in a larger cohort, will provide evidence that, at the time of diagnosis, a multidisciplinary, personalized approach should be started and then continued throughout life to prevent, over time, relentless weight gain and the complications and deterioration of the quality of life of which this extremely disabling condition is characterized.

Author Contributions

D.T., A.T. and R.B. wrote the manuscript, D.T. and A.T. performed endocrinological assessment of patients, collected and analyzed clinical data, P.M. is the major designer of the study, G.T. and I.R. performed the metabolic assessment of patients, A.L. performed the nutritional assessment of patients, G.F. performed the psychological assessment, A.S. planned physical monitoring by USB devices, L.d.S. coordinated the study and helped to draft the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding. The APC was funded by the Postgraduate School of Pediatrics of the University of Turin.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of Regina Margherita Children Hospital Commitment.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

All records of patients are available in our local Informatic Database Trak-Care System and Local Piedmont Registry of Rare Diseases http://www.sistemapiemonte.it/cms/pa/sanita/servizi/251-registro-pazienti-affetti-da-malattie-rare (accessed on 1 March 2021).

Acknowledgments

Thanks to Ramnitz Mary Scott, National Institute of Health, for precious suggestion in the study-design.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bereket, A.; Kiess, W.; Lustig, R.H.; Muller, H.L.; Goldstone, P.; Weiss, R. Hypothalamic obesity in children. Obes. Rev. 2012, 13, 780. [Google Scholar] [CrossRef] [PubMed]
  2. Polizzi, A.; Pavone, P.; Iannetti, P.; Manfré, L.; Ruggieri, M. Septo-optic dysplasia complex: A heterogeneous malformation syndrome. Pediatr. Neurol. 2006, 34, 66. [Google Scholar] [CrossRef]
  3. Webb, E.; Dattani, M.T. Septo-optic dysplasia. Eur. J. Hum. Genet. 2010, 18, 393. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Lee, M.; Korner, J. Review of physiology, clinical manifestations, and management of hypothalamic obesity in humans. Pituitary 2009, 12, 87. [Google Scholar] [CrossRef]
  5. Iughetti, L.; Bruzzi, P. Obesity and craniopharyngioma. Ital. J. Pediatr. 2011, 16, 37. [Google Scholar] [CrossRef] [Green Version]
  6. Ahmet, A.; Blaser, S.; Stephens, D.; Guger, S.; Rutkas, J.; Hamilton, J. Weight gain in craniopharyngioma—A model for hypothalamic obesity. J. Pediatr. Endocrinol. Metab. 2006, 19, 121. [Google Scholar] [CrossRef] [PubMed]
  7. Abuzzahab, M.J.; Roth, C.L.; Shoemaker, A.H. Hypothalamic Obesity: Prologue and Promise. Horm. Res. Paediatr. 2019, 91, 128–136. [Google Scholar] [CrossRef] [PubMed]
  8. Van Iersel, L.; Brokke, K.E.; Adan, R.A.H.; Bulthuis, L.C.M.; van den Akker, E.L.T.; van Santen, H.M. Pathophysiology and Individualized Treatment of Hypothalamic Obesity Following Craniopharyngioma and Other Suprasellar Tumors: A Systematic Review. Endocr. Rev. 2019, 40, 193–235. [Google Scholar] [CrossRef] [Green Version]
  9. Roth, C.; Wilken, B.; Hanefeld, F.; Schröter, W.; Leonhardt, U. Hyperphagia in children with craniopharyngioma is associated with hyperleptinaemia and a failure in the downregulation of appetite. Eur. J. Endocrinol. 1998, 138, 89. [Google Scholar] [CrossRef]
  10. Harz, K.J.; Müller, H.L.; Waldeck, E.; Pudel, V.; Roth, C. Obesity in Patients with Craniopharyngioma: Assessment of Food Intake and Movement Counts Indicating Physical Activity. J. Clin. Endocrinol. Metab. 2003, 88, 5227. [Google Scholar] [CrossRef] [Green Version]
  11. Holmer, H.; Pozarek, G.; Wirfält, E.; Popovic, V.; Ekman, B.; Björk, J. Reduced energy expenditure and impaired feeding-related signals but not high energy intake reinforces hypothalamic obesity in adults with childhood onset craniopharyngioma. J. Clin. Endocrinol. Metab. 2010, 95, 5395. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Cohen, M.; Syme, C.; McCrindle, B.W.; Hamilton, J. Autonomic nervous system balance in children and adolescents with craniopharyngioma and hypothalamic obesity. Eur. J. Endocrinol. 2013, 168, 845. [Google Scholar] [CrossRef] [Green Version]
  13. Holmer, H.; Ekman, B.; Björk, J.; Nordstöm, C.-H.; Popovic, V.; Siversson, A. Hypothalamic involvement predicts cardiovascular risk in adults with childhood onset craniopharyngioma on long-term GH therapy. Eur. J. Endocrinol. 2009, 161, 671. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Bülow, B.; Attewell, R.; Hagmar, L.; Malmström, P.; Nordström, C.H.; Erfurth, E.M. Postoperative prognosis in craniopharyngioma with respect to cardiovascular mortality, survival, and tumor recurrence. J. Clin. Endocrinol. Metab. 1998, 83, 3897. [Google Scholar] [CrossRef]
  15. Rosenfeld, A.; Arrington, D.; Miller, J.; Olson, M.; Gieseking, A.; Etzl, M. A review of childhood and adolescent craniopharyngiomas with particular attention to hypothalamic obesity. Pediatr. Neurol. 2014, 50, 4. [Google Scholar] [CrossRef]
  16. Lustig, R.H.; Hinds, P.S.; Ringwald-Smith, K.; Christensen, R.K.; Kaste, S.C.; Schreiber, R.E. Octreotide therapy of pediatric hypothalamic obesity: A double-blind, placebo-controlled trial. J. Clin. Endocrinol. Metab. 2003, 88, 2586. [Google Scholar] [CrossRef] [Green Version]
  17. Hamilton, J.K.; Conwell, L.S.; Syme, C.; Ahmet, A.; Jeffery, A.; Daneman, D. Hypothalamic Obesity following Craniopharyngioma Surgery. Results of a Pilot Trial of Combined Diazoxide and Metformin Therapy. Int. J. Pediatr. Endocrinol. 2011, 2011, 417949. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Kalina, M.A.; Wilczek, M.; Kalina-Faska, B.; Skała-Zamorowska, E.; Mandera, M.; Tendera, E.M. Carbohydrate-lipid profile and use of metformin with micronized fenofibrate in reducing metabolic consequences of craniopharyngioma treatment in children: Single institution experience. J. Pediatr. Endocrinol. Metab. 2015, 28, 45–51. [Google Scholar] [CrossRef]
  19. Fernandes, J.K.; Klein, M.J.; Ater, J.L.; Kuttesch, J.F.; Vassilopoulou-Sellin, R. Triiodothyronine supplementation for hypothalamic obesity. Metabolism 2002, 51, 1381–1383. [Google Scholar] [CrossRef] [PubMed]
  20. Van Santen, H.M.; Schouten-Meeteren, A.Y.; Serlie, M.; Meijneke, R.W.H.; van Trotsenburg, A.S.; Verberne, H.; Holleman, F.; Fliers, E. Effects of T3 treatment on brown adipose tissue and energy expenditure in a patient with craniopharyngioma and hypothalamic obesity. J. Pediatr. Endocrinol. Metab. 2015, 28, 53–57. [Google Scholar] [CrossRef] [PubMed]
  21. Mason, P.W.; Krawiecki, N.; Meacham, L.R. The use of dextroamphetamine to treat obesity and hyperphagia in children treated for craniopharyngioma. Arch. Pediatr. Adolesc. Med. 2002, 156, 887. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Ismail, D.; O’Connell, M.; Zacharin, M. Dexamphetamine use for management of obesity and hypersomnolence following hypothalamic injury. J. Pediatr. Endocrinol. Metab. 2006, 19, 129. [Google Scholar] [CrossRef] [PubMed]
  23. Denzer, C.; Denzer, F.; Lennerz, B.S.; Vollbach, H.; Lustig, R.H.; Wabitsch, M. Treatment of Hypothalamic Obesity with Dextroamphetamine: A Case Series. Obes. Facts 2019, 12, 91–102. [Google Scholar] [CrossRef] [PubMed]
  24. Greenway, F.L.; Bray, G.A. Treatment of hypothalamic obesity with caffeine and ephedrine. Endocr. Pract. 2008, 14, 697–703. [Google Scholar] [CrossRef] [PubMed]
  25. Zoicas, F.; Droste, M.; Mayr, B.; Buchfelder, M.; Schöfl, C. GLP-1 analogues as a new treatment option for hypothalamic obesity in adults: Report of nine cases. Eur. J. Endocrinol. 2013, 168, 699. [Google Scholar] [CrossRef] [Green Version]
  26. Lomenick, J.P.; Buchowski, M.S.; Shoemaker, A.H. A 52-week pilot study of the effects of exenatide on body weight in patients with hypothalamic obesity. Obesity 2016, 24, 1222–1225. [Google Scholar] [CrossRef] [PubMed]
  27. McCandless, S.E.; Yanovski, J.A.; Miller, J.; Fu, C.; Bird, L.M.; Salehi, P.; Chan, C.L.; Stafford, D.S.; Abuzzahab, M.J.; Viskochil, D.; et al. Effects of MetAP2 inhibition on hyperphagia and body weight in Prader-Willi syndrome: A randomized, double-blind, placebo-controlled trial. Diabetes Obes. Metab. 2017, 19, 1751–1761. [Google Scholar] [CrossRef] [Green Version]
  28. ClinicalTrials.gov. Bethesda (MD): National Library of Medicine (US). 29 July 2016. Identifier NCT02849743, Intranasal Oxytocin in Hypothalamic Obesity. Available online: https://clinicaltrials.gov/ct2/show/NCT02849743?term=NCT02849743&rank=1 (accessed on 15 May 2018).
  29. Hsu, E.A.; Miller, J.L.; Perez, F.A.; Roth, C.L. Oxytocin and Naltrexone Successfully Treat Hypothalamic Obesity in a Boy Post-Craniopharyngioma Resection. J. Clin. Endocrinol. Metab. 2018, 103, 370–375. [Google Scholar] [CrossRef] [Green Version]
  30. Poitou, C.; Puder, L.; Dubern, B.; Krabusch, P.; Genser, L.; Wiegand, S.; Verkindt, H.; Köhn, A.; von Schwartzenberg, R.J.; Flück, C.; et al. Long-term outcomes of bariatric surgery in patients with bi-allelic mutations in the POMC, LEPR, and MC4R genes. Surg. Obes. Relat. Dis. 2021, S1550-728900233-1. [Google Scholar] [CrossRef]
  31. Lentferink, Y.E.; Knibbe, C.A.J.; van der Vorst, M.M.J. Efficacy of Metformin Treatment with Respect to Weight Reduction in Children and Adults with Obesity: A Systematic Review. Drugs 2018, 78, 1887–1901. [Google Scholar] [CrossRef] [Green Version]
  32. Cole, T.J.; Lobstein, T. Extended internation (IOTF) body mass index cut-off for thinness, overweight and obesity. Pediatr. Obes. 2012, 7, 284–294. [Google Scholar] [CrossRef] [PubMed]
  33. Matthews, D.R.; Hosker, J.P.; Rudenski, A.S.; Naylor, B.A.; Treacher, D.F.; Turner, R.C. Homeostasis model assessment: Insulin resistance and beta-cell function from fasting plasma glucose and insulin concentrations in man. Diabetologia 1985, 28, 412–419. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Sparrow, S.S.; Cicchetti, D.; Balla, D.A. Vineland Adaptive Behavior Scales, 2nd ed.; NCS Pearson, Inc.: Minneapolis, MN, USA, 2005. [Google Scholar]
  35. Cole, T.J.; Freeman, J.V.; Preece, M.A. British 1990 growth reference cen- tiles for weight, height, body mass index and head circumference fitted by maximum penalized likelihood. Stat. Med. 1998, 17, 407–429. [Google Scholar] [CrossRef]
  36. Rodríguez, G.; Moreno, L.A.; Sarría, A.; Fleta, J.; Bueno, M. Resting energy expenditure in children and adolescents: Agreement between calorimetry and prediction equations. Clin. Nutr. 2002, 21, 255–260. [Google Scholar] [CrossRef]
  37. Muller, H.L. Consequences of craniopharyngioma surgery in children. J. Clin. Endocrinol. Metab. 2011, 96, 1981–1991. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Kreier, F.; Fliers, E.; Voshol, P.J.; Van Eden, C.G.; Havekes, L.M.; Kalsbeek, A.; Van Heijningen, C.L.; Sluiter, A.A.; Mettenleiter, T.C.; Romijn, J.A.; et al. Selective parasympathetic innervation of subcutaneous and intra-abdominal fat-functional implications. J. Clin. Investig. 2002, 110, 1243–1250. [Google Scholar] [CrossRef]
  39. Bray, G.A.; Gallagher, T.F., Jr. Manifestations of hypothalamic obesity in man: A comprehensive investigation of eight patients and a reveiw of the literature. Medicine 1975, 54, 301–330. [Google Scholar] [CrossRef] [PubMed]
  40. Bray, G.A.; Inoue, S.; Nishizawa, Y. Hypothalamic obesity. The autonomic hypothesis and the lateral hypothalamus. Diabetologia 1981, 20, 366–377. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  41. Tokunaga, K.; Fukushima, M.; Kemnitz, J.W.; Bray, G.A. Effect of vagotomy on serum insulin in rats with paraventricular or ventromedial hypothalamic lesions. Endocrinology 1986, 119, 1708–1711. [Google Scholar] [CrossRef]
  42. Khokhar, A.; Umpaichitra, V.; Chin, V.L.; Perez-Colon, S. Metformin use in children and adolescents with prediabetes. Pediatr Clin. N. Am. 2017, 64, 1341–1353. [Google Scholar] [CrossRef]
  43. Tang, Q.; Li, X.; Song, P.; Xu, L. Optimal cut-off values for the homeostasis model assessment of insulin resistance (HOMA-IR) and pre-diabetes screening: Developments in research and prospects for the future. Drug Discov. Ther. 2015, 9, 380–385. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Wallace, T.M.; Levy, J.C.; Matthews, D.R. Use and abuse of HOMA modeling. Diabetes Care 2004, 27, 1487–1495. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Van der Aa, M.P.; Knibbe, C.A.J.; de Boer, A.; van der Vorst, M.M.J. Definition of insulin resistance affects prevalence rate in pediatric patients: A systematic review and call for consensus. J. Pediatr. Endocrinol. Metab. 2017, 30, 123–131. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. Evaluation of equivalent age according to Vineland Adaptive Behavior Scales.
Figure 1. Evaluation of equivalent age according to Vineland Adaptive Behavior Scales.
Children 08 00531 g001
Figure 2. Changes in weight gain (kg/month) during the six months before and the six months after multidisciplinary management.
Figure 2. Changes in weight gain (kg/month) during the six months before and the six months after multidisciplinary management.
Children 08 00531 g002
Table 1. Main baseline clinical and auxological data of the 13 enrolled subjects.
Table 1. Main baseline clinical and auxological data of the 13 enrolled subjects.
SubjectSexDisease *Treatment **Age (Years)Height (cm)Height (SDS)Weight (kg)Weight (SDS)BMI (kg/m²)BMI (SDS)
1FCH-L-G-E-D16.1171.71.381134.1638.33.43
2FCH-L-G-E-D15.1154.2−1.31570.4223.91.27
3FCH-L-G-E-D13.81661.10963.7234.83.23
4FCH-L-G-E-D13.3143.5−1.9852.50.5425.51.87
5FCH-L-G-E-D10.3145.50.7862.52.7729.53.08
6FAH-L-E14.7153.5−1.28973.7141.13.76
7MAH-L-D-Tr8.8113.4−3.2830.50.5423.72.72
8FATr-To8.1126.4−0.30442.6227.54.76
9MSODH-L-G-D12.4148.5−0.28843.1838.33.62
10MSODH-L-G9.3120.6−2.40351.0224.33.88
11MSODH-L-G-Te12.9141.7−1.5746.80.4823.31.78
12FSODH-L-G-D13.6155.5−0.35822.9533.95.15
13MLHX3H-L-G-Te12.3150−0.01531.4323.561.95
* C = craniopharyngioma; A = astrocytoma; SOD = septo-optic dysplasia; LHX3 = LHX3 mutation. ** H = hydrocortisone; L = levothyroxine; G = rhGH; E = estroprogestin; D = desmopressin; Tr = triptorelin; To = vaptan; Te = testosterone. Patients 6 and 7 had GH deficiency but they were not on rhGH treatment due to their residual tumors.
Table 2. Caloric intake of the diets administered, resting energy expenditure, and data from the accelerometer-based activity monitor.
Table 2. Caloric intake of the diets administered, resting energy expenditure, and data from the accelerometer-based activity monitor.
SubjectCI (kcal/Die)BEE (kcal/Day)Mov/DayDEC (kcal/Die)
114501851--
214001487512.5237.5
313001746548.8322
415001278530244.4
515001313--
616001478228.5133
71400956407.8108.2
815001081600172.4
917001349--
1014001024495.3169.1
1116001251353.3100
1217001513655.4314.6
1317001384442.6162.9
CI = caloric intake; BEE = basal energy expenditure calculated with Schofield formula [36]; Mov = movements; DEC = daily energy consumption due to movements detected by the accelerometer.
Table 3. Clinical and metabolic parameters at T0 and T1.
Table 3. Clinical and metabolic parameters at T0 and T1.
T0T1p-Value
Weight (SDS)2.13 ± 1.402.01 ± 1.560.25
BMI (SDS)3.12 ± 1.173.03 ± 1.200.18
Weight gain (kg/month)0.84 ± 0.550.29 ± 0.790.03 *
Insulin (µU/mL)19.28 ± 12.2918.16 ± 14.440.69
HOMA index3.52 ± 2.183.33 ± 2.930.73
Triglycerides (mg/dL)108.6 ± 51.0110.5 ± 72.50.79
Total cholesterol (mg/dL)191.4 ± 45.4189.8 ± 29.40.98
HDL cholesterol (mg/dL)56.8 ± 22.058.7 ± 25.20.46
* Statistically significant (p-value < 0.05).
Table 4. Main data at T0-T1-T2 of the 4 subjects treated with metformin from T1.
Table 4. Main data at T0-T1-T2 of the 4 subjects treated with metformin from T1.
SubjectWeight (SDS)BMI (SDS)Weight Gain (kg/Month)HOMA Index
T0T1T2T0T1T2T0T1T2T0T1T2
14.164.053.953.433.333.281.02−0.2−0.166.162.061.4
33.723.933.823.233.323.261.51.6−0.053.162.841.91
63.713.543.313.763.673.560.34−0.34−0.386.44.133.82
103.183.393.043.683.743.450.441.54−0.874.73.453.74
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Tessaris, D.; Matarazzo, P.; Tuli, G.; Tuscano, A.; Rabbone, I.; Spinardi, A.; Lezo, A.; Fenocchio, G.; Buganza, R.; de Sanctis, L. Multidisciplinary Approach for Hypothalamic Obesity in Children and Adolescents: A Preliminary Study. Children 2021, 8, 531. https://doi.org/10.3390/children8070531

AMA Style

Tessaris D, Matarazzo P, Tuli G, Tuscano A, Rabbone I, Spinardi A, Lezo A, Fenocchio G, Buganza R, de Sanctis L. Multidisciplinary Approach for Hypothalamic Obesity in Children and Adolescents: A Preliminary Study. Children. 2021; 8(7):531. https://doi.org/10.3390/children8070531

Chicago/Turabian Style

Tessaris, Daniele, Patrizia Matarazzo, Gerdi Tuli, Antonella Tuscano, Ivana Rabbone, Alessandra Spinardi, Antonella Lezo, Giorgia Fenocchio, Raffaele Buganza, and Luisa de Sanctis. 2021. "Multidisciplinary Approach for Hypothalamic Obesity in Children and Adolescents: A Preliminary Study" Children 8, no. 7: 531. https://doi.org/10.3390/children8070531

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop