Next Article in Journal
High Hydrostatic Pressure Processing of Human Milk Increases Apelin and GLP-1 Contents to Modulate Gut Contraction and Glucose Metabolism in Mice Compared to Holder Pasteurization
Previous Article in Journal
IBF-R Regulates IRE1α Post-Translational Modifications and ER Stress in High-Fat Diet-Induced Obese Mice
Previous Article in Special Issue
A Cross-Sectional Study of Evening Hyperphagia and Nocturnal Ingestion: Core Constituents of Night Eating Syndrome with Different Background Factors
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Nutrients
Volume 14
Issue 1
10.3390/nu14010218
nutrients-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Anxiolytic Effect and Improved Sleep Quality in Individuals Taking Lippia citriodora Extract

by
Alejandro Martínez-Rodríguez
1,2,*,
María Martínez-Olcina
1,
Juan Mora
1,
Pau Navarro
3,
Nuria Caturla
3 and
Jonathan Jones
3
1
Department of Analytical Chemistry, Nutrition and Food Science, University of Alicante, 03690 Alicante, Spain
2
Alicante Institute of Health and Biomedical Research (ISABIAL), 03010 Alicante, Spain
3
Monteloeder, S.L., Miguel Servet 16, Nave 17, 03203 Elche, Spain
*
Author to whom correspondence should be addressed.
Nutrients 2022, 14(1), 218; https://doi.org/10.3390/nu14010218
Submission received: 7 December 2021 / Revised: 28 December 2021 / Accepted: 2 January 2022 / Published: 4 January 2022
(This article belongs to the Special Issue Diet and Sleep: The Towers of Lifestyle, Wellness, and Survival)
Browse Figures
Versions Notes

Abstract

:
The current fast-moving, hectic lifestyle has increased the number of individuals worldwide with difficulties in managing stress, which in turn is also affecting their sleep quality. Therefore, the objective of the current study was to assess a natural plant-based dietary supplement comprised of lemon verbena (Lippia citriodora) extract, purified in phenylpropanoids, in alleviating stress and improving quality of sleep. A double-blind, placebo-controlled study was conducted for 8 weeks, followed by a 4-week washout period. Both validated questionnaires and functional tests were performed during the study, whereas questionnaires were used after the washout. As a result, the group taking the lemon verbena extract significantly reduced their perception of stress after 8 weeks, which was corroborated by a significant decrease in cortisol levels. After the washout period, the subjects reported to present even lower stress levels, due to the lasting effect of the ingredient. As for sleep quality, the subjects taking the supplement reported feeling better rested, with a stronger effect observed in women. Sleep tracking using a wearable device revealed that the supplement users improved their times in the deeper stages of sleep, specifically their percentage of time in deep sleep and REM. In conclusion, lemon verbena extract purified in phenylpropanoids is revealed as a natural solution to help individuals to improve their stress and sleep quality.

1. Introduction

Anxiety is a normal part of life, and generally is a temporary condition. However, anxiety can occasionally prolong in time, having an impact on everyday activities [1], and giving rise to other conditions, such as depression, drug abuse, cardiovascular disease, and insomnia [2].
There are several synthetic drugs that are commonly used to treat anxiety. These are mainly antidepressants and benzodiazepines [3]. However, their high cost, important side effects and a rising interest in natural solutions have driven researchers to search for botanical-based formulas [4]. To this end, there are a number of plants that have been described to possess potential sedative and anxiolytic effects [5,6,7,8,9,10,11]. Of note is lemon verbena (Lippia citriodora), which is native to western South America but is also cultivated in the Mediterranean region and Middle East [12]. The leaves of this plant have been traditionally used to treat various conditions, including fever, digestive discomfort, insomnia and anxiety [13,14]. One of the most abundant polyphenols found in lemon verbena leaves is verbascoside [15], a phenylpropanoid that has been shown to possess antioxidant [16], anti-inflammatory [17] and antimicrobial [18] effects, while also having been shown to promote sleep and alleviate anxiety in mice [19]. In the case of the latter, the mechanism of action that has been described is related to the binding of verbascoside to neural GABA-A receptors, in the same location as benzodiazepines, thereby potentially conferring a similar effect.
Despite its reported traditional use, there are few clinical studies that have assessed the potential anti-anxiolytic and sedative effects of the plant. Therefore, the objective of the current study is to assess the effectiveness of lemon verbena extract, standardized in total phenylpropanoids, on subjects with high levels of perceived stress and low quality of sleep.

2. Materials and Methods

2.1. Study Design

This study is a randomized clinical trial in which participants were assigned to one of two groups (Figure 1), to determine the efficacy of a nutraceutical in improving different health parameters. Following published recommendations [20], the subjects were electronically randomized by block design in two arms: an experimental group (lemon verbena extract purified in verbascoside) and a control group (placebo).

2.2. Lemon Verbena Extract Characterization

The dietary supplement comprised of a purified extract of lemon verbena leaves (L. citriodora), standardized in a minimum of 28% total phenylpropanoids, of which 24% minimum corresponds to verbascoside (commercially known as PLX® or RelaxPLX). This ingredient was provided by Monteloeder SL (Alicante, Spain). The subjects were instructed to take 1 capsule per day, 1–2 h before sleeping. Each capsule contained 400 mg of the lemon verbena extract and 150 mg of excipient (cellulose microcrystalline).
The purification process of the lemon verbena extract was similar to previously published methods [21]. Briefly, dried lemon verbena leaves were mixed with at least 70% ethanol and macerated for 2 h at <80 °C. Then, it was filtered through a silica–cellulose press filter (1 µm) to eliminate insoluble materials, and dried in a vacuum at 60–80 °C. For chromatogram analysis, the extract was dissolved at a concentration of 1 mg/mL.
The chromatogram of the lemon verbena extract can be observed in Figure 2 and Table 1. The separation of the compounds from the lemon verbena extract was carried out at room temperature with a gradient elution program at a flow rate of 1 mL/min. The mobile phases consisted in water:acetic acid (2.5%) (A) and acetonitrile (B). The following multi-step linear gradient was applied: 0 min, 5% B; 20 min, 30% B; 30 min, 90% B; 35 min, 5% B; 40 min, 5% B. The initial conditions were held for 10 min. The injection volume in the HPLC system was 20 µL. An HPLC Agilent 1260 Infinity II with an array detector was used. HPLC detection was performed at 330 nm.

2.3. Subjects

A total of 40 patients aged 38.7 ± 11.5 years were recruited in several healthcare centers in Elche, Alicante during 2021. All of them were volunteers, the sample consisted of both men and women, and had to meet the following inclusion criteria: (1) over 21 years of age; (2) without any chronic pathology; (3) score on the perceived stress scale (PSS) greater than 15 (moderate levels of stress); and (4) score on the Pittsburgh sleep quality index (PSQI) greater than 5 (poor sleep quality).

2.4. Trial Design

Figure 3 and Figure 4 show the design and development of the research. The intervention lasted 2 months, plus a follow up one month afterwards. Each participant ingested one pill (lemon verbena extract 400 mg or placebo; depending on the group) per day, 1–2 h before bedtime, during the 2 months of investigation. First, participants were assessed to determine whether they met the eligibility criteria, and data was collected on their baseline characteristics (age, weight, height, location). In each of the visits (3 in total) all variables were measured; weight, systolic blood pressure, diastolic blood pressure, height, body composition by electrical impedance (weight, BMI, % fat). Cortisol was also assessed. Each of the volunteers filled out the different questionnaires included in the research (Figure 4) and an electrocardiogram was performed to determine resting heart rate. In addition, the participants wore the Fitbit monitoring bracelet for 7 days at the three time points (baseline—1–2 months). After one month of this last evaluation (three months), the patients retested the questionnaires to study the psychological effect after one month without nutraceutical intake (washout).

2.5. Declarations: Ethics Approval, Informed Consent

The present study was conducted in accordance with the norms of the Helsinki declaration. The Human Research Ethics Committee of the University of Alicante (Spain) granted approval to conduct a randomized trial (UA-2021-03-26) and all study participants gave their written consent prior to participation. Moreover, the investigators maintained the confidentiality of all personal data of the participants, coding personal information for this purpose.

2.6. Data Collection

2.6.1. Body Composition

In the present investigation, weight and body composition were assessed using the Tanita BC-730F validated bioimpedance scale (Tanita, Amsterdam, The Netherlands). The height of the subjects was measured with a SECA 123 stadiometer (Seca, Hamburg, Germany). From the body mass and height data, BMI (kg/m2) was calculated. The aim of making these measurements was to ensure that there were no changes in parameters (e.g., fat mass, weight) that could influence the sleep and stress results.

2.6.2. Sleep Quality Index

The Pittsburgh sleep quality index (PSQI) [22] was used to measure sleep quality. This 24-item questionnaire assesses habitual sleep during the past 30 days. A total of 19 of the questions are self-assessed, with 15 multiple-choice and 4 written, while 5 of the questions refer to the opinion of a “sleeping partner”. According to the PSQI assessment, sleep quality is divided into 7 components: subjective sleep quality, sleep latency, sleep duration, habitual sleep efficiency, sleep disturbances, sleep medication use, and daytime dysfunction. Component scores range from 0 to 3 points. A score of 0 points indicates no difficulty, while a score of 3 indicates severe difficulty. The 7 components are summed to obtain an overall score, which has a range of 0 to 21 points, with a score of 0 points indicating no difficulty, and a score of 21 indicating severe difficulty in all areas studied.

2.6.3. Stress

Perceived stress was analyzed using the perceived stress scale (PSS) questionnaire [23]. The PSS is a valid, reliable, and widely used psychological and psychiatric tool that measures a person’s perception of stress during the previous month. The 10-question version, the PSS-10, was used. Participants rated their emotional and cognitive responses to specific circumstances in their daily life on a 5-point Likert scale, ranging from 0 to 4 (0 = never, 1 = almost never, 2 = sometimes, 3 = quite often, and 4 = very often). The maximum scale score is 40, with higher scores reflecting higher levels of stress and a greater probability of stress interfering with health.

2.6.4. Cortisol Assessment

Cortisol was measured by blood analysis, as an altered stress response and consequent elevated circulating glucocorticoid levels have been found [24] in neuropsychiatric disorders such as depression or anxiety disorders.

2.6.5. Fitbit Sleep Tracking

Sleep-related variables were collected from activity wristbands (Fitbit Charge 2): minutes asleep, times awake, minutes of light sleep, minutes of deep sleep, and minutes of REM. From these data, the percentage of time asleep, light sleep, deep sleep and REM were calculated. The participants wore the activity tracker during the 7 days at the beginning, at 1 month, and at 2 months of the intervention. From these data, the average values were calculated and used for the analysis.

2.7. Statistical Analysis

Statistical analysis of the data was performed with the JAMOVI version 1.6.23.0 statistical program (Sydney, Australia). For descriptive statistics (mean ± standard deviation) and inferential analysis, the Shapiro–Wilk test was used to establish the normality distribution. Statistical differences between the different times and groups were tested by ANOVA (general linear model; 3 times × 2 groups)—analysis of variance, with Bonferroni post hoc comparisons. The significance level was set at p < 0.05. Effect sizes were calculated with the η2 statistic; an effect of η2 ≥ 0.01 indicates a small effect, ≥0.059 a medium effect, and ≥0.138 a large effect.

3. Results

3.1. Population Demographics

The study population comprised of 40 individuals, recruited based on their perceived levels of stress and sleep quality. To this end, the PSS score was used to assess anxiety, and the PSQI questionnaire for sleep quality. Participants with a PSS score over 15 and PSQI score over 5 were considered for recruitment. The participants were divided into 2 groups, placebo (n = 20; 4 males and 16 females) and experimental (n = 20; 10 males and 10 females). Table 2 shows the descriptive data on weight, height, BMI, fat, and visceral fat for each of the groups. No significant changes were observed in body weight/BMI nor fat mass in either of the two groups (Table 3). All were instructed to take the product 1–2 h before going to sleep.

3.2. Stress Analysis: Perceived Stress Scale (PSS) and Cortisol Levels

The perceived stress scale (PSS) is a validated questionnaire that allows to measure the amount of stress an individual perceived during the previous month. High values indicate a high level of stress. The results indicated a similar level of stress perceived by both groups during the first month (Table 4 and Table 5). However, during the second month, a significant improvement was detected in the group taking the supplement (−10.7% compared to baseline, p < 0.05). During the washout period, the effect of the dietary supplement could still be perceived, with a 20.5% reduction, on average, compared to baseline. A slight tendency to decrease was detected throughout the whole study in the placebo group but did not reach statistical significance. No significant differences were observed in the intergroup analysis.
Cortisol is known as the stress hormone and is a standard method of measuring stress. In the current study, a similar observation was observed as with the PSS questionnaire. Interestingly, decreased cortisol levels were detected in both groups in the first month. However, in the second month, cortisol levels increased in the placebo group to almost baseline levels. In the case of the group consuming the lemon verbena extract, cortisol levels continued decreasing in the second month. Specifically, a 15.6% decrease in cortisol levels were detected in the supplement group after two months of intake compared to baseline, indicating a lower level of stress in this group. The intergroup analysis did not reveal a significant difference, although a tendency to decrease was detected in the second month (p = 0.08). Therefore, the group taking the dietary supplement perceived an improved level of stress, coinciding with lower levels of the stress hormone cortisol.

3.3. Sleep Analysis: Perceived Sleep Quality Index (PSQI) and Sleep Activity Tracking

Sleep quality was assessed both at the perception level and using a tracking device. The perceived sleep quality index (PSQI) questionnaire was used as the validated test, while Fitbit trackers were provided to the subjects to track their sleep. Regarding the PSQI, a high value indicates the perceived poor quality of sleep. The data from the trackers were collected at the baseline, 1 month, 2 months and after the 1-month washout period. As for the Fitbit trackers, the subjects wore the trackers for 7 consecutive days at the baseline, 1 month and 2 months, and the average values of the parameters assessed were calculated.
Regarding the PSQI questionnaire, results indicated that significant differences were observed in the dietary supplement group starting at the first month, continuing to decrease in the second (−12.2% compared to the baseline, p < 0.05) (Table 6 and Table 7). The results after the washout were even more remarked, with a 25.9% decrease compared to the baseline. No significant differences were detected in the placebo group.
When the data was separated based on gender, a more notable effect was observed in the PSQI questionnaire in women (Table 6 and Table 7). In this case, significant differences were observed during the first month, with a 12.7% decrease with respect to baseline values. In the second month, a 22.6% reduction was observed, with similar values obtained during the washout period. No changes were observed in the placebo group in any of the time points analyzed. Significant differences were detected in both vs. the baseline as well as vs. placebo. Thus, the dietary supplement seemed to possess a stronger effect in the females of the study group.
As for the Fitbit data, the following parameters were assessed: %minutes asleep, %minutes awake, number of times awakened, %REM, %deep sleep and %light sleep (Table 8 and Table 9). No significant changes were observed in the placebo group during the whole study, except for a decrease in the number of times awakened during the first month. On the other hand, significant differences were observed in several parameters in the experimental group, regarding the data collected in the second month of the study. Specifically, a significant reduction in the number of times awakened during the night was observed. Additionally, the amount of time while asleep in deep sleep was significantly increased, while REM significantly increased compared to the placebo group. This was observed both in the total population as well as in women only (Table 10 and Table 11). In all cases, the significant differences were observed when the data was compared vs. the baseline, except for %REM where a significant difference vs. the placebo was detected. In the case of women only, %REM was significantly different when comparing with placebo, and %deep sleep vs. baseline values. A tendency to decrease the number of times awakened in women was also detected (p = 0.09). As these stages of sleep are associated with mental and physical recovery, it can be assumed that the dietary supplement significantly improved the quality of sleep, and not the quantity. Considering the fact that the individuals slept for an average of 469 and 447 min (approx. 7.5–8 h) in the placebo and experimental groups, respectively, it was not expected to find a significant increase in the minutes asleep.
Therefore, the dietary supplement improved the perceived quality of sleep. Additionally, the number of times the subjects awoke during the night was significantly lower, coinciding with an increased amount of time in the deeper stages of sleep.

4. Discussion

In this study, the effect of a dietary supplement comprised of lemon verbena leaf extract was assessed on a population of individuals with moderate levels of stress and poor sleep quality. The toxicity of the lemon verbena extract has been previously studied in rats [25]. That study revealed that the ingredient was safe even at up to at least 2000 mg/kg body weight. As for effective dosages, previous studies have shown that the ingredient was effective for sleep and stress at a daily dosage of 120 mg of verbascoside, albeit with a less concentrated extract. In his study, it was decided to use a more purified extract to see if we could obtain a similar, if not better, effect, while allowing to use a lower dosage that could fit in a single capsule (as opposed to the previous study where the participants had to take two). Several clinical studies have been conducted with the ingredient, with no side effects reported [26,27,28,29,30].
The study population was compared to a placebo group, and analyzed for 8 weeks, followed by a 4-week washout period. A randomized, double-blind placebo-controlled clinical trial was conducted. The results indicate that lemon verbena extracts, purified in the polyphenol verbascoside, may have a significant effect in reducing anxiety when taken continuously for at least 2 months. Specifically, perceived stress decreased after two months, which coincided with lower cortisol levels. Furthermore, the participants taking the lemon verbena extracts reported to perceive improved sleep quality, which was corroborated with an increased amount of time spent in the deeper stages of sleep. Interestingly, a stronger effect on sleep quality perception was observed in women.
Few studies have clinically demonstrated that lemon verbena can improve sleep quality and stress. For example, a clinical study in patients with insomnia reported improved perceived sleep quality after 4 weeks of lemon verbena intake [31]. In another study, lemon verbena extract reduced the number of awakenings during the night, and less reported anxiety after 3 weeks of intake in amateur athletes [27]. However, only validated questionnaires were used in both studies, with no objective analysis included. In the current study, cortisol levels were analyzed in order to assess stress levels and to corroborate with the PSS questionnaire. Similarly, sleep data collected from the Fitbit trackers were used to assess sleep quality. Therefore, the current study provides a more complete, objective assessment of both sleep and stress in individuals with moderate levels of stress and poor sleep quality using lemon verbena extracts.
Fitbit trackers have been used in many other clinical studies, including to assess sleep and anxiety [32,33,34,35]. The advantages of using these trackers are numerous; from being more affordable than medical sleep monitors, their ease of use without requiring technical supervision, their ability to be used for extended period of times, and them being relatively simple to extract data from. Some authors consider that consumer activity trackers may have limited accuracy to measure sleep, especially when compared to gold-standard methods such as polysomnography [36,37]. Despite this, while Fitbit trackers may not be an adequate option to study sleep patterns in disease, for the healthy population it is an affordable, fast, reliable and easy method to collect data.
The mechanisms by which lemon verbena exerts its effects have been partially elucidated. Gamma-aminobutyric acid (GABA) neurotransmitters are known to stimulate sleep and induce relaxation [38]. There are three known GABA receptors, A, B and C, being GABA-A the most relevant for sleep and anxiety. Specifically, there are several methods by which botanical extracts can exert its effect through the GABA system; either by binding to GABA-A receptors to increase its sensitivity to GABA, by increasing GABA synthesis, or increasing GABA release.
In the case of lemon verbena, previous studies have revealed that the major polyphenol verbascoside can bind to the GABA-A receptor in a similar fashion as benzodiazepines, which are regularly used to treat anxiety [39]. In fact, in the referenced study, the sedative effect of lemon verbena extract was enhanced in the presence of diazepam, and its effect decreased when the benzodiazepine receptor antagonist flumazenil was used. Therefore, this mechanism could attribute to the effects observed when consuming the extract.
Several other studies have also elucidated on how lemon verbena and/or verbascoside can induce relaxation, besides GABA-A receptor binding. One study reported that verbascoside exerted its effect via the modulation of cAMP and calcium channels [40]. Furthermore, low doses of verbascoside increased the expression of BDNF, serotonin, noradrenaline and dopamine. Other studies have also analyzed the effect of verbascoside in both animal models and in humans, with plants similar to lemon verbena [41,42].
This research has several strengths; it is a randomized controlled design, sleep quality could be measured both objectively and subjectively, patients could be followed without long lapses of time, CONSORT guidelines were followed and also, the pharmaceutical formulations in the form of a nutraceutical did not cause any patient to not want to participate, as has happened in other investigations with syrups, since sugar also has some biological effects and can affect sleep. However, among the limitations of the present investigation, it should be noted that some authors consider that consumer activity tracking devices, such as Fitbit, may have limited accuracy in measuring sleep, especially when compared to reference methods, such as polysomnography. However, a consumer wearable does not require an external expert, nor sophisticated machinery, which is why it is implemented in research.

5. Conclusions

In conclusion, the consumption of a lemon verbena extract purified in verbascoside has been clinically proven to help reduce anxiety and improve quality of sleep. Previous studies suggest that the mechanism of action is at least partially based on the binding of the polyphenol to GABA-A receptors in the same binding sites as benzodiazepines. Therefore, these results suggest the plausibility of using lemon verbena extracts as a natural alternative to sedative drugs, that possess many side effects and can cause dependency.

Author Contributions

Conceptualization, A.M.-R., J.M., J.J. and N.C.; methodology, A.M.-R., J.M. and M.M.-O.; software, M.M.-O. and P.N; validation, A.M.-R. and J.J.; formal analysis, A.M.-R. and M.M.-O.; investigation, A.M.-R. and M.M.-O.; resources, J.J., N.C. and P.N.; data curation, A.M.-R. and M.M.-O.; writing—original draft preparation, A.M.-R. and M.M.-O.; writing—review and editing, J.M., J.J. and N.C.; visualization, A.M.-R., J.M. and J.J.; supervision, A.M.-R. and J.J.; project administration, A.M.-R. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Ethics Committee of University of Alicante (UA-2021-03-26; 25 July 2021).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study is available on request from the corresponding author. The data are not publicly available due to is personal health information.

Acknowledgments

To the company Monteloeder, S.L., which participated in the design of the study protocol and provided the test product samples. The sponsor’s employees did not participate in the data analysis; the investigators were external to the company. To the European Institute of Exercise and Health (EIEH) of Alicante University for their selfless collaboration in this research.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Mendlowicz, M.V.; Stein, M.B. Quality of life in individuals with anxiety disorders. Am. J. Psychiatry 2000, 157, 669–682. [Google Scholar] [CrossRef]
  2. Regier, D.A.; Rae, D.S.; Narrow, W.E.; Kaelber, C.T.; Schatzberg, A.F. Prevalence of anxiety disorders and their comorbidity with mood and addictive disorders. Br. J. Psychiatry 1998, 34, 24–28. [Google Scholar] [CrossRef]
  3. Trevor, A.J. Sedative-Hypnotic Drugs. In Basic & Clinical Pharmacology, 15e; Katzung, B.G., Vanderah, T.W., Eds.; McGraw-Hill: New York, NY, USA, 2021. [Google Scholar]
  4. Kamboj, V.P. Herbal medicine. Curr. Sci. 2000, 78, 35. Available online: http://www.sciepub.com/reference/189774 (accessed on 18 November 2021).
  5. Singh, G.K.; Chauhan, S.K.; Rai, G.; Chatterjee, S.S.; Kumar, V. Potential antianxiety activity of Fumaria indica: A preclinical study. Pharmacogn. Mag. 2013, 9, 14–22. [Google Scholar]
  6. Jaiswal, A.K.; Bhattacharya, S.K.; Acharya, S.B. Anxiolytic activity of Azadirachta indica leaf extract in rats. Indian J. Exp. Biol. 1994, 32, 489–491. [Google Scholar]
  7. Saeed, S.A.; Bloch, R.M.; Antonacci, D.J. Herbal and dietary supplements for treatment of anxiety disorders. Am. Fam. Physician 2007, 76, 549–556. [Google Scholar]
  8. Rabbani, M.; Sajjadi, S.E.; Jalali, A. Hydroalcohol extract and fractions of Stachys lavandulifolia Vahl: Effects on spontaneous motor activity and elevated plus-maze behaviour. Phytother. Res. 2005, 19, 854–858. [Google Scholar] [CrossRef]
  9. Murphy, K.; Kubin, Z.J.; Shepherd, J.N.; Ettinger, R.H. Valeriana officinalis root extracts have potent anxiolytic effects in laboratory rats. Phytomedicine 2010, 17, 674–678. [Google Scholar] [CrossRef]
  10. Taiwo, A.E.; Leite, F.B.; Lucena, G.M.; Barros, M.; Silveira, D.; Silva, M.V.; Ferreira, V.M. Anxiolytic and antidepressant-like effects of Melissa officinalis (lemon balm) extract in rats: Influence of administration and gender. Indian J. Pharmacol. 2012, 44, 189–192. [Google Scholar]
  11. Rabbani, M.; Sajjadi, S.E.; Vaezi, A. Evaluation of anxiolytic and sedative effect of essential oil and hydroalcoholic extract of Ocimum basilicum L. and chemical composition of its essential oil. Res. Pharm. Sci. 2015, 10, 535–543. [Google Scholar]
  12. Pascual, M.E.; Slowing, K.; Carretero, E.; Sánchez Mata, D.; Villar, A. Lippia: Traditional uses, chemistry and pharmacology: A review. J. Ethnopharmacol. 2001, 76, 201–214. [Google Scholar] [CrossRef]
  13. Ghasempour, M.; Omran, S.M.; Moghadamnia, A.A.; Shafiee, F. Effect of aqueous and ethanolic extracts of Lippia citriodora on candida albicans. Electron. Physician 2016, 8, 2752–2758. [Google Scholar] [CrossRef] [Green Version]
  14. Montanari, B. Aromatic, Medicinal Plants and Vulnerability of Traditional Herbal Knowledge in a Berber Community of the High Atlas Mountains of Morocco. Plant Divers. Resour. 2014, 36, 388–402. [Google Scholar]
  15. Carnat, A.P.; Carnat, A.; Fraisse, D.; Lamaison, J.L. The aromatic and polyphenolic composition of lemon balm (Melissa officinalis L. subsp. officinalis) tea. Pharm. Acta Helv. 1998, 72, 301–305. [Google Scholar] [CrossRef]
  16. Arthur, H.; Joubert, E.; De Beer, D.; Malherbe, C.J.; Witthuhn, R.C. Phenylethanoid glycosides as major antioxidants in Lippia multiflora herbal infusion and their stability during steam pasteurisation of plant material. Food Chem. 2011, 127, 581–588. [Google Scholar] [CrossRef]
  17. Speranza, L.; Franceschelli, S.; Pesce, M.; Reale, M.; Menghini, L.; Vinciguerra, I.; De Lutiis, M.A.; Felaco, M.; Grilli, A. Antiinflammatory effects in THP-1 cells treated with verbascoside. Phytother. Res. 2010, 24, 1398–1404. [Google Scholar] [CrossRef]
  18. Avila, J.G.; de Liverant, J.G.; Martínez, A.; Martínez, G.; Muñoz, J.L.; Arciniegas, A.; Romo de Vivar, A. Mode of action of Buddleja cordata verbascoside against Staphylococcus aureus. J. Ethnopharmacol. 1999, 66, 75–78. [Google Scholar] [CrossRef]
  19. Razavi, B.M.; Zargarani, N.; Hosseinzadeh, H. Anti-anxiety and hypnotic effects of ethanolic and aqueous extracts of Lippia citriodora leaves and verbascoside in mice. Avicenna J. Phytomed. 2017, 7, 353–365. [Google Scholar]
  20. Saghaei, M. An overview of randomization and minimization programs for randomized clinical trials. J. Med. Signals Sens. 2011, 1, 55–61. [Google Scholar] [CrossRef] [Green Version]
  21. Quirantes-Piné, R.; Funes, L.; Micol, V.; Segura-Carretero, A.; Fernández-Gutiérrez, A. High-performance liquid chromatography with diode array detection coupled to electrospray time-of-flight and ion-trap tandem mass spectrometry to identify phenolic compounds from a lemon verbena extract. J. Chromatogr. A 2009, 1216, 5391–5397. [Google Scholar] [CrossRef]
  22. Buysse, D.J.; Reynolds, C.F.; Monk, T.H.; Berman, S.R.; Kupfer, D.J. The Pittsburgh sleep quality index: A new instrument for psychiatric practice and research. Psychiatry Res. 1989, 28, 193–213. [Google Scholar] [CrossRef]
  23. Remor, E. Scientific Information System Psychometric Properties of a European Spanish Version of the Perceived Stress Scale (PSS). Spanish J. Psychol. 2006, 9, 86–93. [Google Scholar] [CrossRef] [Green Version]
  24. Sousa-Lima, J.; Moreira, P.S.; Raposo-Lima, C.; Sousa, N.; Morgado, P. Relationship between obsessive compulsive disorder and cortisol: Systematic review and meta-analysis. Eur. Neuropsychopharmacol. 2019, 29, 1185–1198. [Google Scholar] [CrossRef]
  25. Funes, L.; Fernández-Arroyo, S.; Laporta, O.; Pons, A.; Roche, E.; Segura-Carretero, A.; Fernández-Gutiérrez, A.; Micol, V. Correlation between plasma antioxidant capacity and verbascoside levels in rats after oral administration of lemon verbena extract. Food Chem. 2009, 117, 589–598. [Google Scholar] [CrossRef]
  26. Funes, L.; Carrera-Quintanar, L.; Cerdán-Calero, M.; Ferrer, M.D.; Drobnic, F.; Pons, A.; Roche, E.; Micol, V. Effect of lemon verbena supplementation on muscular damage markers, proinflammatory cytokines release and neutrophils’ oxidative stress in chronic exercise. Eur. J. Appl. Physiol. 2011, 111, 695–705. [Google Scholar] [CrossRef]
  27. Martínez-Rodríguez, A.; Moya, M.; Vicente-Salar, N.; Brouzet, T.; Carrera-Quintanar, L.; Cervelló, E.; Micol, V.; Roche, E. Changes in biochemical and psychological parameters in university students performing aerobic exercise and consuming lemon verbena extracts. Curr. Top. Nutraceutical Res. 2015, 13, 95–102. [Google Scholar]
  28. Carrera-Quintanar, L.; Funes, L.; Vicente-Salar, N.; Blasco-Lafarga, C.; Pons, A.; Micol, V.; Roche, E. Effect of polyphenol supplements on redox status of blood cells: A randomized controlled exercise training trial. Eur. J. Nutr. 2015, 54, 1081–1093. [Google Scholar] [CrossRef]
  29. Caturla, N.; Funes, L.; Pérez-Fons, L.; Micol, V. A Randomized, Double-Blinded, Placebo-Controlled Study of the Effect of a Combination of Lemon Verbena Extract and Fish Oil Omega-3 Fatty Acid on Joint Management. J. Altern. Complement. Med. 2011, 17, 1051. [Google Scholar] [CrossRef]
  30. Carrera-Quintanar, L.; Funes, L.; Viudes, E.; Tur, J.; Micol, V.; Roche, E.; Pons, A. Antioxidant effect of lemon verbena extracts in lymphocytes of university students performing aerobic training program. Scand. J. Med. Sci. Sports 2012, 22, 454–461. [Google Scholar] [CrossRef]
  31. Afrasiabian, F.; Mirabzadeh Ardakani, M.; Rahmani, K.; Azadi, N.A.; Alemohammad, Z.B.; Bidaki, R.; Karimi, M.; Emtiazy, M.; Hashempur, M.H. Aloysia citriodora Palau (lemon verbena) for insomnia patients: A randomized, double-blind, placebo-controlled clinical trial of efficacy and safety. Phytother. Res. 2019, 33, 350–359. [Google Scholar] [CrossRef]
  32. Peach, H.D.; Gaultney, J.F.; Ruggiero, A.R. Direct and Indirect Associations of Sleep Knowledge and Attitudes With Objective and Subjective Sleep Duration and Quality via Sleep Hygiene. J. Prim. Prev. 2018, 39, 555–570. [Google Scholar] [CrossRef]
  33. Weatherall, J.; Paprocki, Y.; Meyer, T.M.; Kudel, I.; Witt, E.A. Sleep Tracking and Exercise in Patients with Type 2 Diabetes Mellitus (Step-D): Pilot Study to Determine Correlations between Fitbit Data and Patient-Reported Outcomes. JMIR mHealth uHealth 2018, 6, e8122. [Google Scholar] [CrossRef]
  34. Liang, Z.; Ploderer, B.; Liu, W.; Nagata, Y.; Bailey, J.; Kulik, L.; Li, Y. SleepExplorer: A visualization tool to make sense of correlations between personal sleep data and contextual factors. Pers. Ubiquitous Comput. 2016, 20, 985–1000. [Google Scholar] [CrossRef]
  35. Yurkiewicz, I.R.; Simon, P.; Liedtke, M.; Dahl, G.; Dunn, T. Effect of Fitbit and iPad Wearable Technology in Health-Related Quality of Life in Adolescent and Young Adult Cancer Patients. J. Adolesc. Young Adult Oncol. 2018, 7, 579–583. [Google Scholar] [CrossRef]
  36. De Zambotti, M.; Claudatos, S.; Inkelis, S.; Colrain, I.M.; Baker, F.C. Evaluation of a consumer fitness-tracking device to assess sleep in adults. Chronobiol. Int. 2015, 32, 1024–1028. [Google Scholar] [CrossRef] [Green Version]
  37. Cook, J.D.; Prairie, M.L.; Plante, D.T. Utility of the Fitbit Flex to evaluate sleep in major depressive disorder: A comparison against polysomnography and wrist-worn actigraphy. J. Affect. Disord. 2017, 217, 299–305. [Google Scholar] [CrossRef]
  38. Shi, Y.; Dong, J.-W.; Zhao, J.-H.; Tang, L.-N.; Zhang, J.-J. Herbal Insomnia Medications that Target GABAergic Systems: A Review of the Psychopharmacological Evidence. Curr. Neuropharmacol. 2014, 12, 289–302. [Google Scholar] [CrossRef]
  39. Ragone, M.; Sella, M.; Pastore, A.; Consolini, A. Sedative and Cardiovascular Effects of Aloysia citriodora Palau, on Mice and Rats. Lat. Am. J. Pharm. 2010, 29, 79–86. [Google Scholar]
  40. Sabti, M.; Sasaki, K.; Gadhi, C.; Isoda, H. Elucidation of the molecular mechanism underlying lippia citriodora(Lim.)-Induced relaxation and Anti-Depression. Int. J. Mol. Sci. 2019, 20, 3556. [Google Scholar] [CrossRef] [Green Version]
  41. Carmona, F.; Coneglian, F.S.; Batista, P.A.; Aragon, D.C.; Angelucci, M.A.; Martinez, E.Z.; Pereira, A.M.S. Aloysia polystachya (Griseb.) Moldenke (Verbenaceae) powdered leaves are effective in treating anxiety symptoms: A phase-2, randomized, placebo-controlled clinical trial. J. Ethnopharmacol. 2019, 242, 112060. [Google Scholar] [CrossRef]
  42. Costa de Melo, N.; Sánchez-Ortiz, B.L.; dos Santos Sampaio, T.I.; Matias Pereira, A.C.; Pinheiro da Silva Neto, F.L.; Ribeiro da Silva, H.; Alves Soares Cruz, R.; Keita, H.; Soares Pereira, A.M.; Tavares Carvalho, J.C. Anxiolytic and Antidepressant Effects of the Hydroethanolic Extract from the Leaves of Aloysia polystachya (Griseb.) Moldenke: A Study on Zebrafish (Danio rerio). Pharmaceuticals 2019, 12, 106. [Google Scholar] [CrossRef] [Green Version]
Nutrients 14 00218 g001 550
Figure 1. Participant’s flowchart.
Figure 1. Participant’s flowchart.
Nutrients 14 00218 g001
Nutrients 14 00218 g002 550
Figure 2. Chromatogram of the lemon verbena extract used in the study, analyzed at 330 nm.
Figure 2. Chromatogram of the lemon verbena extract used in the study, analyzed at 330 nm.
Nutrients 14 00218 g002
Nutrients 14 00218 g003 550
Figure 3. Design and development of the intervention. PSS = perceived stress scale; PSQI = Pittsburgh sleep quality index.
Figure 3. Design and development of the intervention. PSS = perceived stress scale; PSQI = Pittsburgh sleep quality index.
Nutrients 14 00218 g003
Nutrients 14 00218 g004 550
Figure 4. Development of the visits. PSS = perceived stress scale; PSQI = Pittsburgh sleep quality index.
Figure 4. Development of the visits. PSS = perceived stress scale; PSQI = Pittsburgh sleep quality index.
Nutrients 14 00218 g004
Table
Table 1. HPLC analysis compounds.
Table 1. HPLC analysis compounds.
NameRetention Time
Luteolin-7-diglucuronide7.013
Verbascoside15.040
Diosmetin-7-O-diglucuronide15.720
Chrysoeriol-7-diglucuronide15.987
Isoverbascoside16.413
Forsythoside A17.253
Eukovoside20.027
Acacetin-7-diglucuronide25.667
Martynoside27.427
Table
Table 2. Basic anthropometric and demographic characteristics of the sample.
Table 2. Basic anthropometric and demographic characteristics of the sample.
VariablePlacebo Group (n = 20)Experimental Group (n = 20)
Mean ± SDMean ± SD
Age (years)43.4 ± 13.934.0 ± 6.28
Height (cm)164 ± 8.08173 ± 9.07
Weight (kg)63.2 ± 10.780.8 ± 10.7
BMI (kg/m2)23.5 ± 3.026.7 ± 4.5
Body fat (%)23.8 ± 8.1725.7 ± 8.81
Visceral fat4.47 ± 2.605.11 ± 2.84
n = sample number; SD = standard deviation; cm = centimeters; kg = kilograms; % = percentage.
Table
Table 3. Body composition values table.
Table 3. Body composition values table.
VariableGroupBaselineMonth 2
Mean ± SDMean ± SD
WeightPlacebo63.2 ± 10.963.3 ± 11.0
Experimental80.8 ± 16.280.0 ± 15.8
BMIPlacebo23.5 ± 3.123.5 ± 3.0
Experimental26.7 ± 4.526.5 ± 4.3
Fat MassPlacebo24.5 ± 8.223.5 ± 9.1
Experimental25.4 ± 10.324.9 ± 10.0
SD = standard deviation.
Table
Table 4. Chart depicting values; anxiety tests.
Table 4. Chart depicting values; anxiety tests.
VariableGroupBaselineMonth 1Month 2Washout
Mean ± SDMean ± SDMean ± SDMean ± SD
PSS Score Placebo22.3 ± 7.121.5 ± 8.320.7 ± 7.620.2 ± 6.6
Experimental20.8 ± 7.120.3 ± 6.618.7 ± 5.7*17.1 ± 7.6 *
CortisolPlacebo16.6 ± 5.614.3 ± 4.8 ***15.7 ± 4.9NA
Experimental15.1 ± 6.013.7 ± 5.7 **12.6 ± 6.0***NA
SD = standard deviation; PSS = perceived stress scale; NA = no data analysis. * p < 0.05, ** p < 0.01, *** p < 0.001 vs. baseline. ANOVA test were performed.
Table
Table 5. Results of anxiety tests. Change vs. baseline = percent change from baseline.
Table 5. Results of anxiety tests. Change vs. baseline = percent change from baseline.
VariableGroupMonth 1 vs. BaselineMonth 2 vs. BaselineWashout vs. Baseline
Mean ± SDMean ± SDMean ± SD
PSS ScorePlacebo0.96 ± 0.240.93 ± 0.270.91 ± 0.41
Experimental0.98 ± 0.240.90 ± 0.27 *0.82 ± 0.25 *
CortisolPlacebo0.87 ± 0.11 ***0.94 ± 0.31NA
Experimental0.91 ± 0.08 **0.83 ± 0.31 ***NA
SD = standard deviation; PSS = perceived stress scale; NA = no data analysis. * p < 0.05, ** p < 0.01, *** p < 0.001 vs. baseline. ANOVA test were performed.
Table
Table 6. Chart depicting values.
Table 6. Chart depicting values.
VariableGroupBaselineMonth 1Month 2Washout
Mean ± SDMean ± SDMean ± SDMean ± SD
PSQI Score (Total)Placebo8.5 ± 2.97.8 ± 2.37.7 ± 2.67.3 ± 2.8
Experimental6.7 ± 2.06.2 ± 2.2 *5.9 ± 2.6 *5.0 ± 2.4 **
PSQI Score MalesPlacebo5.5 ± 0.65.38 ± 2.66.4 ± 4.64.9 ± 2.8
Experimental8.7 ± 3.28.7 ± 1.98.0 ± 2.57.8 ± 3.1*
PSQI Score FemalesPlacebo8.3 ± 2.78.1 ± 2.48.3 ± 2.47.9 ± 2.5
Experimental7.3 ± 2.66.5 ± 2.4 *5.7 ±2.5 *†5.6 ± 2.7 **†
SD = standard deviation; PSQI = Pittsburgh sleep quality index. * p < 0.05, ** p < 0.01 vs. baseline. † p < 0.05 vs. placebo. ANOVA test were performed.
Table
Table 7. Results of PSQI questionnaire. Change vs. baseline = percent change from baseline.
Table 7. Results of PSQI questionnaire. Change vs. baseline = percent change from baseline.
VariableGroupMonth 1 vs. BaselineMonth 2 vs. BaselineWashout vs. Baseline
Mean ± SDMean ± SDMean ± SD
PSQI Score (Total)Placebo0.92 ± 0.240.91 ± 0.420.86 ± 0.48
Experimental0.93 ± 0.21 *0.88 ± 0.34 *0.75± 0.25 **
PSQI Score MalesPlacebo0.98 ± 0.18 1.18 ± 0.65 0.86 ± 0.36
Experimental0.99 ± 0.330.92 ± 0.650.89 ± 0.36
PSQI Score FemalesPlacebo0.98 ± 0.23 1.00 ± 0.41 0.95 ± 0.48
Experimental0.88 ± 0.21 *0.78 ± 0.28*†0.76 ± 0.22 **†
SD = standard deviation; PSQI = Pittsburgh sleep quality index. * p < 0.05, ** p < 0.01 vs. baseline. † p < 0.05 vs. placebo. ANOVA test were performed.
Table
Table 8. Chart depicting Fitbit values in total population.
Table 8. Chart depicting Fitbit values in total population.
VariableGroupBaselineMonth 1Month 2
Mean ± SDMean ± SDMean ± SD
% Minutes AsleepPlacebo87.7 ± 1.787.6 ± 2.288.6 ± 3.0
Experimental84.9 ± 1.087.8 ± 1.888.4 ± 2.3
% Minutes AwakePlacebo12.3 ± 1.712.4 ± 2.211.3 ± 2.9
Experimental12.1 ± 2.112.2 ± 1.711.6 ± 2.3
Number of Times AwakenedPlacebo24.2 ± 4.920.9 ± 5.2 *20.6 ± 6.7
Experimental28.8 ± 8.729.9 ± 7.822.9 ± 7.2 *
% REMPlacebo20.2 ± 4.723.2 ± 8.119.0 ± 5.2
Experimental21.4 ± 5.021.2 ± 5.323.0 ± 5.1 †
% Light SleepPlacebo65.3 ± 6.870.4 ± 12.265.1 ± 10.1
Experimental64.6 ± 9.962.9 ± 6.561.3 ± 7.1
% Deep SleepPlacebo15.2 ± 5.416.9 ± 7.116.8 ± 3.6
Experimental16.7 ± 3.416.6 ± 3.418.6 ± 3.7 *
SD = standard deviation; % = percentage. * p < 0.05 vs. baseline, † p < 0.05 vs. placebo.
Table
Table 9. Results of Fitbit data. Change vs. baseline = percent change from baseline.
Table 9. Results of Fitbit data. Change vs. baseline = percent change from baseline.
VariableGroupMonth 1 vs. BaselineMonth 2 vs. Baseline
Mean ± SDMean ± SD
% Minutes AsleepPlacebo0.99 ± 0.131.01 ± 0.10
Experimental1.03 ± 0.101.04 ± 0.07
% Minutes AwakePlacebo1.01 ± 0.130.92 ± 0.21
Experimental1.01 ± 0.130.96 ± 0.16
Number of Times AwakenedPlacebo0.86 ± 0.19 *0.85 ± 0.28
Experimental1.04 ± 0.36 0.79 ± 0.29 *
% REMPlacebo1.05 ± 0.090.94 ± 0.18
Experimental1.08 ± 0.29 1.07 ± 0.25 †
% Light SleepPlacebo1.08 ± 0.060.99 ± 0.13
Experimental0.97 ± 0.150.95 ± 0.13
% Deep SleepPlacebo1.11 ± 0.061.11 ± 0.28
Experimental0.99 ± 0.131.11 ± 0.27 *
Results of Fitbit data. Change vs. baseline = percent change from baseline. SD = standard deviation; % = percentage. * p < 0.05 vs. baseline, † p < 0.05 vs. placebo. ANOVA test were performed.
Table
Table 10. Chart depicting Fitbit values in women population.
Table 10. Chart depicting Fitbit values in women population.
VariableGroupBaselineMonth 1Month 2
Mean ± SDMean ± SDMean ± SD
% Minutes AsleepPlacebo87.7 ± 1.887.3 ± 2.288.0 ± 2.3
Experimental88.1 ± 2.487.6 ± 1.989.2 ± 1.7
% Minutes AwakePlacebo12.3 ± 1.812.6 ± 2.211.8 ± 2.1
Experimental11.8 ± 2.212.3 ± 1.910.7 ± 1.8
Number of Times AwakenedPlacebo23.5 ± 5.320.6 ± 5.521.0 ± 5.4
Experimental25.6 ± 9.428.1 ± 7.619.1 ± 7.6
% REMPlacebo20.6 ± 5.222.9 ± 8.319.3 ± 5.8
Experimental21.5 ± 6.021.1 ± 6.526.9 ± 2.7 †
% Light SleepPlacebo66.3 ± 7.170.9 ± 13.066.4 ± 11.1
Experimental67.7 ± 12.565.1 ± 8.158.8 ± 8.6
% Deep SleepPlacebo14.1 ± 5.416.2 ± 7.316.0 ± 3.6
Experimental15.8 ± 3.915.2 ± 3.519.1 ± 4.5 *
SD = standard deviation; % = percentage. * p < 0.05 vs. baseline, † p < 0.05 vs. placebo. ANOVA test were performed.
Table
Table 11. Fitbit values in women population. change vs. baseline = percent change from baseline.
Table 11. Fitbit values in women population. change vs. baseline = percent change from baseline.
VariableGroupMonth 1 vs. BaselineMonth 2 vs. Baseline
Mean ± SDMean ± SD
% Minutes AsleepPlacebo0.99 ± 0.141.00 ± 0.02
Experimental0.99 ± 0.071.01 ± 0.01
% Minutes AwakePlacebo1.02 ± 0.150.96 ± 0.13
Experimental1.04 ± 0.120.91 ± 0.05
Number of Times AwakenedPlacebo0.88 ± 0.49 0.89 ± 0.24
Experimental1.10 ± 0.190.75 ± 0.41
% REMPlacebo1.11 ± 0.21 0.94 ± 0.21
Experimental0.98 ± 0.07 1.25 ± 0.24 †
% Light SleepPlacebo1.07 ± 0.141.00 ± 0.14
Experimental0.96 ± 0.080.87 ± 0.17
% Deep SleepPlacebo1.15 ± 0.421.13 ± 0.28
Experimental0.96 ± 0.081.22 ± 0.29 *
SD = standard deviation; % = percentage. * p < 0.05 vs. baseline, † p < 0.05 vs. placebo. ANOVA test were performed.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Martínez-Rodríguez, A.; Martínez-Olcina, M.; Mora, J.; Navarro, P.; Caturla, N.; Jones, J. Anxiolytic Effect and Improved Sleep Quality in Individuals Taking Lippia citriodora Extract. Nutrients 2022, 14, 218. https://doi.org/10.3390/nu14010218

AMA Style

Martínez-Rodríguez A, Martínez-Olcina M, Mora J, Navarro P, Caturla N, Jones J. Anxiolytic Effect and Improved Sleep Quality in Individuals Taking Lippia citriodora Extract. Nutrients. 2022; 14(1):218. https://doi.org/10.3390/nu14010218

Chicago/Turabian Style

Martínez-Rodríguez, Alejandro, María Martínez-Olcina, Juan Mora, Pau Navarro, Nuria Caturla, and Jonathan Jones. 2022. "Anxiolytic Effect and Improved Sleep Quality in Individuals Taking Lippia citriodora Extract" Nutrients 14, no. 1: 218. https://doi.org/10.3390/nu14010218

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop