Next Article in Journal
Did the New French Regulation of Zolpidem Decrease the Problematic Consumption of Zolpidem? A Field Study among Users
Next Article in Special Issue
Night Work and Sustainable Working Life—A Prospective Trajectory Analysis of Swedish Twins
Previous Article in Journal
At Which Area Level Does COVID-19 Infection Matter Most for an Individual’s Self-Rated Health? A Multilevel Fixed-Effects Model Analysis in Japan
Previous Article in Special Issue
Impact of Rotating Shifts on Lifestyle Patterns and Perceived Stress among Nurses: A Cross-Sectional Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

Shift Work and Serum Vitamin D Levels: A Systematic Review and Meta-Analysis

1
Occupational Health, Department of Clinical and Molecular Sciences, Polytechnic University of Marche, 60126 Ancona, Italy
2
Endocrinology Clinic, Department of Clinical and Molecular Sciences, Polytechnic University of Marche, 60126 Ancona, Italy
*
Authors to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(15), 8919; https://doi.org/10.3390/ijerph19158919
Submission received: 15 June 2022 / Revised: 19 July 2022 / Accepted: 20 July 2022 / Published: 22 July 2022
(This article belongs to the Special Issue Health Consequences of Shift Work and Chronodisruption)

Abstract

:
Vitamin D deficiency and insufficiency are highly prevalent conditions worldwide due to several factors, including poor sun exposure. Shift workers may be exposed to the risk of hypovitaminosis D due to fewer opportunities for sunlight exposure compared to day workers. A systematic review of the PubMed, SCOPUS, and EMBASE databases was conducted according to the Preferred Reporting Items for Systemic Reviews and Meta-Analyses (PRISMA) statement to investigate the effect of shift work on vitamin D levels. Mean differences (MD) and 95% confidence intervals (CI) of serum 25-OH-D levels in shift workers and non-shift workers were calculated. A total of 13 cross-sectional studies were included in the meta-analysis. We found significantly lower levels of serum 25-OH-D in shift workers compared with non-shift workers (MD: −1.85, 95% CI [−2.49 to −1.21]). Heterogeneity among included studies was high (I2 = 89%, p < 0.0001), and neither subgroup analysis nor meta-regression were able to identify specific sources of the heterogeneity that may be related to the different characteristics of shift work among studies. The monitoring of serum vitamin D levels and prompt correction of any deficiencies should be considered in shift workers. Notably, since a large part of the observations are derived from Koreans, larger epidemiological studies are needed in other populations.

1. Introduction

As shown by worldwide data, vitamin D deficiency (25-OH-D levels below 20 ng/mL) and vitamin D insufficiency (25-OH-D levels between 21 and 29 ng/mL) are serious global health problems [1,2]. Indeed, approximately one billion people are estimated to be affected by vitamin D insufficiency [3]. The prevalence of this condition varies widely by geographic area, latitude, lifestyle habits (work, sun exposure, type of clothing used), dietary habits, gender, and genetic factors [4]. Notably, since the optimal 25-OH-D levels are still debated, the above-mentioned definitions of hypovitaminosis D are not universally accepted. Consequently, maintaining 25-OH-D levels > 20 ng/mL is widely accepted for most of the population, but individual objectives may vary [5].
Approximately 90% of the vitamin D detectable in human serum is synthesized in the skin from a cholesterol-like precursor (7-dehydrocholesterol) present in epidermal cells. This, as a result of exposure to ultraviolet B (UV-B) radiation from sunlight, is converted to vitamin D3 (cholecalciferol). The remaining portion (around 10%) is obtained from foods such as oily fish, egg yolk, animal liver, and some types of mushrooms. Animal sources contain vitamin D3, while plant sources contain vitamin D2 (ergocalciferol). Vitamin D2 and vitamin D3 are both biologically inactive and they undergo further enzymatic conversions: first, they undergo a 25-hydroxylation in the liver, becoming 25-(OH)-D (calcifediol), the main circulating form of vitamin D, with a half-life of 2–3 weeks. Then, 25-(OH)-D is finally activated by 1-alpha-hydroxylation in the kidney, becoming 1,25(OH)2D (calcitriol) with a half-life of 4–6 h [6,7]. Vitamin D plays a key role in the homeostasis of calcium metabolism and in the process of bone modeling and remodeling [4]; therefore, deficiency of this vitamin is associated with osteoporosis and a higher incidence of fractures [6,8].
Since endogenous vitamin D synthesis is highly dependent on sunlight, poor exposure to solar radiation is the leading cause of hypovitaminosis D [9]. A systematic review of 71 studies conducted worldwide found that occupation is a major factor impacting vitamin D levels and that indoor workers are at greater risk of developing hypovitaminosis D than outdoor workers [10]. In addition, several studies have shown an association between low vitamin D levels and many other diseases, such as autoimmune disorders, cardiovascular disease, infectious diseases, type 2 diabetes mellitus, cancer, and neurological and neuropsychiatric disorders, such as schizophrenia, dementia, and depression [6,11]. Shift work refers to a work organization in which the workers have shift schedules to cover more than the usual 8 h day, up to and including the whole 24 h [12]. Shift work—in particular, shift work including night shifts—may be a risk factor for vitamin D deficiency, since shift workers are likely to have fewer opportunities for sunlight exposure than day workers [13]. In addition, shift workers are more likely to consume unhealthy foods, as well as displaying a poor tendency to take vitamin supplements [14,15].
Several studies have shown an association between shift work and overweight [16,17,18,19]. At the same time, it is known that hypovitaminosis D is common in obese individuals and that BMI and fat mass are factors inversely related to 25-OH-D levels [1,20,21].
Since several factors associated with shift work can predispose shift workers to lower vitamin D levels, the objective of the present meta-analysis is to determine whether shift work constitutes a risk of low levels of vitamin D.

2. Materials and Methods

2.1. Search Strategy

A systematic search was conducted through the Scopus, PubMed, and EMBASE databases from January to February 2022. The terms “vitamin D”, “25-hydroxyvitamin-D”, or “25-OH-D” were combined with “shift work”, “night work”, “night shift work”, “shiftwork”, “shift schedule”, or “indoor work”. In particular, the following query strings were used: “(vitamin D* OR 25-Hydroxyvitamin-D OR 25(OH)D OR 25-OH-D) AND (shift work* OR night work* OR night shift work* OR shiftwork* OR nightwork* OR shift schedule OR indoor work*)” (PubMed, EMBASE), and “TITLE-ABS-KEY ((vitamin D* OR 25-Hydroxyvitamin-D) AND (shift work* OR night work* OR night shift work* OR shiftwork * OR nightwork* OR shift schedule OR indoor work*))” (Scopus). The search was conducted by two authors (M.M. and G.S.) according to the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement [22]. The study was registered on PROSPERO (CRD42022341088).

2.2. Selection Criteria

The eligible studies were selected following the PICO model: Population (adult workers), Intervention (shift work), Comparison (non-shift work), Outcome (25-OH-D serum levels). All the studies reporting vitamin D levels in adult workers (differentiated in shift workers and non-shift workers) until 2021 were included. In vitro or animal studies, case reports, and non-English papers were excluded.

2.3. Data Extraction and Quality Assessment

Three authors (M.M., G.S., and M.B.) performed data extraction. The following data were collected: first author, year, study design, method of vitamin D measurement, number of subjects, gender, age, body mass index (BMI), mean serum 25-OH-D levels. When the values of 25(OH)D levels were reported in nmol/L, they were converted into ng/mL by dividing them by 2.496. When the standard error of the mean (SEM) was reported, standard deviation (SD) was calculated by multiplying SEM by the square root of the number of subjects. The quality of evidence (QoE) was assessed by one researcher (M.M.) using the Cambridge Quality Checklists (CQCs) [23]. In brief, the CQCs were designed to identify high-quality studies for systematic reviews and meta-analyses and provide information on correlations (five items investigating sampling method, response and retention rates, sample size, and correlates/outcome assessment), risk factors (definition of study design), and causal risk factors (how the risk factor is causally related to the outcome).

2.4. Statistical Analysis

The analysis was performed using RevMan software v. 5.4 (Cochrane Collaboration, Oxford, UK) and Comprehensive Meta-Analysis v. 3 (Biostat Inc., Englewood, NJ, USA). Mean difference and 95% confidence interval (CI) were calculated to compare serum vitamin D levels between shift workers and non-shift workers, and meta-analysis was performed using a random-effect model. The I2 statistic was applied to inspect heterogeneity, with I2 > 50% and p < 0.1 indicating high between-study heterogeneity. Publication bias was assessed by funnel plot asymmetry as well as Egger’s test. To investigate the source of heterogeneity, subgroup analysis (based on methods of vitamin D measurement and gender prevalence), meta-regression (with adjustment for age and BMI), and sensitivity analysis (omitting each single study to explore its effect on the overall meta-analysis) were conducted. Statistical significance was set at 0.05.

3. Results

3.1. Study Selection

Using the above-mentioned search strategy, 223 abstracts were extracted. After the removal of 48 duplicates, 161 articles were screened. Of these, 102 were identified by title or abstract as papers on other topics, review articles, editorials, case reports, animal or in vitro studies, or non-English articles. Of the remaining 59 full-text articles assessed for eligibility, 46 were excluded due to non-extractable data (e.g., vitamin D values not specified, not clearly distinguished between shift and non-shift workers, or data summarized with different descriptive statistics to mean and SEM or SD). Finally, 13 studies [12,24,25,26,27,28,29,30,31,32,33,34,35] were included in the present meta-analysis (Figure 1). All the included studies had a cross-sectional design, and their main characteristics are presented in Table 1. The characteristics of the workers and shift work in the included studies are summarized in Table 2. The results of QoE are shown in Table 3.

3.2. Differences in Vitamin D Levels between Shift Workers and Non-Shift Workers

Based on 13 studies including a total of 110,287 subjects, a random-effects model revealed significantly lower serum 25-OH-vitamin D levels in shift workers compared with non-shift workers (mean difference, MD: −1.85, 95% CI [−2.49 to −1.21]) with high heterogeneity between studies (I2 = 89%, p < 0.0001) (Figure 2). Egger’s test (p = 0.37) and visual examination of funnel plots (Figure 3) indicated no significant publication bias over the included studies. As far as sensitivity analysis is concerned, omitting the study of Park et al. [30], a slight decrease in between-study heterogeneity was observed (I2 = 83%, p < 0.0001), without substantial changes in the estimate of the effect size (MD: −1.75, 95% CI [−2.42 to −1.09]). Some studies reported 25-OH-D mean values with high SD. This suggests that a non-normal distribution should be carefully considered in studies on 25-OH-D serum levels.
It would have been interesting to evaluate the prevalence of people with insufficient vitamin D levels among shift and non-shift workers. However, the selected studies rarely reported these data and different cut-offs were used, making the data not analyzable. The type of shift work and particularly the number of night shifts worked per month are likely high related to sunlight exposure and therefore to vitamin D levels. The investigation of this relation was not possible due to the lack of a clear definition of “shift work” in several studies.

3.3. Differences in Vitamin D Levels between Shift Workers and Non-Shift Workers—Subgroup Analysis

3.3.1. Methods of Measurement

In order to explore the source of heterogeneity, a subgroup analysis according to the methods of serum 25-OH-D level measurement was performed. The test for subgroup differences indicated that there was no statistically significant subgroup effect (p = 0.17), suggesting that the method of measurement does not modify the effect of shift work on serum vitamin D levels. However, most of studies reported vitamin D levels measured by chemiluminescent immunoassay (CLIA), whereas other methods were used in a smaller number of studies (Figure 4). In addition, in three large studies [26,28,30], the method of measurement was not specified.
Omitting these three studies, the analysis was still significant, with a slight reduction in heterogeneity (MD: −0.33, 95% CI [−0.45 to −0.20]; I2 = 78%, p < 0.0001) (Figure 5).

3.3.2. Sex Differences

The subgroup analysis showed a lower effect of shift work on serum vitamin D levels in studies where female workers were >50%, with lower heterogeneity (MD: −1.27, 95% CI [−2.08 to −0.46]; I2 = 76%, p = 0.0008) compared with studies where women were < 50% (MD: −2.37, 95% CI [−3.33 to −1.41]; I2 = 91%, p < 0.0001), but the subgroup effect was not statistically significant (p = 0.08) (Figure 6). However, a far smaller number of subjects contributed to the female prevalence subgroup (16,466 vs. 93,821), and the analysis may not have been able to detect subgroup differences.

3.3.3. Meta-Regression Analysis

Among the included studies, data on mean age and mean BMI were provided in eight [12,24,25,27,29,30,32,33] and six papers [12,25,27,29,32,33], respectively. Random-effect meta-regression analysis did not show any relationship between age (β = 0.075; 95% CI [−0.323 to 0.472]; p = 0.7) or BMI (β = 0.977; 95% CI [−0.187 to 2.141]; p = 0.1) and mean differences in vitamin D levels (Figure 7).

4. Discussion

The present metanalysis shows significantly lower serum vitamin D levels in shift workers compared with non-shift workers. The main cause of this result may be that shift workers are exposed to lower levels of sunlight than other categories of workers [12]. In addition, the tendency of shift workers to eat meals at irregular times and their tendency to eat a diet rich in fatty and junk food could lead to a reduced dietary intake of vitamin D [13,14]. It is also known that shift workers tend to have a BMI higher than the general population [15,36,37], a factor that could lead to the increased sequestration of vitamin D in adipose tissue and, consequently, lower values of circulating vitamin D [38,39].
In shift workers, the health risks posed by vitamin D deficiency can be combined with the risks of altered circadian rhythms. The expression of vitamin D receptors in areas of the brain that regulate the sleep–wake cycle has been shown [40]. Some studies highlighted an association between vitamin D deficiency and sleep disturbances [41,42,43]. Sleep disorders commonly afflict shift workers; in fact, we can speak of Shift Work Disorder, a sleep–wake cycle disorder characterized by symptoms such as insomnia and excessive sleepiness, due to the deregulation of the circadian rhythm that affects this category of workers [44,45].
Hypovitaminosis D has been extensively studied in bone metabolism disorders and particularly in osteoporosis [2]. Fracture risk in shift workers has never been evaluated in the past, but a recent study by Bukowska-Damska et al. showed a higher rate of bone turnover in female night shift workers, suggesting a potential link between osteoporosis and shift work [46]. Prospective longitudinal studies instead of cross-sectional studies may be more appropriate in assessing the incidence of fractures in shift workers. Accordingly, shift workers should be followed over time for vitamin D deficiency and fracture risk in periodic health surveillance.
Vitamin D deficiency has also been correlated with the occurrence of cardiovascular disease. In particular, several meta-analyses have demonstrated an inverse correlation between vitamin D concentration and cardiovascular mortality [47,48,49]. In addition, vitamin D deficiency has been associated with reduced HDL levels and increased LDL levels [50]. In shift workers, the low serum levels of vitamin D could contribute to the increased cardiovascular risk found in this category of workers [45]. This should be taken into account in the health surveillance of these workers.
Vitamin D metabolism involves several biochemical reactions and metabolites; 25(OH)D is the most represented in the bloodstream due to its long half-life and thus represents the gold standard for estimating the body’s reserves of vitamin D [51]. Different assays for the measurement of 25-OH-D levels are available and this may constitute a possible source of heterogeneity among studies. A subgroup analysis was performed to investigate whether the 25-OH-D measurement method influenced the results of the meta-analysis. However, in three studies [26,28,30], two of which were very large [28,30], the measurement methods were not reported. In addition, CLIA was the method of choice in most of the studies, whereas alternative techniques, including radioimmunoassay (RIA) and liquid chromatography–mass spectrometry (LC-MS), had been used only in three studies [24,25,27]. This is in line with current clinical practice. Indeed, immunoassays (IAs) are currently the method of choice for vitamin D measurement in most laboratories, given their automation and rapidity. However, cross-reactivity between similar vitamin D metabolites is the main drawback of these methods, whose specificity is strictly dependent on the quality of the antibody used [52]. Indeed, despite relatively low intralaboratory variability [53], a recent interlaboratory comparison study showed an acceptable coefficient of variation (lower than 10%) in only 50% of IAs, differently from the LC-MS assays, which provided comparable results in most cases [54]. As evidence of this, removal of studies that had used measurement methods other than IAs did not lead to a reduction in heterogeneity in our meta-analysis.
In the present meta-analysis, a lower effect of shift work on low levels of vitamin D was seen in female-dominated studies. In the literature, there is no consensus on how gender affects vitamin D levels; in fact, some studies report higher average levels in males, and some others in females [55,56,57]. These aspects should be explored further in the future, taking into account possible gender-related bias, such as increased awareness of osteoporosis in women, which could lead to more frequent vitamin D supplementation in female workers.
Ageing is a well-established risk factor for hypovitaminosis D [58] and several epidemiological studies have shown that the prevalence of hypovitaminosis D increases linearly with BMI, with lower vitamin D in overweight and obese subjects [59]. In order to explore whether age or BMI could modify the effect size of shift work on serum vitamin D levels, we performed a meta-regression including age and BMI as covariates. Surprisingly, neither age nor BMI seems to affect vitamin D levels in shift workers. This may be related to the specific population examined, including a working population with a limited age range (18–65 years) and subjects with BMI values contained within the limits of normal weight or slight overweight.
The present meta-analysis has the strength that it is currently the only meta-analysis investigating vitamin D levels in shift workers. In addition, strict adherence to validated investigation methods (PICO criteria and Cambridge Quality Checklists) ensures the transparency and reproducibility of the results. However, our study also presents some limitations. First, all the included studies had a cross-sectional design with low–moderate quality. Second, interstudy heterogeneity was high, and neither subgroup analysis nor meta-regression were able to identify specific sources of the heterogeneity. Several definitions of “shift work” were used in the studies analyzed in this meta-analysis. This is a known problem of epidemiological studies investigating the association between shift work and cancer, and it led the IARC to convene a working group to establish a uniform definition of shift and night work [12]. Similarly, the problem concerns the studies analyzing the relation between shift work and vitamin D levels. The same recommendations of the IARC working group report should be extended in future studies about shift workers and vitamin D levels [12]. Since the displacement from the solar day caused by shift schedules (particularly during non-day shifts) may have a strong influence on sunlight exposure and consequently on vitamin D levels, the different characteristics of shift work may be the cause of the high interstudy heterogeneity observed. Third, most of the studies included random evaluations of serum vitamin D levels, not considering the season. Since vitamin D levels are higher in the spring–summer and lower in the fall–winter periods, some of the heterogeneity could depend on this factor, which needs clarification. Finally, since most of the subjects studied (96.5%) were Korean, the generalizability of our observations may be questionable and larger epidemiological studies are needed in other populations.

5. Conclusions

Our study is the first meta-analysis showing that shift workers have lower levels of vitamin D compared with non-shift workers. Interstudy heterogeneity was high, not explained by age, sex, BMI, and methods of serum 25-OH-D level measurement. It is likely that the characteristics of the shift work, particularly the number of nights worked per month, play a critical role. According to our results, the monitoring of vitamin D levels and the prompt correction of deficiencies to prevent fracture risk should be considered in the periodic health surveillance of this category of workers. It should be noted that since a large part of the observations derive from Koreans, the generalizability of our observations may be questionable and larger epidemiological studies are needed in other populations.

Author Contributions

Conceptualization, M.M., G.S. and M.B.; investigation, M.M., G.S. and M.B.; writing—original draft preparation, M.M. and G.S.; writing—review and editing, L.S. and M.B.; supervision, L.S. and M.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

We thank Anna Bonvini for her help in checking the final manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Xenos, K.; Papasavva, M.; Raptis, A.; Katsarou, M.-S.; Drakoulis, N. Vitamin D Supplementation and Genetic Polymorphisms Impact on Weight Loss Diet Outcomes in Caucasians: A Randomized Double-Blind Placebo-Controlled Clinical Study. Front. Med. 2022, 9, 811326. [Google Scholar] [CrossRef] [PubMed]
  2. Holick, M.F.; Binkley, N.C.; Bischoff-Ferrari, H.A.; Gordon, C.M.; Hanley, D.A.; Heaney, R.P.; Murad, M.H.; Weaver, C.M. Evaluation, treatment, and prevention of vitamin D deficiency: An endocrine society clinical practice guideline. J. Clin. Endocrinol. Metab. 2011, 96, 1911–1930. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Pfotenhauer, K.M.; Shubrook, J.H. Vitamin D deficiency, its role in health and disease, and current supplementation recommendations. J. Am. Osteopath. Assoc. 2017, 117, 301–305. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. El-Hajj Fuleihan, G.; Bouillon, R.; Clarke, B.; Chakhtoura, M.; Cooper, C.; McClung, M.; Singh, R.J. Serum 25-Hydroxyvitamin D Levels: Variability, Knowledge Gaps, and the Concept of a Desirable Range. J. Bone Miner. Res. 2015, 30, 1119–1133. [Google Scholar] [CrossRef]
  5. Passeron, T.; Bouillon, R.; Callender, V.; Cestari, T.; Diepgen, T.L.; Green, A.C.; van der Pols, J.C.; Bernard, B.A.; Ly, F.; Bernerd, F.; et al. Sunscreen photoprotection and vitamin D status. Br. J. Dermatol. 2019, 181, 916–931. [Google Scholar] [CrossRef] [Green Version]
  6. Chang, S.W.; Lee, H.C. Vitamin D and health—The missing vitamin in humans. Pediatr. Neonatol. 2019, 60, 237–244. [Google Scholar] [CrossRef] [Green Version]
  7. Borel, P.; Caillaud, D.; Cano, N.J. Vitamin D Bioavailability: State of the Art. Crit. Rev. Food Sci. Nutr. 2015, 55, 1193–1205. [Google Scholar] [CrossRef]
  8. Vanhevel, J.; Verlinden, L.; Doms, S.; Wildiers, H.; Verstuyf, A. The role of vitamin D in breast cancer risk and progression. Endocr. Relat. Cancer 2022, 29, R33–R55. [Google Scholar] [CrossRef] [PubMed]
  9. Holick, M.F.; Chen, T.C. Vitamin D deficiency: A worldwide problem with health consequences. Am. J. Clin. Nutr. 2008, 87, 1080–1086. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Sowah, D.; Fan, X.; Dennett, L.; Hagtvedt, R.; Straube, S. Vitamin D levels and deficiency with different occupations: A systematic review. BMC Public Health 2017, 17, 519. [Google Scholar] [CrossRef]
  11. Holick, M.F. The vitamin D deficiency pandemic: Approaches for diagnosis, treatment and prevention. Rev. Endocr. Metab. Disord. 2017, 18, 153–165. [Google Scholar] [CrossRef] [PubMed]
  12. Stevens, R.G.; Hansen, J.; Costa, G.; Haus, E.; Kauppinen, T.; Aronson, K.J.; Castaño-Vinyals, G.; Davis, S.; Frings-Dresen, M.H.; Fritschi, L.; et al. Considerations of circadian impact for defining ‘shift work’ in cancer studies: IARC Working Group Report. Occup. Environ. Med. 2011, 68, 154–162. [Google Scholar] [CrossRef]
  13. Lee, H.J.; Choi, H.; Yoon, I.Y. Impacts of serum Vitamin D levels on sleep and daytime sleepiness according to working conditions. J. Clin. Sleep Med. 2020, 16, 1045–1054. [Google Scholar] [CrossRef]
  14. Daugaard, S.; Garde, A.H.; Hansen, Å.M.; Vistisen, H.T.; Rejnmark, L.; Kolstad, H.A. Indoor, outdoor, and night work and blood concentrations of vitamin d and parathyroid hormone. Scand. J. Work. Environ. Health 2018, 44, 647–657. [Google Scholar] [CrossRef] [PubMed]
  15. Kang, M.-Y.; Jang, T.-W.; Lee, H.-E.; Lee, D.-W.; Storz, M.A.; Rizzo, G.; Lombardo, M. Shiftwork Is Associated with Higher Food Insecurity in U.S. Workers: Findings from a Cross-Sectional Study (NHANES). Int. J. Environ. Res. Public Health 2022, 19, 2847. [Google Scholar] [CrossRef]
  16. Barbadoro, P.; Santarelli, L.; Croce, N.; Bracci, M.; Vincitorio, D.; Prospero, E.; Minelli, A. Rotating Shift-Work as an Independent Risk Factor for Overweight Italian Workers: A Cross-Sectional Study. PLoS ONE 2013, 8, e63289. [Google Scholar] [CrossRef]
  17. Croce, N.; Bracci, M.; Ceccarelli, G.; Barbadoro, P.; Prospero, E.; Santarellia, L. Body mass index in shift workers: Relation to diet and physical activity. G. Ital. Di Med. Del Lav. Ed Ergon. 2007, 29, 488–489. [Google Scholar]
  18. Copertaro, A.; Bracci, M.; Barbaresi, M. Assessment of plasma homocysteine levels in shift healthcare workers. Monaldi Arch. Chest Dis.-Card. Ser. 2008, 70, 24–28. [Google Scholar] [CrossRef]
  19. Shah, A.; Turkistani, A.; Luenam, K.; Yaqub, S.; Ananias, P.; Jose, A.M.; Melo, J.P.; Mohammed, L. Is Shift Work Sleep Disorder a Risk Factor for Metabolic Syndrome and Its Components? A Systematic Review of Cross-Sectional Studies. Metab. Syndr. Relat. Disord. 2022, 20, 1–10. [Google Scholar] [CrossRef]
  20. Khodabakhshi, A.; Mahmoudabadi, M.; Vahid, F. The role of serum 25 (OH) vitamin D level in the correlation between lipid profile, body mass index (BMI), and blood pressure. Clin. Nutr. ESPEN 2022, 48, 421–426. [Google Scholar] [CrossRef]
  21. Cheng, S.; Massaro, J.M.; Fox, C.S.; Larson, M.G.; Keyes, M.J.; McCabe, E.L.; Robins, S.J.; O’Donnell, C.J.; Hoffmann, U.; Jacques, P.F.; et al. Adiposity, cardiometabolic risk, and vitamin D status: The framingham heart study. Diabetes 2010, 59, 242–248. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Moher, D. Updating guidance for reporting systematic reviews: Development of the PRISMA 2020 statement. J. Clin. Epidemiol. 2021, 134, 103–112. [Google Scholar] [CrossRef]
  23. Murray, J.; Farrington, D.P.; Eisner, M.P. Drawing conclusions about causes from systematic reviews of risk factors: The Cambridge Quality Checklists. J. Exp. Criminol. 2009, 5, 1–23. [Google Scholar] [CrossRef]
  24. Yang, Z.Y.; Wang, C.C.; Chen, Y.J.; Tsai, C.K.; Li, P.F.; Peng, T.C.; Sun, Y.S.; Chen, W.L. Exploring the relationship between serum Vitamin D and shift work. J. Med. Sci. 2021, 41, 179–185. [Google Scholar] [CrossRef]
  25. Kantermann, T.; Duboutay, F.; Haubruge, D.; Hampton, S.; Darling, A.L.; Berry, J.L.; Kerkhofs, M.; Boudjeltia, K.Z.; Skene, D.J. The direction of shift-work rotation impacts metabolic risk independent of chronotype and social jetlag—An exploratory pilot study. Chronobiol. Int. 2014, 31, 1139–1145. [Google Scholar] [CrossRef] [PubMed]
  26. Jeong, H.; Hong, S.; Heo, Y.; Chun, H.; Kim, D.; Park, J.; Kang, M.-Y. Vitamin D status and associated occupational factors in Korean wage workers: Data from the 5th Korea national health and nutrition examination survey (KNHANES 2010-2012). Ann. Occup. Environ. Med. 2014, 26, 28. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Kim, B.K.; Choi, Y.J.; Chung, Y.S. Other than daytime working is associated with lower bone mineral density: The Korea national health and nutrition examination survey 2009. Calcif. Tissue Int. 2013, 93, 495–501. [Google Scholar] [CrossRef]
  28. Park, H.Y.; Lim, Y.H.; Park, J.B.; Rhie, J.; Lee, S.J. Environmental and occupation factors associated with vitamin d deficiency in korean adults: The korea national health and nutrition examination survey (knhanes) 2010–2014. Int. J. Environ. Res. Public Health 2020, 17, 9166. [Google Scholar] [CrossRef]
  29. Rizza, S.; Pietroiusti, A.; Farcomeni, A.; Mina, G.G.; Caruso, M.; Virgilio, M.; Magrini, A.; Federici, M.; Coppeta, L. Monthly fluctuations in 25-hydroxy-vitamin D levels in day and rotating night shift hospital workers. J. Endocrinol. Investig. 2020, 43, 1655–1660. [Google Scholar] [CrossRef]
  30. Park, H.; Suh, B.; Lee, S.J. Shift work and depressive symptoms: The mediating effect of vitamin D and sleep quality. Chronobiol. Int. 2019, 36, 689–697. [Google Scholar] [CrossRef]
  31. Alefishat, E.; Farha, R.A. Determinants of Vitamin D status among Jordanian employees: Focus on the night shift effect. Int. J. Occup. Med. Environ. Health 2016, 29, 859–870. [Google Scholar] [CrossRef]
  32. Erden, G.; Ozdemir, S.; Ozturk, G.; Erden, I.; Kara, D.; Isik, S.; Ergil, J.; Vural, C.; Arzuhal, A. Vitamin D Levels of Anesthesia Personnel, Office Workers and Outdoor Workers in Ankara, Turkey. Clin. Lab. 2016, 62, 2003–2005. [Google Scholar] [CrossRef] [PubMed]
  33. Romano, A.; Vigna, L.; Belluigi, V.; Conti, D.M.; Barberi, C.E.; Tomaino, L.; Consonni, D.; Riboldi, L.; Tirelli, A.S.; Andersen, L.L. Shift work and serum 25-OH vitamin D status among factory workers in Northern Italy: Cross-sectional study. Chronobiol. Int. 2015, 32, 842–847. [Google Scholar] [CrossRef] [PubMed]
  34. Munter, G.; Levi-Vineberg, T.; Sylvetsky, N. Vitamin D deficiency among physicians: A comparison between hospitalists and community-based physicians. Osteoporos. Int. 2015, 26, 1673–1676. [Google Scholar] [CrossRef] [PubMed]
  35. Kwon, S.I.; Son, J.S.; Kim, Y.O.; Chae, C.H.; Kim, J.H.; Kim, C.W.; Park, H.O.; Lee, J.H.; Jung, J.I. Association between serum vitamin D and depressive symptoms among female workers in the manufacturing industry. Ann. Occup. Environ. Med. 2015, 27, 28. [Google Scholar] [CrossRef] [Green Version]
  36. Chang, W.P.; Jen, H.J. BMI differences between different genders working fixed day shifts and rotating shifts: A literature review and meta-analysis. Chronobiol. Int. 2020, 37, 1754–1765. [Google Scholar] [CrossRef]
  37. Peplonska, B.; Bukowska, A.; Sobala, W. Association of rotating night shift work with BMI and abdominal obesity among nurses and midwives. PLoS ONE 2015, 10, e0133761. [Google Scholar] [CrossRef]
  38. Pereira-Santos, M.; Costa, P.R.F.; Assis, A.M.O.; Santos, C.A.S.T.; Santos, D.B. Obesity and vitamin D deficiency: A systematic review and meta-analysis. Obes. Rev. 2015, 16, 341–349. [Google Scholar] [CrossRef]
  39. Doğan, Y.; Kara, M.; Culha, M.A.; Özçakar, L.; Kaymak, B. The relationship between vitamin D deficiency, body composition, and physical/cognitive functions. Arch. Osteoporos. 2022, 17, 66. [Google Scholar] [CrossRef]
  40. Eyles, D.W.; Liu, P.Y.; Josh, P.; Cui, X. Intracellular distribution of the vitamin D receptor in the brain: Comparison with classic target tissues and redistribution with development. Neuroscience 2014, 268, 1–9. [Google Scholar] [CrossRef]
  41. Massa, J.; Stone, K.L.; Wei, E.K.; Harrison, S.L.; Barrett-Connor, E.; Lane, N.E.; Paudel, M.; Redline, S.; Ancoli-Israel, S.; Orwoll, E.; et al. Vitamin D and actigraphic sleep outcomes in older community-dwelling men: The MrOS sleep study. Sleep 2015, 38, 251–257. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  42. Mccarty, D.E.; Reddy, A.; Keigley, Q.; Kim, P.Y.; Marino, A.A. Vitamin D, Race, and Excessive Daytime Sleepiness. J. Clin. Sleep Med. 2012, 8, 693–697. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Gao, Q.; Kou, T.; Zhuang, B.; Ren, Y.; Dong, X.; Wang, Q. The Association between Vitamin D Deficiency and. Nutrients 2018, 10, 1395. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Brown, B.W.J.; Crowther, M.E.; Appleton, S.L.; Melaku, Y.A.; Adams, R.J.; Reynolds, A.C. Shift work disorder and the prevalence of help seeking behaviors for sleep concerns in Australia: A descriptive study. Chronobiol. Int. 2022, 39, 714–724. [Google Scholar] [CrossRef]
  45. Copertaro, A.; Bracci, M. Working against the biological clock: A review for the occupational physician. Ind. Health 2019, 57, 557–569. [Google Scholar] [CrossRef] [Green Version]
  46. Bukowska-Damska, A.; Skowronska-Jozwiak, E.; Kaluzny, P.; Lewinski, A. Night shift work and osteoporosis-bone turnover markers among female blue-collar workers in Poland. Chronobiol. Int. 2022, 39, 818–825. [Google Scholar] [CrossRef]
  47. Zhang, W.; Yi, J.; Liu, D.; Wang, Y.; Jamilian, P.; Gaman, M.A.; Prabahar, K.; Fan, J. The effect of vitamin D on the lipid profile as a risk factor for coronary heart disease in postmenopausal women: A meta-analysis and systematic review of randomized controlled trials. Exp. Gerontol. 2022, 161, 111709. [Google Scholar] [CrossRef]
  48. Verdoia, M.; Gioscia, R.; Nardin, M.; Rognoni, A.; De Luca, G. Low levels of vitamin D and coronary artery disease: Is it time for therapy? Kardiol. Pol. 2022, 80, 409–416. [Google Scholar] [CrossRef]
  49. Jaiswal, V.; Ishak, A.; Peng Ang, S.; Babu Pokhrel, N.; Shama, N.; Lnu, K.; Susan Varghese, J.; Storozhenko, T.; Ee Chia, J.; Naz, S.; et al. Hypovitaminosis D and cardiovascular outcomes: A systematic review and meta-analysis. IJC Heart Vasc. 2022, 40, 101019. [Google Scholar] [CrossRef]
  50. Paschou, S.A.; Kosmopoulos, M.; Nikas, I.P.; Spartalis, M.; Kassi, E.; Goulis, D.G.; Lambrinoudaki, I.; Siasos, G. The impact of obesity on the association between vitamin D deficiency and cardiovascular disease. Nutrients 2019, 11, 2458. [Google Scholar] [CrossRef] [Green Version]
  51. Bikle, D.D. Vitamin D Assays. Front. Horm. Res. 2018, 50, 14–30. [Google Scholar] [CrossRef] [PubMed]
  52. Máčová, L.; Bičíková, M. Vitamin D: Current challenges between the laboratory and clinical practice. Nutrients 2021, 13, 1758. [Google Scholar] [CrossRef] [PubMed]
  53. Wise, S.A.; Camara, J.E.; Sempos, C.T.; Lukas, P.; Le Goff, C.; Peeters, S.; Burdette, C.Q.; Nalin, F.; Hahm, G.; Durazo-Arvizu, R.A.; et al. Vitamin D Standardization Program (VDSP) intralaboratory study for the assessment of 25-hydroxyvitamin D assay variability and bias. J. Steroid Biochem. Mol. Biol. 2021, 212, 105917. [Google Scholar] [CrossRef] [PubMed]
  54. Wise, S.A.; Phinney, K.W.; Tai, S.S.C.; Camara, J.E.; Myers, G.L.; Durazo-Arvizu, R.; Tian, L.; Hoofnagle, A.N.; Bachmann, L.M.; Young, I.S.; et al. Baseline assessment of 25-hydroxyVitamin D assay performance: A Vitamin D standardization program (VDSP) interlaboratory comparison study. J. AOAC Int. 2017, 100, 1244–1252. [Google Scholar] [CrossRef]
  55. Vasile, M.; Corinaldesi, C.; Antinozzi, C.; Crescioli, C. Vitamin D in autoimmune rheumatic diseases: A view inside gender differences. Pharmacol. Res. 2017, 117, 228–241. [Google Scholar] [CrossRef]
  56. Hagenau, T.; Vest, R.; Gissel, T.N.; Poulsen, C.S.; Erlandsen, M.; Mosekilde, L.; Vestergaard, P. Global vitamin D levels in relation to age, gender, skin pigmentation and latitude: An ecologic meta-regression analysis. Osteoporos. Int. 2009, 20, 133–140. [Google Scholar] [CrossRef]
  57. McCullough, M.L.; Weinstein, S.J.; Freedman, D.M.; Helzlsouer, K.; Flanders, W.D.; Koenig, K.; Kolonel, L.; Laden, F.; Le Marchand, L.; Purdue, M.; et al. Correlates of circulating 25-hydroxyvitamin D: Cohort Consortium Vitamin D Pooling Project of Rarer Cancers. Am. J. Epidemiol. 2010, 172, 21–35. [Google Scholar] [CrossRef] [Green Version]
  58. Mosekilde, L. Vitamin D and the elderly. Clin. Endocrinol. 2005, 62, 265–281. [Google Scholar] [CrossRef]
  59. Forrest, K.Y.Z.; Stuhldreher, W.L. Prevalence and correlates of vitamin D deficiency in US adults. Nutr. Res. 2011, 31, 48–54. [Google Scholar] [CrossRef]
Figure 1. Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) flowchart.
Figure 1. Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) flowchart.
Ijerph 19 08919 g001
Figure 2. Forest plot showing mean differences in serum 25-hydroxyvitamin D (25-OH-D) levels (ng/mL) in shift workers and non-shift workers [12,24,25,26,27,28,29,30,31,32,33,34,35].
Figure 2. Forest plot showing mean differences in serum 25-hydroxyvitamin D (25-OH-D) levels (ng/mL) in shift workers and non-shift workers [12,24,25,26,27,28,29,30,31,32,33,34,35].
Ijerph 19 08919 g002
Figure 3. Funnel plot of the included studies showing no significant asymmetry.
Figure 3. Funnel plot of the included studies showing no significant asymmetry.
Ijerph 19 08919 g003
Figure 4. Forest plots showing mean differences in serum 25-hydroxyvitamin D (25-OH-D) levels (ng/mL) in shift workers and non-shift workers (subgroup 1: methods of vitamin D measurement) [12,24,25,26,27,28,29,30,31,32,33,34,35].
Figure 4. Forest plots showing mean differences in serum 25-hydroxyvitamin D (25-OH-D) levels (ng/mL) in shift workers and non-shift workers (subgroup 1: methods of vitamin D measurement) [12,24,25,26,27,28,29,30,31,32,33,34,35].
Ijerph 19 08919 g004
Figure 5. Forest plots showing mean differences in serum 25-hydroxyvitamin D (25-OH-D) levels (ng/mL) in shift workers and non-shift workers (omitting unspecified methods of vitamin D measurement) [12,24,25,27,29,31,32,33,34,35].
Figure 5. Forest plots showing mean differences in serum 25-hydroxyvitamin D (25-OH-D) levels (ng/mL) in shift workers and non-shift workers (omitting unspecified methods of vitamin D measurement) [12,24,25,27,29,31,32,33,34,35].
Ijerph 19 08919 g005
Figure 6. Forest plots showing mean differences in serum 25-hydroxyvitamin D (25-OH-D) levels (ng/mL) in shift workers and non-shift workers (subgroup 2: gender prevalence) [12,24,25,26,27,28,29,30,31,32,33,34,35].
Figure 6. Forest plots showing mean differences in serum 25-hydroxyvitamin D (25-OH-D) levels (ng/mL) in shift workers and non-shift workers (subgroup 2: gender prevalence) [12,24,25,26,27,28,29,30,31,32,33,34,35].
Ijerph 19 08919 g006
Figure 7. Meta-regression analysis performed for mean differences in serum vitamin D levels between shift and non-shift workers, with age (A) and BMI (B) as covariates.
Figure 7. Meta-regression analysis performed for mean differences in serum vitamin D levels between shift and non-shift workers, with age (A) and BMI (B) as covariates.
Ijerph 19 08919 g007
Table 1. Main characteristics of the included studies.
Table 1. Main characteristics of the included studies.
Shift WorkersNon-Shift Workers
Authors, YearCountryVitamin D AssayNumberAge (Years)BMI (kg/m2)Vitamin D Levels (ng/mL)NumberAge (Years)BMI (kg/m2)Vitamin D Levels (ng/mL)Gender Prevalence
Yang et al., 2021 [24]U.S.A.RIA72830.09 ± 14.18-16.90 ± 6.77229739.67 ± 14.50-17.93 ± 6.67Men
Park et al., 2020 [28]Korea-2365--15.90 ± 9.7311,620--17.30 ± 10.78Women
Rizza et al., 2020 [29]ItalyCLIA8844.70 ± 7.9024.30 ± 5.4023.10 ± 9.1020047.60 ± 9.8023.20 ± 4.0025.90 ± 11.30Women
Lee et al., 2020 [12]KoreaCLIA41229.02 ± 6.9921.08 ± 2.7913.22 ± 5.7943236.39 ± 11.3821.83 ± 2.8214.95 ± 8.37Women
Park et al., 2019 [30]Korea-266635.84 ± 6.31-14.64 ± 5.9979,41239.88 ± 6.23-17.02 ± 6.78Men
Alefishat et al., 2016 [31]JordanCLIA82--21.00 ± 12.0058--28.00 ± 14.00Women
Erden et al., 2016 [32]TurkeyCLIA12535.06 ± 9.6024.46 ± 3.848.98 ± 4.893034.30 ± 7.1824.78 ± 2.688.18 ± 2.39Women
Romano et al., 2015 [33]ItalyCLIA9642.50 ± 7.6026.40 ± 3.6013.40 ± 5.3010051.20 ± 13.0028.00 ± 2.2021.90 ± 10.70Men
Munter et al., 2015 [34]IsraelCLIA37--14.80 ± 5.5044--19.30 ± 7.00Men
Kwon et al., 2015 [35]KoreaCLIA872--8.89 ± 3.23182--9.94 ± 3.25Women
Kantermann et al., 2014 [25]BelgiumLC-MS1843.40 ± 6.2026.90 ± 4.9014.90 ± 7.42944.70 ± 4.8029.30 ± 4.7017.16 ± 4.62Men
Jeong et al., 2014 [26]Korea-969--17.00 ± 9.844440--18.00 ± 12.33Men
Kim et al., 2013 [27]KoreaRIA62733.80 ± 9.5023.10 ± 3.5016.30 ± 5.90237837.10 ± 8.5023.50 ± 3.4017.60 ± 6.10Men
BMI = body mass index; CLIA = chemiluminescence immunoassay; LC-MS = liquid chromatography tandem mass spectrometry; RIA = radioimmunoassay; continuous variables are presented as mean ± standard deviation.
Table 2. Characteristics of workers and shift work.
Table 2. Characteristics of workers and shift work.
Authors, YearType of Workers (and Comparison)Definition of Shift WorkOutdoor/Indoor Work
Yang et al., 2021 [24]Unspecified—National surveyWorking regular evening shifts, regular night shifts, and/or rotating shiftsUnspecified
Park et al., 2020 [28]Unspecified—National surveyWorking night shifts or rotating shiftUnspecified
Rizza et al., 2020 [29]Hospital workersShift schedule of four to seven 12 h nights per month, followed by 2 days offIndoor
Lee et al., 2020 [12]Hospital workers≥6 night shifts (working hours of 6:00 p.m. to 8:00 a.m., 7:00 p.m. to 7:00 a.m., or 10:00 p.m. to 7:00 a.m.) in a monthIndoor
Park et al., 2019 [30]UnspecifiedParticipants who responded to the question “In the past year, during which time of the day have you worked the most?” using the option “I work during other hours” rather than “I work mostly during the day (between 6 a.m. and 6 p.m.)”Unspecified
Alefishat et al., 2016 [31]EmployeesSubjects working from 4:00 p.m. till 7:00 a.m. at least 4 times per month for at least 3 yearsUnspecified
Erden et al., 2016 [32]Anesthesia personnel (versus office workers)Night shifts (unspecified)Indoor
Romano et al., 2015 [33]Factory workers2 or 3 night shifts per weekUnspecified
Munter et al., 2015 [34]PhysiciansNight shifts (unspecified)Indoor
Kwon et al., 2015 [35]Factory workersA night shift from 10 p.m. to the next morning at 6.a.m. at least four times per month on average or worked an average of at least 60 h per month during the night shift.Indoor
Kantermann et al., 2014 [25]Factory workersSlow counterclockwise shifts: 6 days night (22–6 h), one off and 6 days morning (6–14 h), one off and 6 days late (14–22), one day offUnspecified
Jeong et al., 2014 [26]Unspecified—National surveyThose who worked in the afternoon (2 p.m. to midnight), at night (from 9 p.m. to 8 a.m. the following day), in regular rotation of shifts between day shifts and the night shifts, in 24 h shifts, in segmented shifts (working more than two shifts a day), and in irregular shiftsUnspecified
Kim et al., 2013 [27]Unspecified—National surveyThe following categories: (1) evening (14:00–24:00), (2) night (21:00–08:00), (3) regular shift time (day and night or regular 24 h), or (4) irregular shift time (includes two times or more in a day)Unspecified
Table 3. Scoring of Cambridge Quality Checklists on included studies.
Table 3. Scoring of Cambridge Quality Checklists on included studies.
Authors, YearChecklist for Correlates
(0–5)
Checklist for Risk Factors
(1–3)
Checklist for Causal Risk Factors
(1–7)
Total Score
(2–15)
Yang et al., 2021 [24]2125
Park et al., 2020 [28]3126
Rizza et al., 2020 [29]2125
Lee et al., 2020 [12]3159
Park et al., 2019 [30]2125
Alefishat et al., 2016 [31]2125
Erden et al., 2016 [32]2125
Romano et al., 2015 [33]2125
Munter et al., 2015 [34]2125
Kwon et al., 2015 [35]2125
Kantermann et al., 2014 [25]2125
Jeong et al., 2014 [26]2125
Kim et al., 2013 [27]2125
Checklist for correlates (adequate sampling method, adequate response rates, adequate sample size, good measure of correlate, good measure of outcome; one point each). Checklist for risk factors (cross-sectional data = 1; retrospective data = 2; prospective data = 3). Causal risk factor (study without a comparison group, no analysis of change = 1; inadequately controlled study, no analysis of change = 2: study without a comparison group with analysis of change = 3; inadequately controlled study with analysis of change = 4; controlled non-experimental study, no analysis of change = 5; controlled non-experimental study, with analysis of change = 6; randomized experiment targeting a risk factor = 7).
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Martelli, M.; Salvio, G.; Santarelli, L.; Bracci, M. Shift Work and Serum Vitamin D Levels: A Systematic Review and Meta-Analysis. Int. J. Environ. Res. Public Health 2022, 19, 8919. https://doi.org/10.3390/ijerph19158919

AMA Style

Martelli M, Salvio G, Santarelli L, Bracci M. Shift Work and Serum Vitamin D Levels: A Systematic Review and Meta-Analysis. International Journal of Environmental Research and Public Health. 2022; 19(15):8919. https://doi.org/10.3390/ijerph19158919

Chicago/Turabian Style

Martelli, Margherita, Gianmaria Salvio, Lory Santarelli, and Massimo Bracci. 2022. "Shift Work and Serum Vitamin D Levels: A Systematic Review and Meta-Analysis" International Journal of Environmental Research and Public Health 19, no. 15: 8919. https://doi.org/10.3390/ijerph19158919

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop