Next Article in Journal
C1-C2 Rotatory Subluxation in Adults “A Narrative Review”
Next Article in Special Issue
Desquamative Gingivitis in the Context of Autoimmune Bullous Dermatoses and Lichen Planus—Challenges in the Diagnosis and Treatment
Previous Article in Journal
Clinical Significance of Clonal Hematopoiesis of Indeterminate Potential in Hematology and Cardiovascular Disease
Previous Article in Special Issue
Odontogenic Sinusitis: From Diagnosis to Treatment Possibilities—A Narrative Review of Recent Data
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Effects of 810 nm Diode Laser and Indocyanine Green on Periodontal Parameters and HbA1c in Patients with Periodontitis and Type II Diabetes Mellitus: A Randomized Controlled Study

by
Irina-Georgeta Sufaru
1,†,
Maria-Alexandra Martu
1,*,
Ionut Luchian
1,*,
Simona Stoleriu
2,†,
Diana Diaconu-Popa
3,†,
Cristian Martu
4,†,
Silvia Teslaru
1,
Liliana Pasarin
1 and
Sorina Mihaela Solomon
1
1
Department of Periodontology, Grigore T. Popa University of Medicine and Pharmacy, Universitatii Street 16, 700115 Iasi, Romania
2
Department of Cariology and Restorative Dental Therapy, Grigore T. Popa University of Medicine and Pharmacy, Universitatii Street 16, 700115 Iasi, Romania
3
Department of Oral Implantology, Removable Dentures and Technology, Grigore T. Popa University of Medicine and Pharmacy, Universitatii Street 16, 700115 Iasi, Romania
4
ENT Clinic Department, Grigore T. Popa University of Medicine and Pharmacy, Universitatii Street 16, 700115 Iasi, Romania
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Diagnostics 2022, 12(7), 1614; https://doi.org/10.3390/diagnostics12071614
Submission received: 1 June 2022 / Revised: 30 June 2022 / Accepted: 30 June 2022 / Published: 2 July 2022
(This article belongs to the Special Issue Diagnosis and Treatment of Periodontal Diseases in 2022)

Abstract

:
The aim of this study was to investigate the effects of adjunctive periodontal therapy of 5 mg/mL indocyanine green irradiation by an 810 nm diode laser (aPDT), supplementary to scaling and root planing (SRP) in patients with periodontitis and type II diabetes mellitus (DM) compared to the SRP alone, on periodontal clinical parameters and glycated hemoglobin A1c (HbA1c). The study was conducted on 49 subjects with type II DM and periodontitis, divided into two groups: the SRP group (n = 25), who followed SRP alone, and the SRP + aPDT group (n = 24), who followed SRP and four weekly sessions of indocyanine green irradiation by an 810 nm diode laser. Plaque Index (PI), Bleeding on Probing Index (BOP), probing depth (PD), clinical attachment loss (CAL) and HbA1c were investigated at baseline and after 6 months. At 6 months, both SRP alone and SRP + aPDT generated significant reductions in all the investigated parameters; SRP + aPDT produced more significant reductions for BOP, PD and CAL (p < 0.001) but not for PI and HbA1c, than SRP alone. aPDT with indocyanine green therapy was well tolerated, with two subjects reporting slight discomfort. Therefore, aPDT with indocyanine green might represent a good adjunctive periodontal treatment option for SRP in patients with type II DM and periodontitis.

1. Introduction

Periodontitis is an inflammatory disease of the tissues that serve to maintain and sustain the functionality of the teeth on the dental arches. Its etiology is often multifactorial, the main cause being the onset of periodontal dysbiosis, in favor of anaerobic gram-negative bacteria [1]. The human body will react to this dysbiosis through innate and adaptive defense mechanisms, with the manifestation of an inflammatory response, detectable at molecular and clinical levels. If the causal factors are not removed, the inflammation may evolve, turning initially reversible lesions into attachment losses, with the onset of periodontitis [2].
A number of local and systemic factors can influence either the retention of periodontopathogenic bacterial plaque, with changes in its quantity and quality, or the ability of the immune system to effectively counteract bacterial aggression [3]. The latter include diabetes mellitus (DM). This study focuses on type II DM patients with periodontitis; type II DM is a metabolic disease, often the consequence of an inadequate diet, which may be associated with other predisposing factors (tobacco use, alcohol, genetic factors, etc.) [4]. The overall impact of DM is epidemic in nature, with worrying statistical parameters, especially in light of the complications that patients with diabetes may experience. These include changes of a micro- and macro-vascular nature, which make DM the leading cause of blindness (diabetic retinopathy), amputation of the lower limbs, kidney failure, hypertension or even death from cardiovascular causes [5]. Periodontal disease has been identified as the sixth complication of DM, as a result of a combination of mechanisms that include reduced immune response capacity in the patient with diabetes, increased markers of inflammatory and oxidative stress through the production of advanced glycation end-products (AGEs) and tissue healing deficits [6]. Of course, the manifestations of these complications are all the more important as the metabolic control is more deficient [7]. A measure of this ability is the evaluation of glycated hemoglobin (HbA1c). Moreover, it seems that periodontal inflammatory status can also negatively influence metabolic control in patients with diabetes [8].
The treatment of the patient with periodontal impairment includes, first of all, the removal of the risk factors, which, in the first stage, involves, in addition to the patient’s motivation and awareness, professional hygiene techniques [9]. Scaling and root planing (SRP) remain the gold standard in periodontal therapy, with the aim of obtaining “plaque-free” coronal and root surfaces, with a relief that allows the creation of a new periodontal attachment. Nevertheless, the majority of clinical trials have suggested that non-surgical periodontal debridement improves glycemic control among individuals with type 2 diabetes mellitus [10,11,12]. A meta-analysis performed by Jain et al. [12] found that SRP treatment decreased HbA1c by 0.26% (p = 0.17) at 3–4 months compared to the control group. A systematic review and meta-analysis [13] found that SRP generated a statistically significant reduction in HbA1C levels at 3 months of about 0.40% (range 0.27–0.65%).
However, it seems that SRP cannot completely remove bacterial species and their products, especially from periodontal soft tissues [14]. Thus, new methods of additional periodontal treatment have been developed, methods that involve local and/or systemic administration of antiseptic or antibiotic substances [15], therapies to modulate the host immune response (sub-antimicrobial doses of doxycycline) [16] or photo-bio-modulation therapies and photo-disinfection of periodontal pockets [17].
Antimicrobial photodynamic therapy (aPDT) is an adjuvant, minimally invasive therapeutic method that involves the use of three main components: light source (laser or LED), photosensitizer and singlet oxygen released into the tissue, the latter generating the bactericidal effect [18]. Most studies investigating the effects of aPDT in patients with periodontitis have used phenothiazine derivatives (methylene blue, toluidine blue), xanthene or riboflavin as photosensitizers. Recently, special attention has been paid to indocyanine green, as a product with photosensitizing potential [17].
Indocyanine green consists of two aromatic parts linked together by a polyunsaturated chain; it is a dye commonly used in medicine, especially in imaging investigations [19]. It penetrates rapidly into tissues and has low toxicity, being approved by the FDA for clinical use and recognized as non-toxic [20]. The absorption range for indocyanine green is between 600 nm and 900 nm and it emits fluorescence between 750 nm and 950 nm [21].
Data on the efficacy of this substance in patients with periodontitis and DM are limited; for this reason, we propose a study aimed at investigating the effects on periodontal clinical parameters and HbA1c of aPDT adjunctive therapy with indocyanine green as a photosensitizer in patients with periodontitis and type II diabetes, compared to the use of SRP alone. Our primary outcome investigation regarded the local, periodontal response to treatment of a particular group of subjects, prone to severe periodontal destructions and impaired healing. As a secondary outcome, we wanted to assess any potential supplementary benefits other than those already demonstrated by scaling and root planing, on HbA1c.
The proposed null hypothesis was that aPDT with indocyanine green does not provide any additional benefits to SRP on local periodontal parameters, nor on glycemic control, measured by HbA1c, for this particular category of patients.

2. Materials and Methods

2.1. Patient Selection

This prospective, randomized controlled, single-blind interventional study was performed on 49 patients diagnosed with periodontitis and type II diabetes. The methodology of the study was in accordance with the rules set out in the Declaration of Helsinki and was approved by the Bioethics Commission of the institution. All study participants signed the informed consent form and were aware of their right to withdraw from the study at any stage of the study without being subject to any sanctions.
The study included male and female subjects, diagnosed with type II diabetes mellitus by the diabetologist, and who presented periodontal probing depths higher than 5 mm upon periodontal examination. Exclusion criteria were represented by: (i) systemic diseases other than diabetes, which could influence periodontal status; (ii) smoking; (iii) history of antibiotic therapy, anti-inflammatory therapy or periodontal treatment in the last 3 months; (iv) significant changes in DM treatment during the study period.

2.2. Sample Size Calculation and Randomization

Based on previous findings [22], a probing depth (PD) reduction of 1 mm was used to determine the size of the groups, with a power of 90%, and alpha set to 0.05, resulting in an optimal size of 22 subjects per group. However, in order to counteract potential withdrawals from the study, we set a size of 25 patients per group, estimating an abandonment rate of 10%. The 50 resulting subjects were, thus, divided into two groups: patients who followed scaling and root planing therapy (n = 25) (SRP group) and patients who followed SRP and aPDT therapy with diode laser and indocyanine green (n = 25) (SRP + aPDT group); one patient who did not attend all aPDT sessions was finally excluded from the study group.
The SRP group consisted of 56.00% male subjects and 44.00% female subjects, with an overall mean age of 54.24 ± 3.41 years old; the SRP + aPDT group consisted of 54.20% male subjects and 45.80% female subjects, with an overall mean age of 55.58 ± 3.62 years old. There were no significant differences in age between the two groups (p = 0.734) (Table 1).
The distribution of patients to one of the two groups was randomized, through a system of sealed envelopes. Participants were offered randomly generated treatment assignments in sealed opaque envelopes, doubled with carbon paper, the therapeutic operator not being involved in making the envelopes.

2.3. Clinical Investigations

For each patient included in the study, the following periodontal parameters were determined: (a) the simplified plaque index (PI) [23], with the qualitative percentage determination of the surfaces with bacterial plaque; (b) bleeding on probing index (BOP), with the qualitative determination of the percentage of bleeding sites following the periodontal probing; (c) probing depth (PD), established by inserting the periodontal probe into the periodontal pocket, evaluated at six points per tooth (mesial–buccal, buccal, distal–buccal, mesial–lingual, lingual, distal–lingual); (d) periodontal clinical attachment loss (CAL), assessed as the distance between the enamel–cement junction and the base of the periodontal pocket. A North Carolina No.15 Periodontal Probe (Hu-Friedy, Chicago, IL, USA) was used for clinical measurements.
All periodontal assessments were performed by an experienced qualified examiner. Calibration was accepted if >90% of the measurements were reproduced within 48 h. Clinical examinations were performed blind to the type of treatment followed by the subjects. Clinical measurements were performed at baseline (T0) and 6 months apart (T1).

2.4. Evaluation of HbA1c

For the analysis of glycated hemoglobin, venous blood was collected in 3 mL vacutainer with EDTA K3 (FL Medical, Torreglia PD, Italy). The quantification of glycated hemoglobin in total hemolyzed blood was based on a turbidimetric inhibition reaction, as previously described [24,25]. Glycated hemoglobin A1c (HbA1c) was determined for each patient at baseline and after 6 months. The method of determining HbA1c was immunoturbidimetric (Boehringer Mannheim, Baden-Wurttemberg, Germany), a test characterized by high specificity for anti-HbA1c antibodies [26].

2.5. Treatment Methods

All patients in the SRP and SRP + aPDT groups underwent non-surgical periodontal treatment, which involved ultrasound scaling (Woodpecker UDS-A-LED, Guilin Woodpecker Medical Instrument Co., Ltd., Guangxi, China) and root planing (Gracey Standard and Mini—Hu-Friedy, Chicago, IL, USA) (SRP), in one session. All patients were instructed in the technique of brushing their teeth and to avoid rinsing with antiseptics during the study.
Patients in the study group also received aPDT therapy with diode laser and indocyanine green. For the preparation of the photosensitizer, the indocyanine green powder (ICG Pulsion, PULSION Medical Systems SE, Feldkirchen, Germany) was mixed with pure water, with a ratio of 5 mL water to 25 g bottle of powder, to obtain a concentration of 5 mg/mL according to the manufacturer’s instructions. Since the aqueous solution of indocyanine green is unstable and must be used within 24 h, the fresh solution was prepared whenever necessary and the excess was discarded.
The laser system used in the present study was a diode laser (A.R.C. Laser GmbH, Nuremberg, Germany) with a wavelength of 810 nm. Based on previous findings [27,28], the laser was applied continuously with a power of 0.2 W and a total energy of 12 J. In the periodontal pocket 1 mL of indocyanine green solution was inserted with a blunt needle and left in place for 60 s. The pocket was immediately irradiated with a diode laser by placing the tip in the pocket and moving it circumferentially around the tooth for 60 s. The procedure was repeated at 7, 14 and 21 days.
All the patients were instructed to follow the nutritional recommendations and to continue their normal physical activity throughout the study. The flowchart of the study from enrollment to completion is presented in Figure 1.

2.6. Statistical Analysis

All data were recorded in individual patient records, stored and statistically analyzed. For statistical analysis we used Microsoft Excel 2021 software (Microsoft, Washington, DC, USA) and Wizard 2 for Mac (Evan Miller®). The Shapiro–Wilk test was performed to determine the normality of the data distribution. The normally distributed values were compared with the t-Test and for the abnormally distributed values we used the Mann–Whitney test. The significance level was set at p < 0.05. The Pearson correlation test was used to determine the relationship between clinical parameters and HbA1c.

3. Results

The present study was completed in a SRP group of 25 subjects (474 sites, with a mean of 18.96 ± 4.48) who followed only SRP and a SRP + aPDT group of 24 subjects (445 sites, with a mean of 18.54 ± 4.07) that followed SRP + aPDT (Table 1).
At baseline, the PI values in the SRP group were 79.44 ± 6.31 and 80.04 ± 5.90 for the SRP + aPDT group, with no statistically significant difference (p = 0.732). After 6 months, PI showed significant decreases for both the SRP and the SRP + aPDT groups (17.72 ± 6.38, p < 0.001 and 17.08 ± 5.14, p < 0.001, respectively), with no statistically significant difference between groups at +6 months either (Table 2).
For BOP, the values at baseline were of 67.76 ± 6.57 in the SRP alone subjects and 68.67 ± 6.10 in the SRP + aPDT subjects, with a p = 0.620. The assessments after 6 months showed significant decreases for both groups: 8.08 ± 5.09 for the SRP group (p < 0.001) and 4.21 ± 3.85 for the SRP + aPDT group (p < 0.001); moreover, the decrease was more significant for the SRP + aPDT subjects (p < 0.001) (Table 2).
PD and CAL followed the same trend as BOP. At baseline, the PD and CAL values for the SRP group were of 5.54 ± 0.24 mm and 4.51 ± 0.20 mm, respectively; the values in the SRP + aPDT group were of 5.53 ± 0.24 mm and 4.50 ± 0.22 mm, with no statistically significant differences between the groups (p = 0.878 and p = 0.951, respectively). After 6 months, both parameters showed significant decreases; for the SRP group PD = 4.10 ± 0.22 mm, p < 0.001 and CAL = 3.15 ± 0.17 mm, p < 0.001; for the SRP + aPDT group, PD = 3.56 ± 0.19 mm, p < 0.001 and CAL = 2.58 ± 0.19 mm, p < 0.001. The decreases for PD and CAL were more significant in the subjects with SRP + aPDT (both p-values were lower than 0.001) (Table 2).
The values of HbA1c at baseline were of 6.52 ± 0.25 for the SRP group subjects and of 6.53 ± 0.24 for the SRP + aPDT group (p = 0.900). Both treatment options generated significant and similar reductions of HbA1c for both groups. The HbA1c value for SRP group subjects after 6 months was 6.28 ± 0.24, p = 0.001 (Figure 2); the value for the SRP + aPDT group was 6.262 ± 0.040, p < 0.001 (Figure 3) and Δ values of 0.244 ± 0.014 for the SRP alone and of 0.26 ± 0.19 for the SRP + aPDT.
We found a strong positive correlation between HbA1c and tissue loss parameters (PD and CAL) in both groups. In the SRP group, we observed a ρ = 0.922 and ρ = 0.896 for PD at baseline and +6 months, respectively; for CAL the values were ρ = 0.796 and ρ = 0.809; also, the decrease in HbA1c (ΔHbA1c) correlated with ΔPD and ΔCAL (ρ = 0.773 and ρ = 0.491, respectively). In the SRP + aPDT group, the coefficients were ρ = 0.989 and ρ = 0.995 for PD at baseline and +6 months, respectively; for CAL the values were ρ = 0.918 and ρ = 0.794; also, the decrease in HbA1c (ΔHbA1c) correlated with ΔPD and ΔCAL (ρ = 0.963 and ρ = 0.697, respectively).
The treatment regime was well tolerated, without any significant side effects. Two patients in the SRP + aPDT group (8.33%) reported slight discomfort due to the local heating during aPDT.

4. Discussion

The present research proposed an evaluation of the effects of an 810 nm wavelength diode laser and indocyanine green supplementary therapy on periodontal clinical parameters and HbA1c, compared to SRP alone, in patients with diabetes mellitus and periodontitis. As far as we know, this is one of the first studies to investigate the effects of indocyanine green aPDT in patients with DM.
Photodynamic therapy has emerged as an additional method for periodontal treatment, an alternative to antibiotic therapy, which can cause a number of side effects, such as, in addition to toxicity, the emergence of resistant microorganisms. Existing data in the literature on the effectiveness of aPDT with various photosensitizers are heterogeneous. While some results suggest that the benefits of SRP supplementation with aPDT are minor [29], other information, focused on the effects of aPDT with indocyanine green, would indicate that indocyanine green is more effective than previously analyzed agents in the management of periodontitis [30]. Although the local effects of using methylene blue or toluidine have been beneficial in terms of periodontal status improvements in patients with DM, they may generate a number of less desirable effects, such as tooth staining due to their prolonged adhesive property [31].
The adjunct aPDT therapy, with various photosensitizers, was previously investigated in DM subjects; the data suggest that, even if the clinical periodontal improvements were significant when compared to SRP alone, the HbA1c reduction as additional benefit were modest. Nevertheless, the found studies [32,33,34,35] had significant heterogeneity regarding the energy source, the used laser power, irradiation sessions and also concentrations for photosensitizers.
Indocyanine green is considered a safe substance without the side effects of antibiotics [17]. Mechanisms that could explain the beneficial effects of indocyanine green as an adjunct to aPDT have been investigated in clinical, microbiological, and immunological studies [27,28]. The hypotheses investigated include the bactericidal effect on periodontal pathogens, as well as potential effects on the local immune response [30].
The mechanism of action of indocyanine green is different from other photosensitizers—it exhibits a 20% photodynamic effect and the main action is through photothermal effect, which induce cell damage by increasing intracellular temperature [36]. Photothermal therapy involves the energy absorption from laser radiation by indocyanine green, inducing an effectively elevated local temperature [37].
In vitro studies showed that indocyanine green aPDT could effectively reduce bacterial load in periodontal pockets [31,38]. Boehm and Ciancio [38] demonstrated that indocyanine green aPDT generated a significant killing of A. actinomycetemcomitans and P. gingivalis. Srikant et al. [39] observed substantial reduction in the proportion of viable bacteria at the end of 1 week in sites receiving indocyanine green (5 mg/mL) aPDT compared to sites which followed SRP alone or SRP plus low-level laser therapy.
An investigation found that, in addition to photothermic effects, indocyanine green was shown to have a photodynamic effect by generating reactive oxygen species (ROS) [40]. Since pathogens indicate various susceptibility for singlet oxygen and radical species, it is important for future studies to measure the ROS under the selected experimental conditions. This would lead to understanding the photoreaction mechanisms and, consequently, mechanism of the applied aPDT.
Our study investigated the effects of additional aPDT with indocyanine green to SRP versus SRP alone on periodontal clinical parameters in patients with type II diabetes and periodontitis: bacterial plaque index (PI), probing bleeding index (BOP), probing depth (PD) and loss of periodontal clinical attachment (CAL), along with HbA1c analysis, assessments performed at baseline and after six months. It is important to note that there were no statistically significant differences between the groups regarding all these parameters at baseline.
At the six-month evaluations, we noticed statistically significant differences compared to baseline for all clinical parameters in both groups. Following comparisons between groups at six months, we noticed that there were no significant differences between PI values, unlike the studies conducted by Sethi and Raut [28] or Vangipuram et al. [41], where PI was significantly lower in the SRP + aPDT group than in the SRP group. We specify that in the study there was a rigorous protocol of motivation and awareness of the patient, the brushing technique being clearly explained, with the reinstatement of the instruction whenever necessary. We also cannot ignore the fact that patients may have shown high compliance as a result of awareness of participation in a study (potential Hawthorne effect) [42]. We also recommended that patients avoid oral rinses with antiseptics during the study to avoid the risk of bias.
Moreover, in a systematic review and meta-analysis it was suggested that multiple applications of aPDT are more efficient in reducing periodontal pathogens compared to a single application [43]. Based on these findings, our treatment protocol involved four sessions of aPDT.
Statistically significant differences between groups appeared when comparing BOP, PD and CAL; subjects who followed SRP + aPDT showed more significant decreases than subjects who followed only scaling and root planing. These data are consistent with the results of other studies. Al-Momani [44], in a split-mouth design study in patients with type II diabetes and stage III periodontitis, grade C, noticed significant improvements in clinical and antimicrobial parameters. Raut et al. [27] also observed a reduction in PD and CAL in the test group with indocyanine green aPDT therapy compared to the control group after 6 months. A recent meta-analysis [30] observed statistically significant improvements in aPDT results with indocyanine green at 3 months and 6 months after therapy, compared with single SRP; PD demonstrated an average additional reduction of 1.17 mm and 1.06 mm at 3 and 6 months, respectively. For CAL, an average additional gain of 0.70 mm and 1.03 mm was observed at 3 and 6 months, respectively [30].
Highly significant reductions for the indocyanine green aPDT group were also observed for BOP and PD by Monzavi et al. [36] and Hill et al. [45], without significant benefits, however, for CAL. It is worth noting, however, that they used a concentration of indocyanine green solution of 1 mg/mL. Similar to our study, Shingnapurkar et al. [46], using the same concentration of 5 mg/mL indocyanine green, observed significant reductions for CAL, in addition to BOP and PD.
Bassir et al. [47], in a study on aPDT with indocyanine green 1 mg/mL, for 30 s per session, for four sessions in patients with periodontitis, concluded that indocyanine green with an 810 nm diode laser in combination with SRP led to complete resolution of inflammation and significant reduction in periodontal pocket.
One study compared the antimicrobial efficacy of aPDT with indocyanine green, metronidazole gel, and chlorhexidine gel in vitro and reported that all of these modalities significantly reduced bacterial load [48]. However, the major clinical disadvantages associated with chlorhexidine, including taste change and pigmentation of teeth and mucosa, were absent in the case of aPDT. In addition, Chiang et al. [49] demonstrated that cytotoxicity on oral cells by aPDT with indocyanine green was significantly less prominent compared to that of chlorhexidine.
Moreover, the subgingival environment is characterized by lack of oxygen, which may not provide favorable conditions for better action of these traditional photosensitizers, while indocyanine green works even in the absence of oxygen [31]. Importantly, indocyanine green gets stimulated only in the presence of laser light, hence only the target (bacterial cells) gets affected in a dose-controlled fashion.
Thus, there is a need to establish a standard protocol for the use of indocyanine green solution in periodontal therapy of aPDT, in terms of solution concentration, but also in the number of aPDT sessions. During the studies, including the present study, which used four sessions of aPDT, no adverse effects were reported to contraindicate the repetitive application of aPDT with indocyanine green. Two patients reported mild discomfort during aPDT application but did not require discontinuation of therapy.
HbA1c followed significant decreases in both subjects who had only scaling and root planing, and those with SRP + aPDT (0.244 ± 0.014 for the SRP alone and 0.267 ± 0.02 for the SRP + aPDT). This aspect is consistent with other data in the literature—Jain et al. [12] observed, in a meta-analysis, a decrease in HbA1c by 0.26% (p = 0.17) at 3–4 months after SRP. This reduction can be considered, from a global point of view, as minor; further investigations, with full apprehension of all patient variables, are required in order to determine if this reduction can be based on the effects of the local, periodontal treatment. Nevertheless, even if minor, reductions of HbA1c can exert a considerable impact on the systemic status of the patient with type II diabetes, especially on its complications. Each 1% reduction in the mean HbA1c was associated with a 21% reduction in risk for diabetes-related deaths, 14% for myocardial infarction and 37% for microvascular complications [50]. What we noticed, however, in this study is that aPDT did not generate more significant effects on HbA1c than SRP alone.
Thus, we can note that the null hypothesis was partially refuted; aPDT with indocyanine green had more statistically significant effects on BOP, PD and CAL, but not on PI and HbA1c. Therefore, this type of adjunctive therapy has the potential to generate supplementary clinical benefits to SRP on the periodontal destructive status of patients with type II diabetes, with no significant benefit to SRP in terms of glycemic control.
Of course, this study also has a number of limitations. Further investigations of our proposed therapeutic protocol on larger groups of DM and periodontitis subjects are required, with the inclusion of systemically healthy subjects as controls. We also did not assess the duration of diabetes illness, a factor which can negatively impact the evolution of periodontitis and the response to periodontal treatment [51]. Even if the exact DM treatment variables were not investigated in detail, any changes in DM treatment or diet were considered as exclusion criteria.
Moreover, our study was predominantly clinical; we intend to continue and expand our investigations of the microbiological and molecular changes that could be generated by aPDT periodontal adjunctive treatment with indocyanine green in type II DM patients. Interesting observations might also emerge from comparative studies with other available photosensitizers, such as methylene blue, toluidine blue or curcumin. Moreover, further research could investigate the potential effects of this particular therapy in patients with other systemic conditions, such as osteo-articular, renal or cardiovascular diseases and periodontitis.

5. Conclusions

Within the limitations of our study, the therapeutic protocol of four sessions with an 810 nm wavelength diode laser and 5 mg/mL indocyanine green as adjunctive to scaling and root planing resulted in statistically higher reductions in bleeding on probing, probing depth, and periodontal clinical attachment loss in patients with type II diabetes mellitus and periodontitis, when compared to SRP alone. Further investigations need to clarify the clinical and molecular advantages of using a photosensitizer that does not require the presence of oxygen in the microaerophilic deep periodontal pockets of DM patients.

Author Contributions

Conceptualization, I.-G.S. and S.M.S.; methodology, S.S., D.D.-P., S.T., L.P. and S.M.S.; software, I.-G.S.; validation, M.-A.M., I.L., D.D.-P., L.P. and C.M.; formal analysis, S.S. and C.M.; investigation, I.-G.S., S.S. and S.T.; resources, D.D.-P. and C.M.; data curation, M.-A.M., S.S., D.D.-P. and C.M.; writing—original draft preparation, I.-G.S., M.-A.M. and I.L.; writing—review and editing, S.S., C.M. and S.M.S.; visualization, S.M.S.; supervision, I.-G.S. and S.M.S.; project administration, S.M.S.; funding acquisition, S.S., D.D.-P. and C.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of Grigore T. Popa University of Medicine and Pharmacy Iasi (Approval Form No. 1226/06.05.2019).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data used to support the findings of this study are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Van Dyke, T.E.; Bartold, P.M.; Reynolds, E.C. The nexus between periodontal inflammation and dysbiosis. Front. Immunol. 2020, 11, 511. [Google Scholar] [CrossRef] [PubMed]
  2. Gibertoni, F.; Sommer, M.E.L.; Esquisatto, M.A.M.; Amaral, M.E.C.D.; Oliveira, C.A.; Andrade, T.A.M.; Mendonça, F.A.S.; Santamaria, M., Jr.; Felonato, M. Evolution of periodontal disease: Immune response and RANK/RANKL/OPG system. Braz. Dent. J. 2017, 28, 679–687. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Zhao, D.; Wu, M.Z.; Yu, S.Y.; Pelekos, G.; Yiu, K.H.; Jin, L. Periodontitis links to concurrent systemic comorbidities among ‘self-perceived health’ individuals. J. Periodontal Res. 2022, 57, 632–643. [Google Scholar] [CrossRef]
  4. Namayandeh, S.M.; Karimi, A.; Fallahzadeh, H.; Rahmanian, M.; Sadr Bafghi, S.M.; Soltani, M.; Hadiani, L. The incidence rate of diabetes mellitus (type II) and its related risk factors: A 10-year longitudinal study of Yazd Healthy Heart Cohort (YHHC). Iran. Diabetes Metab. Syndr. 2019, 13, 1437–1441. [Google Scholar] [CrossRef]
  5. Eschwège, E. Epidémiologie du diabète de type 2, diagnostic, prévalence, facteurs de risque, complications [Epidemiology of type II diabetes, diagnosis, prevalence, risk factors, complications]. Arch. Mal. Coeur Vaiss 2000, 4, 13–17. [Google Scholar]
  6. Löe, H. Periodontal disease. The sixth complication of diabetes mellitus. Diabetes Care 1993, 16, 329–334. [Google Scholar] [CrossRef] [PubMed]
  7. Vijan, S.; Stevens, D.L.; Herman, W.H.; Funnell, M.M.; Standiford, C.J. Screening, prevention, counseling, and treatment for the complications of type II diabetes mellitus. Putting evidence into practice. J. Gen. Intern. Med. 1997, 12, 567–580. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Astolfi, V.; Ríos-Carrasco, B.; Gil-Mur, F.J.; Ríos-Santos, J.V.; Bullón, B.; Herrero-Climent, M.; Bullón, P. Incidence of peri-implantitis and relationship with different conditions: A retrospective study. Int J. Environ. Res. Public Health 2022, 19, 4147. [Google Scholar] [CrossRef]
  9. Elkerbout, T.A.; Slot, D.E.; Rijnen, M.E.; van der Weijden, G.A.F. Change in oral hygiene behaviour after non-surgical periodontal therapy-A retrospective analyses. Int. J. Dent. Hyg. 2022, 0, 1–13. [Google Scholar] [CrossRef]
  10. Koromantzos, P.A.; Makrilakis, K.; Dereka, X.; Katsilambros, N.; Vrotsos, I.A.; Madianos, P.N. A randomized, controlled trial on the effect of non-surgical periodontal therapy in patients with type 2 diabetes. Part I: Effect on periodontal status and glycaemic control. J. Clin. Periodontol. 2011, 38, 142–147. [Google Scholar] [CrossRef] [PubMed]
  11. Sun, W.-L.; Chen, L.-L.; Zhang, S.-Z.; Wu, Y.-M.; Ren, Y.-Z.; Qin, G.-M. Inflammatory cytokines, adiponectin, insulin resistance and metabolic control after periodontal intervention in patients with type 2 diabetes and chronic periodontitis. Intern. Med. 2011, 50, 1569–1574. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Jain, A.; Gupta, J.; Bansal, D.; Sood, S.; Gupta, S.; Jain, A. Effect of scaling and root planing as monotherapy on glycemic control in patients of Type 2 diabetes with chronic periodontitis: A systematic review and meta-analysis. J. Indian Soc. Periodontol. 2019, 23, 303–310. [Google Scholar] [CrossRef] [PubMed]
  13. Madianos, P.N.; Koromantzos, P.A. An update of the evidence on the potential impact of periodontal therapy on diabetes outcomes. J. Clin. Periodontol. 2018, 45, 188–195. [Google Scholar] [CrossRef] [PubMed]
  14. Schulz, S.; Stein, J.M.; Schumacher, A.; Kupietz, D.; Yekta-Michael, S.S.; Schittenhelm, F.; Conrads, G.; Schaller, H.G.; Reichert, S. Nonsurgical Periodontal Treatment Options and Their Impact on Subgingival Microbiota. J. Clin. Med. 2022, 11, 1187. [Google Scholar] [CrossRef] [PubMed]
  15. Jepsen, K.; Jepsen, S. Antibiotics/antimicrobials: Systemic and local administration in the therapy of mild to moderately advanced periodontitis. Periodontology 2000 2016, 71, 82–112. [Google Scholar] [CrossRef]
  16. Golub, L.M.; Lee, H.M. Periodontal therapeutics: Current host-modulation agents and future directions. Periodontology 2000 2020, 82, 186–204. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Sobotta, L.; Skupin-Mrugalska, P.; Piskorz, J.; Mielcarek, J. Non-porphyrinoid photosensitizers mediated photodynamic inactivation against bacteria. Dye. Pigment. 2019, 163, 337–355. [Google Scholar] [CrossRef]
  18. Sales, L.S.; Miranda, M.L.; de Oliveira, A.B.; Ferrisse, T.M.; Fontana, C.R.; Milward, M.; Brighenti, F.L. Effect of the technique of photodynamic therapy against the main microorganisms responsible for periodontitis: A systematic review of in-vitro studies. Arch. Oral Biol. 2022, 138, 105425. [Google Scholar] [CrossRef] [PubMed]
  19. Qi, S.; Zhang, H.; Wang, X.; Lv, J.; Liu, D.; Shen, W.; Li, Y.; Du, J.; Yang, Q. Development of a NIR fluorescent probe for highly selective and sensitive detection of cysteine in living cells and in vivo. Talanta 2021, 234, 122685. [Google Scholar] [CrossRef] [PubMed]
  20. Porcu, E.P.; Salis, A.; Gavini, E.; Rassu, G.; Maestri, M.; Giunchedi, P. Indocyanine green delivery systems for tumour detection and treatments. Biotechnol. Adv. 2016, 34, 768–789. [Google Scholar] [CrossRef] [PubMed]
  21. Houthoofd, S.; Vuylsteke, M.; Mordon, S.; Fourneau, I. Photodynamic therapy for atherosclerosis. The potential of indocyanine green. Photodiagnosis Photodyn. Ther. 2020, 29, 101568. [Google Scholar] [CrossRef] [PubMed]
  22. Zhang, H.; Li, C.; Shang, S.; Luo, Z. Scaling and root planing with enhanced root planing on healthcare for type 2 diabetes mellitus: A randomized controlled clinical trial. J. Dent. Sci 2013, 8, 272–280. [Google Scholar] [CrossRef] [Green Version]
  23. O’Leary, T.J.; Drake, R.B.; Naylor, J.E. The plaque control record. J. Periodontol. 1972, 43, 38. [Google Scholar] [CrossRef] [PubMed]
  24. Anton, D.-M.; Martu, M.-A.; Maris, M.; Maftei, G.-A.; Sufaru, I.-G.; Tatarciuc, D.; Luchian, I.; Ioanid, N.; Martu, S. Study on the Effects of Melatonin on Glycemic Control and Periodontal Parameters in Patients with Type II Diabetes Mellitus and Periodontal Disease. Medicina 2021, 57, 140. [Google Scholar] [CrossRef]
  25. Zaharescu, A.; Martu, I.; Luchian, A.; Martu, M.; Sufaru, I.; Martu, C.; Solomon, S. Role of adjunctive therapy with subantimicrobial doses of doxycycline in glycemic control (HbA1c) in patients with diabetes and endo-periodontal lesions to prevent sinus complications. Exp. Ther. Med. 2021, 21, 277. [Google Scholar] [CrossRef]
  26. Hamwi, A.; Schweiger, C.R.; Veitl, M.; Schmid, R. Quantitative measurement of HbA1c by an immunoturbidimetric assay compared to a standard HPLC method. Am. J. Clin. Pathol 1995, 104, 89–95. [Google Scholar] [CrossRef]
  27. Raut, C.P.; Sethi, K.S.; Kohale, B.R.; Mamajiwala, A.; Warang, A. Indocyanine green-mediated photothermal therapy in treatment of chronic periodontitis: A clinico-microbiological study. J. Indian Soc. Periodontol. 2018, 22, 221–227. [Google Scholar] [CrossRef] [PubMed]
  28. Sethi, K.S.; Raut, C.P. Antimicrobial photodynamic therapy using indocyanine green as a photosensitizer in treatment of chronic periodontitis: A clinico-microbial study. Indian J. Dent. Res. 2019, 30, 870. [Google Scholar]
  29. Sgolastra, F.; Petrucci, A.; Severino, M.; Graziani, F.; Gatto, R.; Monaco, A. Adjunctive photodynamic therapy to non-surgical treatment of chronic periodontitis: A systematic review and meta-analysis. J. Clin. Periodontol. 2013, 40, 514–526. [Google Scholar] [CrossRef]
  30. Bashir, N.Z.; Singh, H.A.; Virdee, S.S. Indocyanine green–mediated antimicrobial photodynamic therapy as an adjunct to periodontal therapy: A systematic review and meta-analysis. Clin. Oral Investig. 2021, 25, 5699–5710. [Google Scholar] [CrossRef]
  31. Nagahara, A.; Mitani, A.; Fukuda, M.; Yamamoto, H.; Tahara, K.; Morita, I.; Ting, C.C.; Watanabe, T.; Fujimura, T.; Osawa, K.; et al. Antimicrobial photodynamic therapy using a diode laser with a potential new photosensitizer, indocyanine green-loaded nanospheres, may be effective for the clearance of Porphyromonas gingivalis. J. Periodontal Res. 2013, 48, 591–599. [Google Scholar] [CrossRef] [PubMed]
  32. Al-Zahrani, M.S.; Bamshmous, S.O.; Alhassani, A.A.; Al-Sherbini, M.M. Short-term effects of photodynamic therapy on periodontal status and glycemic control of patients with diabetes. J. Periodontol. 2009, 80, 1568–1573. [Google Scholar] [CrossRef]
  33. Macedo, G.D.; Novaes, A.B.; Souza, S.L.; Taba, M.; Palioto, D.B.; Grisi, M.F. Additional effects of aPDT on nonsurgical periodontal treatment with doxycycline in type II diabetes: A randomized, controlled clinical trial. Lasers Med. Sci. 2014, 29, 881–886. [Google Scholar] [CrossRef] [PubMed]
  34. Ramos, U.D.; Ayub, L.G.; Reino, D.M.; Grisi, M.F.; Taba, M.; Souza, S.L.; Palioto, D.B.; Novaes, A.B. Antimicrobial photodynamic therapy as an alternative to systemic antibiotics: Results from a double-blind, randomized, placebo-controlled, clinical study on type 2 diabetics. J. Clin. Periodontol. 2015, 43, 147–155. [Google Scholar] [CrossRef] [PubMed]
  35. dos Santos, N.C.; Andere, N.M.; Araujo, C.F.; de Marco, A.C.; dos Santos, L.M.; Jardini, M.A.; Santamaria, M.P. Local adjunct effect of antimicrobial photodynamic therapy for the treatment of chronic periodontitis in type 2 diabetics: Split-mouth double-blind randomized controlled clinical trial. Lasers Med. Sci. 2016, 22, 1–8. [Google Scholar]
  36. Monzavi, A.; Chinipardaz, Z.; Mousavi, M.; Fekrazad, R.; Moslemi, N.; Azaripour, A.; Bagherpasand, O.; Chiniforush, N. Antimicrobial photodynamic therapy using diode laser activated indocyanine green as an adjunct in the treatment of chronic periodontitis: A randomized clinical trial. Photodiagn. Photodyn. Ther. 2016, 14, 93–97. [Google Scholar] [CrossRef]
  37. Sukumar, K.; Tadepalli, A.; Parthasarathy, H.; Ponnaiyan, D. Evaluation of combined efficacy of photodynamic therapy using indocyanine green photosensitizer and non-surgical periodontal therapy on clinical and microbial parameters in the management of chronic periodontitis subjects: A randomized split-mouth design. Photodiagn. Photodyn. Ther. 2020, 31, 101949. [Google Scholar] [CrossRef]
  38. Boehm, T.K.; Ciancio, S.G. Diode laser activated indocyanine green selectively kills bacteria. J. Int. Acad. Periodontol. 2011, 13, 58–63. [Google Scholar]
  39. Srikanth, K.; Chandra, R.V.; Reddy, A.A.; Reddy, B.H.; Reddy, C.; Naveen, A. Effect of a single session of antimicrobial photodynamic therapy using indocyanine green in the treatment of chronic periodontitis: A randomized controlled pilot trial. Quintessence Int. 2015, 46, 391–400. [Google Scholar]
  40. You, Q.; Sun, Q.; Wang, J.; Tan, X.; Pang, X.; Liu, L.; Yu, M.; Tan, F.; Li, N. A single-light triggered and dual-imaging guided multifunctional platform for combined photothermal and photodynamic therapy based on TD-controlled and ICG-loaded CuS@mSiO2. Nanoscale 2017, 9, 3784–3796. [Google Scholar] [CrossRef]
  41. Vangipuram, P.; Ravishankar, P.L.; Saravanan, A.V.; Vaidya, J.; Visithiriyan, G.; Gurupasath, P. Indocyanine green-mediated photodynamic therapy as adjuvant to non-surgical periodontal treatment in chronic periodontitis patients: A clinical and microbiological study. Ann. RSCB 2021, 25, 363–371. [Google Scholar]
  42. McCarney, R.; Warner, J.; Iliffe, S.; van Haselen, R.; Griffin, M.; Fisher, P. The Hawthorne Effect: A randomised, controlled trial. BMC Med. Res. Methodol. 2007, 7, 30. [Google Scholar] [CrossRef] [Green Version]
  43. Jervøe-Storm, P.M.; Jepsen, S.; Worthington, H.V.; Needleman, I.; Eberhard, J. Adjunctive antimicrobial photodynamic therapy for treating periodontal and peri-implant diseases. Cochrane Database Syst. Rev. 2015, 6, CD011778. [Google Scholar] [CrossRef]
  44. Al-Momani, M.M. Indocyanine-mediated antimicrobial photodynamic therapy promotes superior clinical effects in stage III and grade C chronic periodontitis among controlled and uncontrolled diabetes mellitus: A randomized controlled clinical trial. Photodiagn. Photodyn. Ther. 2021, 35, 102379. [Google Scholar] [CrossRef] [PubMed]
  45. Hill, G.; Dehn, C.; Hinze, A.V.; Frentzen, M.; Meister, J. Indocyanine green-based adjunctive antimicrobial photodynamic therapy for treating chronic periodontitis: A randomized clinical trial. Photodiagn. Photodyn. Ther. 2019, 26, 29–35. [Google Scholar] [CrossRef] [PubMed]
  46. Shingnapurkar, S.H.; Mitra, D.K.; Kadav, M.S.; Shah, R.A.; Rodrigues, S.V.; Prithyani, S.S. The effect of indocyanine green-mediated photodynamic therapy as an adjunct to scaling and root planing in the treatment of chronic periodontitis: A comparative split-mouth randomized clinical trial. Indian J. Dent. Res. 2016, 27, 609–617. [Google Scholar] [CrossRef]
  47. Bassir, S.H.; Moslemi, N.; Jamali, R.; Mashmouly, S.; Fekrazad, R.; Chiniforush, N.; Shamshiri, A.R.; Nowzari, H. Photoactivated disinfection using light-emitting diode as an adjunct in the management of chronic periodontitis: A pilot double-blind split-mouth randomized clinical trial. J. Clin. Periodontol. 2013, 40, 65–72. [Google Scholar] [CrossRef]
  48. Fekrazad, R.; Khoei, F.; Bahador, A.; Hakimiha, N. Photo-activated elimination of Aggregatibacter actinomycetemcomitans in planktonic culture: Comparison of photodynamic therapy versus photothermal therapy method. Photodiagn. Photodyn. Ther. 2017, 19, 28–32. [Google Scholar] [CrossRef]
  49. Chiang, C.P.; Hsieh, O.; Tai, W.C.; Chen, Y.J.; Chang, P.C. Clinical outcomes of adjunctive indocyanine green-diode lasers therapy for treating refractory periodontitis: A randomized controlled trial with in vitro assessment. J. Formos. Med. Assoc. 2020, 119, 652–659. [Google Scholar] [CrossRef]
  50. Stratton, I.M.; Adler, A.I.; Neil, H.A.; Matthews, D.R.; Manley, S.E.; Cull, C.A.; Hadden, D.; Turner, R.C.; Holman, R.R. Association of glycaemia with macrovascular and microvascular complications of type 2 diabetes (UKPDS 35): Prospective observational study. BMJ 2000, 321, 405–412. [Google Scholar] [CrossRef] [Green Version]
  51. Kim, E.K.; Lee, S.G.; Choi, Y.H.; Won, J.S.; Merchant, A.T.; Lee, H.K. Association between diabetes-related factors and clinical periodontal parameters in type-2 diabetes mellitus. BMC Oral Health 2013, 13, 64. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. The flowchart of the study.
Figure 1. The flowchart of the study.
Diagnostics 12 01614 g001
Figure 2. HbA1c variations in the SRP group.
Figure 2. HbA1c variations in the SRP group.
Diagnostics 12 01614 g002
Figure 3. HbA1c variations in the SRP + aPDT group.
Figure 3. HbA1c variations in the SRP + aPDT group.
Diagnostics 12 01614 g003
Table 1. Demographic parameters for study groups at baseline and after 6 months.
Table 1. Demographic parameters for study groups at baseline and after 6 months.
ParameterSRP GroupSRP + aPDT Group
Subjects number (n)2524
Number of sites474445
Age (years) (mean±standard deviation)55.24 ± 3.4155.58 ± 3.62
Gender
n (%)
Male14 (56.00%)13 (54.16%)
Female11 (44.00%)11 (45.84%)
Table 2. Clinical parameters for study groups at baseline and after 6 months.
Table 2. Clinical parameters for study groups at baseline and after 6 months.
ParameterSRP Group (n = 25)SRP + aPDT Group (n = 24)
Baselin *+6 Month *Δ #Baselin *+6 Months *Δ #
PI79.44 ± 6.3117.72 ± 6.38 a62
(60–66)
80.04 ± 5.9017.08 ± 5.14 a63
(60–67)
BOP67.76 ± 6.578.08 ± 5.09 a60
(55–66)
68.67 ± 6.104.21 ± 3.85 ab65 c
(55–69)
PD (mm)5.54 ± 0.244.10 ± 0.22 a1.4
(1.4–1.5)
5.53 ± 0.243.56 ± 0.19 ab1.9 c
(1.8–2.2)
CAL (mm)4.51 ± 0.203.15 ± 0.17 a1.40
(1.20–1.50)
4.50 ± 0.222.58 ± 0.19 ab1.95 c
(1.70–2.10)
Δ: level of decrease between evaluations; PI: Plaque Index; BOP: Bleeding on Probing Index; PD: probing depth; CAL: clinical attachment loss; * Values are expressed as Mean ± Standard Deviation; # Values are expressed as Median (Min–Max); a Intra-group p < 0.05 after 6 months (t-Test); b Inter-group p < 0.05 at the same time of evaluation (t-Test); c p < 0.001 (Man-Whitney test).
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Sufaru, I.-G.; Martu, M.-A.; Luchian, I.; Stoleriu, S.; Diaconu-Popa, D.; Martu, C.; Teslaru, S.; Pasarin, L.; Solomon, S.M. The Effects of 810 nm Diode Laser and Indocyanine Green on Periodontal Parameters and HbA1c in Patients with Periodontitis and Type II Diabetes Mellitus: A Randomized Controlled Study. Diagnostics 2022, 12, 1614. https://doi.org/10.3390/diagnostics12071614

AMA Style

Sufaru I-G, Martu M-A, Luchian I, Stoleriu S, Diaconu-Popa D, Martu C, Teslaru S, Pasarin L, Solomon SM. The Effects of 810 nm Diode Laser and Indocyanine Green on Periodontal Parameters and HbA1c in Patients with Periodontitis and Type II Diabetes Mellitus: A Randomized Controlled Study. Diagnostics. 2022; 12(7):1614. https://doi.org/10.3390/diagnostics12071614

Chicago/Turabian Style

Sufaru, Irina-Georgeta, Maria-Alexandra Martu, Ionut Luchian, Simona Stoleriu, Diana Diaconu-Popa, Cristian Martu, Silvia Teslaru, Liliana Pasarin, and Sorina Mihaela Solomon. 2022. "The Effects of 810 nm Diode Laser and Indocyanine Green on Periodontal Parameters and HbA1c in Patients with Periodontitis and Type II Diabetes Mellitus: A Randomized Controlled Study" Diagnostics 12, no. 7: 1614. https://doi.org/10.3390/diagnostics12071614

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop