Next Article in Journal
RETRACTED: Nobel et al. Modern Subtype Classification and Outlier Detection Using the Attention Embedder to Transform Ovarian Cancer Diagnosis. Tomography 2024, 10, 105–132
Previous Article in Journal
Test–Retest Reproducibility of Reduced-Field-of-View Density-Weighted CRT MRSI at 3T
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Impact of Deep Learning Denoising Algorithm on Diffusion Tensor Imaging of the Growth Plate on Different Spatial Resolutions

1
Radiology Department, Columbia University Irving Medical Center, New York, NY 10032, USA
2
GE Healthcare, New York, NY 10032, USA
*
Author to whom correspondence should be addressed.
Tomography 2024, 10(4), 504-519; https://doi.org/10.3390/tomography10040039
Submission received: 21 February 2024 / Revised: 25 March 2024 / Accepted: 29 March 2024 / Published: 2 April 2024
(This article belongs to the Topic AI in Medical Imaging and Image Processing)

Abstract

:
To assess the impact of a deep learning (DL) denoising reconstruction algorithm applied to identical patient scans acquired with two different voxel dimensions, representing distinct spatial resolutions, this IRB-approved prospective study was conducted at a tertiary pediatric center in compliance with the Health Insurance Portability and Accountability Act. A General Electric Signa Premier unit (GE Medical Systems, Milwaukee, WI) was employed to acquire two DTI (diffusion tensor imaging) sequences of the left knee on each child at 3T: an in-plane 2.0 × 2.0 m m 2 with section thickness of 3.0 mm and a 2 mm3 isovolumetric voxel; neither had an intersection gap. For image acquisition, a multi-band DTI with a fat-suppressed single-shot spin-echo echo-planar sequence (20 non-collinear directions; b-values of 0 and 600 s/mm2) was utilized. The MR vendor-provided a commercially available DL model which was applied with 75% noise reduction settings to the same subject DTI sequences at different spatial resolutions. We compared DTI tract metrics from both DL-reconstructed scans and non-denoised scans for the femur and tibia at each spatial resolution. Differences were evaluated using Wilcoxon-signed ranked test and Bland–Altman plots. When comparing DL versus non-denoised diffusion metrics in femur and tibia using the 2 mm × 2 mm × 3 mm voxel dimension, there were no significant differences between tract count (p = 0.1, p = 0.14) tract volume (p = 0.1, p = 0.29) or tibial tract length (p = 0.16); femur tract length exhibited a significant difference (p < 0.01). All diffusion metrics (tract count, volume, length, and fractional anisotropy (FA)) derived from the DL-reconstructed scans, were significantly different from the non-denoised scan DTI metrics in both the femur and tibial physes using the 2 mm3 voxel size (p < 0.001). DL reconstruction resulted in a significant decrease in femorotibial FA for both voxel dimensions (p < 0.01). Leveraging denoising algorithms could address the drawbacks of lower signal-to-noise ratios (SNRs) associated with smaller voxel volumes and capitalize on their better spatial resolutions, allowing for more accurate quantification of diffusion metrics.

1. Introduction

Diffusion tensor imaging (DTI) can characterize tissue microstructure and microarchitecture inside a voxel of interest [1], thus providing new information previously unavailable from conventional magnetic resonance imaging (MRI). DTI techniques have been rigorously studied and well described within the fields of brain, spine, and nerve imaging [2,3,4,5,6]. The use of DTI in the physeal–metaphyseal complex for prediction of pediatric growth has been studied for approximately 10 years [7]. Characterization of columns of cartilage and newly formed bone in the physis and adjacent metaphysis through tractography has proven useful for the determination of height gain and the evaluation of growth failure in pediatric subjects [7,8,9,10,11,12,13]. Tractography is the result of tensor estimation inside each voxel; the tensor depicts the main direction of unrestricted water diffusion inside the columns running perpendicular to the growth plate [2,7].
Accurate quantitative DTI metrics rely on specific acquisition parameters and the achievement of satisfactory SNRs due to the intrinsic vulnerability of MR-DTI to artifacts caused by diffusion gradients and motion [1]. Ample studies have used DL to optimize DTI in the central nervous system, from basic denoising to using denoising algorithms to minimize the diffusion weighted data requirements, and even to asses sensitivity and specificity of the technique for classification of white matter disorders [14,15,16,17,18]. However, only a few studies have investigated the effects of varying acquisition parameters on DTI metrics in the orthopedic field, which were predominantly performed on adults or animal models, primarily focusing on adult muscle fibers or articular structures in rat knees [19,20,21,22,23,24]. These studies highlighted the sensitivity of knee connective tissues, specifically ligaments, to changes in spatial resolution [24]. Surprisingly, the rat knee physes demonstrated no significant variations in fractional anisotropy (FA) or mean diffusion across different spatial resolutions. Furthermore, the influence of these variations on physeal–metaphyseal tractographic diffusion metrics such as tract count, volume, and length remains unassessed [24].
Spatial resolution plays an essential role in ensuring the quality and reliability of DTI by influencing and modulating the occurrence of partial volume effects (PVEs) [25]. Larger voxel dimensions (associated with lower spatial resolution) offer higher SNRs but increase the probability of PVEs. In contrast, smaller voxel dimensions provide better spatial resolution and reduce the likelihood of PVEs at the cost of lower SNRs.
Our study aims to assess the impact of a deep learning (DL) denoising reconstruction algorithm applied to identical patient scans acquired with two different voxel dimensions, representing distinct spatial resolutions. We hypothesize that the denoising reconstruction algorithm will have a more pronounced effect on the smaller voxel dimensions, given their inherently lower SNR and consequent higher level of noise, which can be more effectively eliminated through the algorithm. Through this study, we hope to obtain valuable insights into the potential benefits of employing the denoising reconstruction technique in the context of varying spatial resolutions in DTI of the growth plate.
Our research presents a novel application of a deep learning (DL) denoising algorithm to DTI data of the knee growth plate. This application has not previously been explored or validated. The commercial software provided by the manufacturer was designed for denoising clinical structural images such as 2D T1 and T2 weighted scans. However, we will utilize a prototype denoising reconstruction algorithm applied to diffusion EPI scans, which is not yet commercially approved or tested for DTI scans. Our study will evaluate the effectiveness of this prototype denoising reconstruction in evaluating microstructural diffusion metrics, possibly demonstrating its potential to enhance the spatial resolution of DTI scans and offering novel insights into more reliable growth plate DTI metric changes over time.

2. Materials and Methods

2.1. Subjects

A prospective study was conducted at our tertiary pediatric center, in compliance with the Health Insurance Portability and Accountability Act and approved by the institutional review board, to evaluate growth using DTI of the knee. Healthy girls (8–15 years old) and boys (10–16 years old) (14 girls, 13 boys) during the pubertal and adolescent expected growth spurt, were recruited between August 2022 and November 2023. Informed consent and assent were provided by every parent/legal guardian and child, respectively before they participated in the study. The study was conducted in accordance with the Declaration of Helsinki, and the protocol was approved by the Ethics Committee of Columbia University Irving Medical Center (AAAS9882).

2.2. MRI

We performed two DTI sequences of the left knee on each child at our pediatric center at 3T. We used a multi-band DTI acquisition with a fat-suppressed single-shot spin-echo echo-planar sequence (20 non-collinear directions; b-values of 0 and 600 s/mm2). Slice-selective gradient reversal was used for fat suppression. Two voxel dimensions were acquired on each subject, an in-plane 2.0 × 2.0 mm2 with section thickness of 3.0 mm and a 2 mm3 isovolumetric voxel, both without inter-section gap. We used a General Electric Signa Premier unit (GE HealthCare, Waukesha, WI, USA) with an 18-channel knee coil (Quality Electrodynamics, Mayfield Village, OH, USA). Parameters: repetition time (TR)/echo time (TE); 3000/51.7 ms; bandwidth 1953.12 Hz/pixel; parallel imaging factor, 2; signal averages, 5 for 600 b-value scans; matrix 128 × 128; field of view, 256 × 256 mm.

2.3. Intra-Voxel Tensor Visualization at Different Spatial Resolutions

To illustrate how acquisition at different spatial resolution (smaller versus larger 3D voxels) influences diffusion tensor direction, we employed MRtrix3 3.0.4 [26]. This software package is commonly used in diffusion imaging to visualize intravoxel tensors. The diffusion tensor is a mathematical model that characterizes the diffusion properties within a voxel, capturing the directionality and magnitude of water diffusion in three-dimensional space [27]. MRtrix3 uses the acquired MR-DTI data to estimate the diffusion orientation at each voxel [26], making it a useful tool to visualize and examine fiber tractography in the physes.
A diffusion-weighted image was selected as input for MRtrix3—2 mm × 2 mm × 3 mm volume. The volume was resampled into 2 mm3 image using MRtrix3’s regrid command. Confirmed successful resampling was achieved with the mrinfo command from MRtrix3 toolbox. Both the original and resampled images were saved into separate folders along with their corresponding .bval and .bvec files. For each corresponding image, the Dhollander algorithm was employed [28]. This method is instrumental in creating basis functions essential for estimating fiber orientation distributions (FODs) derived from the diffusion signal. Consequently, a model was established to project how the diffusion signal changes in different orientations and with varying diffusion gradients applied. The outputs from this algorithm provided the corresponding voxels used to build the basis function. Subsequently, the dwi2fod command from MRtrix3 toolbox was utilized to apply this basis function to each voxel in the input volume [29]. Finally, the mrcat command was used to concatenate these into a single volume, enabling the visualization of tensor ellipsoids that are representative of the fiber orientation directions.

2.4. AIRTM Recon DL Algorithm (GE Healthcare, Waukesha, WI)

The MR vendor provided a commercially available DL model with 75% noise reduction settings (Recon DL strength: High) applied. This model was applied on the same subject DTI sequences acquired at two different spatial resolutions (isovolumetric 2 mm3 and 2 mm × 2 mm × 3 mm).

2.5. Segmentation

Using fiber tract reconstruction software, Diffusion Toolkit v. 0.6.4 (trackvis.org, Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, USA) and Trackvis (FACT algorithm), the brightest voxel inside the physes was used as the reference point to locate the physes. A region of interest (ROI) was drawn intersecting the distal femoral and proximal tibial growth plates perpendicular to the long axis of the bone on every slice. ROIs were manually drawn in the AIRTM Recon DL reconstructed scans (n = 54 DL reconstructed scans) over the distal femur and proximal tibia physes. The same ROIs were applied to non-denoised scans (n = 54 non-denoised scans) for consistency. Diffusion metrics (tract count, tract volume, tract length, and fractional anisotropy (FA)) were obtained from the resultant tractography.

2.6. Signal-to-Noise Ratio Measurements

The signal-to-noise ratio (SNR) serves as an important metric when assessing the quality of DTI data. Enhanced SNR results in more dependable tensor estimation, consequently boosting the reliability and clarity of DTI-derived metrics, like FA, mean diffusivity, tract length etc. In MRI data, particularly DTI, noise can vary spatially due to elements like multi-channel coil sensitivity profiles, parallel imaging, and susceptibility artifacts. Traditional methodologies might not effectively capture this noise variance. To tackle this, SNR was calculated using the validated single-image set method applied by Wang et al. for the assessment of SNR in muscle diffusion tensor imaging [30]. Imaged volumes were paired with others that had proximally aligned diffusion encoding directions. We performed a subtraction of each DWI to yield initial noise image volumes. Each slice was transformed to k-space using 2D Fourier transformation, followed by Butterworth filtering and 2-D inverse transformation to image space, resulting in the final noise image volumes. Finally, the average noise variance was calculated from the same local ROI for both b0 and b600 images.

2.7. Statistical Analysis

We compared the tract count, volume, length and FA, derived from both reconstructed scans and non-denoised scans for femur and tibia, at each spatial resolution. Differences between spatial resolutions were evaluated using Wilcoxon-signed ranked test and Bland–Altman plots. All statistical analysis was performed on JMP®, Version <17>. SAS Institute Inc., Cary, NC, USA, 1989–2023.

3. Results

Twenty-seven subjects (14 girls, 13 boys) were included in the study; each subject had 2 DTI sequences to which a DL reconstruction algorithm was applied (n = 27 subjects, n = 54 non-denoised DTI scans, n = 54 DL reconstructed scans). In all subjects, isovolumetric 2 mm3 DTI scans exhibited a visibly higher quantity of tensor ellipsoids compared to the 2 mm × 2 mm × 3 mm acquisition, a more defined diffusion direction was observed in the smaller voxel size, as shown in Figure 1. Fiber tract count, volume, and length were consistently larger in both the femur and tibia physes when using the isovolumetric 2 mm3 voxel size in both the DL reconstructed scans and non-denoised scans, as shown in Table 1 and Table 2.
Applying the reconstruction algorithm led to an increase in femorotibial tract count, volume, and length in both DL reconstructed voxel dimensions compared to non-denoised scans (Table 3 and Table 4). DTI metrics showed a greater increase in scans acquired using isovolumetric 2 mm3 compared to the scans acquired with 2 mm × 2 mm × 3 mm voxel dimensions (p = 0.04). Diffusion metrics (tract count, volume, and length) derived from the DL reconstructed scans were significantly higher from the non-denoised scan DTI metrics in both the femur and tibial physes using the 2 mm3 voxel dimension (p < 0.001 (Table 3, Figure 2 and Figure 3).
When comparing DL versus non-denoised diffusion metrics in femur and tibia using the 2 mm × 2 mm × 3 mm voxel dimension there were no significant differences between tract count (p = 0.1, p = 0.14) tract volume (p = 0.14, p = 0.29), or tibial tract length (p = 0.16); femur tract length exhibited a significant difference (p < 0.01) (Table 4, Figure 4 and Figure 5). DL reconstruction resulted in a significant decrease in femorotibial fractional anisotropy (FA) for both voxel dimensions (p < 0.01) (Figure 3 and Figure 5). Figure 6A,B show DTI tractography changes in non-denoised and denoised 2 mm3 versus non-denoised and denoised 2 mm × 2 mm × 3 mm in a 9-year-old girl and a 10-year-old boy.
SNR values were significantly higher in the non-denoised femur and tibia ROIs in the 2 mm × 2 mm × 3 mm voxel dimension compared to the 2 mm3 voxel size (p < 0.0001), a pattern observed both before and after applying DL-denoising (Table 5). Following the application of DL-denoising, the femur and tibia ROI SNR on b0 exhibited a 39% and 41% increase in the 2 mm3 voxel dimension, respectively, in contrast to the 37% and 38% increase in the 2 mm × 2 mm × 3 mm (Table 5). Moreover, the SNR for the femur and tibia ROI on b600 experienced a 39% and 40% increase in the 2 mm3 voxel size, whereas a more pronounced increment of 40% and 42% was observed in the 2 mm × 2 mm × 3 mm (Table 6).

4. Discussion

Voxel dimension is one of the factors that influences fiber tracking and the degree of PVEs [25]. Larger voxel sizes can contain more than one dominant diffusion orientation, thereby causing possible errors in estimating the primary tensor direction which ultimately impacts fiber tracking and the resultant diffusion metrics [1,25]. This may explain the markedly smaller tensor ellipsoid representations inside a voxel with a less defined direction observed in the larger voxel dimension (which results in lower microscopic resolution) compared to the smaller isotropic voxel size used (2 mm3). The relationship between voxel resolution and image quality is evident in Figure 1, where the knee bones and physes are more sharply defined on the isotropic 2 mm3 voxel size [31].
The use of larger voxels resulted in smaller fiber tract diffusion metrics. Larger 3D voxels can cover the entire field of view (FOV) and thickness with fewer voxels overall at a lower spatial resolution, the opposite is true when using smaller voxel sizes, hence fewer tensors overall are calculated on bigger voxels (as more area is covered by one 3D voxel and a single dominant tensor is calculated per voxel) accounting for lower tract count, length, and volume when using a larger voxel size.
We hypothesize the significant increase in both femur and tibia fiber tract count, volume, and length after denoising isovolumetric 2 mm3 scans is due to the removal of intrinsically increased noise by the applied reconstruction algorithm. Diffusion metrics on the bigger voxel size in same subject scans, however, had better SNR and lower microscopic resolution, which was not improved with the reconstruction algorithm. This may possibly explain the small changes in tract count and volume in both physis after reconstruction algorithm application, which were not significant. The change in femoral tract length after denoising the 2 mm × 2 mm × 3 mm voxel size was small yet statistically significant, suggesting tract length is more sensitive to small SNR changes when compared to tract volume and tract count. In previous femur and tibia physeal DTI studies evaluating growth, tract length results have been variable: showing poor interobserver reliability compared to other fiber tract diffusion metrics (count, volume, length, and FA) evaluated in the same specimens [8], and it also did not show the expected change with age in animal models [8], which could suggest tract length is susceptible to small changes.
FA is the measurement of the degree of restricted water diffusion, calculated from the eigen value of the diffusion tensor [32]. In brain white matter, FA has been seen to decrease steadily after 20 years of age. Previous studies on the knee physes, have shown increasing FA with age as the closing physes, now ossified cartilage, show greater water diffusion restriction [7,9]. FA contrasts the principal eigenvalues of diffusivity and is considered to be limited by noise, making it susceptible to voxel size effects [33]. A previous study evaluating FA in brain white matter fiber tracts in different subjects using increasing voxel sizes found voxel size to significantly affect FA with smaller voxels giving higher FA values and reporting the impact was strongest at the highest spatial resolutions [33]. These mirrors our findings where same subject mean femur and the tibia FA values were 0.34 and 0.36 (2 mm3) and 0.26 for both femur and tibia (2 mm × 2 mm × 3 mm).
High noise levels can bias DTI measurements, which can consequently produce errors in estimation of fiber tract parameters [34]. Low SNR can cause overestimation and underestimation of the largest and smallest eigenvalues, respectively [35]. A previous study evaluating DL noise reduction effects on FA in CNS structures in 20 patients, performed one image acquisition (NAQ1) versus five image acquisitions (NAQ5), and compared FA values after DL denoising was applied in NAQ1 [36]. They found FA to be overestimated when the number of image acquisitions was one (NAQ1), and after denoising NAQ1′s FA decreased and came closer to that of NAQ5 [36]. In our study, a similar decrease in FA values on both spatial resolutions after application of the DL reconstruction occurred likely due to noise elimination and the resultant increased signal, with greater signal achieved in the intrinsically noisier 2 mm3 spatial resolution explaining the greater drop in FA in the smaller voxel size (non-denoised versus denoised FA for the femur, 0.31 and 0.29, and the tibia, 0.36 to 0.34). This finding is also consistent with previous studies that low SNR leads to overestimation of FA on skeletal muscle [37], and the positive bias in FA values on peripheral nerve was removed after denoising [18].
We observed that the ROI SNR values for both the femur and tibia were higher when utilizing the larger voxel size (2 mm × 2 mm × 3 mm), irrespective of denoising. This aligns with the acknowledged trade-off between spatial resolution and SNR. Initially we anticipated a higher increase in SNR after denoising the smaller voxel dimensions (2 mm3). The signal-to-noise ratio (SNR) quantitatively increased slightly more for the b600 images in the 2 mm × 2 mm × 3 mm voxel size than for the 2 mm3. The 2 mm × 2 mm × 3 mm demonstrated higher SNR before denoising and the subsequent increase in SNR did not impact the metrics as observed in the smaller, noisier voxel dimensions.
The children imaged in this study are part of an ongoing longitudinal cohort, focusing on predicting growth in healthy children using DTI of the physeal–metaphyseal complex. As a standard practice, the left knee was chosen for imaging as it was more likely to be the non-dominant knee and less prone to injury, ensuring consistency and reducing potential confounding factors for analysis. No differences are predicted in the equally healthy right contralateral extremity in terms of SNR or imaging acquisition that would alter the findings on this study.
This study is limited by the small sample size used. To address this, the methods could be replicated in a bigger subject population to determine if the effects observed are consistent. The data can also be compared in groups of children in the clinical setting, with musculoskeletal disease for example and/or adult population. This study provides information to support the leveraging of denoising algorithms, such as AIRTM Recon DL, on DTI acquisition with smaller voxel volumes. The noise is reduced while preserving the higher spatial resolution, allowing for more accurate quantification of diffusion metrics.
This approach could address the drawbacks of lower SNR associated with smaller voxel volumes and capitalizes on their better spatial resolutions. This allows clinicians a clearer view of growth plate tissue microstructures without sacrificing signal. In addition, it may be possible to take advantage of better image resolution without a greater acquisition time which is essential when imaging pediatric subjects. In cases where there will be various same subject acquisitions, FA values are more reliable when they are denoised than when they are not.
Recognizing DTI’s inherent sensitivity to noise, which significantly impacts the reliability of metrics such as fractional anisotropy (FA) and tract count, our discussion delves into the effectiveness of the DL denoising algorithm. This pretrained prototype is adept at generating noise-tolerant, reliable DTI metrics, a critical advancement for interpreting complex microstructures like the knee growth plate in the context of skeletal growth. This capability to reduce noise while preserving essential diffusion signals is pivotal, especially for the knee growth plate, where precise visualization and accurate tract counts and other diffusion metrics are crucial for assessing prediction of post-imaging growth and growth plate closure as well as positive and negative effect of treatments like growth hormone administration for potential growth disorders in pediatric patients. The significant improvements in DTI metrics following denoising underscore the impact of DL techniques in addressing DTI’s traditional challenges. Given its fixed pretrained parameters, this inference network seamlessly translates across different body parts for DTI scans, negating the need for retraining. This characteristic is helpful in clinical and research settings, offering a stable, reliable tool to enhance DTI data quality.

5. Conclusions

A DL reconstruction algorithm may lead to significant increase in femorotibial DTI metrics (tract count, volume, and length) when applied on smaller voxel sizes, while causing a significant decrease in FA regardless of voxel dimension, larger cohorts should be used to asses validation.
Leveraging denoising algorithms could address the drawbacks of lower SNR associated with smaller voxel volumes and capitalizes on their better spatial resolutions, allowing for more accurate quantification of diffusion metrics.

Author Contributions

Author contributions included conceptualization by L.S., S.J., D.J. and J.S.; methodology by L.S., H.-Y.H., S.J., D.J., M.F. and M.R.L.; software development by R.R.N.J., J.S., M.F. and M.R.L.; validation by J.S., H.-Y.H. and B.S.; formal analysis by S.J., D.J., B.S. and H.-Y.H.; investigation conducted by L.S., H.-Y.H., R.R.N.J. and D.J.; resources provided by D.J., M.F. and J.S.; data curation managed by L.S., D.J. and B.S.; original draft preparation by L.S., B.S., M.F., J.S. and M.R.L.; review and editing performed by M.F., J.S. and M.R.L.; visualization by S.J. and R.R.N.J.; supervision overseen by D.J. and S.J.; project administration handled by D.J. and H.-Y.H.; and funding acquisition by D.J. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by both the Society for Pediatric Radiology Research and Education Foundation and National Institutes of Health R01 grant number HD104720.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board (or Ethics Committee) of Columbia University Irving Medical Center (AAS988 approved 27 March 2020).

Informed Consent Statement

Informed consent and assent was obtained from all subjects and legal guardians respectively, involved in the study. Written informed consent has been obtained from the patients to publish this paper.

Data Availability Statement

Data generated and analyzed during this study are not publicly available due to subject imaging containing protected health information but are available from the corresponding author on reasonable request.

Conflicts of Interest

Authors Jaemin Shin, Maggie Fung, and Marc Leber report a relationship with General Electric Company that includes employment. For the remaining authors, none are declared. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Soares, J.M.; Marques, P.; Alves, V.; Sousa, N. A Hitchhiker’s Guide to Diffusion Tensor Imaging. Front. Neurosci. 2013, 7, 31. [Google Scholar] [CrossRef] [PubMed]
  2. Ranzenberger, L.R.; Das, M.; Snyder, T. Diffusion Tensor Imaging. In StatPearls 2023, November 12; StatPearls Publishing: Treasure Island, FL, USA, 2024. [Google Scholar]
  3. Chen, Q.; Abrigo, J.; Deng, M.; Shi, L.; Wang, Y.X.; Chu, W.C.W. Alzheimer’s Disease Neuroimaging Initiative. Diffusion Changes in Hippocampal Cingulum in Early Biologically Defined Alzheimer’s Disease. J. Alzheimer’s Dis. 2023, 91, 1007–1017. [Google Scholar] [CrossRef] [PubMed]
  4. Alexander, A.L.; Lee, J.E.; Lazar, M.; Field, A.S. Diffusion Tensor Imaging of the Brain. Neurotherapeutics 2007, 4, 316–329. [Google Scholar] [CrossRef] [PubMed]
  5. Vedantam, A.; Jirjis, M.B.; Schmit, B.D.; Wang, M.C.; Ulmer, J.L.; Kurpad, S.N. Diffusion Tensor Imaging of the Spinal Cord: Insights from Animal and Human Studies. Neurosurgery 2014, 74, 1–8. [Google Scholar] [CrossRef] [PubMed]
  6. Jambawalikar, S.; Baum, J.; Button, T.; Li, H.; Geronimo, V.; Gould, E.S. Diffusion Tensor Imaging of Peripheral Nerves. Skelet. Radiol. 2010, 39, 1073–1079. [Google Scholar] [CrossRef] [PubMed]
  7. Jaimes, C.; Berman, J.I.; Delgado, J.; Ho-Fung, V.; Jaramillo, D. Diffusion-Tensor Imaging of the Growing Ends of Long Bones: Pilot Demonstration of Columnar Structure in the Physes and Metaphyses of the Knee. Radiology 2014, 273, 491–501. [Google Scholar] [CrossRef] [PubMed]
  8. Kvist, O.; Damberg, P.; Dou, Z.; Berglund, J.S.; Flodmark, C.E.; Nilsson, O.; Diaz, S. Magnetic Resonance and Diffusion Tensor Imaging of the Adolescent Rabbit Growth Plate of the Knee. Magn. Reson. Med. 2023, 89, 331–342. [Google Scholar] [CrossRef] [PubMed]
  9. Bedoya, M.A.; Delgado, J.; Berman, J.I.; Chauvin, N.A.; Zurakowski, D.; Ramirez-Grueso, R.; Ntoulia, A.; Jaramillo, D. Diffusion-Tensor Imaging of the Physes: A Possible Biomarker for Skeletal Growth-Experience with 151 Children. Radiology 2017, 284, 210–218. [Google Scholar] [CrossRef]
  10. Delgado, J.; Jaramillo, D.; Chauvin, N.A.; Chauvin, N.A.; Zurakowski, D.; Ramirez-Grueso, R.; Ntoulia, A.; Jaramillo, D. Evaluating Growth Failure with Diffusion Tensor Imaging in Pediatric Survivors of High-Risk Neuroblastoma Treated with High-Dose cis-Retinoic Acid. Pediatr. Radiol. 2019, 49, 1056–1065. [Google Scholar] [CrossRef]
  11. Duong, P.; Mostoufi-Moab, S.; Raya, J.G.; Jaimes, C.; Delgado, J.; Jaramillo, D. Imaging Biomarkers of the Physis: Cartilage Volume on MRI vs. Tract Volume and Length on Diffusion Tensor Imaging. J. Magn. Reson. Imaging 2020, 52, 544–551. [Google Scholar] [CrossRef]
  12. Barrera, C.A.; Bedoya, M.A.; Delgado, J.; Berman, J.I.; Chauvin, N.A.; Edgar, J.C. Correlation between Diffusion Tensor Imaging Parameters of the Distal Femoral Physis and Adjacent Metaphysis, and Subsequent Adolescent Growth. Pediatr. Radiol. 2019, 49, 1192–1200. [Google Scholar] [CrossRef] [PubMed]
  13. Jaramillo, D.; Duong, P.; Nguyen, J.C.; Mostoufi-Moab, S.; Nguyen, M.K.; Moreau, A.; Barrera, C.A.; Hong, S.; Raya, J.G. Diffusion Tensor Imaging of the Knee to Predict Childhood Growth. Radiology 2022, 303, 655–663. [Google Scholar] [CrossRef] [PubMed]
  14. Tian, Q.; Li, Z.; Fan, Q.; Polimeni, J.R.; Bilgic, B.; Salat, D.H.; Huang, S.Y. SDnDTI: Self-supervised Deep Learning-based Denoising for Diffusion Tensor MRI. Neuroimage 2022, 253, 119033. [Google Scholar] [CrossRef] [PubMed]
  15. Tian, C.; Fei, L.; Zheng, W.; Xu, Y.; Zuo, W.; Lin, C.W. Deep Learning on Image Denoising: An Overview. Neural Netw. 2020, 131, 251–275. [Google Scholar] [CrossRef] [PubMed]
  16. Tian, Q.; Bilgic, B.; Fan, Q.; Liao, C.; Ngamsombat, C.; Hu, Y.; Witzel, T.; Setsompop, K.; Polimeni, J.R.; Huang, S.Y. DeepDTI: High-fidelity Six-direction Diffusion Tensor Imaging using Deep Learning. Neuroimage 2020, 219, 117017. [Google Scholar] [CrossRef] [PubMed]
  17. Vidyadharan, S.; Prabhakar Rao, B.V.V.S.N.; Perumal, Y.; Chandrasekharan, K.; Rajagopalan, V. Deep Learning Classifies Low- and High-Grade Glioma Patients with High Accuracy, Sensitivity, and Specificity Based on Their Brain White Matter Networks Derived from Diffusion Tensor Imaging. Diagnostics 2022, 12, 3216. [Google Scholar] [CrossRef] [PubMed]
  18. Sneag, D.B.; Zochowski, K.C.; Tan, E.T.; Queler, S.C.; Burge, A.; Endo, Y.; Lin, B.; Fung, M.; Shin, J. Denoising of Diffusion MRI Improves Peripheral Nerve Conspicuity and Reproducibility. J. Magn. Reson. Imaging 2020, 51, 1128–1137. [Google Scholar] [CrossRef] [PubMed]
  19. Charles, J.P.; Grant, B.; D’Août, K.; Bates, K.T. Subject-specific Muscle Properties from Diffusion Tensor Imaging Significantly Improve the Accuracy of Musculoskeletal Models. J. Anat. 2020, 237, 941–959. [Google Scholar] [CrossRef] [PubMed]
  20. Malis, V.; Sinha, U.; Csapo, R.; Narici, M.; Smitaman, E.; Sinha, S. Diffusion Tensor Imaging and Diffusion Modeling: Application to Monitoring Changes in the Medial Gastrocnemius in Disuse Atrophy Induced by Unilateral Limb Suspension. J. Magn. Reson. Imaging 2019, 49, 1655–1664. [Google Scholar] [CrossRef]
  21. Mazzoli, V.; Moulin, K.; Kogan, F.; Hargreaves, B.A.; Gold, G.E. Diffusion Tensor Imaging of Skeletal Muscle Contraction Using Oscillating Gradient Spin Echo. Front. Neurol. 2021, 12, 608549. [Google Scholar] [CrossRef]
  22. Zhao, Q.; Ridout, R.P.; Shen, J.; Wang, N. Effects of Angular Resolution and b Value on Diffusion Tensor Imaging in Knee Joint. Cartilage 2021, 13 (Suppl. S2), 295S–303S. [Google Scholar] [CrossRef] [PubMed]
  23. Wang, N.; Mirando, A.J.; Cofer, G.; Qi, Y.; Hilton, M.J.; Johnson, G.A. Characterization complex collagen fiber architecture in knee joint using high-resolution diffusion imaging. Magn. Reson. Med. 2020, 84, 908–919. [Google Scholar] [CrossRef] [PubMed]
  24. Wang, N.; Mirando, A.J.; Cofer, G.; Qi, Y.; Hilton, M.J.; Johnson, G.A. Diffusion tractography of the rat knee at microscopic resolution. Magn. Reson. Med. 2019, 81, 3775–3786. [Google Scholar] [CrossRef] [PubMed]
  25. Mukherjee, P.; Chung, S.W.; Berman, J.I.; Hess, C.P.; Henry, R.G. Diffusion Tensor MR Imaging and Fiber Tractography: Technical Considerations. AJNR Am. J. Neuroradiol. 2008, 29, 843–852. [Google Scholar] [CrossRef] [PubMed]
  26. Tournier, J.D.; Smith, R.; Raffelt, D.; Tabbara, R.; Dhollander, T.; Pietsch, M.; Christiaens, D.; Jeurissen, B.; Yeh, C.-H.; Connelly, A. MRtrix3: A Fast, Flexible and Open Software Framework for Medical Image Processing and Visualisation. Neuroimage 2019, 202, 116137. [Google Scholar] [CrossRef] [PubMed]
  27. O’Donnell, L.J.; Westin, C.F. An Introduction to Diffusion Tensor Image Analysis. Neurosurg. Clin. N. Am. 2011, 22, 185–196. [Google Scholar] [CrossRef] [PubMed]
  28. Dhollander, T.; Raffelt, D.; Connelly, A. Unsupervised 3-tissue Response Function Estimation from Single-shell or Multi-shell Diffusion MR Data without a Co-registered T1 Image. In Proceedings of the ISMRM Workshop on Breaking the Barriers of Diffusion MRI, Lisbon, Portugal, 11–16 September 2016. [Google Scholar]
  29. Tournier, J.D.; Calamante, F.; Connelly, A. Robust Determination of the Fibre Orientation Distribution in Diffusion MRI: Non-negativity Constrained Super-resolved Spherical Deconvolution. Neuroimage 2007, 35, 1459–1472. [Google Scholar] [CrossRef] [PubMed]
  30. Wang, Z.J.; Yamamura, J.; Keller, S. Signal-to-noise Ratio Assessment of Muscle Diffusion Tensor Imaging using Single Image Set and Validation by the Difference Image Method. Br. J. Radiol. 2019, 92, 20190133. [Google Scholar] [CrossRef] [PubMed]
  31. Mulder, M.J.; Keuken, M.C.; Bazin, P.L.; Alkemade, A.; Forstmann, B.U. Size and shape matter: The impact of voxel geometry on the identification of small nuclei. PLoS ONE 2019, 14, e0215382. [Google Scholar] [CrossRef]
  32. Kaplan, P.E. Fractional Anisotropy. In Encyclopedia of Clinical Neuropsychology; Kreutzer, J.S., DeLuca, J., Caplan, B., Eds.; Springer: New York, NY, USA, 2011. [Google Scholar] [CrossRef]
  33. Gattu, R.; Latif, Z.; Kou, Z.; Haacke, E.M.; Benson, R.R. Effect of Voxel Size on DTI Fractional Anisotropy. Proc. Intl. Soc. Mag. Reson. Med. 2009, 17, 3578. Available online: https://archive.ismrm.org/2009/3579.html (accessed on 21 June 2023).
  34. St-Jean, S.; Coupé, P.; Descoteaux, M. Non Local Spatial and Angular Matching: Enabling higher spatial resolution diffusion MRI datasets through adaptive denoising. Med. Image Anal. 2016, 32, 115–130. [Google Scholar] [CrossRef] [PubMed]
  35. Seo, Y.; Rollins, N.K.; Wang, Z.J. Reduction of Bias in the Evaluation of Fractional Anisotropy and Mean Diffusivity in Magnetic Resonance Diffusion Tensor Imaging Using Region-of-Interest Methodology. Sci. Rep. 2019, 9, 13095. [Google Scholar] [CrossRef] [PubMed]
  36. Sagawa, H.; Fushimi, Y.; Nakajima, S.; Fujimoto, K.; Miyake, K.K.; Numamoto, H.; Koizumi, K.; Nambu, M.; Kataoka, H.; Nakamoto, Y.; et al. Deep Learning-based Noise Reduction for Fast Volume Diffusion Tensor Imaging: Assessing the Noise Reduction Effect and Reliability of Diffusion Metrics. Magn. Reson. Med. Sci. 2021, 20, 450–456. [Google Scholar] [CrossRef] [PubMed]
  37. Froeling, M.; Nederveen, A.J.; Nicolay, K.; Strijkers, G.J. DTI of Human Skeletal Muscle: The Effects of Diffusion Encoding Parameters, Signal-to-noise Ratio and T2 on Tensor Indices and Fiber Tracts. NMR Biomed. 2013, 26, 1339–1352. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Same subject DTI acquisition using voxel sizes of (A) 2 mm3 and (D) 2 mm × 2 mm × 3 mm. The image quality is visibly better when DL reconstruction is applied in the 2 mm3 voxel size (A), with sharper bone contours and an increase in fiber tracts on both the femur and tibia. Conversely, in the 2 mm × 2 mm × 3 mm voxel size, both the non-denoised and DL denoise images (D) appear equally pixelated, and there are minimal changes in tractography. The tensor ellipsoid representation of intravoxel eigen vectors is substantially larger and more numerous in the 2 mm3 voxel size (B,C) compared to the 2 mm × 2 mm × 3 mm voxel size (E,F).
Figure 1. Same subject DTI acquisition using voxel sizes of (A) 2 mm3 and (D) 2 mm × 2 mm × 3 mm. The image quality is visibly better when DL reconstruction is applied in the 2 mm3 voxel size (A), with sharper bone contours and an increase in fiber tracts on both the femur and tibia. Conversely, in the 2 mm × 2 mm × 3 mm voxel size, both the non-denoised and DL denoise images (D) appear equally pixelated, and there are minimal changes in tractography. The tensor ellipsoid representation of intravoxel eigen vectors is substantially larger and more numerous in the 2 mm3 voxel size (B,C) compared to the 2 mm × 2 mm × 3 mm voxel size (E,F).
Tomography 10 00039 g001
Figure 2. Bland–Altman plots regarding the difference in DTI metrics for same physeal ROIs between DL reconstructed-and non-denoised (Non-DL) image DTIs. The horizontal axis represents the mean of the two methods and the vertical axis, the difference between them. The solid line (red) shows the mean difference (close to zero) and the dashed lines show the 95% limits of agreement.
Figure 2. Bland–Altman plots regarding the difference in DTI metrics for same physeal ROIs between DL reconstructed-and non-denoised (Non-DL) image DTIs. The horizontal axis represents the mean of the two methods and the vertical axis, the difference between them. The solid line (red) shows the mean difference (close to zero) and the dashed lines show the 95% limits of agreement.
Tomography 10 00039 g002
Figure 3. Bland–Altman plots regarding the difference in DTI metrics for same physeal ROIs between DL-reconstructed and non-denoised (non-DL) image DTIs. The horizontal axis represents the mean of the two methods and the vertical axis, the difference between them. The solid line (red) shows the mean difference (close to zero) and the dashed lines show the 95% limits of agreement.
Figure 3. Bland–Altman plots regarding the difference in DTI metrics for same physeal ROIs between DL-reconstructed and non-denoised (non-DL) image DTIs. The horizontal axis represents the mean of the two methods and the vertical axis, the difference between them. The solid line (red) shows the mean difference (close to zero) and the dashed lines show the 95% limits of agreement.
Tomography 10 00039 g003
Figure 4. Bland–Altman plots regarding the difference in DTI metrics for same physeal ROIs between DL reconstructed and non-denoised (non-DL) DTIs. The zero value is indicated by the red line. The horizontal axis represents the mean of the two methods and the vertical axis, the difference between them. The solid line (red) shows the mean difference (close to zero) and the dashed lines show the 95% limits of agreement. The mean is very close to zero for most cases, indicating little difference between the methods, and the range of LoA is relatively small indicating a good numerical agreement in the methods among the majority of patients for the 2 mm × 2 mm × 3 mm voxel size.
Figure 4. Bland–Altman plots regarding the difference in DTI metrics for same physeal ROIs between DL reconstructed and non-denoised (non-DL) DTIs. The zero value is indicated by the red line. The horizontal axis represents the mean of the two methods and the vertical axis, the difference between them. The solid line (red) shows the mean difference (close to zero) and the dashed lines show the 95% limits of agreement. The mean is very close to zero for most cases, indicating little difference between the methods, and the range of LoA is relatively small indicating a good numerical agreement in the methods among the majority of patients for the 2 mm × 2 mm × 3 mm voxel size.
Tomography 10 00039 g004
Figure 5. Bland–Altman plots regarding the difference in DTI metrics for same physeal ROIs between DL reconstructed and non-denoised (non-DL) DTIs. The zero value is indicated by the red line. The horizontal axis represents the mean of the two methods and the vertical axis, the difference between them. The solid line (red) shows the mean difference (close to zero) and the dashed lines show the 95% limits of agreement. The mean is very close to zero for most cases, indicating little difference between the methods, and the range of LoA is relatively small indicating a good numerical agreement in the methods among the majority of patients for the 2 mm × 2 mm × 3 mm voxel size.
Figure 5. Bland–Altman plots regarding the difference in DTI metrics for same physeal ROIs between DL reconstructed and non-denoised (non-DL) DTIs. The zero value is indicated by the red line. The horizontal axis represents the mean of the two methods and the vertical axis, the difference between them. The solid line (red) shows the mean difference (close to zero) and the dashed lines show the 95% limits of agreement. The mean is very close to zero for most cases, indicating little difference between the methods, and the range of LoA is relatively small indicating a good numerical agreement in the methods among the majority of patients for the 2 mm × 2 mm × 3 mm voxel size.
Tomography 10 00039 g005
Figure 6. (a). 2 mm × 2 mm × 3 mm (A) non-denoised (left) and 2 mm × 2 mm × 3 mm denoised (right) versus 2 mm3 (B) non-denoised (left) and denoised (right) in a 9-year-old girl. There is an evident increase in fiber tract on the denoised images acquired with a 2 mm3, while denoised and non-denoised images are very similar using 2 mm × 2 mm × 3 mm voxel size. (b). 2 mm × 2 mm × 3 mm (C) non-denoised (left) and denoised (right), versus 2 mm3 (D) non-denoised (left) and denoised (right) in a10 year-old boy. There is an evident increase in fiber tract on the denoised images acquired with a 2 mm3, while denoised and non-denoised images are very similar using 2 mm × 2 mm × 3 mm voxel size.
Figure 6. (a). 2 mm × 2 mm × 3 mm (A) non-denoised (left) and 2 mm × 2 mm × 3 mm denoised (right) versus 2 mm3 (B) non-denoised (left) and denoised (right) in a 9-year-old girl. There is an evident increase in fiber tract on the denoised images acquired with a 2 mm3, while denoised and non-denoised images are very similar using 2 mm × 2 mm × 3 mm voxel size. (b). 2 mm × 2 mm × 3 mm (C) non-denoised (left) and denoised (right), versus 2 mm3 (D) non-denoised (left) and denoised (right) in a10 year-old boy. There is an evident increase in fiber tract on the denoised images acquired with a 2 mm3, while denoised and non-denoised images are very similar using 2 mm × 2 mm × 3 mm voxel size.
Tomography 10 00039 g006
Table 1. Denoised AIr Recon DL DTI metrics: 2 mm3 versus 2 mm × 2 mm × 3 mm.
Table 1. Denoised AIr Recon DL DTI metrics: 2 mm3 versus 2 mm × 2 mm × 3 mm.
DTI METRICAIr Recon DLAIr Recon DLp-Value
Isovolumetric 2 mm3 2 mm × 2 mm × 3 mm
femur tract count753.03 ± 409.17410.37 ± 308.29<0.0001 *
femur tract volume12.47 ± 7.05 9.52 ± 7.17<0.0006 *
femur tract length8.83 ± 2.489.07 ± 3.93 0.9
femur FA0.29 ± 0.040.25 ± 0.02 <0.0001 *
tibia tract count341.62 ± 187.3137.44 ± 177.31<0.0001 *
tibia tract volume5.34 ± 2.74.50 ± 8.360.0005 *
tibia tract length5.36 ± 0.84 6.81 ± 2.420.002 *
tibia FA0.34 ± 0.050.24 ± 0.03 <0.0001 *
Wilcoxon signed rank test; p-value < 0.05 was considered significant (*).
Table 2. Raw Data DTI metrics: 2 mm3 versus 2 mm × 2 mm × 3 mm.
Table 2. Raw Data DTI metrics: 2 mm3 versus 2 mm × 2 mm × 3 mm.
DTI METRIC Raw Data Raw Data p-Value
Isovolumetric 2 mm3 2 mm × 2 mm × 3 mm
femur tract count576.85 ± 257.21388.62 ± 274.57 <0.0001 *
femur tract volume9.3 ± 4.459.03 ± 6.4 0.13
femur tract length6.11 ± 1.397.96 ± 3.250.001 *
femur FA0.31 ± 0.040.26 ± 0.030.0001 *
tibia tract count277.22 ± 133.89123.44 ± 112.03 0.0001 *
tibia tract volume4.33 ± 1.992.74 ± 2.2 0.0001 *
tibia tract length4.26 ± 0.626.43 ± 1.75 0.0001 *
tibia FA0.36 ± 0.060.26 ± 0.040.0001 *
Wilcoxon signed rank test; p-value < 0.05 was considered significant (*).
Table 3. Raw data versus DL denoised DTI metrics: 2 mm3.
Table 3. Raw data versus DL denoised DTI metrics: 2 mm3.
DTI METRICRaw Data AIr Recon DLp-Value
Isovolumetric 2 mm3 Isovolumetric 2 mm3
femur tract count576.85753.03<0.0001 *
femur tract volume9.312.47<0.0001 *
femur tract length6.118.83<0.0001 *
femur FA0.310.29<0.0001 *
tibia tract count277.22341.620.013 *
tibia tract volume4.335.340.001 *
tibia tract length4.265.36<0.0001 *
tibia FA0.360.340.005 *
Wilcoxon signed rank test; p-value < 0.05 was considered significant (*).
Table 4. Raw data versus DL denoised DTI metrics: 2 mm × 2 mm × 3 mm.
Table 4. Raw data versus DL denoised DTI metrics: 2 mm × 2 mm × 3 mm.
DTI METRIC Raw Data AIr Recon DLp-Value
2 mm × 2 mm × 3 mm2 mm × 2 mm × 3 mm
femur tract count388.62410.370.1
femur tract volume9.039.520.14
femur tract length7.969.070.001 *
femur FA0.260.250.017 *
tibia tract count123.44137.440.14
tibia tract volume2.744.50.29
tibia tract length6.436.810.16
tibia FA0.260.24<0.0001 *
Wilcoxon signed rank test; p-value < 0.05 was considered significant (*).
Table 5. SNR values in the non-denoised femur and tibia ROIs: 2 mm × 2 mm × 3 mm voxel dimension compared to 2 mm3 voxel size.
Table 5. SNR values in the non-denoised femur and tibia ROIs: 2 mm × 2 mm × 3 mm voxel dimension compared to 2 mm3 voxel size.
Voxel Size Comparison of ROI SNRs for b0 and b600 DTI with and without DL
2 mm3DLNon-DLp-value
femur_b044.231.7<0.0001 *
femur_b60018.913.7<0.0001 *
tibia_b036.425.8<0.0001 *
tibia_b60016.611.9<0.0001 *
2 mm × 2 mm × 3 mmDLNon-DLp-value
femur_b067.149.0<0.0001 *
femur_b60029.620.9<0.0001 *
tibia_b054.139.3<0.0001 *
tibia_b60025.417.9<0.0001 *
Wilcoxon signed rank test; p-value < 0.05 was considered significant (*).
Table 6. SNR Increase.
Table 6. SNR Increase.
SNR Increase
(Mean Difference SNR/Non-DL SNR)
2 mm32 mm × 2 mm × 3 mm
femur_b00.390.37
tibia_b00.410.38
femur_b6000.390.42
tibia_b6000.40.42
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Santos, L.; Hsu, H.-Y.; Nelson, R.R., Jr.; Sullivan, B.; Shin, J.; Fung, M.; Lebel, M.R.; Jambawalikar, S.; Jaramillo, D. Impact of Deep Learning Denoising Algorithm on Diffusion Tensor Imaging of the Growth Plate on Different Spatial Resolutions. Tomography 2024, 10, 504-519. https://doi.org/10.3390/tomography10040039

AMA Style

Santos L, Hsu H-Y, Nelson RR Jr., Sullivan B, Shin J, Fung M, Lebel MR, Jambawalikar S, Jaramillo D. Impact of Deep Learning Denoising Algorithm on Diffusion Tensor Imaging of the Growth Plate on Different Spatial Resolutions. Tomography. 2024; 10(4):504-519. https://doi.org/10.3390/tomography10040039

Chicago/Turabian Style

Santos, Laura, Hao-Yun Hsu, Ronald R. Nelson, Jr., Brendan Sullivan, Jaemin Shin, Maggie Fung, Marc R. Lebel, Sachin Jambawalikar, and Diego Jaramillo. 2024. "Impact of Deep Learning Denoising Algorithm on Diffusion Tensor Imaging of the Growth Plate on Different Spatial Resolutions" Tomography 10, no. 4: 504-519. https://doi.org/10.3390/tomography10040039

Article Metrics

Back to TopTop