Next Article in Journal
The Material Heterogeneity Effect on the Local Resistance of Pultruded GFRP Columns
Previous Article in Journal
Molecular Dynamics Simulation of Silane Inserted CSH Nanostructure
Previous Article in Special Issue
Deep Reinforcement Learning Environment Approach Based on Nanocatalyst XAS Diagnostics Graphic Formalization
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Leveraging Deep Neural Networks for Estimating Vickers Hardness from Nanoindentation Hardness

1
School of Material Science & Engineering, Harbin Institute of Technology, Harbin 150001, China
2
State Key Laboratory of Advanced Welding and Joining, Harbin Institute of Technology, Harbin 150001, China
*
Authors to whom correspondence should be addressed.
Materials 2024, 17(1), 148; https://doi.org/10.3390/ma17010148
Submission received: 11 November 2023 / Revised: 22 December 2023 / Accepted: 26 December 2023 / Published: 27 December 2023

Abstract

:
This research presents a comprehensive analysis of deep neural network models (DNNs) for the precise prediction of Vickers hardness (HV) in nitrided and carburized M50NiL steel samples, with hardness values spanning from 400 to 1000 HV. By conducting rigorous experimentation and obtaining corresponding nanoindentation data, we evaluated the performance of four distinct neural network architectures: Multilayer Perceptron (MLP), Convolutional Neural Network (CNN), Long Short-Term Memory network (LSTM), and Transformer. Our findings reveal that MLP and LSTM models excel in predictive accuracy and efficiency, with MLP showing exceptional iteration efficiency and predictive precision. The study validates models for broad application in various steel types and confirms nanoindentation as an effective direct measure for HV hardness in thin films and gradient-variable regions. This work contributes a validated and versatile approach to the hardness assessment of thin-film materials and those with intricate microstructures, enhancing material characterization and potential application in advanced material engineering.

1. Introduction

The hardness of a material serves as a crucial index, encapsulating the material’s capacity to resist deformation or fracturing, bearing immense implications for disciplines such as materials science, engineering, and manufacturing [1,2,3,4,5,6,7,8,9,10,11,12]. Methods to measure hardness, embracing Vickers hardness (HV) [13,14,15,16], Brinell hardness (HB) [17,18,19,20], and Rockwell hardness (HR) [21,22,23,24], have garnered wide acceptance, contributing a valuable perspective in the comprehension of materials’ mechanical behaviors. Within the ambit of materials science, the process of hardness conversion is of paramount importance [25,26,27]. It unearths not only the deformation-resistance properties of an identical material across varied hardness scales but also introduces the opportunity to evaluate additional mechanical properties under non-destructive circumstances, thus bypassing more invasive testing approaches. Moreover, hardness conversion extends essential references for the selection and design of materials across a spectrum of application requirements. Crucially, whether the materials’ scales are macroscopic, microscopic, or nanoscale, hardness conversion enables the performance comparison across these scales, thus advancing a deeper interpretation and evaluation of material performance. Researchers [27] have developed theoretical equations to transition between Brinell hardness (HB), Rockwell hardness (HR), and Vickers hardness (HV). These equations are based on the power-law stress-strain relationship and the equivalent energy principle. Furthermore, the pre-existing relationship between tensile strength (σb) and Hollomon parameters (K, N) was integrated, allowing the derivation of the theoretical conversion between hardness (HB/HR/HV) and tensile strength (σb). These equations have undergone rigorous validation using an extensive dataset from ASTM and ISO standards, demonstrating a high degree of agreement.
However, these conventional hardness-characterization techniques may incur destructive consequences and require substantial time. Moreover, the precise hardness quantification of thin films and coatings poses significant challenges, which restrict the application of these measurement methodologies in such scenarios. With the advent of nanoindentation technology, it is now feasible to gauge hardness at the nanoscale. This innovative method presents a more efficient and less destructive substitute for thin films and coatings [28,29,30,31]. Determining the relationship between the comparatively microscopic nanohardness and macrohardness proves to be exceptionally crucial. However, the connection between Vickers hardness and nanoindentation hardness is far from linear, with multiple factors such as the material properties and microstructures exerting substantial influence. Certain researchers [26] observed in their investigations of Vickers hardness and nanoindentation hardness of unalloyed titanium (Ti), nickel (Ni), tungsten (W), 304 coarse grain stainless steel (CG-SS), and 304 nano-grain austenitic stainless steel (NG-SS) that the relationship between Vickers hardness and nanoindentation hardness does not conform to mathematical geometric relationships, owing to the sink-in and pile-up effects. This intricate non-linear relationship poses significant challenges in predicting Vickers hardness.
Discerning latent relationships among parameters is an area where neural networks excel remarkably. Neural networks have experienced substantial advances within the domain of materials science [32,33,34,35,36,37,38,39,40,41,42,43], with notable breakthroughs in facets such as materials genomics and predictive modeling. Such networks have been harnessed to predict properties of a diverse array of materials, encompassing but not confined to varied compositions of steel, hence propelling the progression of material design and discovery [44,45,46,47,48]. Furthermore, neural networks have been employed to predict mechanical performance and behavior under disparate conditions, offering invaluable insights that aid the design and manufacturing processes. Karimi et al. [49] developed a Graph Neural Network (GNN) model focused on predicting the nanoscale hardness of 310S steel. Utilizing grain location and orientation data, the model learns from nanomechanical load-displacement curves, effectively predicting the material’s micromechanical response. The findings not only provide a rapid and cost-effective method for hardness estimation but also guide more detailed nanoindentation experiments. Moreover, this research underscored the complementary nature of data-driven methods to traditional laboratory measurements and physical simulations, marking a significant contribution to the field of materials science. In this context, our predictive model, duly trained on a substantial dataset of corresponding Vickers hardness and nanoindentation hardness measurements, is projected to contribute significantly to this continuous trend.
In this research, we introduce an innovative approach that employs deep neural network technology to predict the Vickers hardness (HV) values of materials from nanoindentation experiments. Our goal was to construct and train a robust neural network model based on detailed HV and nanoindentation hardness measurement data. Building upon this, we innovatively generated a dataset spanning a hardness gradient of 400 to 1000 HV by subjecting M50NiL steel to a dual process of carburization and nitriding. This model focuses on the prediction of Vickers hardness within this hardness gradient range, with an emphasis on assessing its interpolation accuracy within this interval. To determine the optimal prediction model, we compared four contemporary neural network architectures: Multilayer Perceptron (MLP), Convolutional Neural Network (CNN), Long Short-Term Memory network (LSTM), and Transformer. After a series of tests and evaluations, Multilayer Perceptron (MLP) was selected as the best model due to its exceptional performance in predicting Vickers hardness. The advancements of this study not only enhance our characterization and understanding of the properties of thin films and coating materials but also provide significant technological innovation in the measurement of hardness within the field of materials science.

2. Methodology

2.1. Collection of Data

In the quest for securing a substantial number of hardness data points, the fabrication of an ample assortment of hardness standard specimens becomes a prerequisite. Nonetheless, the voluminous data requirement of neural networks presents an obstacle, rendering this approach practically unattainable. In the pursuit of an adequate hardness dataset, we designed an innovative strategy: through the dual treatment of carburizing and nitriding applied to M50NiL steel [50,51,52], we successfully procured a subtle hardness gradient extending from the surface to the core. Our choice of M50NiL steel was driven by its widespread use as a bearing material, reflecting its industrial relevance. Furthermore, the ability of M50NiL steel to achieve a wide range of hardness levels through these treatments allowed us to generate a broad and diverse dataset, crucial for the accurate training of our neural network models. This strategic choice not only enhanced the breadth and applicability of our dataset but also ensured robust and wide-ranging applicability of our models in real-world scenarios, particularly in industries where M50NiL steel is prevalently used.

2.1.1. Materials and Surface Treatment

The material under investigation was M50NiL steel, the constituents of which are elucidated in Table 1. The specimens employed were annealed cylindrical entities, exhibiting dimensions of Φ35 × 10 mm. The initial carburizing procedure was executed at 960 °C for a period of 20 h, followed by a 2-bar gas quenching process. Subsequent to this was a high-temperature quenching protocol, with a specified quenching temperature of 1100 °C, an isothermal hold duration of 40 min, and a quenching pressure of 2 bar. The carburizing process leverages a vacuum carburizing furnace (ECM, ICBP® Flex, Grenoble, France), while the quenching phase employs a miniature high-temperature vacuum furnace (BMI, BMICRO, FL, USA). Plasma nitriding treatment ensued, conducted within a glow ion nitriding furnace, an item of equipment custom-built by our research group. Plasma nitriding was facilitated through the active screen nitriding technique, thereby achieving a remarkably uniform nitriding layer [53,54,55]. A pulsed power supply (bias of 800 V, 40 kHz, adjustable duty cycle) was utilized for nitriding treatment. In the absence of power supply activation and gas infusion, the chamber was evacuated to a pressure of 5 Pa. The determined experimental parameters included an N2:H2 ratio of 1:20, a temperature of 500 °C, and a duration of 50 h. Upon the conclusion of nitriding, both the nitriding furnace and the samples underwent a gradual cooling process to room temperature.

2.1.2. Hardness Test

Prior to the execution of hardness testing, all specimens underwent ultrasonic cleansing within an ethanol medium. Subsequent to this, surface cross-sectional hardness examinations were conducted. The post-nitriding micro-Vickers hardness gradient was quantified utilizing a Micro Vickers Hardness Tester (Buehler, VH3100, Bluff, IL, USA), operating under a load of 500 g for a duration of 15 s. This process facilitated the acquisition of between 300 and 400 Vickers hardness data points at specified depths along the cross-section. All data points used were subjected to error analysis, and data points with varying errors were incorporated into the datasets. Nanoindentation hardness was assessed via the Continuous Stiffness Measurement (CSM) method, enabling the detection and subsequent elimination of anomalous data points throughout the testing process. This resulted in a final tally of 90 nanoindentation data points at predetermined depths. As illustrated in Figure 1, by utilizing Optical Microscopy (OM) and Scanning Electron Microscopy (SEM), we calibrated the locations for two types of hardness test points, thereby obtaining an accurate relationship between position and hardness. Specifically, Figure 1a,b represent the OM images of Vickers hardness and nanoindentation hardness, respectively, while Figure 1c,d are partial images of the SEM for Vickers hardness and nanoindentation hardness, respectively. These two datasets served as the foundation for the generation of subsequent datasets.

2.2. DNN Model

The comprehensive model workflow is depicted in Figure 2. Through the implementation of the two data sets, separate DNN models correlating depth with both Vickers hardness and nanoindentation hardness were established. Utilizing these two models allowed for the procurement of extended datasets corresponding to both Vickers and nanoindentation hardness. Ultimately, a predictive model was achieved, facilitating the determination of Vickers hardness based on nanoindentation hardness. In this study, to ensure uniformity in experimental conditions, all deep learning models were trained on graphics cards (NVIDIA, GeForce RTX 4080, Santa Clara, CA, USA), which possess equal computational capabilities. Such a practice helped to eliminate the potential impact of hardware differences on the experimental outcomes. Furthermore, the use of TensorFlow, a widely recognized open-source framework, for building and training the models ensured the standardization and reproducibility of the entire research process.

2.2.1. Depth-Hardness Model

In the current study, we applied deep learning techniques to accurately construct predictive models for nanoindentation and Vickers hardness. The model, implemented using the TensorFlow library’s neural network architectures [56,57,58], was specifically optimized for the complex relationship between hardness characteristics and material depth. In an environment equipped with high-performance Graphics Processing Units (GPUs), the model underwent a rigorous training process utilizing a specially collected dataset of hardness tests. Our network utilized the depth of the material layers as input, with the prediction target of corresponding hardness values.
Prior to the formal training, we conducted thorough preprocessing of the dataset, which included data cleansing, outlier handling, and the partitioning into training, validation, and test sets. To negate the impact that may arise from different scales of measurement, we further implemented normalization of the input features. During this process, the StandardScaler() method from the scikit-learn library was employed.
The neural network model used in our study consisted of several fully connected layers (dense layers), including an input layer, three hidden layers, and an output layer. The arrangement of neurons in our hidden layers, set at 32, 64, and 128 units, respectively, followed a well-established principle in neural network architecture. This progression allowed our model to incrementally capture more complex features, with each layer doubling its neuron count to effectively handle the increasing complexity of data representation. This design ensured a harmonious balance between computational efficiency and the ability to intricately model the characteristics of our dataset. The sigmoid function was chosen as the activation function to effectively address non-linear problems. For model training, the Adam optimizer was utilized, with the mean squared error (MSE) loss function serving as the optimization target. The mean absolute error (MAE) was also monitored to assess the quality of training.
During the training phase, the model underwent 5000 iterations of learning, with a large batch size of 1024 implemented to execute the batch gradient descent algorithm. Additionally, custom callback functions were utilized to track training progress and model performance. Following rigorous testing and validation, this depth-hardness model was successfully saved and confirmed to have stable and superior performance characteristics.

2.2.2. Nanoindentation-Vickers Hardness Dataset

To overcome the limitation of insufficient original hardness data, our study adopted an innovative strategy, namely, the augmentation of the dataset using deep learning techniques through an established depth-hardness prediction model. The two TensorFlow-based neural network models, once trained, were capable of predicting hardness values at varying depths. Using these models, we generated 25,000 data points covering a depth range from 100 to 1800 nanometers. These data points comprehensively reflected the quantitative relationship between nanoindentation hardness and Vickers hardness, and their integration into an expanded dataset not only enriched the training material but also extended the model’s applicability beyond the specific steel initially used. This approach significantly enhanced the model’s generalizability and predictive accuracy for a wider range of materials. The generated data points were integrated to form an expanded dataset, intended to provide the neural network with ample training resources to ensure the model’s generalizability and predictive accuracy.
In this section, further explanation is required regarding the generation of these data points and how they contribute to enhancing the model’s generalization capability and predictive accuracy. Initially, these data points were generated through nanoindentation experiments on M50NiL steel subjected to carburizing and nitriding, as this process yielded a wide range of hardness data points (400–1000 HV). This ensured that our generated data covered a broad spectrum of practical application scenarios. Regarding the construction of the model, although it utilized only a few hundred data points, these points were not entirely random. They exhibited a certain continuity or conformed to a specific curve relationship. This characteristic enabled us to generate a large number of hardness values at various depths using the model’s derived curves from a limited amount of data. This implied that the model learned not only the hardness values but also how these values vary with changes in the material’s microstructure and testing conditions. Finally, by integrating these simulated data points with the original dataset, we significantly increased the volume and diversity of data available for model training. This aspect was crucial for enhancing the model’s generalization capability. Generalization capability refers to the model’s ability to adapt and predict new data that it has not previously encountered. In our case, this meant that the model could accurately predict the hardness of various materials, even if those materials were not included in the original dataset.

2.2.3. Nanoindentation–Vickers Hardness Model

Building on the dataset established in Section 2.2.2, our study meticulously evaluated the performance of four different structured neural network models in the prediction of hardness. These models included MLP, CNN, LSTM, and Transformer. Despite differences in their architectural structures, all models were constructed and optimized following the fundamental design principles of the depth-hardness model outlined in Section 2.2.1.
During the model evaluation process, key metrics such as training time consumption, response speed, mean squared error (MSE), and the coefficient of determination (R2) were given special attention, while the models’ accuracy on the test set was also examined. By synthesizing these performance indicators, this study identified the most suitable neural network model for predicting the relationship between nanoindentation and Vickers hardness through comparative analysis. The selected model possessed excellent predictive capabilities and computational efficiency, meeting the demands for precise and rapid hardness prediction.

3. Results and Discussion

The distance-hardness datasets for nanoindentation and Vickers hardness were obtained using a method of cross-validation between OM and SEM images. Figure 3a,b display the Pearson correlation graphs for nanoindentation and Vickers hardness relative to nitriding depth, with correlation coefficients of −0.863 and −0.911, respectively. This high degree of correlation for both types of hardness with respect to depth indicates that establishing neural network models was highly appropriate for this context.
By establishing DNN models, we generated depth-hardness curves and compared actual versus predicted hardness profiles. To address the limited data available for our neural network model, and to preserve clarity in our graphical representations, all data points—including those from the training, validation, and test sets—were plotted collectively. This approach allowed us to provide a clear, comprehensive view of the model’s performance across the entire dataset. Figure 4 illustrates the relationship between depth and hardness, as predicted by our neural network models, with Figure 4a,b representing the depth-hardness and actual-predicted curves for Vickers hardness, respectively. Figure 4c,d correspond to the depth-hardness and actual-predicted curves for nanoindentation hardness, respectively. Both models were trained through 3000 and 6000 iterations, utilizing early stopping mechanisms to prevent overfitting. It is evident from Figure 4 that the prediction data increasingly converged with the actual data as the number of iterations rose. After training with 3000 iterations, the nanoindentation hardness model achieved an R2 value of 0.9945, indicating an exceptionally high correlation between the model predictions and the actual values. The corresponding RMSE was 0.13, signifying a relatively small discrepancy between predicted and actual values. For the Vickers hardness model, an R2 value of 0.9982 was attained after 6000 iterations of training, suggesting that the model could explain nearly all the variability. The RMSE for this model stood at 8.53, which was also comparatively low. Overall, the performance of both models was quite impressive, underscoring the effectiveness of employing neural networks for hardness modeling. This approach can be harnessed for the prediction of hardness and the analysis of material properties.

3.1. Validation of Nanoindentation–Vickers Hardness DNN Model

Utilizing two depth-hardness models, we generated a dataset comprising 25,000 pairs of nanoindentation and Vickers hardness data. A neural network model was established to analyze this dataset. Validation was conducted on four distinct neural network architectures—MLP, CNN, LSTM, and Transformer—from which we first obtained their training curves, as depicted in Figure 5. The experiment monitored the models’ loss curves throughout the training process, including both training and validation losses. In all cases, the training curves exhibited similar trends. Initially, both training and validation losses decreased rapidly, indicating that the models were effectively learning patterns from the training data during the initial learning phase. As the number of training epochs increased, the training loss continued to decrease, whereas the validation loss exhibited some fluctuations. These oscillations can arise when a model, particularly if it is of a high capacity, learns inconsistent features across different data subsets, introducing volatility into the loss curves. Despite these fluctuations, the overall trend was a decrease, signifying that the models were improving their performance on the validation set throughout the training process. More importantly, these oscillations did not necessarily affect the final experimental outcomes. Experimental results typically depend on a model’s final performance, rather than on every step of the entire training process. As long as there was a general downward trend in the MSE on the validation set, the model was considered to be improving.
Upon evaluation of the four fully trained models, as illustrated in Figure 6, the MLP, CNN, LSTM, and Transformer demonstrated varying performance in predicting Vickers hardness. The MLP model showed near-perfect prediction in both the actual vs. predicted plots (Figure 6a) and the predicted hardness plot (Figure 6b), achieving an R2 value of 1.0000 and an RMSE of just 0.10, indicating extremely high accuracy and minimal error in its predictions. The CNN model, with an R2 value of 0.9998 and an RMSE of 1.84, as shown in the actual vs. predicted plots (Figure 6c), also displayed high prediction precision in the predicted hardness plot (Figure 6d), although it was slightly less precise compared to the MLP model. The LSTM model maintained an R2 value of 1.0000 and an RMSE of 0.11 in the actual vs. predicted plots (Figure 6e), showcasing prediction capabilities on par with those of the MLP, and exhibited similar prediction trends to those of the MLP and CNN in the predicted hardness plot (Figure 6f). Lastly, the Transformer model’s performance, with an R2 value of 0.9975 and an RMSE of 6.54 in the actual vs. predicted plots (Figure 6g), although consistent with the actual hardness trend in the predicted hardness plot (Figure 6h), indicated a larger prediction error compared to those of the other models.
In summary, the MLP and LSTM models exhibited the highest accuracy and lowest error in predicting Vickers hardness, while the Transformer model performed slightly less well on these metrics. Interestingly, the LSTM model demonstrated high accuracy and low error in the predictions, which may be attributed to its design for handling and predicting significant events in time-series data, as it can learn long-term dependencies. This suggests that the Vickers hardness data may contain time-series characteristics or sequential patterns, which the LSTM is capable of capturing, thereby enhancing its predictive performance.
Table 2 and the corresponding radar chart (Figure 7) present a comparative performance analysis of the four neural network models: MLP, CNN, LSTM, and Transformer. The MLP had the shortest duration per iteration (0.25 s) and boasted the lowest mean squared error (MSE = 0.10) coupled with a perfect coefficient of determination (R2 = 1.00), indicating its efficiency and accuracy. Although the total training time for the MLP was relatively long (2469.2 s) and required a high number of iterations (10,000), it demonstrated high efficiency per iteration. In contrast, the CNN had a shorter total training time but less accuracy (MSE = 1.84). The LSTM was comparable to the MLP in terms of accuracy but had the longest training duration (4793.6 s). The Transformer, while faster, lacked in accuracy (MSE = 6.54), leading to its minimal representation on the radar chart in Figure 7. This visual anomaly was due to the scale of MSE values, where the Transformer’s significantly higher MSE resulted in a much lower score on the radar chart. Upon comprehensive consideration, given its outstanding iterative efficiency and accuracy, the MLP was the most suitable model under the conditions of this study.
Previous studies posited that the relationship between nanoindentation hardness and Vickers hardness is generally linear [59,60,61]. Observations from Figure 6 also suggest an approximately linear relationship. This correlation may persist regardless of its linearity due to material characteristics, testing errors, and inherent coupling effects. The capacity to refine accuracy by incorporating more data is precisely where the strength of neural networks lies. This adaptability to enhance precision with additional data input demonstrates the neural networks’ robustness in modeling complex relationships, even when they deviate from linearity.

3.2. Experimental Verification of DNN Models

The model developed in this study was validated on an established dataset to ensure its predictive accuracy within a specific parameter range. To further investigate the robustness of our model in predicting the hardness of M50NiL steel materials, our team implemented a series of laboratory-level validation measures. Moreover, to comprehensively evaluate the model’s generalization capabilities, we compared the performance of different steel grades under identical testing conditions. Table 3 and Table 4 document the data for these materials from Vickers hardness tests. Due to space constraints, not all test data could be listed in the tables. Within the hardness range designed for the model, namely 400–1000 HV, the model demonstrated a relatively precise predictive capability, with an error rate below 4%. However, beyond the dataset’s hardness range, particularly in regions above 1000 HV, the model’s prediction accuracy significantly decreased, revealing limitations when extrapolating to uncovered data. We believe that by further expanding the dataset to encompass a broader range of hardness, this issue might be effectively addressed.

4. Conclusions

In summary, our research on the prediction of hardness in M50NiL steel using deep neural network models led to several key findings:
  • Model Performance Comparison: The MLP and LSTM models demonstrated superior performance in terms of accuracy and error metrics, with the MLP showing particularly commendable iteration efficiency and precision in prediction. While the CNN model benefited from shorter training times, its accuracy was comparatively lower. The Transformer model was notably deficient in accuracy.
  • Applicability Across Steel Varieties: The developed predictive models proved effective not only for M50NiL steel but also for other types of steel, indicating a broad adaptability. This suggests that the neural network models we developed hold the potential for widespread application in the field of materials science.
  • Advancement in Measurement Techniques: This study supports the adoption of nanoindentation as a direct measurement method for HV hardness, particularly apt for thin films and areas with significant gradient variation. This method offers a more precise and convenient approach to determining hardness in materials with complex microstructures.
The demonstrated efficacy of MLP and LSTM models for predicting the hardness of various steels paves the way for the development of more sophisticated, real-time predictive algorithms in materials science. The potential expansion of these models to a wider range of materials, coupled with the precision offered by nanoindentation techniques, heralds a future of enhanced material design and smarter manufacturing processes tailored to specific performance criteria.
All the DNN models and codes mentioned in this study have been uploaded to the Supplementary Material section for the convenience of readers who wish to delve deeper into and utilize these technologies.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ma17010148/s1.

Author Contributions

J.N.: conceptualization, methodology, software, formal analysis, investigation, data curation, visualization, writing—original draft. B.M.: investigation, formal analysis, writing—review and editing. J.G.: investigation, writing—review and editing, visualization. Z.D.: resources, investigation, writing—review and editing. Y.H.: validation, writing—review and editing. Z.C.: investigation, validation. F.W.: investigation, validation. X.M.: project administration, conceptualization, supervision, writing—review and editing, funding acquisition. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China (NSFC), grant numbers 51971084 and 52031003. The APC was also funded by the NSFC.

Data Availability Statement

Data are contained within the article and Supplementary Material.

Acknowledgments

We express our gratitude to the National Natural Science Foundation of China for their financial support. Our special thanks to Harbin Institute of Technology’s Analytical and Testing Center and AECC Harbin Bearing Co., Ltd., for their invaluable support with testing equipment, significantly contributing to our research.

Conflicts of Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

References

  1. Olakanmi, E.O.T.; Cochrane, R.F.; Dalgarno, K.W. A review on selective laser sintering/melting (SLS/SLM) of aluminium alloy powders: Processing, microstructure, and properties. Prog. Mater. Sci. 2015, 74, 401–477. [Google Scholar] [CrossRef]
  2. Oliver, W.C.; Pharr, G.M. An improved technique for determining hardness and elastic modulus using load and displacement sensing indentation experiments. J. Mater. Res. 1992, 7, 1564–1583. [Google Scholar] [CrossRef]
  3. Liu, M.; Li, C.; Zhang, Y.; An, Q.; Yang, M.; Gao, T.; Mao, C.; Liu, B.; Cao, H.; Xu, X.; et al. Cryogenic minimum quantity lubrication machining: From mechanism to application. Front. Mech. Eng. 2021, 16, 649–697. [Google Scholar] [CrossRef]
  4. Elahinia, M.; Shayesteh Moghaddam, N.; Taheri Andani, M.; Amerinatanzi, A.; Bimber, B.A.; Hamilton, R.F. Fabrication of NiTi through additive manufacturing: A review. Prog. Mater. Sci. 2016, 83, 630–663. [Google Scholar] [CrossRef]
  5. Liu, W.; Wu, Y.; He, J.; Nieh, T.; Lu, Z. Grain growth and the Hall–Petch relationship in a high-entropy FeCrNiCoMn alloy. Scr. Mater. 2013, 68, 526–529. [Google Scholar] [CrossRef]
  6. Oliver, W.C.; Pharr, G.M. Measurement of hardness and elastic modulus by instrumented indentation: Advances in understanding and refinements to methodology. J. Mater. Res. 2004, 19, 3–20. [Google Scholar] [CrossRef]
  7. Schuh, B.; Mendez-Martin, F.; Völker, B.; George, E.P.; Clemens, H.; Pippan, R.; Hohenwarter, A. Mechanical properties, microstructure and thermal stability of a nanocrystalline CoCrFeMnNi high-entropy alloy after severe plastic deformation. Acta Mater. 2015, 96, 258–268. [Google Scholar] [CrossRef]
  8. Chuang, M.-H.; Tsai, M.-H.; Wang, W.-R.; Lin, S.-J.; Yeh, J.-W. Microstructure and wear behavior of AlxCo1.5CrFeNi1.5Tiy high-entropy alloys. Acta Mater. 2011, 59, 6308–6317. [Google Scholar] [CrossRef]
  9. Yeh, J.-W.; Chen, S.K.; Lin, S.-J.; Gan, J.-Y.; Chin, T.-S.; Shun, T.-T.; Tsau, C.-H.; Chang, S.-Y. Nanostructured High-Entropy Alloys with Multiple Principal Elements: Novel Alloy Design Concepts and Outcomes. Adv. Eng. Mater. 2004, 6, 299–303. [Google Scholar] [CrossRef]
  10. Zhang, Z.; Sui, M.; Li, C.; Zhou, Z.; Liu, B.; Chen, Y.; Said, Z.; Debnath, S.; Sharma, S. Residual stress of grinding cemented carbide using MoS2 nano-lubricant. Int. J. Adv. Manuf. Technol. 2022, 119, 5671–5685. [Google Scholar] [CrossRef]
  11. Wang, L.; Ma, Z.; Qiu, H.; Zhang, Y.; Yu, Z.; Gu, J. Significantly Enhanced Electromagnetic Interference Shielding Performances of Epoxy Nanocomposites with Long-Range Aligned Lamellar Structures. Nano-Micro Lett. 2022, 14, 224. [Google Scholar] [CrossRef] [PubMed]
  12. Galindo-Nava, E.; Rivera-Díaz-Del-Castillo, P. Understanding the factors controlling the hardness in martensitic steels. Scr. Mater. 2016, 110, 96–100. [Google Scholar] [CrossRef]
  13. Ben Ghorbal, G.; Tricoteaux, A.; Thuault, A.; Louis, G.; Chicot, D. Comparison of conventional Knoop and Vickers hardness of ceramic materials. J. Eur. Ceram. Soc. 2017, 37, 2531–2535. [Google Scholar] [CrossRef]
  14. Kang, S.-K.; Kim, J.-Y.; Park, C.-P.; Kim, H.-U.; Kwon, D. Conventional Vickers and true instrumented indentation hardness determined by instrumented indentation tests. J. Mater. Res. 2010, 25, 337–343. [Google Scholar] [CrossRef]
  15. Broitman, E. Indentation Hardness Measurements at Macro-, Micro-, and Nanoscale: A Critical Overview. Tribol. Lett. 2017, 65, 23. [Google Scholar] [CrossRef]
  16. Chaudhri, M.M. Indentation hardness of diamond single crystals, nanopolycrystal, and nanotwinned diamonds: A critical review. Diam. Relat. Mater. 2020, 109, 108076. [Google Scholar] [CrossRef]
  17. Watari, F.; Yokoyama, A.; Omori, M.; Hirai, T.; Kondo, H.; Uo, M.; Kawasaki, T. Biocompatibility of materials and development to functionally graded implant for bio-medical application. Compos. Sci. Technol. 2004, 64, 893–908. [Google Scholar] [CrossRef]
  18. Rautkari, L.; Laine, K.; Kutnar, A.; Medved, S.; Hughes, M. Hardness and density profile of surface densified and thermally modified Scots pine in relation to degree of densification. J. Mater. Sci. 2013, 48, 2370–2375. [Google Scholar] [CrossRef]
  19. Prabu, S.B.; Karunamoorthy, L.; Kathiresan, S.; Mohan, B. Influence of stirring speed and stirring time on distribution of particles in cast metal matrix composite. J. Am. Acad. Dermatol. 2006, 171, 268–273. [Google Scholar] [CrossRef]
  20. Prasad, D.S.; Shoba, C.; Ramanaiah, N. Investigations on mechanical properties of aluminum hybrid composites. J. Mater. Res. Technol. 2014, 3, 79–85. [Google Scholar] [CrossRef]
  21. Orrit-Prat, J.; Bonet, R.; Rupérez, E.; Punset, M.; Ortiz-Hernández, M.; Guillem-Marti, J.; Lousa, A.; Cano, D.; Díaz, C.; Fuentes, G.G.; et al. Bactericidal silver-doped DLC coatings obtained by pulsed filtered cathodic arc co-deposition. Surf. Coat. Technol. 2021, 411, 126977. [Google Scholar] [CrossRef]
  22. Kang, S.; Jung, Y.-S.; Jun, J.-H.; Lee, Y.-K. Effects of recrystallization annealing temperature on carbide precipitation, microstructure, and mechanical properties in Fe–18Mn–0.6C–1.5Al TWIP steel. Mater. Sci. Eng. A 2010, 527, 745–751. [Google Scholar] [CrossRef]
  23. Qin, Y.; Mayweg, D.; Tung, P.-Y.; Pippan, R.; Herbig, M. Mechanism of cementite decomposition in 100Cr6 bearing steels during high pressure torsion. Acta Mater. 2020, 201, 79–93. [Google Scholar] [CrossRef]
  24. Lin, J.; Moore, J.J.; Mishra, B.; Pinkas, M.; Sproul, W.D. The structure and mechanical and tribological properties of TiBCN nanocomposite coatings. Acta Mater. 2010, 58, 1554–1564. [Google Scholar] [CrossRef]
  25. Chicot, D.; Bemporad, E.; Galtieri, G.; Roudet, F.; Alvisi, M.; Lesage, J. Analysis of data from various indentation techniques for thin films intrinsic hardness modelling. Thin Solid Films 2008, 516, 1964–1971. [Google Scholar] [CrossRef]
  26. Lu, Y.; Su, Y.; Ge, W.; Yang, T.; Yan, Z.; Wang, Y.; Xia, S. Conversion between Vickers hardness and nanohardness by correcting projected area with sink-in and pile-up effects. Plasma Sci. Technol. 2020, 22, 065602. [Google Scholar] [CrossRef]
  27. Chen, H.; Cai, L.-X. Theoretical Conversions of Different Hardness and Tensile Strength for Ductile Materials Based on Stress–Strain Curves. Met. Mater. Trans. A 2018, 49, 1090–1101. [Google Scholar] [CrossRef]
  28. Gibson, R.F. A review of recent research on nanoindentation of polymer composites and their constituents. Compos. Sci. Technol. 2014, 105, 51–65. [Google Scholar] [CrossRef]
  29. Ma, Z.; Gamage, R.P.; Zhang, C. Application of nanoindentation technology in rocks: A review. Géoméch. Geophys. Geo-Energy Geo-Resour. 2020, 6, 60. [Google Scholar] [CrossRef]
  30. Hua, D.; Xia, Q.; Wang, W.; Zhou, Q.; Li, S.; Qian, D.; Shi, J.; Wang, H. Atomistic insights into the deformation mechanism of a CoCrNi medium entropy alloy under nanoindentation. Int. J. Plast. 2021, 142, 102997. [Google Scholar] [CrossRef]
  31. Voyiadjis, G.Z.; Yaghoobi, M. Review of Nanoindentation Size Effect: Experiments and Atomistic Simulation. Crystals 2017, 7, 321. [Google Scholar] [CrossRef]
  32. Liu, X.; Athanasiou, C.E.; Padture, N.P.; Sheldon, B.W.; Gao, H. A machine learning approach to fracture mechanics problems. Acta Mater. 2020, 190, 105–112. [Google Scholar] [CrossRef]
  33. Liu, H.; Liu, Z.; Jia, W.; Lin, X.; Zhang, S. A novel transformer-based neural network model for tool wear estimation. Meas. Sci. Technol. 2020, 31, 065106. [Google Scholar] [CrossRef]
  34. Cha, Y.; Choi, W.; Suh, G.; Mahmoudkhani, S.; Büyüköztürk, O. Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types: Autonomous SHM using deep faster R-CNN. Comput. Civ. Infrastruct. Eng. 2018, 33, 731–747. [Google Scholar] [CrossRef]
  35. Sadeghpour, E.; Nonn, A. Data-driven models for structure-property prediction in additively manufactured steels. Comput. Mater. Sci. 2022, 215, 111782. [Google Scholar] [CrossRef]
  36. Goh, G.B.; Hodas, N.O.; Vishnu, A. Deep learning for computational chemistry. J. Comput. Chem. 2017, 38, 1291–1307. [Google Scholar] [CrossRef] [PubMed]
  37. Cha, Y.; Choi, W.; Büyüköztürk, O. Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks: Deep learning-based crack damage detection using CNNs. Comput. Civ. Infrastruct. Eng. 2017, 32, 361–378. [Google Scholar] [CrossRef]
  38. Sanchez-Lengeling, B.; Aspuru-Guzik, A. Inverse molecular design using machine learning: Generative models for matter engineering. Science 2018, 361, 360–365. [Google Scholar] [CrossRef]
  39. Toyao, T.; Maeno, Z.; Takakusagi, S.; Kamachi, T.; Takigawa, I.; Shimizu, K.-I. Machine Learning for Catalysis Informatics: Recent Applications and Prospects. ACS Catal. 2020, 10, 2260–2297. [Google Scholar] [CrossRef]
  40. Huang, W.; Martin, P.; Zhuang, H.L. Machine-learning phase prediction of high-entropy alloys. Acta Mater. 2019, 169, 225–236. [Google Scholar] [CrossRef]
  41. Cecen, A.; Dai, H.; Yabansu, Y.C.; Kalidindi, S.R.; Song, L. Material structure-property linkages using three-dimensional convolutional neural networks. Acta Mater. 2018, 146, 76–84. [Google Scholar] [CrossRef]
  42. Moosavi, S.M.; Jablonka, K.M.; Smit, B. The Role of Machine Learning in the Understanding and Design of Materials. J. Am. Chem. Soc. 2020, 142, 20273–20287. [Google Scholar] [CrossRef] [PubMed]
  43. Yang, J.; Li, S.; Wang, Z.; Dong, H.; Wang, J.; Tang, S. Using Deep Learning to Detect Defects in Manufacturing: A Comprehensive Survey and Current Challenges. Materials 2020, 13, 5755. [Google Scholar] [CrossRef] [PubMed]
  44. Pathak, Y.; Juneja, K.S.; Varma, G.; Ehara, M.; Priyakumar, U.D.D. Deep learning enabled inorganic material generator. Phys. Chem. Chem. Phys. 2020, 22, 26935–26943. [Google Scholar] [CrossRef] [PubMed]
  45. Yu, Z.; Ye, S.; Sun, Y.; Zhao, H.; Feng, X.-Q. Deep learning method for predicting the mechanical properties of aluminum alloys with small data sets. Mater. Today Commun. 2021, 28, 102570. [Google Scholar] [CrossRef]
  46. Hu, J.; Song, Y. Piezoelectric modulus prediction using machine learning and graph neural networks. Chem. Phys. Lett. 2022, 791, 139359. [Google Scholar] [CrossRef]
  47. Rao, C.; Liu, Y. Three-dimensional convolutional neural network (3D-CNN) for heterogeneous material homogenization. Comput. Mater. Sci. 2020, 184, 109850. [Google Scholar] [CrossRef]
  48. Schütt, K.T.; Gastegger, M.; Tkatchenko, A.; Müller, K.-R.; Maurer, R.J. Unifying machine learning and quantum chemistry with a deep neural network for molecular wavefunctions. Nat. Commun. 2019, 10, 5024. [Google Scholar] [CrossRef]
  49. Karimi, K.; Salmenjoki, H.; Mulewska, K.; Kurpaska, L.; Kosińska, A.; Alava, M.J.; Papanikolaou, S. Prediction of steel nanohardness by using graph neural networks on surface polycrystallinity maps. Scr. Mater. 2023, 234, 115559. [Google Scholar] [CrossRef]
  50. Li, G.-M.; Liang, Y.-L.; Zhang, X.-F.; Sun, H.; Cao, Y.-G. Effect of the carburized layer on the plasma nitriding behavior of duplex treated M50NiL steel. Mater. Res. Express 2019, 6, 096550. [Google Scholar] [CrossRef]
  51. Li, G.-M.; Liang, Y.-L.; Sun, H.; Cao, Y.-G. Nitriding behavior and mechanical properties of carburizing and nitriding duplex treated M50NiL steel. Surf. Coat. Technol. 2020, 384, 125315. [Google Scholar] [CrossRef]
  52. Li, G.-M.; Liang, Y.-L.; Yin, C.-H.; Sun, H.; Zhu, Z.-L. Study of M50NiL steel under carburizing and nitriding duplex treatment. Surf. Coat. Technol. 2019, 375, 132–142. [Google Scholar] [CrossRef]
  53. Niu, J.; Zhang, X.; Ma, X.; Liu, Y.; Wang, L.; Wu, T. Characterization of vein-like structures formed in nitrided layers during plasma nitriding of 8Cr4Mo4V steel. Materialia 2022, 22, 101378. [Google Scholar] [CrossRef]
  54. Niu, J.; Qureshi, M.W.; Ding, Z.; Ma, X.; He, Y. Effect of nitriding on the transformation of alloy carbides (VC and Mo2C) in 8Cr4Mo4V steel. Appl. Surf. Sci. 2023, 610, 155561. [Google Scholar] [CrossRef]
  55. Li, Y.; He, Y.; Xiu, J.; Wang, W.; Zhu, Y.; Hu, B. Wear and corrosion properties of AISI 420 martensitic stainless steel treated by active screen plasma nitriding. Surf. Coat. Technol. 2017, 329, 184–192. [Google Scholar] [CrossRef]
  56. Andor, D.; Alberti, C.; Weiss, D.; Severyn, A.; Presta, A.; Ganchev, K.; Petrov, S.; Collins, M. Globally Normalized Transition-Based Neural Networks. arXiv 2016, arXiv:1603.06042. [Google Scholar]
  57. Abadi, M.; Barham, P.; Chen, J.; Chen, Z.; Davis, A.; Dean, J.; Devin, M.; Ghemawat, S.; Irving, G.; Isard, M.; et al. TensorFlow: A system for large-scale machine learning. arXiv 2016, arXiv:1605.08695. [Google Scholar]
  58. Abadi, M.; Agarwal, A.; Barham, P.; Brevdo, E.; Chen, Z.; Citro, C.; Corrado, G.S.; Davis, A.; Dean, J.; Devin, M.; et al. TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. arXiv 2016, arXiv:1603.04467. [Google Scholar]
  59. Yang, Y.; Zhang, C.; Ding, Z.; Su, C.; Yan, T.; Song, Y.; Cheng, Y. A correlation between micro- and nano-indentation on materials irradiated by high-energy heavy ions. J. Nucl. Mater. 2018, 498, 129–136. [Google Scholar] [CrossRef]
  60. Ding, Z.; Zhang, C.; Yang, Y.; Song, Y.; Kimura, A.; Jang, J. Hardening of ODS ferritic steels under irradiation with high-energy heavy ions. J. Nucl. Mater. 2017, 493, 53–61. [Google Scholar] [CrossRef]
  61. Geng, D.; Yu, H.; Kondo, S.; Kasada, R. Toward the correlation of indentation hardness in micro- and nano-scale: Understanding of indentation edge behaviors in Fe–Cr alloys. J. Mater. Sci. 2022, 57, 13736–13755. [Google Scholar] [CrossRef]
Figure 1. OM and SEM images used for calibrating indenter positions in Vickers and nanoindentation hardness tests. (a,b) are OM images for Vickers and nanoindentation tests; (c,d) are SEM images for the same.
Figure 1. OM and SEM images used for calibrating indenter positions in Vickers and nanoindentation hardness tests. (a,b) are OM images for Vickers and nanoindentation tests; (c,d) are SEM images for the same.
Materials 17 00148 g001
Figure 2. Schematic representation of the DNN model-development process.
Figure 2. Schematic representation of the DNN model-development process.
Materials 17 00148 g002
Figure 3. Pearson correlation charts for (a) nanohardness and (b) Vickers hardness against nitriding depth. Correlation coefficients are −0.863 for nanohardness and −0.911 for Vickers hardness, indicating a strong negative correlation with depth for both hardness measures.
Figure 3. Pearson correlation charts for (a) nanohardness and (b) Vickers hardness against nitriding depth. Correlation coefficients are −0.863 for nanohardness and −0.911 for Vickers hardness, indicating a strong negative correlation with depth for both hardness measures.
Materials 17 00148 g003
Figure 4. Neural network model predictions for depth vs. hardness. (a) Depth-hardness curve for Vickers hardness, (b) actual vs. predicted Vickers hardness, (c) depth-hardness curve for nanoindentation hardness, (d) actual vs. predicted nanoindentation hardness. Models were trained with early stopping to avoid overfitting, showing high correlation between predictions and actual measurements.
Figure 4. Neural network model predictions for depth vs. hardness. (a) Depth-hardness curve for Vickers hardness, (b) actual vs. predicted Vickers hardness, (c) depth-hardness curve for nanoindentation hardness, (d) actual vs. predicted nanoindentation hardness. Models were trained with early stopping to avoid overfitting, showing high correlation between predictions and actual measurements.
Materials 17 00148 g004
Figure 5. Training and validation loss curves for neural network models on a nanoindentation–Vickers hardness dataset. (a) MLP model showing loss over 10,000 epochs; (b) CNN model with loss over 5000 epochs; (c) LSTM model depicting loss across 7500 epochs; (d) Transformer model’s loss observed for 3000 epochs. Each subplot illustrates the initial rapid decrease in loss, followed by stabilization or fluctuations as training progresses.
Figure 5. Training and validation loss curves for neural network models on a nanoindentation–Vickers hardness dataset. (a) MLP model showing loss over 10,000 epochs; (b) CNN model with loss over 5000 epochs; (c) LSTM model depicting loss across 7500 epochs; (d) Transformer model’s loss observed for 3000 epochs. Each subplot illustrates the initial rapid decrease in loss, followed by stabilization or fluctuations as training progresses.
Materials 17 00148 g005
Figure 6. Comparison of machine learning models for Vickers hardness prediction: (a) MLP accuracy, (b) MLP predicted vs. nanohardness, (c) CNN accuracy, (d) CNN predicted vs. nanohardness, (e) LSTM accuracy, (f) LSTM predicted vs. nanohardness, (g) Transformer accuracy, (h) Transformer predicted vs. nanohardness.
Figure 6. Comparison of machine learning models for Vickers hardness prediction: (a) MLP accuracy, (b) MLP predicted vs. nanohardness, (c) CNN accuracy, (d) CNN predicted vs. nanohardness, (e) LSTM accuracy, (f) LSTM predicted vs. nanohardness, (g) Transformer accuracy, (h) Transformer predicted vs. nanohardness.
Materials 17 00148 g006
Figure 7. Radar chart comparing the performance of MLP, CNN, LSTM, and Transformer models on metrics of time, epochs, time per epoch, MSE, and R2.
Figure 7. Radar chart comparing the performance of MLP, CNN, LSTM, and Transformer models on metrics of time, epochs, time per epoch, MSE, and R2.
Materials 17 00148 g007
Table 1. Chemical composition (in wt.%) of M50NiL steel.
Table 1. Chemical composition (in wt.%) of M50NiL steel.
CCrMoVNiMnSiFe
0.134.14.21.24.20.130.18Bal.
Table 2. Performance comparison of four different machine learning models—MLP, CNN, LSTM, and Transformer—in terms of training time, number of epochs, time per epoch, coefficient of determination (R2), and mean squared error (MSE) for predicting Vickers hardness within the range of 400–1000 HV.
Table 2. Performance comparison of four different machine learning models—MLP, CNN, LSTM, and Transformer—in terms of training time, number of epochs, time per epoch, coefficient of determination (R2), and mean squared error (MSE) for predicting Vickers hardness within the range of 400–1000 HV.
Time (s)EpochTime/Epoch(s)MSER2
MLP2469.210,0000.25 0.101.0000
CNN1291.850000.26 1.840.9998
LSTM4793.675000.64 0.111.0000
Transformer1790.530000.60 6.540.9975
Table 3. Predicted, actual, and error values for the Vickers hardness within the range of 400–1000 HV.
Table 3. Predicted, actual, and error values for the Vickers hardness within the range of 400–1000 HV.
M50NiLM50NiL CarburizingM50NiL Carburized and NitridingM50M50 NitridingOthers
Predicted453.6517.4651.8660.2713.0819.3924.5965.6750.5842.8924.8/
Actual4605156456707308309401000740860935/
Errors1.40%0.46%1.05%1.47%2.33%1.33%1.70%3.50%1.41%2.01%1.10%1.80%
Table 4. Predicted, actual. and error values for Vickers hardness outside the range of 400–1000 HV.
Table 4. Predicted, actual. and error values for Vickers hardness outside the range of 400–1000 HV.
M50 Nitriding Compound LayerM50 Nitriding Diffusion LayerOthers
Predicted965965965965965965///
Actual135013401290110011101090///
Errors28.52%27.99%25.19%12.27%13.06%11.47%30.29%27.38%41.56%
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Niu, J.; Miao, B.; Guo, J.; Ding, Z.; He, Y.; Chi, Z.; Wang, F.; Ma, X. Leveraging Deep Neural Networks for Estimating Vickers Hardness from Nanoindentation Hardness. Materials 2024, 17, 148. https://doi.org/10.3390/ma17010148

AMA Style

Niu J, Miao B, Guo J, Ding Z, He Y, Chi Z, Wang F, Ma X. Leveraging Deep Neural Networks for Estimating Vickers Hardness from Nanoindentation Hardness. Materials. 2024; 17(1):148. https://doi.org/10.3390/ma17010148

Chicago/Turabian Style

Niu, Junbo, Bin Miao, Jiaxu Guo, Zhifeng Ding, Yin He, Zhiyu Chi, Feilong Wang, and Xinxin Ma. 2024. "Leveraging Deep Neural Networks for Estimating Vickers Hardness from Nanoindentation Hardness" Materials 17, no. 1: 148. https://doi.org/10.3390/ma17010148

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop