Next Article in Journal
Exploratory Study of Sex Identification for Chicken Embryos Based on Blood Vessel Images and Deep Learning
Next Article in Special Issue
Design of Wireless Sensor Network for Agricultural Greenhouse Based on Improved Zigbee Protocol
Previous Article in Journal
Harnessing the Power of Transfer Learning in Sunflower Disease Detection: A Comparative Study
Previous Article in Special Issue
Tea Bud Detection and 3D Pose Estimation in the Field with a Depth Camera Based on Improved YOLOv5 and the Optimal Pose-Vertices Search Method
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Communication

Predicting Models for Plant Metabolites Based on PLSR, AdaBoost, XGBoost, and LightGBM Algorithms Using Hyperspectral Imaging of Brassica juncea

1
Smart Farm Research Center, Korea Institute of Science and Technology (KIST), Saimdang-ro 679, Gangneung 25451, Republic of Korea
2
Department of Bio-Medical Science & Technology, University of Science and Technology, Seoul 02792, Republic of Korea
3
Department of Smart Farm Science, Kyung Hee University, Yongin 17104, Republic of Korea
*
Author to whom correspondence should be addressed.
Agriculture 2023, 13(8), 1477; https://doi.org/10.3390/agriculture13081477
Submission received: 24 May 2023 / Revised: 29 June 2023 / Accepted: 29 June 2023 / Published: 26 July 2023
(This article belongs to the Special Issue Advances in Agricultural Engineering Technologies and Application)

Abstract

:
The integration of hyperspectral imaging with machine learning algorithms has presented a promising strategy for the non-invasive and rapid detection of plant metabolites. For this study, we developed prediction models using partial least squares regression (PLSR) and boosting algo-rithms (such as AdaBoost, XGBoost, and LightGBM) for five metabolites in Brassica juncea leaves: total chlorophyll, phenolics, flavonoids, glucosinolates, and anthocyanins. To enhance the model performance, we employed several spectral data preprocessing methods and feature-selection al-gorithms. Our results showed that the boosting algorithms generally outperformed the PLSR models in terms of prediction accuracy. In particular, the LightGBM model for chlorophyll and the AdaBoost model for flavonoids improved the prediction performance, with R2p = 0.71–0.74, com-pared to the PLSR models (R2p = 0.53–0.58). The final models for the glucosinolates and anthocya-nins performed sufficiently for practical uses such as screening, with R2p = 0.82–0.85 and RPD = 2.4–2.6. Our findings indicate that the application of a single preprocessing method is more effective than utilizing multiple techniques. Additionally, the boosting algorithms with feature selection ex-hibited superior performance compared to the PLSR models in the majority of cases. These results highlight the potential of hyperspectral imaging and machine learning algorithms for the non-destructive and rapid detection of plant metabolites, which could have significant implications for the field of smart agriculture.

1. Introduction

Mustard (Brassica juncea), also commonly known as Chinese mustard, brown mustard, leaf mustard, vegetable mustard, and oriental mustard, is an annual plant that belongs to the Brassicaceae family [1]. Mustard contains bioactive components such as glucosinolates and their degradation products; polyphenols (flavonoids and anthocyanins); and large amounts of dietary fiber, chlorophyll, β-carotene, ascorbic acid, minerals, and volatile components [2]. Mustard is used as a spice because of its pungent taste. It also has important uses in medicine; its leaves are used as a diuretic, stimulant, and expectorant in folk medicine. Previous studies have found that B. juncea has bactericidal properties, can reduce the risk of atherosclerosis, and has antioxidant- and peroxynitrite-scavenging effects [1,3]. Additionally, B. juncea has exhibited antibacterial and antitumor properties and has been shown to improve various metabolic disorders [4]. Despite its excellent bioactivity, its industrial use as a raw material for medicine is limited by traditional analytical techniques, which are time-consuming and destructive. Therefore, a non-destructive method of determining bioactive compound contents should be developed for quality control in the production stage.
Recently, hyperspectral imaging has been used for the assessment of the biophysical traits of plants. Spectral information from hyperspectral images can be combined with various data processing and mining tools to ensure fast, non-destructive, and highly accurate detection of functional component contents [5]. Preprocessing of spectral data is an important step for suppressing the undesired effects of measurement conditions and enhancing relevant features, which commonly contain normalization, derivatives, and smoothing [6]. Partial least squares regression (PLSR) is a widely used method to analyze large amounts of hyperspectral data and predict functional components in plants, such as chlorophyll and carotenoids in spinach [7] or total polyphenols in cocoa beans [8]. In our previous study, we aimed to develop a predictive model for the functional components of mustard plants using a PLSR prediction model based on hyperspectral images and preprocessing techniques [9]. In that study, we found that a preprocessing combination of SNV transformation and 1st-Der with spectral data resulted in high-performance prediction models for the total chlorophyll, carotenoid, and glucosinolate contents, while a preprocessing combination of the S.G. filter and SNV transformation gave the highest prediction rate for the total phenolics. However, the accuracy of this model was limited because the amount of data was relatively small and it was only applied in an indoor environment.
Machine learning techniques, combined with hyperspectral imaging, have been extensively used for the determination of food quality [10], such as identifying contaminants in food [11]. Among them, boosting methods in ensemble learning are attracting attention for their outstanding performance and have paved the way for data analysis. Boosting algorithms, such as those for adaptive boosting (AdaBoost), extreme gradient boosting (XGBoost), and the light gradient-boosting model (LightGBM), have performed well in hyperspectral imaging-based data classification tasks [12,13]. Effective training of machine learning models usually requires abundant data for a more accurate predictive model [14]. To train the model and improve the accuracy of the PLSR prediction model for functional components such as chlorophyll, phenolics, flavonoids, glucosinolates, and anthocyanins in mustard plants, we first acquired more hyperspectral imaging data of plant leaves. For this study, we aimed to develop a model with excellent predictive performance by adding enough training data to apply boosting algorithms and applying a combination of data processing methods. This analysis has expanded upon the previous study by including the prediction of the total phenolic components, which was not previously considered. However, the prediction of the total carotenoids was excluded from the current study due to its poor performance in the previous study. To apply the developed model and predict functional components in the growing environment, hyperspectral images were measured from various angles.

2. Materials and Methods

2.1. Training Data Acquisition

The plant growth conditions and analysis methods used for this study were the same as those described in detail in the previous study [9]. Briefly, mustard plants (B. juncea L. Czern.) were cultivated in three different environments. Plants in an indoor farm were hydroponically grown under mixed LEDs and with Hoagland nutrient solution. Plants in a greenhouse and an open field were grown in pots filled with commercial soil and fertilizer. Fifteen plants from each cultivation environment were harvested for 4 weeks after the transplant to ensure variation in growth stage and leaf color. A total of 122 fully expanded leaves were collected for analysis.
As with the experimental setup in the previous study [9], the hyperspectral imaging system consisted of a hyperspectral imaging camera (MicroHSI 410 SHARK; Corning Inc., Corning, NY, USA) and eight 15 W halogen lamps. A total of 112 hyperspectral images were acquired, with 1408 spatial pixels and 150 spectral bands in the range of 400–1000 nm. After the hyperspectral imaging data were obtained, the leaves were freeze-dried for 4 days and powdered for component analysis [9,15]. The powder obtained using pulverization after freeze-drying was subdivided into 3 repetitions of 20 mg each and used for the analysis of 5 functional components. Briefly, the previous methods were used for the determination of the total chlorophyll content [16], total phenolic content [17], total flavonoid content [18], total glucosinolate content [19], and total anthocyanin content [20]. As a result of the component analysis, analysis values with high degrees of variation in content were excluded, and the average value of the rest was used as the component value for model development.

2.2. Data Processing and Prediction Models

The average of the spectral data was extracted from hyperspectral images within predefined regions of interest, as in the previous method [9]. The average spectral data of 150 bands for each of the 112 hyperspectral images were obtained [9]. The preprocessing methods, used alone or in combination (Table S1), included normalization, logarithmic transformation, a Savitzky–Golay filter, the 1st and 2nd derivative after SG filtering, multiplicative scatter correction (MSC), and standard normal variate (SNV) transformation. The SG filter was applied with a three-order polynomial fit with five data points, using the SciPy package in Python 3.9. A total of 36 preprocessing combinations were used to prepare the spectral data for the development of the predictive models.
Partial least squares regression (PLSR), adaptive boosting (AdaBoost), extreme gradient boosting (XGboost), and light gradient boosting model (LightGBM) algorithms were applied to predict the content of each metabolite in the plants. PLSR is a method that is commonly used to predict metabolite content from hyperspectral data. It works by extracting latent variables (LVs), which are linear combinations of original predictor variables that capture the maximum variation in data. The number of LVs is chosen based on the optimal performance of the relevant model, which is typically determined through cross-validation.
AdaBoost, XGboost, and LightGBM are boosting algorithms that are also commonly used for regression tasks [21,22,23]. Boosting algorithms combine multiple weak learners (e.g., decision trees) into a strong learner, which improves the accuracy of predictions. In this study, boosting algorithms were used for both feature selection and regression.
To reduce redundant information in the hyperspectral data, feature selection based on the importance of boosting was used. Only bands with a feature importance value greater than 1.25 times the average value were selected. The implementation of model development was programmed using the Scikit-learn, XGboost, and LightGBM packages in Python 3.9.
The preprocessing and feature-selection methods were determined, and the parameters for all of the algorithms were optimized after tenfold cross-validation based on the training dataset, corresponding to 80% of the data. After hyperparameter tuning, the performance of the final model was tested with an independent validation dataset that corresponded to 20% of the data. The model performance was evaluated based on the coefficient of determination (R2) and the root mean square error (RMSE), as follows:
R 2 = 1 i = 1 n ( y ^ i y i ) 2 i = 1 n y i y ¯ 2
R M S E = 1 n i = 1 n ( y ^ i y i ) 2
where y i is the measured value of the component analysis; y ^ i is the value predicted by the model; y ¯ is the mean value of the component analysis; and n is the number of samples.

3. Results and Discussion

3.1. Development of a Prediction Model Based on Hyperspectral Imaging with the PLSR, AdaBoost, XGboost, and LightGBM Algorithms

The total chlorophyll, phenolic, flavonoid, glucosinolate, and anthocyanin contents in the B. juncea plants are summarized in Table 1. The reflectance spectra of 112 leaves were obtained by averaging the hyperspectral data, followed by preprocessing, as shown in Figure 1. In the spectra of the B. juncea leaves, the green and red regions were relatively low and high, respectively, compared to those of a typical green leaf. These different spectra could be caused by the absolute contents and ratio of chlorophyll and anthocyanin in the leaf [24]. The plant used in this study was a red mustard cultivar with purple–green leaves and a high anthocyanin content (Table 1).
PLSR models for five metabolites were developed using 36 preprocessing methods (Table S1). The optimal combination of preprocessing methods for each of the five PLSR models, as well as the optimal number of latent variables (LVs) for each component, was determined based on the low root mean square error of cross-validation (RMSECV) values, as shown in Table 2. Spectral preprocessing is an essential step in order to avoid undesirable scattering effects and reveal signals that correspond to chemical components [25]. The appropriate preprocessing method will depend on various factors, including the wavelength range and interval, the prediction model, the target compound, and the plant organs used, such as leaves and fruits. In previous studies, the performance of the PLSR model in detecting total phenolic content using a VIS-NIR hyperspectral imaging system was improved with the normalization method in apple fruits [26] and with the SG filter and derivative transformation in Arabidopsis leaves [27]. Derivative transforms emphasize spectral features but also emphasize the noise of data. The first and second derivatives removed an additive and a linear baseline, respectively. Logarithmic transformation can be employed to address a non-linear problem. In a previous study using the SWIR hyperspectral imaging system, the logarithmic transformation Log (1/R) improved the performance of the PLSR model for the ABA content in zucchini leaves [28]. MSC and SNV transformation are useful in reducing spectral variability due to scattering and baseline shifts. To further improve model performance, spectral preprocessing methods can be used in combination [9]. In this study, the prediction performance of the PLSR model was higher with the single preprocessing methods than with combinations of multiple methods (Table 2).
The AdaBoost, XGboost, and LightGBM prediction models were also developed using 36 preprocessing methods. The best preprocessing method for each algorithm and metabolite was determined based on low RMSECV values (Table S2). After that, the prediction models were compared according to the selection of three features (bands) based on the feature importance in the boosting algorithms (Table 3). The spectral bands that were reduced by the algorithms made the performances of several models better compared with the full bands. Hyperspectral data require band selection due to the large amount of highly correlated and redundant information. Reducing the number of features, even to less than 20% of the total band, can enhance the performance of a regression algorithm [28,29]. Combinations of different feature-selection and regression algorithms can improve model accuracy [30].
The importance values for selecting the features of each best performance model are given in Figure 2. For chlorophyll prediction, the highest importance was at 480.57 nm, followed by 916.83 nm, among 17 bands selected based on the XGBoost algorithm with 1st Der processing data. For phenolic prediction, the feature importance was the highest at 904.82 nm, followed by 760.73 nm, among 28 bands selected based on the LightGBM algorithm with Norm processing data. The selected features were distributed in the ranges of 488.57–544.61 nm and 672.68–992.87 nm, respectively. For flavonoid prediction, the feature importance was the highest at 692.69 nm, followed by 608.64 nm, among 33 bands selected based on the AdaBoost algorithm with 2nd Der processing data. The feature importance for glucosinolate prediction was concentrated in the range of 870–900 nm. The highest importance values were, in order, at 872.80, 896.81, 880.8, and 628.66 nm among 28 bands selected based on the AdaBoost algorithm with SNV processing data. For anthocyanin prediction, the feature importance was the highest at 924.83 nm among 37 bands selected with the LightGBM algorithm with Log (1/R), 1st Der, and MSC processing data. The features were selected depending on the spectral data preprocessing method as well as the selection algorithm.
Overall, the boosting algorithms showed better prediction performances compared to the PLSR models (Table 2 and Table 3). Specifically, the LightGBM model was found to be the best for predicting chlorophyll, while the AdaBoost model was the best for predicting phenolics, flavonoids, glucosinolates, and anthocyanins. The boosting models performed better than the best PLSR models, except when it came to anthocyanins, where the PLSR models showed better performances. The performances of the best prediction models for five metabolites are given in Figure 3. The best model for chlorophyll was the 1st Der processing–XGBoost selection–LightGBM prediction model with 17 bands selected (R2P = 0.737, RMSEP = 1.052). The best model for phenolics was the Norm processing–LightGBM selection–AdaBoost prediction model with 28 bands selected (R2P = 0.594, RMSEP = 1.426). For flavonoids, the 2nd Der processing–AdaBoost selection–AdaBoost prediction model with 33 bands selected performed the best (R2P = 0.709, RMSEP = 1.417). For glucosinolates, the SNV processing–AdaBoost selection–AdaBoost prediction model with 28 bands selected was best (R2P = 0.816, RMSEP = 4.744). The best boosting model for anthocyanins was the Log (1/R)–1st Der-MSC processing–LightGBM selection–AdaBoost prediction model with 37 bands selected (R2P = 0.824, RMSEP = 1.876). The best PLSR model for anthocyanins was that with 9 LVs and using Log (1/R)–SG filter–MSC processing data, which had the highest performance of all of the models (R2P = 0.850, RMSEP = 1.728). The ratio of prediction to deviation (RPD) value of the final AdaBoost models for glucosinolates and anthocyanins was 2.4, which indicates that these models are sufficient for practical screening applications [31,32]. However, the best PLSR model for anthocyanins performed even better, with an RPD value of 2.6. It is worth noting that the selection of the best model depended on various factors, including the spectral data preprocessing method and the selection algorithm used.

3.2. Application of the Functional Component Prediction Model with Visualization

Prediction models based on hyperspectral imaging are used to predict content at a single-pixel level and generate compound distribution maps. The prediction model developed here was applied to actual plants that were grown and utilized the spectrum of every pixel. The spatial distribution of five metabolites was found to be uneven across the leaf area (Figure 4). Yuan et al. (2021) visualized the distribution of SPAD values, which indicate chlorophyll content in pepper leaves [29]. The distribution of the total phenolics has been visualized using hyperspectral imaging and modeling in Arabidopsis plants [27] and shelled cocoa beans [8]. Hence, by employing a hyperspectral imaging system and the necessary software to run the algorithm, we could non-destructively and continuously monitor the compound distribution. This phytochemical monitoring will aid in making cultivation decisions to effectively control the quality of functional plants.

4. Conclusions

A prediction model using hyperspectral imaging was developed based on PLSR and boosting algorithms such as AdaBoost, XGboost, and LightGBM to predict five metabolites in B. juncea: total chlorophyll, phenolics, flavonoids, glucosinolates, and anthocyanins. To improve the model performance, various spectral data preprocessing methods and feature-selection algorithms were adopted. The prediction performance was higher with the single preprocessing methods than with combinations of multiple PLSR- and boosting-model methods. Feature selection based on boosting algorithms could improve prediction performance. The cross-validation and prediction performances were better in the boosting algorithms than in the PLSR models, except regarding anthocyanin prediction. The final models for glucosinolates and anthocyanins especially performed sufficiently for practical use such as screening, as R2p = 0.82–0.85 and RPD = 2.4–2.6. This research presents a promising approach for the rapid and accurate prediction of metabolites in plants using hyperspectral imaging, which can contribute to the development of precision agriculture and plant breeding.
Overall, our results showed that boosting algorithms can be applied to predict the functional components of medicinal plants. Many studies have compared spectral data preprocessing methods and tried to improve prediction performance. We have confirmed that prediction performance can be improved by reducing spectral bands with a feature-selection algorithm. To develop faster and more accurate prediction techniques, it is necessary to continuously introduce the latest algorithms and data processing methods. Based on hyperspectral images, non-destructive monitoring techniques of functional components can be used as tools for quality control in the field of smart agriculture, including in the medicinal plant industry.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/agriculture13081477/s1, Table S1: List of preprocessing methods for hyperspectral data of B. juncea plants; Table S2: Determination of preprocessing methods for AdaBoost, XGBoost, and LightGBM prediction algorithms for five metabolites in B. juncea plants.

Author Contributions

Conceptualization, S.H.P. and S.M.K.; funding acquisition, S.M.K.; investigation, S.H.P. and H.I.Y.; methodology, H.I.Y., J.-H.C., D.-H.J., J.-E.P. and Y.J.P.; project administration, S.H.P.; software, H.I.Y. and H.L.; validation, H.I.Y. and S.H.P.; writing—original draft, H.I.Y. and S.H.P.; review and editing, H.I.Y., J.-S.Y. and S.H.P. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Korean Institute of Planning and Evaluation for Technology in Food, Agriculture and Forestry (IPET) and by the Korean Smart Farm R&D Foundation (KosFarm) through the Smart Farm Innovation Technology Development Program, funded by the Ministry of Agriculture, Food and Rural Affairs (MAFRA), the Ministry of Science and ICT (MSIT), and the Rural Development Administration (RDA) (421034-04).

Institutional Review Board Statement

Not applicable.

Data Availability Statement

The original contributions presented in this study are included in the article and Supplementary Materials; further inquiries can be directed to the corresponding authors.

Conflicts of Interest

The authors declare that this research was conducted in the absence of any commercial or financial relationships that could be construed as potential conflicts of interest.

References

  1. Szőllősi, R. Indian Mustard (Brassica juncea L.) Seeds in Health. In Nuts and Seeds in Health and Disease Prevention; Academic Press: Cambridge, MA, USA, 2020; pp. 357–364. [Google Scholar]
  2. Tian, Y.; Deng, F. Phytochemistry and Biological Activity of Mustard (Brassica juncea): A Review. CyTA—J. Food 2020, 18, 704–718. [Google Scholar] [CrossRef]
  3. Kumar, V.; Kumar Thakur, A.; Dev Barothia, N.; Chatterjee, S.S. Therapeutic Potentials of Brassica juncea: An Overview. CellMed 2011, 1, e2. [Google Scholar] [CrossRef] [Green Version]
  4. Park, C.H.; Park, Y.E.; Yeo, H.J.; Kim, J.K.; Park, S.U. Effects of Light-Emitting Diodes on the Accumulation of Phenolic Compounds and Glucosinolates in Brassica juncea Sprouts. Horticulturae 2020, 6, 77. [Google Scholar] [CrossRef]
  5. Sarić, R.; Nguyen, V.D.; Burge, T.; Berkowitz, O.; Trtílek, M.; Whelan, J.; Lewsey, M.G.; Čustović, E. Applications of Hyperspectral Imaging in Plant Phenotyping. Trends Plant Sci. 2022, 27, 301–315. [Google Scholar] [CrossRef] [PubMed]
  6. Beć, K.B.; Grabska, J.; Bonn, G.K.; Popp, M.; Huck, C.W. Principles and Applications of Vibrational Spectroscopic Imaging in Plant Science: A Review. Front. Plant Sci. 2020, 11, 1226. [Google Scholar] [CrossRef]
  7. Zhang, C.; Wang, Q.; Liu, F.; He, Y.; Xiao, Y. Rapid and Non-Destructive Measurement of Spinach Pigments Content during Storage Using Hyperspectral Imaging with Chemometrics. Measurement 2017, 97, 149–155. [Google Scholar] [CrossRef]
  8. Caporaso, N.; Whitworth, M.B.; Fowler, M.S.; Fisk, I.D. Hyperspectral Imaging for Non-Destructive Prediction of Fermentation Index, Polyphenol Content and Antioxidant Activity in Single Cocoa Beans. Food Chem. 2018, 258, 343–351. [Google Scholar] [CrossRef]
  9. Choi, J.-H.; Park, S.H.; Jung, D.-H.; Park, Y.J.; Yang, J.-S.; Park, J.-E.; Lee, H.; Kim, S.M. Hyperspectral Imaging-Based Multiple Predicting Models for Functional Component Contents in Brassica juncea. Agriculture 2022, 12, 1515. [Google Scholar] [CrossRef]
  10. Saha, D.; Manickavasagan, A. Machine Learning Techniques for Analysis of Hyperspectral Images to Determine Quality of Food Products: A Review. Curr. Res. Food Sci. 2021, 4, 28–44. [Google Scholar] [CrossRef]
  11. Bonifazi, G.; Capobianco, G.; Gasbarrone, R.; Serranti, S. Contaminant Detection in Pistachio Nuts by Different Classification Methods Applied to Short-Wave Infrared Hyperspectral Images. Food Control 2021, 130, 108202. [Google Scholar] [CrossRef]
  12. Jafarzadeh, H.; Mahdianpari, M.; Gill, E.; Mohammadimanesh, F.; Homayouni, S. Bagging and Boosting Ensemble Classifiers for Classification of Multispectral, Hyperspectral and PolSAR Data: A Comparative Evaluation. Remote Sens. 2021, 13, 4405. [Google Scholar] [CrossRef]
  13. Weksler, S.; Rozenstein, O.; Haish, N.; Moshelion, M.; Wallach, R.; Ben-Dor, E. Detection of Potassium Deficiency and Momentary Transpiration Rate Estimation at Early Growth Stages Using Proximal Hyperspectral Imaging and Extreme Gradient Boosting. Sensors 2021, 21, 958. [Google Scholar] [CrossRef]
  14. Sha, W.; Guo, Y.; Yuan, Q.; Tang, S.; Zhang, X.; Lu, S.; Guo, X.; Cao, Y.-C.; Cheng, S. Artificial Intelligence to Power the Future of Materials Science and Engineering. Adv. Intell. Syst. 2020, 2, 1900143. [Google Scholar] [CrossRef] [Green Version]
  15. Park, Y.J.; Park, J.-E.; Truong, T.Q.; Koo, S.Y.; Choi, J.-H.; Kim, S.M. Effect of Chlorella Vulgaris on the Growth and Phytochemical Contents of “Red Russian” Kale (Brassica napus Var. Pabularia). Agronomy 2022, 12, 2138. [Google Scholar] [CrossRef]
  16. Lichtenthaler, H.K.; Buschmann, C. Chlorophylls and Carotenoids: Measurement and Characterization by UV-VIS Spectroscopy. Curr. Protoc. Food Anal. Chem. 2001, 1, F4.3.1–F4.3.8. [Google Scholar] [CrossRef]
  17. Thomas, M.; Badr, A.; Desjardins, Y.; Gosselin, A.; Angers, P. Characterization of Industrial Broccoli Discards (Brassica oleracea Var. Italica) for Their Glucosinolate, Polyphenol and Flavonoid Contents Using UPLC MS/MS and Spectrophotometric Methods. Food Chem. 2018, 245, 1204–1211. [Google Scholar] [CrossRef]
  18. Dewanto, V.; Xianzhong, W.; Adom, K.K.; Liu, R.H. Thermal Processing Enhances the Nutritional Value of Tomatoes by Increasing Total Antioxidant Activity. J. Agric. Food Chem. 2002, 50, 3010–3014. [Google Scholar] [CrossRef]
  19. Mawlong, I.; Sujith Kumar, M.S.; Gurung, B.; Singh, K.H.; Singh, D. A Simple Spectrophotometric Method for Estimating Total Glucosinolates in Mustard De-Oiled Cake. Int. J. Food Prop. 2017, 20, 3274–3281. [Google Scholar] [CrossRef] [Green Version]
  20. Yang, Y.-C.; Sun, D.-W.; Pu, H.; Wang, N.-N.; Zhu, Z. Rapid Detection of Anthocyanin Content in Lychee Pericarp during Storage Using Hyperspectral Imaging Coupled with Model Fusion. Postharvest Biol. Technol. 2015, 103, 55–65. [Google Scholar] [CrossRef]
  21. Freund, Y.; Schapire, R.E. A Short Introduction to Boosting. J. Jpn. Soc. Artif. Intell. 1999, 14, 771–780. [Google Scholar]
  22. Chen, T.; Guestrin, C. Xgboost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; ACM: New York, NY, USA, 2016; pp. 785–794. [Google Scholar]
  23. Ke, G.; Meng, Q.; Finley, T.; Wang, T.; Chen, W.; Ma, W.; Ye, Q.; Liu, T.-Y. LightGBM: A Highly Efficient Gradient Boosting Decision Tree. Adv. Neural Inf. Process Syst. 2017, 30, 3146–3154. [Google Scholar]
  24. Gitelson, A.A.; Merzlyak, M.N.; Chivkunova, O.B. Optical Properties and Nondestructive Estimation of Anthocyanin Content in Plant Leaves. Photochem. Photobiol. 2001, 74, 38–45. [Google Scholar] [CrossRef] [PubMed]
  25. Mishra, P.; Lohumi, S.; Khan, H.A.; Nordon, A. Close-Range Hyperspectral Imaging of Whole Plants for Digital Phenotyping: Recent Applications and Illumination Correction Approaches. Comput. Electron. Agric. 2020, 178, 105780. [Google Scholar] [CrossRef]
  26. Hasanzadeh, B.; Abbaspour-Gilandeh, Y.; Soltani-Nazarloo, A.; Hernández-Hernández, M.; Gallardo-Bernal, I.; Hernández-Hernández, J.L. Non-Destructive Detection of Fruit Quality Parameters Using Hyperspectral Imaging, Multiple Regression Analysis and Artificial Intelligence. Horticulturae 2022, 8, 598. [Google Scholar] [CrossRef]
  27. Jayapal, P.K.; Joshi, R.; Sathasivam, R.; Van Nguyen, B.; Faqeerzada, M.A.; Park, S.U.; Sandanam, D.; Cho, B.-K. Non-Destructive Measurement of Total Phenolic Compounds in Arabidopsis under Various Stress Conditions. Front. Plant Sci. 2022, 13, 982247. [Google Scholar] [CrossRef]
  28. Burnett, A.C.; Serbin, S.P.; Davidson, K.J.; Ely, K.S.; Rogers, A. Detection of the Metabolic Response to Drought Stress Using Hyperspectral Reflectance. J. Exp. Bot. 2021, 72, 6474–6489. [Google Scholar] [CrossRef]
  29. Yuan, Z.; Ye, Y.; Wei, L.; Yang, X.; Huang, C. Study on the Optimization of Hyperspectral Characteristic Bands Combined with Monitoring and Visualization of Pepper Leaf SPAD Value. Sensors 2021, 22, 183. [Google Scholar] [CrossRef]
  30. Luo, M.; Wang, Y.; Xie, Y.; Zhou, L.; Qiao, J.; Qiu, S.; Sun, Y. Combination of Feature Selection and CatBoost for Prediction: The First Application to the Estimation of Aboveground Biomass. Forests 2021, 12, 216. [Google Scholar] [CrossRef]
  31. Bellon-Maurel, V.; Fernandez-Ahumada, E.; Palagos, B.; Roger, J.-M.; McBratney, A. Critical Review of Chemometric Indicators Commonly Used for Assessing the Quality of the Prediction of Soil Attributes by NIR Spectroscopy. TrAC Trends Anal. Chem. 2010, 29, 1073–1081. [Google Scholar] [CrossRef]
  32. Heil, K.; Schmidhalter, U. An Evaluation of Different NIR-Spectral Pre-Treatments to Derive the Soil Parameters C and N of a Humus-Clay-Rich Soil. Sensors 2021, 21, 1423. [Google Scholar] [CrossRef]
Figure 1. Single preprocessing method for hyperspectral data of B. juncea plants: raw reflectance (A), normalization (B), logarithmic transformation (C), Savitzky–Golay filter (D), first and second derivative after SG filtering (E,F), multiplicative scatter correction (G), and standard normal variate transformation (H). Colored lines represent different leaf samples. The combination of preprocessing methods refers to Table S1.
Figure 1. Single preprocessing method for hyperspectral data of B. juncea plants: raw reflectance (A), normalization (B), logarithmic transformation (C), Savitzky–Golay filter (D), first and second derivative after SG filtering (E,F), multiplicative scatter correction (G), and standard normal variate transformation (H). Colored lines represent different leaf samples. The combination of preprocessing methods refers to Table S1.
Agriculture 13 01477 g001
Figure 2. Feature importance values used to determine the best prediction models for total chlorophyll (A), phenolics (B), flavonoids (C), glucosinolates (D), and anthocyanins (E) in B. juncea plants. Orange bars represent selected features, and light blue bars represent unselected features, i.e., those not used in the prediction model. The best prediction models are documented in Table 3.
Figure 2. Feature importance values used to determine the best prediction models for total chlorophyll (A), phenolics (B), flavonoids (C), glucosinolates (D), and anthocyanins (E) in B. juncea plants. Orange bars represent selected features, and light blue bars represent unselected features, i.e., those not used in the prediction model. The best prediction models are documented in Table 3.
Agriculture 13 01477 g002
Figure 3. The optimal models for predicting the concentrations of the total chlorophyll (A), phenolics (B), flavonoids (C), glucosinolates (D), and anthocyanins (E,F) in B. juncea plants, as presented in Table 3. R2P and RMSEP indicate coefficient of determination and root mean square error of prediction, respectively.
Figure 3. The optimal models for predicting the concentrations of the total chlorophyll (A), phenolics (B), flavonoids (C), glucosinolates (D), and anthocyanins (E,F) in B. juncea plants, as presented in Table 3. R2P and RMSEP indicate coefficient of determination and root mean square error of prediction, respectively.
Agriculture 13 01477 g003
Figure 4. Distribution map of five metabolites, described by an application of hyperspectral image-based prediction in a growing environment: total chlorophyll, phenolics, flavonoids, glucosinolates, and anthocyanins in B. juncea plants.
Figure 4. Distribution map of five metabolites, described by an application of hyperspectral image-based prediction in a growing environment: total chlorophyll, phenolics, flavonoids, glucosinolates, and anthocyanins in B. juncea plants.
Agriculture 13 01477 g004
Table 1. Statistical summary of the five components in B. juncea plants.
Table 1. Statistical summary of the five components in B. juncea plants.
MetabolitesMinMaxMeanStandard Deviation
Chlorophyll (mg g−1 DW)2.5412.177.242.28
Phenolics (mg g−1 DW)2.1311.286.222.33
Flavonoids (mg g−1 DW)3.0013.597.522.51
Glucosinolates (µmol g−1 DW)11.8855.0831.3611.25
Anthocyanins (mg g−1 DW)0.0033.803.235.35
Table 2. Performances of five PLSR models based on best preprocessing methods and optimal latent variables (LVs) for each component of B. juncea plants.
Table 2. Performances of five PLSR models based on best preprocessing methods and optimal latent variables (LVs) for each component of B. juncea plants.
MetabolitesPreprocessing MethodOptimal LVsCalibrationCross-ValidationPrediction
R2CRMSECR2CVRMSECVR2PRMSEP
ChlorophyllLog (1/R) + 1st Der + MSC50.6671.3320.4071.7770.5671.349
Log (1/R) + 1st Der + SNV50.6671.3320.4051.7790.5531.371
Raw reflectance80.6191.4250.3931.7980.5301.405
SG filter20.4311.7400.3881.8060.5261.411
1st Der50.6591.3470.3841.8110.5751.337
PhenolicsSG filter110.7311.2060.4331.7510.5581.487
Norm + SNV60.5661.5320.4251.7610.4581.648
SNV60.5661.5320.4251.7610.4581.648
Norm + SG filter + SNV60.5541.5520.4241.7630.4401.675
SG filter + SNV60.5541.5520.4241.7630.4401.675
Flavonoids1st Der10.4521.8140.4061.8880.5071.845
SG filter10.4421.8300.4041.8920.4771.902
Raw reflectance20.4481.8200.3981.9010.5311.802
2nd Der10.4501.8180.3821.9260.4122.016
Log (1/R) + 1st Der + MSC30.5091.7160.3651.9530.2332.303
GlucosinolatesRaw reflectance80.7835.2290.6476.6670.7255.804
Norm + SG filter70.7465.6510.6476.6680.6626.435
SG filter110.8074.9220.6466.6790.7595.436
Norm + SG filter + MSC80.7535.5810.6336.7940.6466.591
SG filter + MSC80.7535.5810.6336.7990.6456.592
AnthocyaninsLog (1/R) + SNV80.8542.1090.7462.7800.8361.808
Log (1/R) + SG filter + SNV90.8552.1040.7452.7860.8491.737
Log (1/R)110.8682.0020.7452.7870.8371.801
Log (1/R) + MSC90.8532.1150.7442.7910.8611.664
Log (1/R) + SG filter + MSC90.8502.1370.7432.7940.8501.728
R2: coefficient of determination; RMSEC, RMSECV, and RMSEP: root mean square errors of calibration, cross-validation, and prediction, respectively. Bold indicates the best performance based on the RMSEP for each component.
Table 3. Performance of AdaBoost, XGboost, and LightGBM prediction models for five metabolites in B. juncea plants according to feature-selection algorithms after determination of preprocessing and hyperparameter tuning.
Table 3. Performance of AdaBoost, XGboost, and LightGBM prediction models for five metabolites in B. juncea plants according to feature-selection algorithms after determination of preprocessing and hyperparameter tuning.
Prediction ModelPreprocessing MethodFeature SelectionCalibrationCross-ValidationPrediction
MethodFeature No.R2CRMSECR2CVRMSECVR2PRMSEP
Total Chlorophyll
AdaBoostLog (1/R) + 2nd Der + MSCFull band1500.8780.8070.4481.7140.5941.307
AdaBoost280.9260.6280.5731.5070.4761.483
XGboost130.8680.8380.4631.6900.3481.656
LightGBM350.9290.6160.5411.5630.5021.447
XGboostLog (1/R) + 2nd Der + MSCFull band1500.9960.1370.5191.6000.4761.484
AdaBoost280.9970.1200.5941.4710.5451.382
XGboost130.8910.7630.4881.6510.4551.514
LightGBM351.0000.0330.6281.4070.5761.334
LightGBM1st DerFull band1500.9450.5430.4141.7660.6951.133
AdaBoost310.8290.9540.4631.6910.6481.217
XGboost170.7431.1700.3881.8050.7371.052
LightGBM350.9600.4620.5511.5470.6571.201
Total Phenolics
AdaBoostNormFull band1500.9240.6420.5811.5050.5211.549
AdaBoost370.9310.6110.6411.3930.5171.554
XGboost160.9210.6520.6461.3820.5121.562
LightGBM280.9250.6370.6181.4370.5941.426
XGboostNorm + SG filterFull band1501.0000.0270.6271.4190.3901.748
AdaBoost340.9740.3720.5731.5180.3541.798
XGboost150.9690.4060.6051.4610.4061.724
LightGBM300.9330.6010.5571.5460.3781.765
LightGBM1st DerFull band1500.8820.7980.5381.5800.5591.486
AdaBoost360.8620.8640.5721.5200.5171.556
XGboost100.7701.1150.5651.5320.3861.753
LightGBM380.9420.5580.6021.4670.4991.583
Total Flavonoids
AdaBoost2nd DerFull band1500.8720.8780.5121.7120.7041.429
AdaBoost330.8271.0180.5511.6420.7091.417
XGboost120.9130.7240.5721.6020.5751.714
LightGBM340.8470.9580.5381.6660.6231.615
XGboost1st DerFull band1500.9720.4090.5161.7050.5861.692
AdaBoost360.9860.2860.5861.5770.5641.736
XGboost70.9320.6400.5451.6530.6441.569
LightGBM460.9970.1380.5801.5880.5681.728
LightGBM1st DerFull band1500.8740.8680.4831.7610.5851.693
AdaBoost360.9050.7540.5431.6570.5191.823
XGboost70.6511.4480.5311.6780.5941.676
LightGBM460.9550.5180.5481.6480.5031.854
Total Glucosinolates
AdaBoostSNVFull band1500.9352.8680.6666.4810.7685.333
AdaBoost280.9073.4170.6746.4010.8164.744
XGboost140.9133.3010.6996.1570.7825.169
LightGBM340.9352.8520.6776.3720.7305.748
XGboostSG filter + SNVFull band1500.9970.6440.6706.4450.7515.521
AdaBoost290.9960.6700.6766.3820.7635.389
XGboost120.9930.9280.7155.9870.7785.211
LightGBM411.0000.2330.7076.0710.7765.238
LightGBMLog (1/R) + 1st Der + SNVFull band1500.8753.9590.7026.1220.6756.308
AdaBoost300.9622.1830.7415.7090.6626.435
XGboost80.9013.5380.7445.6780.6136.890
LightGBM510.9851.3860.7395.7290.6656.411
Total Anthocyanins
AdaBoostLog (1/R) + 1st DerFull band1500.9750.8650.8342.2460.7142.390
AdaBoost260.9680.9860.8192.3490.6392.682
XGboost110.9690.9730.7352.8390.5193.097
LightGBM370.9760.8510.8222.3290.8241.876
XGboost1st DerFull band1501.0000.0030.7242.8990.2653.830
AdaBoost201.0000.0410.7252.8920.7422.271
XGboost110.9870.6250.7382.8260.2513.865
LightGBM400.9970.2970.6643.1980.3893.492
LightGBMLog (1/R) + 1st DerFull band1500.8991.7560.6853.0970.7432.264
AdaBoost240.9181.5750.6993.0280.4853.204
XGboost90.8262.3030.6873.0890.3143.699
LightGBM390.9331.4300.7422.8040.7172.375
R2: coefficient of determination; RMSEC, RMSECV, and RMSEP: root mean square errors of calibration, cross-validation, and prediction, respectively. Bold indicates the best performance based on the RMSEP for each component.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Yoon, H.I.; Lee, H.; Yang, J.-S.; Choi, J.-H.; Jung, D.-H.; Park, Y.J.; Park, J.-E.; Kim, S.M.; Park, S.H. Predicting Models for Plant Metabolites Based on PLSR, AdaBoost, XGBoost, and LightGBM Algorithms Using Hyperspectral Imaging of Brassica juncea. Agriculture 2023, 13, 1477. https://doi.org/10.3390/agriculture13081477

AMA Style

Yoon HI, Lee H, Yang J-S, Choi J-H, Jung D-H, Park YJ, Park J-E, Kim SM, Park SH. Predicting Models for Plant Metabolites Based on PLSR, AdaBoost, XGBoost, and LightGBM Algorithms Using Hyperspectral Imaging of Brassica juncea. Agriculture. 2023; 13(8):1477. https://doi.org/10.3390/agriculture13081477

Chicago/Turabian Style

Yoon, Hyo In, Hyein Lee, Jung-Seok Yang, Jae-Hyeong Choi, Dae-Hyun Jung, Yun Ji Park, Jai-Eok Park, Sang Min Kim, and Soo Hyun Park. 2023. "Predicting Models for Plant Metabolites Based on PLSR, AdaBoost, XGBoost, and LightGBM Algorithms Using Hyperspectral Imaging of Brassica juncea" Agriculture 13, no. 8: 1477. https://doi.org/10.3390/agriculture13081477

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop