Next Article in Journal
Approach for Preservation and Reconstruction of Two-Dimensional Wave Spectra and Its Application to Boundary Conditions in Nested Wave Modeling
Previous Article in Journal
Rice Yield Prediction in Hubei Province Based on Deep Learning and the Effect of Spatial Heterogeneity
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Estimating Black Oat Biomass Using Digital Surface Models and a Vegetation Index Derived from RGB-Based Aerial Images

1
“Luiz de Queiroz” College of Agriculture, University of São Paulo, 11 Pádua Dias Avenue, São Paulo 13418-900, Brazil
2
Faculty of Food Engineering and Animal Sciences, University of São Paulo, 225 Duque de Caxias Avenue, São Paulo 13635-900, Brazil
*
Author to whom correspondence should be addressed.
Remote Sens. 2023, 15(5), 1363; https://doi.org/10.3390/rs15051363
Submission received: 29 December 2022 / Revised: 3 February 2023 / Accepted: 14 February 2023 / Published: 28 February 2023

Abstract

:
Responsible for food production and industry inputs, agriculture needs to adapt to worldwide increasing demands and environmental requirements. In this scenario, black oat has gained environmental and economic importance since it can be used in no-tillage systems, green manure, or animal feed supplementation. Despite its importance, few studies have been conducted to introduce more accurate and technological applications. Plant height (H) correlates with biomass production, which is related to yield. Similarly, productivity status can be estimated from vegetation indices (VIs). The use of unmanned aerial vehicles (UAV) for imaging enables greater spatial and temporal resolutions from which to derive information such as H and VI. However, faster and more accurate methodologies are necessary for the application of this technology. This study intended to obtain high-quality digital surface models (DSMs) and orthoimages from UAV-based RGB images via a direct-to-process means; that is, without the use of ground control points or image pre-processing. DSMs and orthoimages were used to derive H (HDSM) and VIs (VIRGB), which were used for H and dry biomass (DB) modeling. Results showed that HDSM presented a strong correlation with actual plant height (HREF) (R2 = 0.85). Modeling biomass based on HDSM demonstrated better performance for data collected up until and including the grain filling (R2 = 0.84) and flowering (R2 = 0.82) stages. Biomass modeling based on VIRGB performed better for data collected up until and including the booting stage (R2 = 0.80). The best results for biomass estimation were obtained by combining HDSM and VIRGB, with data collected up until and including the grain filling stage (R2 = 0.86). Therefore, the presented methodology has permitted the generation of trustworthy models for estimating the H and DB of black oats.

1. Introduction

Alongside the fast pace of technological development, society has been increasing its demand for food and supplies. Moreover, environmental requirements exert pressure on the development of more sustainable processes. Agriculture is implicated in this context, being responsible for food production and many industry inputs, which emphasizes the need for more sustainable forms of production. Methods such as the no-tillage system and the use of green manure have gained prominence over recent years since they contribute to more sustainable agricultural processes, reduce risks and environmental impacts, recycle nutrients, and increase organic matter in the soil [1].
In this context, black oat has gained prominence for being one of the most important winter grasses around the world that can be used as a cover crop [2] or for supplementation in animal feed [3,4]. Furthermore, its application as green manure has great potential; it is often applied in crop succession systems and is able to bring chemical and physical benefits to the soil and increase yield for the subsequent crop [5]. In addition, black oat can also be successfully applied to reduce weed infestations [6]. Despite their importance, black oat and other cover crops are rarely studied concerning new technologies, presenting a research gap in this area.
Plant biomass is directly related to development and yield. Studies have shown that black oat height correlates with biomass production and nitrogen ratios; thus, prediction models can be built based on this parameter [7,8]. Similarly, productivity and nutritional status can be estimated from vegetative indices determined through images [7,9]. It can be understood that nitrogen and biomass, as well as plant height, share a strong correlation.
In the related literature, many studies regarding biomass and nitrogen status for crops such as rice, corn, and wheat (Table 1) can be found. It is important to highlight that the most important cereals, including corn, wheat, rice, and oats, belong to the grass family, which leads to a high correlation in their physiological behavior [10]. Consequently, it is possible to relate the results obtained through VIRGB and plant height applied, for example, to corn, wheat, and rice when assessing biomass and nitrogen status, with the results obtained through the same VIRGBS and plant height applied to black oat.
Therefore, studying the physiological and morphological aspects of black oat becomes interesting because they present correlations with response variables of interest, such as biomass [11]. Nonetheless, methodologies for determining plant biomass are usually destructive, damaging the crop site and demanding extensive labor, thus leading to a need for alternatives that could provide biomass assessment in faster and non-destructive forms. A very advantageous alternative is the determination of VIRGB and plant height through the use of aerial images, which can provide information related to productivity since they are directly related to biomass [12].
In the context of aerial imaging, the use of unmanned aerial vehicles (UAV) has gained prominence [13]. When compared with satellite images, the use of AUV presents advantages. One of the most prominent factors in its application is the possibility of having high spatial and temporal resolution [13]. UAVs present greater flexibility regarding the sample distance (flight height), mission time, and the ease of mission repetition [14]. Another important advantage of UAV-based imaging is the gain in especial and temporal resolution that allows one to obtain information with a high level of detail over time [15], especially due to the ease of performing flights with greater frequency and the possibility of flying at lower heights, which is known as low-altitude remote sensing (LARS) [16].
A UAV can be equipped with several different types of sensors, such as cameras that operate in the visible, multispectral, and hyperspectral ranges of the electromagnetic spectrum [17]. However, the use of multi- and hyper-spectral cameras requires greater and more complex processing to extract information, making their use unfeasible in many applications, which justifies the use of images in the visible spectrum [18].
The visible band of the spectrum is contained within wavelengths ranging from approximately 400 nm to 700 nm [19]. A spectral signature of a plant leaf contains important information. Between spectral wavelengths of 500 and 550 nm, there is a peak of reflectance that characterizes a response region for photosynthetic efficiency. It is noteworthy that the visible spectrum is within this range, which ensures the possibility of extracting spectral information for plant analysis [20].
At wavelengths of approximately 500 nm, 600 nm, and 700 nm, a region of responses to chlorophyll and carotenoids is present; this is an important region for studying nutrient contents and phenology. The ramp between approximately 700 nm and 800 nm is the region known as the red edge because this is where infrared begins; this is an important region for the evaluation of green biomass [20].
Therefore, reflectance response is observed within the wavelengths of the visible spectrum, justifying applications in this region. Visible spectrum aerial images have been successfully applied in many applications such as the determination of gaps in grape yards [21], and the development of prediction models for sugarcane using visible-band vegetation indices [22]. Acorsi et al. [7] studied prediction models for black oat productivity using RGB-based UAV images and are one of very few studies involving this crop and technology.
Furthermore, the use of images obtained by UAV coupled with RGB cameras is a viable alternative for monitoring biomass [23]. This approach has been applied with success to crops such as barley [12], cotton [24], wheat [25], black oat [7], corn [26], soybean [27], and potato [28]. Though they can be found in the literature, applications to black oat are very scarce.
Besides plant height, the productive aspects of plants can be assessed through vegetation indices (VI), which are used to extract information from crops that allow for the derivation of classification models [29]. An extended review on the use of reflectance techniques stated that photosynthetic pigments present in leaves could be used to describe the physiological status of a plant as well as to evaluate its biomass [20]. VIs can be used within different ranges of the electromagnetic spectrum, and studies have shown potential applications for VIs that operate in the visible range of the spectrum. RGB-based vegetative indices (VIRGB) from UAV-based images can be applied to estimate forage biomass and generate trustworthy results [9]. Table 1 presents some studies from the literature that applied VIRGB.
Table 1. Vegetation indices from the literature used in this study.
Table 1. Vegetation indices from the literature used in this study.
NameAbbreviationEquationApplicationReference
Visible Atmospherically
Resistant Index
VARIVARI = (G − R)/(G + R + B)Corn biomass[30]
Normalized Green Red
Difference Index
NGRDINGRDO = (G − R)/(G + R)Grass biomass[9]
Normalized Excess
Green Index
NExGNExG = (2G − R − B)/(R + G)Rice nitrogen[31]
Green–Red Ratio
Index
GRRIGRRI = G/RCorn nitrogen[32]
True Color
Vegetation Index
TCVITCVI = (2R − 2B)/(2R − G − 2B + 255 × 0.4)Wheat nitrogen[33]
Methods for determining biomass that are fast and practical are needed, since in many situations in agriculture, manual methods are time-consuming, depend on extensive training and labor experience, and decision making can vary according to each person performing the tasks [34]. Digital surface models (DSMs) are widely used in agricultural applications, such as crop monitoring for vegetation analysis [21], because they allow the estimation of plant height which, in turn, is related to biomass. The current availability of software based on structure from motion (SfM) techniques facilitates processing for obtaining photogrammetric products such as DSMs and orthoimages. DSMs are models that represent objects at soil level and can be largely used in agricultural applications such as the monitoring of crops [21].
Bendig et al. [35] determined plant height through a DSM (HDSM) based on aerial images in the visible spectrum to monitor barley biomass over time, and the study produced satisfactory results. In general, DSMs from UAV images can be applied over time to determine plant height and model plant growth [36] and biomass [11], since it allows high special and temporal resolutions. Moreover, combinatory approaches might increase biomass modeling capabilities. UAV-based aerial images can be used to create biomass prediction models combining HDSM with VIRGB, producing better results than models using single factors, such as VIRGB or HDSM alone [11].
When it comes to UAV images, some techniques might impair faster parameter determinations. The use of ground control points (GCP) is important in many applications, even though it requires field work in the form of placing signs and measuring high-precision coordinates, demands specific and expensive equipment, and generates greater computational costs for processing. However, Yue et al. [37] published a study using DSMs for productivity estimation and demonstrated that HDSM presented a high correlation with biomass even without using GCPs, thus demonstrating that for fast and non-destructive yield estimation, the application of GCPs might not be essential [26]. It is important to mention that for situations that require a greater precision of coordinates, such as variable rate fertilizer applications, GCPs are indispensable.
Therefore, this study intended to obtain high-quality DSMs and orthoimages from UAV-based RGB images via direct-to-process means; that is, without the use of ground control points or image pre-processing, such as light correction or color calibration, thus offering a faster and more accurate methodology for obtaining these photogrammetric products. Additionally, the present study aimed to estimate black oat dry biomass using regression models based on HDSM and VIRGB alone as well as the combination of HDSM and VIRGB.

2. Materials and Methods

The graphical abstract presented in Figure 1 concisely represents the experimental workflow used in this study. A UAV coupled with a camera operating in the visible band of the spectrum was used to acquire RGB images from black oat crops exposed to natural light. The flight missions for image acquisition were always performed under similar conditions, i.e., clear sky, no wind, and at approximately noon to avoid interference and differences in the images.
Raw images were processed in a computer to obtain the orthoimages and the digital surface models from which visible band vegetation indices (VIRGB) and plant height (HDSM) were derived, respectively. Later, VIRGB and HDSM were employed for biomass modeling.

2.1. Experimental Site

The experimental site is located at the Faculty of Food Engineering and Animal Sciences, University of São Paulo, state of São Paulo, Brazil. The geographical location of the campus is 21°59′ south latitude and 47°23′ west longitude and has an average altitude of 635 m, with declivity. According to the Koppen classification, the climate is Cwa with an average annual temperature and a precipitation of 20.8 °C and 1298 mm, respectively. Finally, the soil at the site is classified as Eutrophic Red Latosol. The experimental site was divided into 20 plots of 8 by 8 m (64 m2), separated into four blocks perpendicular to the direction of the declivity. Alongside each block, a reference area was kept clean to be used as a reference for zero height.
The black oat (cultivar EMBRAPA-29) was sown in the plots within a usable area of 7 by 7 m, in rows 20 cm apart. The design was in randomized blocks with 4 blocks and 5 treatments (T1 to T5); namely, (T1—control) 100% of the recommended dosage for the culture (using nitrogen fertilizer and irrigation with tap water) and (T2) 25%, (T3) 50%, (T4) 75%, and (T5) 100% of treated slaughterhouse effluent (STE) supplied through sprinkler irrigation, which provided different doses of nitrogen. The percentages of STE were combined with tap water to maintain the soil tension between the field capacity and the critical tension.

2.2. Image Acquisition and Processing

The image acquisition was performed using a UAV (model Phantom 4 Pro, SZ DJI Technology Co., Shenzhen, China) featuring a digital camera operating in the visible range of the spectrum with 12.4 megapixels (MP) of resolution, 20 mm of focal length, and an angle of view of 94°. The images were collected once a week with autonomous flights performed at approximately noon on clear days to minimize variations influenced by the natural light in the sunlight spectrum. Since the sensor that was coupled with the UAV was only sensible to the visible band of the spectrum, information on non-visible bands, such as infrared, was not captured.
The autonomous inspection flights were configured and controlled by the Pix4D Capture software (Version 4.9.0, Pix4d S.A., Prilly, Switzerland), with lateral and frontal overlap of 70%, and with the camera positioned perpendicularly to the UAV movement direction and 20 m above the ground. The images were processed on a computer (model PE07CAK5, Lenovo Corp., Hong Kong, China) composed of an Intel Core i7 processor (model 8564U, Inter Corp., Santa Clara, CA, USA), 12 GB of RAM, and a GeForce video board with 2 GB of RAM (model MX 110, NVIDIA Inc., Santa Clara, CA, USA).
The orthoimages and DSMs were obtained using the SfM software Agisoft Metashape Professional (Version 1.6.4, Agisoft LLC, St. Petersburg, Russia) in its free trial standard version. The processing workflow included: image alignment, building a dense point cloud, building mesh, building the digital surface model, and building the orthoimage.
In order to present reference measurements that allow for the evaluation of the estimates, in-field sampling was performed for plant height and biomass. For plant height, on the same days the flight missions were performed, in-field reference height measurements (HREF) were conducted using a 1.5-m ruler. The measurements were taken randomly at thirty points within each experimental plot, measuring the distance from the ground to the highest point of the plant canopy. The average height was calculated, obtaining one mean value for each plot at each assessment date.
Additionally, biomass samples were collected at each growth stage. To determine dry biomass, a 1 m2 sample was collected from the field, considering the aerial part of the plant. Afterwards, the samples were taken to the laboratory, weighed, cleaned, and set to dry in a forced-air convection oven for 72 h at 65 °C. After, the samples were weighed again to determine dry biomass content.

2.3. Processing the Orthoimages and Digital Surface Models

To obtain the HDSM and VIRGB values, the experimental plots for each flight were clipped from the original DSM and orthoimage. All of the processing for image adjustment and clipping of experimental plots was performed using QGIS (Open-Source Geospatial Foundation, version 3.22, Białowieża). To permit the use of one mask for clipping all images, it was necessary to adjust the coordinates so all the images were aligned over the same spatial points. The adjustment was made using the georeferencer raster in QGIS.
After adjusting the coordinates, the images were aligned and the clipping raster function in QGIS was used to clip each experimental plot from all orthoimages and DSMs, thus generating a total of 20 sub-images from each map and flight date. The resulting clipped sub-images from the DSMs and orthoimages were renamed for easier identification and stored in a cloud drive. An algorithm developed in Python was developed to access those images and extract desired information.
In the first step, the algorithm was programmed to read all clipped images from the DSM and determine and store the mean height values for each reference plot by reading the value of each pixel, computing its sum and dividing by the total number of pixels. Next, the algorithm could open each of the experimental plots and subtract the mean height values from each corresponding experimental plot, and then calculate the mean height value for each plot. This resulted in a mean height value, in meters, with ground level altitude equal to zero. In the end, this resulted in one mean height value for each plot from each flight mission date.
Lastly, the Python algorithm was able to access all sub-images from the orthoimage and calculate the VIRGB values presented in Table 1 (VARI, NGRDI, NExG, GRRI, TCVI). To this end, the channels of each visible band (red, green, and blue) were split, and the VIs were calculated using the intensity of the pixels through point operations. The mean values of each VIRGB for each plot and date were determined, generating one mean IV value for each plot.

2.4. Statistical Analysis

Data were analyzed according to the treatments to identify significant differences due to nitrogen dosages through analysis of variance (ANOVA) with a significance level of 0.05. Similarly, the coefficient of determination (R2) and the coefficients of the models were tested for significance (p < 0.05) and non-significant coefficients (p > 0.05) were discarded. All statistical analysis involved in this study was performed using the RStudio software (RStudio, version 4.2.2, Boston, MA, USA).
Modeling was performed using three datasets considering the growth stages. The first dataset considered data collected up until and including the grain filling stage (all data). The second dataset comprehended the data collected up until and including the flowering stage, thus including data from the tillering, booting, and flowering stages. The third dataset considered the data collected up until and including the booting stage; that is, data from the tillering and booting stages. The effects of the data from single stages alone were not considered since initial studies showed low prediction potential for modeling, with regression models presenting no significance (p > 0.05).
To determine the best model for each case of study, the models were fitted to the respective data set, and the significance of the R2 and the coefficients were analyzed. Linear and polynomial single and multiple regression were tested through regression analysis, non-significant models were disregarded, and non-significant coefficients were dropped from the model. From the resulting significant models, the best model with greatest R2 and lowest RMSE was selected for the respective dataset.
To identify the vegetation index that best related to the data obtained in this study, regarding plant height and biomass, Pearson’s correlation was performed and the VIRGB with the highest score was selected for modeling.
For the model validations, each one of the three aforementioned datasets was split into different subsets; that is, modeling and validation datasets. To split the data, 70% of the available data in the respective dataset was randomly selected for modeling, and 30% for validation. This approach was applied for both plant height and dry biomass models.

3. Results

The UAV flights were conducted for image acquisition, and processing was performed following the methodology workflow previously presented. The flight mission was repeated eight times, including two flights within each development stage of the black oat crop. From the images acquired during each flight, high-resolution DSMs and orthoimages were derived. The performance of these photogrammetric products is depicted in Table 2. Furthermore, Figure 2 presents the resulting DSM and orthoimage for one of the dates when a flight mission occurred, to demonstrate the photogrammetric products obtained.

3.1. Plant Height Assessment

Plant height was derived from the DSM (HDSM) through image processing. Correspondingly to each UAV flight, ground references of plant height (HREF) were obtained via in-field measurements. Table 3 presents the descriptive statistics of HDSM and HREF values including mean, standard deviation, and height range. When considering the overall mean from all plant heights of the respective flight date, a standard deviation ranging from 0.01 to 0.17 m was observed for the HREF measurements, while the HDSM measurements generated lower standard deviations, which ranged from 0.01 to 0.07 m. These lower standard deviations might be related to the greater number of points in the determination of HDSM through the aerial images.
Similarly, Table 4 presents the mean values of HDSM and HREF for each treatment according to each flight. According to the analysis of variance (ANOVA), no significant differences were found among the applied treatments for HDSM. On the other hand, significant differences among the treatments were only observed for the HREF values of the last two flights; that is, Flights 7 and 8.
Additionally, in general, the mean height for both methods shows a growing tendency over time, which can be seen along the columns of each treatment in Table 4. Plant height was evaluated according to the growth stage datasets presented in Table 5. Figure 3 displays the regression models for each growth stage dataset along with their descriptive statistics.
In general, models performed better when considering data collected up until and including the grain filling stage (R2 = 0.74) and flowering stage (R2 = 0.85), with the latter presenting better performance. In contrast, the model using data collected up until and including the booting stage presented the weakest performance for estimating plant height.
The regression models were evaluated using 70% of the datasets for modeling and 30% for verification, randomly selected from each dataset of the respective growth stage. The modeling subset was used to build the models, and the verification data was used to evaluate its performance. Figure 4 shows the model performance and the relationship between real and estimated heights.
Corroborating with the previous results (Figure 3), the model with the best performance was the one that used data collected up until and including the flowering stage, with an R2 of 0.85 for the model (Figure 4C) and 0.85 for the estimate regression (Figure 4D). Using data collected up until and including the grain filling stage (all data) provided intermediate performance, R2 was 0.73 and 0.78 for the model and estimate analysis (Figure 4A,B), respectively. Furthermore, models built with data collected up until and including the booting stage provided the weakest prediction performance (Figure 4E,F).
It is, therefore, understood that during the initial growth stages, the height of the plants estimated through aerial imaging does not represent the real height of the plants. On the other hand, later stages were demonstrated to accurately describe the real height of the plants with sufficient reliability [7,38].

3.2. Biomass Assessment

Besides HREF and HDSM, plant dry biomass (DB) was also obtained for each growth stage. The overall mean values of DB for each treatment are presented in Table 5. Descriptive statistics regarding the overall means of each growth stage are shown in Table 6, considering HREF, HDSM, and DB. It is possible to identify a growing tendency over time for all parameters evaluated, indicating that the expected behavior of the plants is being observed.
According to the analysis of variance (ANOVA) performed with data from each growth stage, no significant differences were observed among the treatments, with a confidence level of 0.05.
Similarly to the plant height assessment, data were split into subsets according to the growth stage for DB prediction modeling. The models were evaluated using 70% of the data for modeling and 30% for verification. The modeling subset was used to build the models, and the verification data was used to evaluate its performance.
Once DB had been determined through destructive analysis at the end of each growth stage, the respective last flight data for each of these stages were used in the analysis, indicated by the DAS values in Table 6.
The mean values of DB, in addition to HREF and HDSM, show an increase in standard deviation over time, rising from 0.066 to 0.918. A similar pattern can be observed for all parameters studied.
For predicting biomass, three approaches were investigated. Firstly, a regression model was developed using HDSM; secondly, VIRGBs were used to develop a regression model to estimate dry biomass. Then, a combination of HDSM and VIRGB was evaluated to increase the model accuracy through multiple regression.
To investigate the most suitable index from Table 1 for predicting biomass, a Pearson’s correlation matrix was constructed using VIRGB from the literature (Table 1) with scores considered strong (≥0.7), moderate (<0.7 and ≥0.5), or weak (<0.5). Only those with the greatest correlation were considered for the modeling.
Analyzing the matrix (Table 7), all of the VIRGBs presented a strong correlation with DB and HDSM. For DB, the TCVI showed the highest correlation score (0.7987), with an inversely proportional behavior. Likewise, VARI showed a strong correlation with HDSM (0.7880).
Regression models were derived from the datasets regarding each growth stage, and the significance of the models was evaluated through regression analysis. For each growth stage subset, DB was modeled as a function of HDMS, a function of TCVI, and as a combination of HDSM and TCVI. The best model for each growth stage along with descriptive statistics are presented in Table 8.
It is possible to observe that models developed with a combination of plant height and vegetation indices provided better estimates for plant biomass, with very close coefficients of regressions among the growth stages, producing values of 0.84, 0.85, and 0.86 for the datasets considering data collected up until the booting, flowering, and grain filling stages, respectively.
The model using data collected up until and including the booting stage and the HDSM was the weakest for estimating biomass. However, when considering the data collected up until and including the booting stage and the TCVI, the estimated performance of the model increased. For the subsets of all data and data collected up until and including flowering stage, the models using TCVI had the lowest R2 values.
Overall, models with combinatory factors for HDSM and TCVI performed better for biomass estimation. TCVI alone proved to be good for estimating biomass in the initial stages of development, while for later stages, it might not be recommended. In contrast, plant height alone demonstrated better performance for estimating biomass during the later stages of black oat development.
The combinatory model for data collected up until and including the booting stage yielded an R2 of 0.84, and the data collected up until and including the flowering stage produced an R2 value equal to 0.85. Finally, the model built with all data (collected up until and including the grain filling stage) produced an R2 value equal to 0.86. Although all of the models presented very close R2 values, the model built using all data and a combination of HDSM and TCVI performed slightly better. This result corroborates with the findings from the literature, where combining plant height with vegetation index led to the acquisition of better estimative models.
Using all of the data, two subsets were obtained. Of the data, 70% was used to derive the model and 30% was used for validation. The validation subset was used in the validation model from Table 8. The predicted data were plotted against the real DB values obtained in the laboratory, and the relationship between the estimated and real DB values are presented in Figure 5. The validation of the regression model combining plant height and VIRGB provided an R2 value equal to 0.82, thus demonstrating suitability for estimating biomass.

4. Discussion

In this work, a new workflow for image acquisition and processing, without the use of ground control points and image pre-processing, was presented. The proposed methodology contains the image acquisition step (flight missions), the processing step with SfM software, and the last step, which includes extracting information for plant height determination and vegetation indices calculation.
The methodology workflow here presented can be summarized in Figure 1 and has demonstrated suitability for the proposed objective; that is, obtaining high-quality DSMs and orthoimages from UAV-based RGB images via a direct-to-process method, without the use of ground control points or image pre-processing, resulting in a faster and more accurate methodology for generating these photogrammetric products, and allowing for application regression models based on HDSM and VIRGB, as well as the combination of HDSM and VIRGB successfully, which is discussed in this section.
The calculations of plant height and vegetation indices were performed using the algorithm developed by the authors, which was able to successfully read and extract information from the digital numbers of high-quality images. This information could correspond to the intensities of the R, G, and B channels at the pixel level in the orthoimages or the respective elevation value in the DSM. With the extracted information, plant height could be determined, and vegetation indices calculated.
Even though GCPs were not applied in the study, high-quality photogrammetric products were obtained, which have demonstrated suitability for estimating plant height and biomass. This result corroborates the findings of Yue et al. [37], indicating that for applications where the main interest is to estimate biomass, not using GCPs might have advantages related to a faster and less laborious workflow, without sacrificing the quality of estimates [26,28]. This is possible since applications that are interested in determining plant height or biomass through plant height and vegetation indices do not require high precision in the coordinates of the pixels on the image. This fact permits a faster analysis since the operator can go to the field, perform the flight mission, and start the processing, without the previously required extra in-field work, such as placing marks and obtaining high-precision reference points.
The average DSM resolution was 0.0062 mm pix−1 and the orthoimage average resolution was 0.0124 m pix−1 for flights at 20 m from the ground level. Table 2 presents the resolution information in detail. Moreover, the flight distance from the ground (20 m) proved adequate for assessing the black oat crop under the conditions in the study. From the literature, a similar flight configuration at 25 m above ground level with a 12-MP camera obtained an average ground sampling distance of 0.0174 m pix−1 [7].
Moreover, Bendig et al. [24] obtained images using a UAV coupled with a 16-MP RGB camera performing flights at 50 m from ground level and derived DSM images with 0.01 m resolution. Despite the fact that both of these studies used GCPs for increasing the precision of coordinates, the present study was able to produce comparable photogrammetric products with the advantage of reduced field work, leading to a faster workflow with lower computational costs and eliminating the need for expensive high-precision equipment.
The HDSM and HREF values presented similar behavior in the sense that both of them showed a growing pattern, indicating that the growth of the crop was observed. HREF varied from 0.061 to 0.730 m and HDSM ranged from 0.148 to 1.041 m. Comparable values are found in the literature for black oats, where HREF ranged from 0.120 to 0.650 m and HDSM from 0.08 to 0.81 m [7]. For other crops, such as barley and sorghum, estimated plant heights usually have lower values than the reference heights, which was not observed in this study. Regardless, HDSM can describe the growth behavior of plants [7,11,24], and the results of this study reassert its suitability for modelling plant growth.
Moreover, HDSM presented mean values up to two times greater than the mean values observed for HREF. This behavior is not observed in most studies that use GCPs for correcting coordinates, including altitude [7,11,38,39]. However, the growing pattern is respected, a fact that corroborates the good prediction results found in the present study. Regarding the range of plant heights, both HREF and HDSM have shown greater data dispersion for later growth stages, similar to the results found in the literature for black oats and other crops [7,27]. This statement is corroborated by the increased standard deviation observed during Flights 6, 7, and 8. In general, HDSM had a greater standard deviation for all growth stages compared to HREF.
This could be explained by the natural characteristics of a DSM; since it builds a surface model over all the points existing in the image, it consequently includes points that do not belong to any plant, such as rows or gaps in the field, making the HDSM variability greater. This is less evident in the early development stages since the plant heights are closer to the soil, where the points from rows and gaps are. When it comes to later growth stages, this difference becomes much higher; therefore, the variability increases.
Plants are measured considering their heights in their natural position. At the end of the flowering and at the beginning of grain filling stages, grains are being formed, generating a greater weight at the extremities of the plants, which makes the stems tilt down and, consequently, the heights of some plants might be lower. As the grain filling was not homogeneous during the last stages, plant heights presented greater variation. Therefore, it can be said that for modeling the plant height and biomass of black oats, the later growth stages, starting at approximately 47 DAS, which include the final days of flowering and the entire grain filling stage, might not be adequate. The same results have been found in the literature [7,28].
Moreover, the treatments applied to the crop demonstrated no influence on plant height during the initial growth stages. HREF showed significant differences among treatments only during the last growth stage. This fact might be explained by the accumulation of nitrogen during the experiment, reaching levels sufficient for influencing growth at the final development stage. No significant differences were observed for HDSM. Likewise, the different dosages of STE did not influence dry biomass, which has also shown an increasing pattern over time, similar for all treatments.
The mean values of DB observed in this study were 0.140, 0.711, 3.764, and 5.136 t ha−1 for the tillering, booting, flowering, and grain filling growth stages, respectively. In contrast, Luz et al. [40] studied the influence of different dosages of nitrogen applied through irrigation and found significant differences by destructive foliar analysis and lower mean dry biomass values, ranging from 0.683 to 1.832 t ha−1. On the other hand, mean values ranging from 0.690 to 8.150 t ha−1 were observed in a different study [7]. As studies concerning the influence of nitrogen on black oat are scarce, further investigation is needed to understand these behaviors.
The methodology has shown suitability for estimating real plant height based on HDSM (Figure 1). It was demonstrated that collecting data from sowing during the end of the flowering stage is better for estimating plant height since the regression model for this growth interval presented an R2 of 0.85 and an RMSE of 0.043. On the other hand, using a single stage for estimating plant height has proven to be inadequate, which has also been observed by Jannoura et al. [41].
Being aware of this behavior is important, because it shows that estimating plant height up until approximately 33 DAS, during the booting stage, might not reflect the real growth status of the plants. In contrast, the tests showed that it is not necessary to wait until the last stage of development to have a more accurate estimate. The model validation tests corroborate these statements, since the best performance for estimating plant height was observed when the data collected during the flowering stage was used (Figure 2). The linear relationship between estimated HREF and actual HREF yielded an R2 value equal to 0.85. These values are comparable to those found in other studies concerning black oats [7].
When using all the data available—that is, data collected at the end of the grain filling stage—the model presented a moderate-to-good response for estimating plant height (R2 = 0.73 and RSME 0.113), and the relationship between the estimated and actual height values presented an R2 value of 0.78. Thus, in situations where UAV availability is restricted, we recommend that flights be performed during the initial-to-intermediate growth stages, since results using data collected during the booting stage performed better than single-stage data.
Another point of discussion regarding the methodology presented in this study is the fact that a zero ground height reference was determined for each flight, keeping reference areas clean, while other studies have used the first flight as the zero reference [24,42,43], which brings bias to the data as during the first flight, plants might have already emerged [24,31].
To evaluate the correlation among the response variables (HDSM, VIRGB, and DB), a Pearson’s correlation matrix was used. In this study, we considered the correlation scores to be either high (≥0.7), intermediate (≥5 and <7), or low (<5). As shown in the literature, plant DB has a strong correlation with plant height, which was also observed in this study [7,9,11,27,30,31]. The HDSM showed a correlation score of 0.89, considered high. Moreover, all of the VIRGBs demonstrated a strong correlation with DB, with the best performance presented by TCVI (−0.79). VIRGB vegetation indices have also been tested for other crops, such as peas and oats, and have demonstrated a strong correlation with plant biomass [31] Therefore, HDSM and TCVI were employed for modeling dry biomass.
Vegetation indices previously applied to corn, grass, wheat, and rice in the literature have demonstrated a strong correlation with black oat physiological behavior; thus, they could be used for biomass estimations. HDSM and TCVI were used as factors for building the DB estimation models. Modeling DB using HDSM with data collected up until and including the booting stage resulted in a second-order polynomial equation, but, even though the model was significant (p < 0.05), its R2 of 0.46 was considered low and demonstrated weak potential for estimating DB with good accuracy.
When using data collected until the end of the flowering stage, the fitted model had a linear behavior and performed better for estimating DB, with an R2 value equal to 0.82. Lastly, using data collected up until and including the grain filling stage, the best model was a second-order polynomial regression, which had the higher performance for estimating DB by HDSM, presenting an R2 value of 0.84. Acorsi et al. [7] found that prediction models performed better when using data from the flowering stage (R2 = 0.94).
The suitability of VIRGB for estimating biomass has been observed in the literature [9,18,28], but in general, the quality of the models has been lower than what was found in this study. Considering TCVI alone for estimating biomass, the regression models showed a linear behavior for the subsets of all growth stages with the best performance when using data collected up until and including the booting stage (R2 = 0.80). However, for the later growth stages, the linear regression models presented weaker coefficients of determination (0.60 and 0.64 for the flowering and grain filling stages, respectively). These results indicate that, for an evaluation of biomass needed to be taken at the initial stages of black oats development, the use of TCVI is recommended.
Finally, HDSM and TCVI were combined to produce multiple regression models. When combining the factors, models presented a higher R2, thus proving them to be better at estimating dry biomass. This result reaffirms other studies that have observed improvement in dry biomass modeling for grassland and herbaceous crops by combining HDSM and VIRGB [44,45]. For all the growth stages, second-order polynomial regressions had the best performance (Table 7), with R2 values of 0.84, 0.85, and 0.86 for the data collected up until and including the booting, flowering, and grain filling stages, respectively. Although the R2 values were very close to each other, the model using the data collected up until and including the grain filling stage performed better.
Therefore, the dataset with data collected up until and including the grain filling stage was used for the validation of the second-order polynomial regression model. The validation model using 70% of the dataset is presented in Table 7, and the linear relationship between actual and estimated DB values using 30% of the dataset is shown in Figure 4. The validation model yielded an R2 value of 0.87, while the linear regression had an R2 value of 0.82. These results agree with the findings in the literature regarding the combination of VIRGB and HDSM [24].
In spite of the observed plant height estimative, for estimating black oat DB, this study recommends using data from all growth stages, from sowing through the grain filling stage, and a combination of HDSM and TCVI. Furthermore, it is important to highlight that the presented study did not use GCPs for correcting the coordinates of the DSMs and orthoimages, presenting a methodology that permits performing the inspection flights, generating photogrammetric products using commercial software, extracting the information of interest (i.e., plant height and TCVI), using an open-source algorithm written in Python, and, finally, using those inputs to estimate DB production of black oats with high accuracy and trustworthiness.
Even though it was not the focus of this study, as black oat has the potential for use as green manure and animal feed, further investigation is necessary to understand the dynamics of nitrogen and other foliar nutrients under the conditions presented here, so it can be used as an input for building better models and estimating the nutritional status of the green manure. Moreover, it is necessary to proceed with research considering the bromatological content of the black oat, so models can be developed and correlated with animal nutrition aspects.

5. Conclusions

High-quality DSMs and orthoimages were obtained from UAV-based RGB images and applied to estimating black oat height and biomass. Elevation information extracted from the DSMs was first used to determine plant height along the growth stages of the plants. The coefficient of determination (R2) among HDSM and HREF was found to be intermediate to high with the best results when using data collected up until and including the flowering stage (R2 = 0.85), while using data collected until the end of the grain filling stage yielded an R2 = 0.73. When using data collected up until and including booting stage, the regression showed the lowest performance (R2 = 0.43), indicating that data collected during the initial stages of development might not represent the real height of the plants. It is thus recommended that data collected up until and including flowering be used.
From the studied VIRGBs, TCVI has presented the strongest correlation with dry biomass and also a high correlation with HDSM according to Pearson’s correlation matrix (Table 7).
Dry biomass was studied through regression models. For all growth stages, models that combined VIRGB and HDSM showed the best performance for predicting the dry biomass of black oat, with R2 values of 0.84, 0.85, and 0.86 when using data collected until the end of the booting, flowering, and grain filling stages, respectively. As these R2 values are very close, it can be said that a good estimation of productivity, through dry biomass, can be made at the initial growth stages of black oat. When analyzing DB with a single factor, it is recommended that VIRGB be used when only data collected up until and including the booting stage is available, but for the later growth stages, modeling dry biomass based on HDSM proved to be better.
Therefore, the methodology demonstrated potential for obtaining photogrammetric products via a faster and direct-to-process method, resulting in high-quality DSMs and orthoimages. Without using GCPs, the data extracted from these DSMs and orthoimages provided good-quality models for estimating plant height and dry biomass. Further studies need to be performed to test the models with different sets of data from black oats and other grasses to improve estimation capability.

Author Contributions

Conceptualization, L.R.T. and F.R.; methodology, L.R.T. and F.R.; software, L.R.T.; validation, F.R., T.M.G. and L.B.; formal analysis, F.R. and L.R.T.; investigation, L.R.T. and L.B.; data curation, L.R.T.; writing—original draft preparation, L.R.T.; writing—review and editing, L.R.T., F.R., L.B. and T.M.G.; supervision, F.R.; project administration, F.R.; funding acquisition, F.R. and T.M.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES), grant number 88882.378441/2019-01.

Data Availability Statement

Publicly available datasets were analyzed in this study. The data will be made available posteriorly to this publication. The data will be found here: [https://repositorio.usp.br/] under the title of this research paper. Accessed on 17 February 2023.

Acknowledgments

The authors would like to thank the University of São Paulo Faculty of Food Engineering and Animals Science and “Luiz de Queiroz” College of Agriculture along with their staff. The authors also acknowledge the funding from Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Ceretta, C.A.; Basso, C.J.; Herbes, M.G.; Poletto, N.; Da Silveira, M.J. Produção E Decomposição De Fitomassa De Plantas Invernais De Cobertura De Solo E Milho, Sob Diferentes Manejos Da Adubação Nitrogenada. Ciência Rural 2002, 32, 49–54. [Google Scholar] [CrossRef]
  2. Gabriel, A.; Antonio, F.; Pessoa, S.; Strohhaecker, L.; Helmich, J.J. Preparo Convencional E Cultivo Mínimo Do Solo Na Cultura De Mandioca Em Condições De Adubação Verde Com Ervilhaca E Differences Between Convencional and Minimum Tillage Soil Preparation. Ciência Rural 2000, 30, 953–957. [Google Scholar] [CrossRef]
  3. Cassol, L.C.; Piva, J.T.; Soares, A.B.; Assmann, A.L. Produtividade e composição estrutural de aveia e azevém submetidos a épocas de corte e adubação nitrogenada. Rev. Ceres 2011, 58, 438–443. [Google Scholar] [CrossRef] [Green Version]
  4. Ferolla, F.S.; Vásquez, H.M.; Da Silva, J.F.C.; Viana, A.P.; Domingues, F.N.; Lista, F.N. Composição bromatológica e fracionamento de carboidratos e proteínas de aveia-preta e triticale sob corte e pastejo. Rev. Bras. Zootec. 2008, 37, 197–204. [Google Scholar] [CrossRef] [Green Version]
  5. Machado, L.A.Z. “Aveia: Forragem E Cobertura Do Solo,” Embrapa Agropecuária Oeste-Coleção Sistema Plantio Direto, p. 16, 2000. Available online: https://www.infoteca.cnptia.embrapa.br/bitstream/doc/243576/1/COL20003.pdf (accessed on 20 December 2022).
  6. Fernando Sousa de Almeida and Benedito Noedi Rodrigues, Guia de herbicidas: Contribuição para o uso adequado em plantio direto e convencional, 1st ed. Londrina-PR. 1985. Available online: https://biblioteca.ibge.gov.br/index.php/biblioteca-catalogo?id=216401&view=detalhes (accessed on 17 December 2022).
  7. Acorsi, M.G.; das Dores Abati Miranda, F.; Martello, M.; Smaniotto, D.A.; Sartor, L.R. Estimating Biomass of Black Oat Using UAV-Based RGB Imaging. Agronomy 2019, 9, 344. [Google Scholar] [CrossRef] [Green Version]
  8. Hakl, J.; Hrevušová, Z.; Hejcman, M.; Fuksa, P. The use of a rising plate meter to evaluate lucerne (Medicago sativa L.) height as an important agronomic trait enabling yield estimation. Grass Forage Sci. 2012, 67, 589–596. [Google Scholar] [CrossRef]
  9. Lussem, U.; Bolten, A.; Gnyp, M.L.; Jasper, J.; Bareth, G. Evaluation of Rgb-Based Vegetation Indices from Uav Imagery to Estimate Forage Yield in Grassland. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences-ISPRS, Beijing, China, 7 May 2018, 42, 1215–1219. [Google Scholar] [CrossRef] [Green Version]
  10. McKevith, B. Nutritional aspects of cereals. Nutr. Bull. 2004, 29, 111–142. [Google Scholar] [CrossRef]
  11. Filho, A.C.; Toebe, M.; Alves, B.M.; Burin, C.; Dos Santos, G.O.; Facco, G.; Neu, I.M.M. Relações lineares entre caracteres de aveia preta. Ciencia Rural 2015, 45, 985–992. [Google Scholar] [CrossRef] [Green Version]
  12. Bendig, J.; Yu, K.; Aasen, H.; Bolten, A.; Bennertz, S.; Broscheit, J.; Gnyp, M.L.; Bareth, G. Combining UAV-based plant height from crop surface models, visible, and near infrared vegetation indices for biomass monitoring in barley. Int. J. Appl. Earth Obs. Geoinf. 2015, 39, 79–87. [Google Scholar] [CrossRef]
  13. Bendig, J.; Bolten, A.; Bareth, G. UAV-based Imaging for Multi-Temporal, very high Resolution Crop Surface Models to monitor Crop Growth Variability. Photogramm Fernerkun 2013, 6, 551–562. [Google Scholar] [CrossRef]
  14. Rango, A.; Laliberte, A.; Winters, C.; Kris, H. Devolopment of and operational UAV/remote sensing capability for rangeland management. In Proceedings of the 23nd Bristol International Unmanned Air Vehicle Systems (UAVS) Conference, Bristol, UK, 7 April 2008; p. 9. [Google Scholar]
  15. Getzin, S.; Nuske, R.S.; Wiegand, K. Using Unmanned Aerial Vehicles (UAV) to Quantify Spatial Gap Patterns in Forests. Remote Sens. 2014, 6, 6988–7004. [Google Scholar] [CrossRef] [Green Version]
  16. Zhang, H.; Wang, L.; Tian, T.; Yin, J. A Review of Unmanned Aerial Vehicle Low-Altitude Remote Sensing (UAV-LARS) Use in Agricultural Monitoring in China. Remote Sens. 2021, 13, 1221. [Google Scholar] [CrossRef]
  17. Bagaram, M.B.; Giuliarelli, D.; Chirici, G.; Giannetti, F.; Barbati, A. UAV Remote Sensing for Biodiversity Monitoring: Are Forest Canopy Gaps Good Covariates? Remote Sens. 2018, 10, 1397. [Google Scholar] [CrossRef]
  18. Tsouros, D.C.; Bibi, S.; Sarigiannidis, P.G. A review on UAV-based applications for precision agriculture. Information 2019, 10, 349. [Google Scholar] [CrossRef] [Green Version]
  19. Gonzales, R.C.; Woods, R.E. Digital Image Processing; Prentice Hall: Upper Saddle River, NJ, USA, 1996; ISBN 9780131687288. [Google Scholar]
  20. Peñuelas, J.; Filella, I. Technical focus: Visible and near-infrared reflectance techniques for diagnosing plant physiological status. Trends Plant Sci. 1998, 3, 151–156. [Google Scholar] [CrossRef]
  21. Su, B.; Xue, J.R.; Xie, C.Y.; Fang, Y.L.; Song, Y.Y.; Fuentes, S. Digital surface model applied to unmanned aerial vehicle based photogrammetry to assess potential biotic or abiotic effects on grapevine canopies. Int. J. Agric. Biol. Eng. 2016, 9, 119–130. [Google Scholar] [CrossRef]
  22. Sanches, G.M.; Duft, D.G.; Kölln, O.T.; Luciano, A.C.D.S.; De Castro, S.G.Q.; Okuno, F.M.; Franco, H.C.J. The potential for RGB images obtained using unmanned aerial vehicle to assess and predict yield in sugarcane fields. Int. J. Remote Sens. 2018, 39, 5402–5414. [Google Scholar] [CrossRef]
  23. Ballesteros, R.; Ortega, J.F.; Hernandez, D.; Moreno, M.A. Onion biomass monitoring using UAV-based RGB imaging. Precis. Agric. 2018, 19, 840–857. [Google Scholar] [CrossRef]
  24. Huang, Y.; Brand, H.J.; Sui, R.; Thomson, S.J.; Furukawa, T.; Ebelhar, M.W. Cotton Yield Estimation Using Very High-Resolution Digital Images Acquired with a Low-Cost Small Unmanned Aerial Vehicle. Trans. ASABE 2016, 59, 1563–1574. [Google Scholar] [CrossRef] [Green Version]
  25. Yue, J.; Feng, H.; Li, Z.; Zhou, C.; Xu, K. Mapping winter-wheat biomass and grain yield based on a crop model and UAV remote sensing. Int. J. Remote Sens. 2021, 42, 1577–1601. [Google Scholar] [CrossRef]
  26. García-Martínez, H.; Flores-Magdaleno, H.; Ascencio-Hernández, R.; Khalil-Gardezi, A.; Tijerina-Chávez, L.; Mancilla-Villa, O.; Vázquez-Peña, M. Corn Grain Yield Estimation from Vegetation Indices, Canopy Cover, Plant Density, and a Neural Network Using Multispectral and RGB Images Acquired with Unmanned Aerial Vehicles. Agriculture 2020, 10, 277. [Google Scholar] [CrossRef]
  27. Maimaitijiang, M.; Sagan, V.; Sidike, P.; Hartling, S.; Esposito, F.; Fritschi, F.B. Soybean yield prediction from UAV using multimodal data fusion and deep learning. Remote Sens. Environ. 2019, 237, 111599. [Google Scholar] [CrossRef]
  28. Li, B.; Xu, X.; Zhang, L.; Han, J.; Bian, C.; Li, G.; Liu, J.; Jin, L. Above-ground biomass estimation and yield prediction in potato by using UAV-based RGB and hyperspectral imaging. ISPRS J. Photogramm. Remote Sens. 2020, 162, 161–172. [Google Scholar] [CrossRef]
  29. Zheng, Y.; Zhu, Q.; Huang, M.; Guo, Y.; Qin, J. Maize and weed classification using color indices with support vector data description in outdoor fields. Comput. Electron. Agric. 2017, 141, 215–222. [Google Scholar] [CrossRef]
  30. Gitelson, A.A.; Viña, A.; Arkebauer, T.J.; Rundquist, D.C.; Keydan, G.; Leavitt, B. Remote estimation of leaf area index and green leaf biomass in maize canopies. Geophys. Res. Lett. 2003, 30, 1248. [Google Scholar] [CrossRef] [Green Version]
  31. Zheng, H.; Cheng, T.; Li, D.; Zhou, X.; Yao, X.; Tian, Y.; Cao, W.; Zhu, Y. Evaluation of RGB, Color-Infrared and Multispectral Images Acquired from Unmanned Aerial Systems for the Estimation of Nitrogen Accumulation in Rice. Remote Sens. 2018, 10, 824. [Google Scholar] [CrossRef] [Green Version]
  32. Lu, J.; Cheng, D.; Geng, C.; Zhang, Z.; Xiang, Y.; Hu, T. Combining plant height, canopy coverage and vegetation index from UAV-based RGB images to estimate leaf nitrogen concentration of summer maize. Biosyst. Eng. 2021, 202, 42–54. [Google Scholar] [CrossRef]
  33. Ge, H.; Xiang, H.; Ma, F.; Li, Z.; Qiu, Z.; Tan, Z.; Du, C. Estimating Plant Nitrogen Concentration of Rice through Fusing Vegetation Indices and Color Moments Derived from UAV-RGB Images. Remote Sens. 2021, 13, 1620. [Google Scholar] [CrossRef]
  34. Patrício, D.I.; Rieder, R. Computer vision and artificial intelligence in precision agriculture for grain crops: A systematic review. Comput. Electron. Agric. 2018, 153, 69–81. [Google Scholar] [CrossRef] [Green Version]
  35. Bendig, J.; Bolten, A.; Bennertz, S.; Broscheit, J.; Eichfuss, S.; Bareth, G. Estimating Biomass of Barley Using Crop Surface Models (CSMs) Derived from UAV-Based RGB Imaging. Remote Sens. 2014, 6, 10395–10412. [Google Scholar] [CrossRef] [Green Version]
  36. Tilly, N.; Hoffmeister, D.; Cao, Q.; Lenz-Wiedemann, V.; Miao, Y.; Bareth, G. Transferability of Models for Estimating Paddy Rice Biomass from Spatial Plant Height Data. Agriculture 2015, 5, 538–560. [Google Scholar] [CrossRef] [Green Version]
  37. Yue, J.; Yang, G.; Li, C.; Li, Z.; Wang, Y.; Feng, H.; Xu, B. Estimation of Winter Wheat Above-Ground Biomass Using Unmanned Aerial Vehicle-Based Snapshot Hyperspectral Sensor and Crop Height Improved Models. Remote Sens. 2017, 9, 708. [Google Scholar] [CrossRef] [Green Version]
  38. Watanabe, K.; Guo, W.; Arai, K.; Takanashi, H.; Kajiya-Kanegae, H.; Kobayashi, M.; Yano, K.; Tokunaga, T.; Fujiwara, T.; Tsutsumi, N.; et al. High-Throughput Phenotyping of Sorghum Plant Height Using an Unmanned Aerial Vehicle and Its Application to Genomic Prediction Modeling. Front. Plant Sci. 2017, 8, 421. [Google Scholar] [CrossRef] [Green Version]
  39. Han, X.; Thomasson, J.A.; Bagnall, G.C.; Pugh, N.A.; Horne, D.W.; Rooney, W.L.; Jung, J.; Chang, A.; Malambo, L.; Popescu, S.C.; et al. Measurement and Calibration of Plant-Height from Fixed-Wing UAV Images. Sensors 2018, 18, 4092. [Google Scholar] [CrossRef] [Green Version]
  40. Luz, P.H.D.C.; Herling, V.R.; Braga, G.; Filho, J.C.M.N.; de Lima, C.G. RESPOSTA DA AVEIA PRETA (Avena strigosa SCHREB) À IRRIGAÇÃO POR ASPERSÃO E ADUBAÇÃO NITROGENADA. Braz. J. Agric.-Rev. Agric. 2015, 79, 353–362. [Google Scholar] [CrossRef] [Green Version]
  41. Jannoura, R.; Brinkmann, K.; Uteau, D.; Bruns, C.; Joergensen, R.G. Monitoring of crop biomass using true colour aerial photographs taken from a remote controlled hexacopter. Biosyst. Eng. 2015, 129, 341–351. [Google Scholar] [CrossRef]
  42. Yu, D.; Zha, Y.; Shi, L.; Jin, X.; Hu, S.; Yang, Q.; Huang, K.; Zeng, W. Improvement of sugarcane yield estimation by assimilating UAV-derived plant height observations. Eur. J. Agron. 2020, 121, 126159. [Google Scholar] [CrossRef]
  43. Sumesh, K.S.; Ninsawat, S.; Som-Ard, J. Integration of RGB-based vegetation index, crop surface model and object-based image analysis approach for sugarcane yield estimation using unmanned aerial vehicle. Comput. Electron. Agric. 2021, 180, 105903. [Google Scholar] [CrossRef]
  44. Possoch, M.; Bieker, S.; Hoffmeister, D.; Bolten, A.; Schellberg, J.; Bareth, G. Multi-Temporal crop surface models combined with the rgb vegetation index from UAV-based images for forage monitoring in grassland. ISPRS-Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2016, XLI-B1, 991–998. [Google Scholar] [CrossRef] [Green Version]
  45. Corti, M.; Cavalli, D.; Cabassi, G.; Bechini, L.; Pricca, N.; Paolo, D.; Marinoni, L.; Vigoni, A.; Degano, L.; Gallina, P.M. Improved estimation of herbaceous crop aboveground biomass using UAV-derived crop height combined with vegetation indices. Precis. Agric. 2022, 1–20. [Google Scholar] [CrossRef]
Figure 1. Graphical abstract of the present study to estimate black oat biomass using RGB-based UAV images.
Figure 1. Graphical abstract of the present study to estimate black oat biomass using RGB-based UAV images.
Remotesensing 15 01363 g001
Figure 2. Photogrammetric products resulting from the flight performed on September 15. (a) Orthoimage. (b) Digital surface model.
Figure 2. Photogrammetric products resulting from the flight performed on September 15. (a) Orthoimage. (b) Digital surface model.
Remotesensing 15 01363 g002
Figure 3. Regression models between HREF and HDSM. (A) Regression model using all data; (B) regression model using data collected up until and including the flowering stage; (C) regression model using data collected up until and including booting stage. RMSE = Root Mean Square Error (m), n = number of observations. For all models p < 0.05.
Figure 3. Regression models between HREF and HDSM. (A) Regression model using all data; (B) regression model using data collected up until and including the flowering stage; (C) regression model using data collected up until and including booting stage. RMSE = Root Mean Square Error (m), n = number of observations. For all models p < 0.05.
Remotesensing 15 01363 g003
Figure 4. (A,C,E): Regression models between HREF and HDSM using modeling dataset for all stages, the flowering stage, and the booting stage respectively; (B,D,F): performance of the regression models with the validation dataset for all stages, the flowering stage, and the booting stage, respectively. RMSE = root mean square error (m), n = number of observations. For all models p < 0.05.
Figure 4. (A,C,E): Regression models between HREF and HDSM using modeling dataset for all stages, the flowering stage, and the booting stage respectively; (B,D,F): performance of the regression models with the validation dataset for all stages, the flowering stage, and the booting stage, respectively. RMSE = root mean square error (m), n = number of observations. For all models p < 0.05.
Remotesensing 15 01363 g004
Figure 5. Validation for the model using combinatory regression with HDSM and TCVI.
Figure 5. Validation for the model using combinatory regression with HDSM and TCVI.
Remotesensing 15 01363 g005
Table 2. Descriptive information from photogrammetric products.
Table 2. Descriptive information from photogrammetric products.
FlightDate 1DAS 2Growth
Stage
Density (pt. m−2) 3Image
Overlap 4
DSM
Resolution (mm pix−1)
Orthoimage
Resolution
(cm pix−1)
110 August 202011 Tillering6941.72>86.29 1.26
218 August 202019Tillering7139.54>86.221.24
325 August 202026Booting6977.67>86.251.25
41 September 202033Booting7191.29>86.061.21
58 September 202040Flowering7234.58>86.211.24
615 September 202047Flowering7107.64>86.201.24
723 September 202055Grain filling7549.89>86.131.23
830 September 202062Grain filling7277.06>86.281.26
1 Every date occurred in 2020. 2 Days after sowing. 3 Point density in the dense point cloud. 4 Number of images over a common point.
Table 3. Descriptive statistics of HDSM and HREF for each flight mission and in-field inspection.
Table 3. Descriptive statistics of HDSM and HREF for each flight mission and in-field inspection.
FlightHREF (m)HDSM (m)
µσMinMaxRangeµσMinMaxRange
10.0610.0130.0380.0870.0480.1480.0410.0850.2410.157
20.1110.0150.0690.1380.0690.1350.0370.0890.2100.121
30.1420.0210.1150.1820.0670.1960.0510.1200.2940.174
40.2010.0210.1700.2450.0750.3090.0800.2020.5480.346
50.3020.0250.2460.3370.0910.5680.0760.4180.6940.277
60.3740.0310.3180.4260.1070.8050.1460.5571.0520.495
70.4840.1440.1980.6650.4670.5760.0690.4090.6660.257
80.7300.1080.4260.8760.4501.0410.2830.6021.7651.163
µ = overall mean for the respective flight or in-field inspection, including all experimental plots. σ = standard deviations of the measured values. Min = minimum values observed in the flight or in-field inspection. Max = maximum values observed in the flight or in-field inspection. Range = Min–Max.
Table 4. Mean values of HDSM and HREF according to flight inspection and treatments.
Table 4. Mean values of HDSM and HREF according to flight inspection and treatments.
FlightHREF (m)HDSM (m) ns
T1T2T3T4T5µFT1T2T3T4T5µF
10.0590.0660.0620.0620.0570.0610.1350.1260.1610.1750.1440.148
20.1030.0990.1220.1130.1170.1110.1300.1200.1370.1520.1350.135
30.1330.1500.1420.1440.1390.1420.1820.1840.1970.2160.1980.195
40.1960.2040.2040.1980.2000.2010.2960.3140.2930.3570.2860.309
50.2980.3170.2980.2870.3090.3020.5690.5760.5460.5410.6100.568
60.3630.3770.3830.3640.3820.3740.7420.7760.7940.8450.8670.805
70.450 bc0.624 a0.340 c0.456 bc0.548 ab0.4840.5570.6250.5530.5860.5560.576
80.762 ab0.819 a0.668 b0.685 b0.719 ab0.7300.9821.2230.8631.1091.0251.044
µT0.2950.3320.2770.2890.309 0.4490.4930.4430.4970.477
T1—control, T2–T5: 25%, 50%, 75%, and 100% of treated slaughterhouse effluent, respectively. µF = mean height value for each respective flight in the case of HDSM or in-field inspection in the case of HREF. µT = mean value according to each respective treatment. Different letters in the same row indicate significant differences among treatments and ns = no significant differences observed according to the analysis of variance with a significance level of 0.05.
Table 5. Mean values for dry biomass (t ha−1) according to each treatment.
Table 5. Mean values for dry biomass (t ha−1) according to each treatment.
Growth StageDAST1T2T3T4T5
Tillering190.1110.1120.1750.1230.179
Booting330.6800.5890.7730.7290.782
Flowering473.4003.7393.9023.8093.970
Grain filling625.2384.7154.7155.0665.213
T1—control, T2–T5: 25%, 50%, 75%, and 100% of treated slaughterhouse effluent, respectively. DAS = days after sowing. No significant differences were observed among the treatments for each growth stage, with a confidence level of 0.05.
Table 6. Descriptive statistics for overall mean values for all parameters evaluated in the study.
Table 6. Descriptive statistics for overall mean values for all parameters evaluated in the study.
FlightDASGrowth StageParametersµσMedianRange
1 and 219TilleringHREF0.1110.0150.0690.068
HDSM0.1350.0370.1200.121
DB0.1400.0660.1140.235
3 and 433BootingHREF0.2010.0210.1970.075
HDSM0.3090.0800.2990.346
DB0.7110.2640.6200.856
5 and 647FloweringHREF0.3740.0310.3690.107
HDSM0.8050.1460.7700.495
DB3.7640.6383.7552.442
7 and 862Grain fillingHREF0.7300.1080.7560.450
HDSM1.041 0.2831.0261.163
DB5.1360.9185.0313.434
DAS = days after sowing. µ = overall mean values for 20 plots in each flight mission for in-field inspection. σ = standard deviation. HREF = plant height measure through in-field inspection (m). HDSM = plant height derived from digital surface model (m). DB = dry biomass (g kg−1).
Table 7. Pearson’s correlation matrix.
Table 7. Pearson’s correlation matrix.
DBHDSMHREFMPRINExGVARIGRRITCVI
DB1
HDSM0.88981
HREF0.92490.87111
MPRI0.77970.72440.70591
NExG0.76550.71510.68340.99351
VARI0.78800.72580.71410.99860.98911
GRRI0.79120.72060.71090.99530.98800.99821
TCVI−0.7987−0.7238−0.7371−0.9662−0.9378−0.9764−0.97611
DB = dry biomass. HDSM = height derived from images. HREF = in-field height measurement. MPRI = modified photochemical vegetation index. NExG = normalized extra green index. VARI = visual atmospheric resistance index. GRRI = green–red ratio index. TCVI = true color vegetation index.
Table 8. Descriptive statistics for overall mean values.
Table 8. Descriptive statistics for overall mean values.
Growth StageRegressionEquationnR2RMSE
BootingDB vs. HDSM y = 8.9434 x ² + 6.5081 x 0.4773 400.460.251
DB vs. TCVI y = 1.6049 x + 1.1915 400.800.153
DB vs. HDSM + TCVI y = 2.9654 x 1 3.0222 x 2 + 6.3065 x 1 x 2 + 1.9293 400.840.137
FloweringDB vs. HDSM y = 4.9664 x 0.5290 600.820.685
DB vs. TCVI y = 4.9779 x + 3.2732 600.601.031
DB vs. HDSM + TCVI y = 3.9959 x 1 1.5556 x 2 + 0.4172 600.850.629
Grain
Filling
DB vs. HDSM y = 2.7730 x ² + 8.6046 x 1.1367 800.840.859
DB vs. TCVI y = 6.6919 x + 4.3162 800.641.296
DB vs. HDSM + TCVI y = 3.4617 x 1 2 + 7.0242 x 1 3.5630 x 2 800.860.816
Validation modelDB vs. HDSM + TCVI y = 1.7206 x 1 2 1.8181 + 6.3040 x 1 + 1.1599 560.870.769
Significant R2 and coefficients for all models (p < 0.05). The growth stage indicates which stages were considered in each model. The validation model is the model built with the modeling dataset (70% of available data). x 1 = HDSM and x 2 = TCVI. DB = dry biomass (g kg−1).
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Trevisan, L.R.; Brichi, L.; Gomes, T.M.; Rossi, F. Estimating Black Oat Biomass Using Digital Surface Models and a Vegetation Index Derived from RGB-Based Aerial Images. Remote Sens. 2023, 15, 1363. https://doi.org/10.3390/rs15051363

AMA Style

Trevisan LR, Brichi L, Gomes TM, Rossi F. Estimating Black Oat Biomass Using Digital Surface Models and a Vegetation Index Derived from RGB-Based Aerial Images. Remote Sensing. 2023; 15(5):1363. https://doi.org/10.3390/rs15051363

Chicago/Turabian Style

Trevisan, Lucas Renato, Lisiane Brichi, Tamara Maria Gomes, and Fabrício Rossi. 2023. "Estimating Black Oat Biomass Using Digital Surface Models and a Vegetation Index Derived from RGB-Based Aerial Images" Remote Sensing 15, no. 5: 1363. https://doi.org/10.3390/rs15051363

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop