Next Article in Journal
Nitrogen Allocation Tradeoffs Within-Leaf between Photosynthesis and High-Temperature Adaptation among Different Varieties of Pecan (Carya illinoinensis [Wangenh.] K. Koch)
Previous Article in Journal
Effects of Graphene Oxide on Plant Growth: A Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Selection of Soybean Genotypes under Drought and Saline Stress Conditions Using Manhattan Distance and TOPSIS

by
Bruno Rodrigues de Oliveira
1,*,
Alan Mario Zuffo
2,
Jorge González Aguilera
1,
Fábio Steiner
3,
Sheda Méndez Ancca
4,
Luis Angel Paucar Flores
5 and
Hebert Hernán Soto Gonzales
6
1
Pantanal Editora, Nova Xavantina 78690-000, MT, Brazil
2
Departamento de Agronomia, Universidade Estadual do Maranhão (UEMA), Campus de Balsas, Praça Gonçalves Dias, Balsas 65800-000, MA, Brazil
3
Departamento de Agronomia, Universidade Estadual de Mato Grosso do Sul (UEMS), Cassilândia 79540-000, MS, Brazil
4
Escuela Profesional de Ingeniería Pesquera, Universidad Nacional de Moquegua (UNAM), Ilo 18611, Peru
5
Facultad de Ingeniería de Industrias Alimentarias y Biotecnología, Universidad Nacional de Frontera (UNF), Sullana 20103, Peru
6
Laboratorio de Biología Molecular y Biotecnología, Escuela Profesional de Ingeniería Ambiental, Universidad Nacional de Moquegua (UNAM), Ilo 18611, Peru
*
Author to whom correspondence should be addressed.
Plants 2022, 11(21), 2827; https://doi.org/10.3390/plants11212827
Submission received: 18 September 2022 / Revised: 4 October 2022 / Accepted: 20 October 2022 / Published: 24 October 2022
(This article belongs to the Topic Tolerance to Drought and Salt Stress in Plants)

Abstract

:
The search for soybean genotypes more adapted to abiotic stress conditions is essential to boost the development and yield of the crop in Brazil and worldwide. In this research, we propose a new approach using the concept of distance (or similarity) in a vector space that can quantify changes in the morphological traits of soybean seedlings exposed to stressful environments. Thus, this study was conducted to select soybean genotypes exposed to stressful environments (saline or drought) using similarity based on Manhattan distance and the Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) method. TOPSIS is a multi-criteria decision method for selecting the best alternative using the concept of distance. The use of TOPSIS is essential because the genotypes are not absolutely similar in both treatments. That is, just the distance measure is not enough to select the best genotype simultaneously in the two stress environments. Drought and saline stresses were induced by exposing seeds of 70 soybean genotypes to −0.20 MPa iso-osmotic solutions with polyethylene glycol–PEG 6000 (119.6 g L−1) or NaCl (2.36 g L−1) for 14 days at 25 °C. The germination rate, seedling length, and seedling dry matter were measured. We showed here how the genotypic stability of soybean plants could be quantified by TOPSIS when comparing drought and salinity conditions to a non-stressful environment (control) and how this method can be employed under different conditions. Based on the TOPSIS method, we can select the best soybean genotypes for environments with multiple abiotic stresses. Among the 70 tested soybean genotypes, RK 6813 RR, ST 777 IPRO, RK 7214 IPRO, TMG 2165 IPRO, 5G 830 RR, 98R35 IPRO, 98R31 IPRO, RK 8317 IPRO, CG 7464 RR, and LG 60177 IPRO are the 10 most stable genotypes under drought and saline stress conditions. Owing to high stability and gains with selection verified for these genotypes under salinity and drought conditions, they can be used as genitors in breeding programs to obtain offspring with higher resistance to antibiotic stresses.

1. Introduction

Soybean (Glycine max (L.) Merrill.) is among the most important crops in the world, constituting one of the largest sources of vegetable oil and animal protein [1,2]. The main producing countries are Brazil, the USA, Argentina, China, and India [3]. Abiotic stresses such as drought and salinity negatively affect world soybean production, constituting limiting factors for soybean cultivation, especially in tropical and semi-arid regions [4,5].
In many situations, crop sowing is performed under inappropriate soil moisture conditions to support seed germination, or in areas with excess salts in the soil or irrigation water [4]. Currently, one-third of the world’s cultivated land, 7% of the total world land, and 50% of the irrigated land are affected by salinity [6]. Therefore, the sustainability of agriculture production in many areas of the world is at risk due to soil salinization and water scarcity during the crop growing season.
Low water content and salt excess in the soil at sowing time cause delayed and reduced seed germination, unequal seedling emergence, and unsatisfactory stand establishment, which results in crop yield reductions [7,8]. Drought and salinity affect seed germination and seedling growth by creating highly negative water potentials, thus preventing water uptake by the seeds and plants [8,9,10,11]. Salinity may also cause direct phytotoxic effects of Na+ and Cl ions [9]. Therefore, drought and salt tolerance testing in the initial stages of plant growth is important because a seed with more rapid germination under water or salt stress conditions may be expected to achieve rapid seedling establishment, resulting in higher yields.
Many factors affect plant responses to drought or salt stress, such as plant genetics, timing, the intensity and duration of applied stress, and environmental factors that determine the genotype versus environment interaction [11,12,13,14]. Genetic differences in tolerance to abiotic stresses in soybean genotypes have been reported in other studies [4,15,16,17], which may be useful in identifying genotypes more adapted to sowing under abiotic stress conditions. In the research by Zuffo et al. [4], the authors proposed a multitrait tool to select the best soybean genotypes exposed to drought and saline stresses. They investigated the stability of 46 soybean genotypes using the stability index. Among the results presented, they mention that this index can be used under different stressful environmental conditions to quantify the genotypic stability of soybean genotypes.
In this research, we discussed how the concept of distance (or similarity) in a vector space could be used to evaluate changes in the characteristics of soybean genotypes when subjected to stressed environments.
Two objects are similar if they have characteristics in common. These objects are represented as vectors in a vector space model (V.S.M.) [18]. Each component is a feature or a characteristic of the object and represents a dimension in the vector space. A real n-dimensional vector x (i.e., x n ) is expressed to its components as x = ( x 1 , x 2 , , x n ) , where the symbol represents the real number set. In this text, the features of soybean genotypes are the following variables: germination (GERM), shoot length (SL), root length (RL), total length (TL), shoot dry mass (SDM), root dry mass (RDM) and total dry mass (TDM). Thus, each sample of the dataset is represented as x 7 , that belongs to a 7-dimensional vector space.
In the VSM, the similarity is related to the distance between vectors [19]. In other words, the closer two objects are, the more similar they are. Classic machine learning algorithms, such as a k-nearest neighbor, k-means, support vector machine, and others, use distance metrics to measure similarity [20,21]. There are several ways to calculate the distances between vectors. Some of them are Euclidean, Manhattan, Chebyshev, Mahalanobis, Cosine, Hamming, Jaccard, and Spearman [22].
In this research, the soybean genotype samples are drawn in the VSM. The Manhattan distance is used for compute similarity, as it is more suitable in higher dimensions. It is calculated for different stressful environments. To combine the distance measures and choose which genotype has the shortest distance (higher similarity with the control sample) in both stressed environments, we propose using the Technique for Order Preference by Similarity to Ideal Solution (TOPSIS). This method is a multi-criteria decision-making approach used in several areas [23]. It is preferable to other decision-making approaches because (i) it is suited to a large number of attributes and alternatives; (ii) it requires little subjectivity in the definition of input values; and (iii) it has consistency in the comparison of the alternative ranking [24].
The main objective of this research is to select soybean genotypes exposed to stressful environments (saline or drought) using similarity based on Manhattan distance and the TOPSIS method.

2. Results

To illustrate the proposed approach, Figure 1 shows a further example considering only two normalized variables, i.e., TDM and TL in Figure 1a, “97R73 RR” and “HO Paranaiba IPRO” are the genotypes with the shortest and greatest distances in the Control/Saline comparison, respectively. In Figure 1b, “AS 3575 IPRO” and “CG 8166 RR” are related to the shortest and greatest distances in the Control/Drought comparison, respectively.
Calculations of Manhattan distances are performed according to Equation (1). Distances were calculated for the Control/Saline and Control/Drought comparison. The estimates are made considering the mean values of four samples of each genotype for the variables GERM, SL, RL, TL, SDM, RDM, and TDM, after the normalization procedure for each variable.
Figure 2 shows the values of the Manhattan distances obtained in comparing normalized variables between control and abiotic stress environments and the score obtained by the TOPSIS method. For this experiment, the criteria weights (distances) were equal to 0.5. It is noteworthy that the TOPSIS method was employed for the Manhattan distances and not for the variables.
Table 1 shows the ten best soybean genotypes (cultivars) in ascending order, considering the Manhattan distances obtained in the Control/Saline and Control/Drought comparison. The presented results make it clear that no genotype is better than another. Only the genotype ST 777 IPRO appeared on both lists. This trade-off makes the process of choosing the best genotype a difficult task. Therefore, it is necessary to use the TOPSIS method, which has the power to join these distances to decide which genotype performs better in both environments of abiotic stress.
Table 2 shows the ten best genotypes selected according to the TOPSIS score in descending order. In addition, the Manhattan distances of each genotype in each stressed environment are shown, as well as the rank position according to the distances shown in Figure 3.
The genotypes respond differently in each environment of abiotic stress (Table 1 and Table 2). The results shown in Figure 2 assumed the same weight in the TOPSIS method for both Control/Saline and Control/Drought comparisons. To verify how this weighting affects the selection of the genotypes provided by the TOPSIS, the weights of the distances (criteria) are varied from 0.1 to 1, remembering that the sum of the weights is equal to 1, according to Section 4.3. Some results obtained with this experiment are shown in Table 3.
Finally, Figure 3 and Figure 4 show the original values (without normalization) of the variables GERM, SL, RL, TL, SDM, RDM, and TDM for the four best and worst genotypes, respectively, selected by TOPSIS, considering the same weight for both criteria. This comparison is important to determine if the Manhattan distance and the TOPSIS method are selecting those genotypes that suffer fewer changes in abiotic stress environments.
Table 4 shows the percentage changes (increase or decrease) considering the control and abiotic stress environments. Values are displayed only for the best and worst genotypes according to the TOPSIS selection. The negative sign indicates an increase in the value of the variable.

3. Discussion

Our experience reveals that objects with close features are more similar. Distance metrics mathematically verify this notion [19,25]. In this work, it is being investigated whether these metrics can be used to measure the similarity between soybean genotypes in the control environment and abiotic stress environments. For this, it was necessary to model the obtained data in a 7-dimensional vector. We chose the Manhattan distance to calculate the similarity between the samples because it presents better results in high-dimensional vector spaces [18,20,21,22,25]. Since the genotypes show different responses in saline and drought-stressed environments, we also included the TOPSIS method to select the one with the greatest similarity in both environments. Yao et al. [26], using the TOPSIS approach, compared seeds of Bupleurum chinense and found that the green ones had a good germination characteristic and were recognized as the superior group, followed by the yellow, brown, and black ones. Successful application of the TOPSIS in dealing with complicated issues in managing crop priority planning has been employed in the soybean crop [27].
As a result of using the Manhattan and TOPSIS distance, Figure 1 illustrates well how distance is related to similarity. The genotype “97R73 RR” (Figure 1a) has the shortest distance in the saline stress environment; therefore, it has greater similarity with the average sample of the control environment. The values of the TDM and TL variables are very close for the samples in the control and saline stress environment. On the other hand, the genotype “HO Paranaiba IPRO” has the greatest distance in the saline stress environment. Therefore, it was observed that, in the stress environment, the values of the TDM and TL variables are very different from those in the control environment. The analogous conclusion can be observed in Figure 1b in the drought-stress environment. In this case, it is important to note that, although the distance was shown only for two variables, the distance metric is generalizable for vector spaces of any dimension [19,25]. The difficulty of selecting genotypes through adaptability studies under abiotic stress conditions such as drought, salinity, and aluminum toxicity has been shown in soybean [3,4,5,14,16], sorghum [6], wheat [7], and corn [11]. Several methods are available to evaluate groups of genotypes in different environments. However, it is still difficult to select the best genotypes because the responses are very variable, so new approaches, such as those described in our work, are important.
The results presented in Figure 2 and Table 1 and Table 2, make it clear that no genotype is absolutely better than another. Some genotypes are more similar to the control samples in the saline stress environment, while others are more similar to the control samples in the drought environment. This is because genotypes respond differently to abiotic stress [3,4,5,14,16]. The genotypes “97R73 RR” and “AS 3575 IPRO” are the most similar in saline and drought stress environments, respectively. However, the genotype “AS 3575 IPRO” occupies the 65th position when considering distance in the Control/Saline comparison. On the other hand, the genotype “97R73 RR” occupies the 28th position in the Control/Drought comparison. The response to different stresses is always variable, as verified in the present work, hence the difficulty in selecting most crops.
Analyzing the results in Table 2, we noticed that none of these genotypes was selected by the TOPSIS method. Moreover, the first genotype selected, i.e., “RK 6813 RR”, occupies the 12th and 4th position concerning the Control/Saline and Control/Drought comparisons, respectively. From the Rank column of Table 2, we conclude that TOPSIS makes a balanced selection of genotypes. If we add the Manhattan distances (4th and 5th columns), we notice that the sum values increase, although the individual values of the distances do not show a different order.
Considering the results in Table 3, which show the selection by TOPSIS when varying the criteria weights (distances), we observed that the genotype “ST 777 IPRO” was selected in all cases. On the other hand, the best genotype, “RK 6813 RR”, was not selected in the last case, when the weights were 0.1 and 0.9 for the saline and drought environments, respectively. These genotypes are less dependent on the weights assigned to distances. In other words, these genotypes present more stability relative to abiotic stress environments and reduced distance values. However, the genotype that presents greater stability, and close similarities to both stress environments, is the genotype “AS 3610 IPRO” (see Figure 2). However, their distances for stress environments are greater than those of the genotypes “RK 6813 RR” and “ST 777 IPRO”. The genotype “AS 3610 IPRO” occupies the 24th position, considering the TOPSIS score. It was shown that the TOPSIS method had practical meaning, confirming the applications made by Li et al. [28].
From the original values (without normalization) of the variables GERM, SL, RL, TL, SDM, RDM, and TDM, it can be seen from the results shown in Figure 3 and Figure 4 that the TOPSIS method made an appropriate selection. The values of these variables for the best (RK 6813 RR) and worst (CG 8166 RR) genotypes, respectively, are shown in Figure 3a and Figure 4a. We noticed that the changes in the values of the variables are much more pronounced for the worst genotype than for the best. In other words, the worst genotype, according to the TOPSIS method, is the one that suffered the most modification in abiotic stress environments. Xue et al. [29] demonstrated that the TOPSIS method could be used efficiently to evaluate the total content of bioactive compounds of different grains, thus providing a database for manufacturing companies to optimally select the germination period.
In Table 4, for example, we note that the variable GERM suffered a decrease of 3.03% and 5.55% in the saline and drought environment, respectively, for the best genotype. On the other hand, for the worst genotype, this decrease was 23% and 14%, respectively. Even more drastic was the change concerning the RL variable. For the best genotype, there was an increase of 10.29%, while for the worst, there was a decrease of over 40%. Similar changes are observed for all other variables, showing that the selection provided by the Manhattan distance combined with the TOPSIS method is correct.
By analyzing the most important strengths and weaknesses of the TOPSIS method, we can say that the method shows the accuracy of results when evaluating a large number of alternatives. Expert knowledge is a basic source of information for making effective managerial decisions in the selection process of plants subjected to abiotic stress.
In addition, a wide variety of techniques have been used to introduce effective factors in the selection of superior genotypes. However, the best or most suitable method is not clearly defined, so various methods are used to ensure the correct decision. The constant evaluation in stress environments combined with selection strategies is constantly sought among soybean breeders to promote the selection of genotypes with the best performance. Therefore, the simultaneous use of methods and the presentation of their most important criteria is the only solution to identifying the best genotypes.

4. Materials and Methods

4.1. Plant Material and Stress Treatments

Seeds from a total of 70 midwestern Brazilian commercial soybean genotypes [Glycine max (L.) Merrill.] listed in Table 5 were produced under field conditions at Cassilândia, MS, Brazil (19°05′16″ S, 51°48′04″ W, and an altitude of 480 m), during the 2019 to 2020 growing season, and used in this study. Minimum and maximum air temperatures during the growing season were 21.7 and 35.3 °C, respectively, and mean air relative humidity ranged from 51 to 83%. The harvest was manually performed at the R8 stage (full maturity), and the plants were air-dried at room temperature for 96 h. The seeds were extracted by hand, sieved through round hole sieves with 6.00 mm diameters, and then stored in sealed paper bags at 13 °C and 35% moisture content until use. Before starting the experiment, the water content, thousand seed weight, and germination rate were determined, as described in the Official Rules for Seed Analysis [30]. The results obtained for the soybean genotypes are shown in Table 5.
The seeds were previously disinfected by immersion for 10 min in 1% sodium hypochlorite solution (v/v), washed in running water, and placed to germinate under stressful (drought and saline stress) and non-stressful (control) conditions. The drought and saline stresses were induced by exposing seeds from each soybean genotype to solutions with an osmotic potential of −0.20 MPa prepared with polyethylene glycol (PEG-6000) and sodium chloride (NaCl), respectively. The amount of PEG-6000 (119.57 g L−1) added to obtain the solution with an osmotic pressure of –0.20 MPa was determined by the equation of Michel and Kaufmann [31]: Ψs = [−(1.18 × 10−2) × C − (1.18 × 10−4) × C2 + (2.67 × 10−4) × C × T + (8.39 × 10−7) × C2 × T]/10, where Ψs is the osmotic potential (MPa), C is the concentration (g L−1 of PEG-6000), and T is the temperature (°C). The amount of NaCl (2.357 g L−1) added to obtain the osmotic pressure of –0.20 MPa was calculated by the van’t Hoff equation [32]: Ψs = −R × T × C × i, where R is the universal constant of noble gas (0.008314 MPa mol−1 K−1), T is the absolute temperature (273.15 + °C), C is the molar concentration of the solute (mol L−1), and i is the van’t Hoff factor, that is the number of ions released when the solute is dissolved in water (i.e., for NaCl this value is 2.0 (Na+ and Cl)). Distilled water with an osmotic potential of 0.00 MPa was used as a control. Using an osmotic solution at –0.20 MPa efficiently discriminates the tolerance differences between soybean genotypes [4].

4.2. Germination Conditions and Measured Variables

Four replicates of 50 seeds from each soybean genotype were placed to germinate on three sheets of germination test paper towels, previously moistened with distilled water (control), PEG or NaCl solutions of –0.2 MPa, in the proportion of three times the mass of the dry substrate. The paper towel sheets were then turned into rolls and packaged into plastic bags to prevent evaporation and to maintain the relative humidity close to 100%. Germination was conducted in a growth chamber under 12/12 h photoperiod (light/darkness), with a light intensity of 240 μmol m−2 s−1 and a temperature of 25 °C for 14 days. Seeds were considered germinated when the primary root was longer than 10.0 mm. Germinated seeds were recorded 14 days after the test installation.
After 14 days of exposure to drought and salt stresses, the shoot length (SL), primary root length (RL), and total seedling length (TL) were measured using a meter scale. The shoot dry matter (SDM), root dry matter (RDM), and total seedling dry matter (TDM) were recorded after oven drying at 85 °C for 48 h.

4.3. Manhattan Distance and Similarity

The distance function (metric) of two vectors x and y is designed by d ( x , y ) , d :   n × n , and must satisfy the requirements: (a) d ( x , y ) > 0 ; (b) d ( x , x ) = 0 ; (c) d ( x , y ) = d ( y , x ) ; and (d) d ( x , y ) + d ( y , z ) d ( x , z ) [18]. The Minkowski distances of two vectors x = ( x 1 , x 2 , , x n ) and y = ( y 1 ,   y 2 ,   ,   y n ) are defined as Equation (1):
d ( x , y , p ) = ( i = 1 n | x i y i | p ) 1 / p
For p = 1 and p = 2 , this distance is named Manhattan and Euclidean, respectively. For comparison, Figure 5 shows these distances in the plane, where d ( X , Y , 1 ) = g + h and d ( X , Y , 2 ) = f .
Manhattan distance can be understood as the shortest route taken by a taxi driven in a city whose streets are perpendicular. On the other hand, the Euclidean distance is the intuitive notion of distance used by us. Aggarwal, Hinneburg, and Keim [25] establish that the Manhattan distance is the most adequate to contrast the difference between the nearest and farthest vectors from a fixed vector.
Since the variables can be on different scales, applying a pre-processing step named normalization is necessary. This consists of dividing the variables by their maximum value, i.e., x ˜ i = x i / max ( x i ) , where x i is the value of the variable for the i -th sample and x ˜ i is the respective normalized value. This ensures that x ˜ i is in a range between 0 and 1. In addition, the scale is eliminated, and the variable becomes dimensionless.

4.4. TOPSIS

The TOPSIS method can be employed in six steps, as described below [33]. Let X = ( x i j ) m × n be a decision matrix with m alternatives and n criteria, where x i j is the value of the alternative i concerning criterion j , do:
Step 1. Normalizes the decision matrix: r i j = x i j / i = 1 m x i j 2   ,   j ;
Step 2. Given a criteria weight vector w = [ w 1 , w 2 , , w n ] , obtain the weighted normalized decision matrix: v i j = r i j w j T , such that w j = 1 ;
Step 3. Determine the worst alternative A w (negative-ideal solution) and best alternative A b (positive-ideal solution) as: A w j = max i = 1 m v i j and A b j = min i = 1 m v i j , respectively;
Step 4. Calculate the Euclidean distance from each alternative i to the worst and best alternatives: S i w = i = 1 m ( v i j A w j ) 2 and S i b = i = 1 m ( v i j A b j ) 2 , respectively;
Step 5. Calculate the relative closeness from each alternative i to the worst alternative: C i = S i w / ( S i w + S i b ) .
The coefficient C i provides a TOPSIS score to rank the alternatives. The higher its value, the closer that alternative is to the ideal solution. In the context of this study, the alternatives are the genotypes, and the criteria are the Manhattan distances.

4.5. Proposed Approach

Our objective is to verify which genotypes are less sensitive to changes in the stressed environment, referring to salinity and drought. As stated in Section 4.3, we can use distance metrics to measure the similarity between objects. The experiments carried out with the soybean genotypes considered three environments: control, saline, and drought. We know that stressed environments alter plant responses. Therefore, there will be changes in the values of the measured variables. We can verify how much these modifications altered the characteristics of the plants. To do so, we can model it as a VSM problem. We calculated the distance between the control samples’ mean and the stressed samples’ mean for each genotype. Then, we compare the distances. Those genotypes that present the smallest distance to the control samples are the genotypes less sensitive to saline and/or drought stress. Our approach considers the Manhattan distance because, according to Aggarwal, Hinneburg, and Keim [25], it is more suitable to contrast the difference between the nearest and farthest vectors from a fixed vector.
A second approach aims to combine distances for the comparison in the stressed environments, that is, Control/Saline or Control/Drought. In this way, we will know which genotypes are more similar to the control samples in both stressed environments. To combine the distances of saline ( d s ) and of drought ( d d ) environments from the control, we propose the use of the TOPSIS method, where the first and second column of the decision matrix is composed of values d s and d d , respectively, for each genotype (alternative).
Although TOPSIS can be applied directly in the measured variables, this would not be adequate. Therefore, there is no way to determine whether a greater or lesser value of the magnitude of these variables implies a better or worse genotype. Therefore, it is necessary to use the idea of similarity (or distance). So, we are sure that a smaller distance indicates greater similarity with the control sample.
The entire computational implementation was carried out in the Python language using the Colab environment and the NumPy, Pandas, IPython, Seaborn, Scipy, and Matplotlib libraries [34,35,36,37,38,39,40,41]. The developed source code and experimental data can be accessed at this link: https://github.com/brunobro/selection-of-soybean-genotypes, accessed on 24 August 2022.

5. Conclusions

Our results show that the genotypic stability of 70 soybean genotypes can be quantified by the TOPSIS method and Manhattan distance when comparing drought and salinity conditions in relation to the non-stressful environment (control). Based on the TOPSIS method, we can select the best soybean genotypes for environments with multiple abiotic stresses. Among all soybean genotypes tested, RK 6813 RR, ST 777 IPRO, RK 7214 IPRO, TMG 2165 IPRO, 5G 830 RR, 98R35 IPRO, 98R31 IPRO, RK 8317 IPRO, CG 7464 RR, and LG 60,177 IPRO are the 10 most stable under drought and saline stress conditions. Furthermore, from the point of view of plant breeding, these selected genotypes can be used as parents to obtain genotypes resistant to drought and salinity.

Author Contributions

Conceptualization, B.R.d.O. and A.M.Z.; methodology, B.R.d.O. and F.S.; software, B.R.d.O.; validation, B.R.d.O., A.M.Z., J.G.A., F.S. and H.H.S.G.; formal analysis, B.R.d.O.; investigation, B.R.d.O. and A.M.Z.; resources, B.R.d.O., S.M.A., L.A.P.F. and H.H.S.G.; data curation, B.R.d.O.; writing—original draft preparation, B.R.d.O., A.M.Z., J.G.A., F.S., S.M.A., L.A.P.F. and H.H.S.G.; writing—review and editing, B.R.d.O., A.M.Z., J.G.A., F.S., S.M.A., L.A.P.F. and H.H.S.G.; visualization, B.R.d.O., A.M.Z., J.G.A., F.S. and H.H.S.G.; supervision, B.R.d.O.; project administration, B.R.d.O.; funding acquisition, S.M.A., L.A.P.F. and H.H.S.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

All available data can be obtained by contacting the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Cattelan, A.J.; Dall’Agnol, A. The rapid soybean growth in Brazil. Oilseeds Fats Crops Lipids 2018, 25, 102. [Google Scholar] [CrossRef] [Green Version]
  2. Saidganieva, S.T.Q.; Yuldasheva, S.N.Q. Measures against the damage of the insects of the nightshades family in the Soybean plant. Asian J. Multidimens. Res. 2020, 9, 28–30. [Google Scholar] [CrossRef]
  3. Pagano, M.C.; Miransari, M. The importance of soybean production worldwide. In Abiotic and Biotic Stresses in Soybean Production; Academic Press: Cambridge, MA, USA, 2016; pp. 1–26. [Google Scholar] [CrossRef]
  4. Zuffo, A.M.; Steiner, F.; Aguilera, J.G.; Teodoro, P.E.; Teodoro, L.P.R.; Busch, A. Multi-trait stability index: A tool for simultaneous selection of soya bean genotypes in drought and saline stress. J. Agron. Crop Sci. 2020, 206, 815–822. [Google Scholar] [CrossRef]
  5. Steiner, F.; Zuffo, A.M.; Teodoro, P.E.; Aguilera, J.G.; Teodoro, L.P.R. Multivariate adaptability and stability of soya bean genotypes for abiotic stresses. J. Agron. Crop Sci. 2021, 207, 354–361. [Google Scholar] [CrossRef]
  6. Gheyi, H.R.; Dias, N.S.; Lacerda, C.F. Manejo da Salinidade na Agricultura: Estudos Básicos e Aplicados; INCT Sal: Fortaleza, Brazil, 2010; 472p. [Google Scholar]
  7. Patanè, C.; Saita, A.; Sortino, O. Comparative effects of salt and water stress on seed germination and early embryo growth in two cultivars of sweet sorghum. J. Agron. Crop Sci. 2013, 199, 30–37. [Google Scholar] [CrossRef]
  8. Steiner, F.; Zuffo, A.M.; Zoz, T.; Zoz, A.; Zoz, J. Drought tolerance of wheat and black oat crops at early stages of seedling growth. Rev. De Ciências Agrárias 2017, 40, 576–586. [Google Scholar] [CrossRef] [Green Version]
  9. Acosta-Motos, J.R.; Ortuño, M.F.; Bernal-Vicente, A.; Diaz-Vivancos, P.; Sanchez-Blanco, M.J.; Hernandez, J.A. Plant responses to salt stress: Adaptive mechanisms. Agronomy 2017, 7, 1–18. [Google Scholar] [CrossRef] [Green Version]
  10. Ibrahim, E.A. Seed priming to alleviate salinity stress in germinating seeds. J. Plant Physiol. 2016, 192, 38–46. [Google Scholar] [CrossRef]
  11. Zamljen, T.; Medic, A.; Hudina, M.; Veberic, R.; Slatnar, A. salt stress differentially affects the primary and secondary metabolism of peppers (Capsicum annuum L.) according to the genotype, fruit part, and salinity level. Plants 2022, 11, 853. [Google Scholar] [CrossRef]
  12. Naghavi, M.R.; Pour-Aboughadareh, A.; Khalili, M. Evaluation of drought tolerance indices for screening some of corn (Zea mays L.) cultivars under environmental conditions. Not. Sci. Biol. 2013, 5, 388–393. [Google Scholar] [CrossRef] [Green Version]
  13. Petrović, G.; Jovičić, D.; Nikolić, Z.; Tamindžić, G.; Ignjatov, M.; Milošević, D.; Milošević, B. Comparative study of drought and salt stress effects on germination and seedling growth of pea. Genetika 2016, 48, 373–381. [Google Scholar] [CrossRef] [Green Version]
  14. Pushpavalli, R.; Berger, J.D.; Turner, N.C.; Siddique, K.H.M.; Colmer, T.D.; Vadez, V. Cross-tolerance for drought, heat and salinity stresses in chickpea (Cicer arietinum L.). J. Agron. Crop Sci. 2020, 206, 405–419. [Google Scholar] [CrossRef]
  15. Silva, B.R.S.; Batista, B.L.; Lobato, A.K.S. Anatomical changes in stem and root of soybean plants submitted to salt stress. Plant Biol. 2021, 23, 57–65. [Google Scholar] [CrossRef] [PubMed]
  16. Caranhato, A.L.H.; Angelotti-Mendonça, J.; Mertz-Henning, L.M.; Marin, S.R.R.; de Melo, C.L.P.; Foloni, J.S.S.; Neumaier, N.; Farias, J.R.B.; Nepomuceno, A.L. Drought tolerance of elite soybean cultivars with the introgression of transgene AtAREB1. Pesqui. Agropecuária Bras. 2022, 57, 2656. [Google Scholar] [CrossRef]
  17. Morais, T.B.; Menegaes, J.F.; Sanchotene, D.; Dorneles, S.B.; Melo, A.A.; Swarowsky, A. Biostimulants increase soybean productivity in the absence and presence of water deficit in southern Brazil. J. Agric. Sci. 2022, 14, 111–122. [Google Scholar] [CrossRef]
  18. Sidorov, G.; Gelbukh, A.; Gómez-Adorno, H.; Pinto, D. Soft similarity and soft cosine measure: Similarity of features in vector space model. Comput. Y Sist. 2014, 18, 491–504. [Google Scholar] [CrossRef]
  19. Kubat, M. An Introduction to Machine Learning; Spinger: New York, NY, USA, 2015; 291p. [Google Scholar] [CrossRef]
  20. Ehsani, R.; Drabløs, F. Robust Distance Measures for k NN Classification of Cancer Data. Cancer Inform. 2020, 19, 1–9. [Google Scholar] [CrossRef]
  21. Oliveira, B.R.; da Silva, A.A.P.; Teodoro, L.P.R.; Azevedo, G.B.; Azevedo, G.T.D.O.S.; Baio, F.H.R.; Sobrinho, R.L.; Silva, C.A., Jr.; Teodoro, P.E. Eucalyptus growth recognition using machine learning methods and spectral variables. For. Ecol. Manag. 2021, 497, 119496. [Google Scholar] [CrossRef]
  22. Vanschoenwinkel, B.; Manderick, B. Appropriate Kernel Functions for Support Vector Machine Learning with Sequences of Symbolic Data. In Deterministic and Statistical Methods in Machine Learning; Winkler, J., Niranjan, M., Lawrence, N., Eds.; Springer: Berlin/Heidelberg, Germany, 2005. [Google Scholar] [CrossRef]
  23. Mardani, A.; Jusoh, A.; Nor, K.; Khalifah, Z.; Zakwan, N.; Valipour, A. Multiple criteria decision-making techniques and their applications—A review of the literature from 2000 to 2014. Econ. Res. Ekon. Istraživanja 2015, 28, 516–571. [Google Scholar] [CrossRef]
  24. Kalbar, P.P.; Karmakar, S.; Asolekar, S.R. Selection of an appropriate wastewater treatment technology: A scenario-based multiple-attribute decision-making approach. J. Environ. Manag. 2012, 113, 158–169. [Google Scholar] [CrossRef]
  25. Aggarwal, C.C.; Hinneburg, A.; Keim, D.A. On the surprising behavior of distance metrics in high dimensional space. In International Conference on Database Theory; Springer: Berlin/Heidelberg, Germany, 2001; pp. 420–434. [Google Scholar] [CrossRef] [Green Version]
  26. Yao, R.; Wang, F.; Zou, Y.; Wang, L.; Yang, X.; Chen, X. Comprehensive germination quality evaluation of Bupleurum chinense seeds of different maturities from Qingchuan County with the Topsis approach. Bull. Bot. Res. 2014, 34, 108–113. [Google Scholar] [CrossRef]
  27. Seyedmohammadi, J.; Sarmadian, F.; Jafarzadeh, A.A.; Ghorbani, M.A.; Shahbazi, F. Application of SAW, TOPSIS and fuzzy TOPSIS models in cultivation priority planning for maize, rapeseed and soybean crops. Geoderma 2018, 310, 178–190. [Google Scholar] [CrossRef]
  28. Li, J.; Wang, K.; Gao, Y.; Ma, C.; Sun, D.; Hussain, M.A.; Qayum, A.; Jiang, Z.; Hou, J. Effect of thermal treatment and pressure on the characteristics of green soybean tofu and the optimization conditions of tofu processing by TOPSIS analysis. LWT 2021, 136, 110314. [Google Scholar] [CrossRef]
  29. Xue, Z.; Wang, C.; Zhai, L.; Yu, W.; Chang, H.; Kou, X.; Zhou, F. Bioactive compounds and antioxidant activity of mung bean (Vigna radiata L.), soybean (Glycine max L.) and black bean (Phaseolus vulgaris L.) during the germination process. Czech J. Food Sci. 2016, 34, 68–78. [Google Scholar] [CrossRef] [Green Version]
  30. Brasil-Ministry of Agriculture, Livestock and Supply. Regras Para Análise de Sementes; Mapa/ACS: Brasília, Brazil, 2009; 399p. [Google Scholar]
  31. Michel, B.E.; Kaufmann, M.R. The osmotic potential of polyethylene glycol 6000. Plant Physiol. 1973, 51, 914–916. [Google Scholar] [CrossRef] [PubMed]
  32. Hillel, D. Soil and Water: Physical Principles and Process; Academic Press: New York, NY, USA, 1971; 288p. [Google Scholar]
  33. Yadav, V.; Karmakar, S.; Kalbar, P.P.; Dikshit, A.K. PyTOPS: A Python based tool for TOPSIS. SoftwareX 2019, 9, 217–222. [Google Scholar] [CrossRef]
  34. Hunter, D. Matplotlib: A 2D Graphics Environment. Comput. Sci. Eng. 2007, 9, 90–95. [Google Scholar] [CrossRef]
  35. Pérez, F.; Granger, B.E. IPython: A System for Interactive Scientific Computing. Comput. Sci. Eng. 2007, 9, 21–29. [Google Scholar] [CrossRef]
  36. Van Rossum, G.; Drake, F.L. Python 3 Reference Manual; CreateSpace: Scotts Valley, CA, USA, 2009. [Google Scholar]
  37. McKinney, W. Data structures for statistical computing in python. In Proceedings of the 9th Python in Science Conference, Austin, TX, USA, 28 June–3 July 2010; Volume 445, pp. 51–56. [Google Scholar]
  38. Bisong, E. Google Colaboratory. In Building Machine Learning and Deep Learning Models on Google Cloud Platform; Apress: Berkeley, CA, USA, 2019. [Google Scholar] [CrossRef]
  39. Harris, C.R.; Millman, K.J.; Walt, S.J.; Gommers, R.; Virtanen, P.; Cournapeau, D.; Wieser, E.; Taylor, J.; Berg, S.; Smith, N.J.; et al. Array programming with NumPy. Nature 2020, 585, 357–362. [Google Scholar] [CrossRef]
  40. Virtanen, P.; Gommers, R.; Oliphant, T.E.; Haberland, M.; Reddy, T.; Cournapeau, D.; Burovski, E.; Peterson, P.; Weckesser, W.; Bright, J.; et al. SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python. Nat. Methods 2020, 17, 261–272. [Google Scholar] [CrossRef] [Green Version]
  41. Waskom, M.L. Seaborn: Statistical data visualization. J. Open Source Softw. 2021, 6, 3021. [Google Scholar] [CrossRef]
Figure 1. Shows four vectors for only two variables, i.e., TDM (total seedling dry matter) and TL (shoot length). These vectors are related to the most similar (shortest distance) and least similar (greater distance) genotypes regarding the comparison: (a) Control/Saline, and (b) Control/Drought.
Figure 1. Shows four vectors for only two variables, i.e., TDM (total seedling dry matter) and TL (shoot length). These vectors are related to the most similar (shortest distance) and least similar (greater distance) genotypes regarding the comparison: (a) Control/Saline, and (b) Control/Drought.
Plants 11 02827 g001
Figure 2. Manhattan distances and Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) score for each soybean genotype.
Figure 2. Manhattan distances and Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) score for each soybean genotype.
Plants 11 02827 g002
Figure 3. Values of the original variables in the control and abiotic stress environment for the four best soybean genotypes. (ad) are the values of genotypes RK 6813 RR, ST 777 IPRO, RK 7214 IPRO, and TMG 2165 IPRO, respectively.
Figure 3. Values of the original variables in the control and abiotic stress environment for the four best soybean genotypes. (ad) are the values of genotypes RK 6813 RR, ST 777 IPRO, RK 7214 IPRO, and TMG 2165 IPRO, respectively.
Plants 11 02827 g003
Figure 4. Values of the original variables in the control and abiotic stress environment for the four worst soybean genotypes. (ad) are the values of genotypes CG 8166 RR, HO Paranaiba IPRO, M7110 IPRO, and NS 8399 IPRO, respectively.
Figure 4. Values of the original variables in the control and abiotic stress environment for the four worst soybean genotypes. (ad) are the values of genotypes CG 8166 RR, HO Paranaiba IPRO, M7110 IPRO, and NS 8399 IPRO, respectively.
Plants 11 02827 g004
Figure 5. Comparison of Manhattan (g + h) and Euclidean (f) distances between vectors X and Y.
Figure 5. Comparison of Manhattan (g + h) and Euclidean (f) distances between vectors X and Y.
Plants 11 02827 g005
Table 1. Top ten genotypes to Control/Saline, and Control/Drought distances in ascending order.
Table 1. Top ten genotypes to Control/Saline, and Control/Drought distances in ascending order.
GenotypeControl/Saline DistanceGenotypeControl/Drought Distance
97R73 RR0.3132AS 3575 IPRO0.4034
TMG 2165 IPRO0.3329BMX Ponta IPRO0.4578
RK 8317 IPRO0.3367BMX Foco IPRO0.5371
TMG 2378 IPRO0.3482RK 6813 RR0.5733
98R31 IPRO0.3670TMG 716 RR0.6079
98R35 IPRO0.37205D 6215 IPRO0.6550
NS 5151 IPRO0.3730FPS solar IPRO0.6645
5G 770 RR0.3787ST 777 IPRO0.6649
ST 797 IPRO0.3800RK 7214 IPRO0.6805
ST 777 IPRO0.39265G 830 RR0.7158
Table 2. Top ten genotypes to TOPSIS score in descending order.
Table 2. Top ten genotypes to TOPSIS score in descending order.
GenotypeRankManhattan DistancesTOPSIS Score
C/S *C/D **C/SC/D
RK 6813 RR12th4th0.44610.57330.9380
ST 777 IPRO10th8th0.39260.66490.9230
RK 7214 IPRO14th9th0.47720.68050.9081
TMG 2165 IPRO2nd11th0.33290.73850.9073
5G 830 RR16th10th0.52980.71580.8911
98R35 IPRO.6th18th0.37200.80480.8878
98R31 IPRO.5th23th0.36700.83420.8805
RK 8317 IPRO3rd24th0.33670.86960.8728
CG 7464 RR21th14th0.60550.77140.8650
LG 60,177 IPRO17th20th0.55930.81360.8637
* C/S and ** C/D mean Control/Saline and Control/Draught, respectively.
Table 3. Genotypes selected by the TOPSIS when criteria weights (Control/Saline and Control/Drought distances) vary.
Table 3. Genotypes selected by the TOPSIS when criteria weights (Control/Saline and Control/Drought distances) vary.
WeightsGenotypesTOPSIS Score
Control/SalineControl/Drought
0.10.9BMX Ponta IPRO
BMX Foco IPRO
AS 3575 IPRO
RK 6813 RR
TMG 716 RR
5D 6215 IPRO
ST 777 IPRO
FPS solar IPRO
RK 7214 IPRO
5G 830 RR
0.9581
0.9340
0.9315
0.9284
0.9100
0.8925
0.8903
0.8889
0.8836
0.8687
0.30.7RK 6813 RR
ST 777 IPRO
RK 7214 IPRO
FPS solar IPRO
5D 6215 IPRO
BMX Ponta IPRO
TMG 716 RR
5G 830 RR
TMG 2165 IPRO
BMX Foco IPRO
0.9313
0.8997
0.8908
0.8802
0.8798
0.8794
0.8768
0.8754
0.8735
0.8700
0.70.3ST 777 IPRO
TMG 2165 IPRO
RK 6813 RR
98R35 IPRO
98R31 IPRO
RK 8317 IPRO
RK 7214 IPRO
97R73 RR
ST 797 IPRO
5G 770 RR
0.9507
0.9495
0.9444
0.9362
0.9329
0.9307
0.9262
0.9260
0.9125
0.9119
0.90.1TMG 2165 IPRO
97R73 RR
RK 8317 IPRO
98R31 IPRO
98R35 IPRO
TMG 2378 IPRO
ST 777 IPRO
5G 770 RR
ST 797 IPRO
RK 6719 IPRO
0.9839
0.9788
0.9783
0.9721
0.9713
0.9669
0.9668
0.9647
0.9645
0.9473
Table 4. Percentage change of the original variables for the best (RK 6813 RR) and the worst (CG 8166 RR) genotype.
Table 4. Percentage change of the original variables for the best (RK 6813 RR) and the worst (CG 8166 RR) genotype.
GenotypeComparisonPercentage Increase/Decrease in Variables
GERMSLRLTLSMDRDMTDM
RK 6813 RRControl/Saline3.0340.9630.6936.3425.7828.7226.54
Control/Drought5.5571.68−10.2934.7686.30−0.3164.90
CG 8166 RRControl/Saline23.0064.8471.3767.9957.5047.0854.76
Control/Drought14.0084.1440.3764.0992.3146.0280.20
GERM: germination; SL: shoot length; RL: root length; TL: total length; SDM: shoot dry mass; RDM: root dry mass and TDM: total dry mass.
Table 5. Agronomic characteristics, seed water content (WC), thousand seed weight (SW), and germination rate (GR) of 70 Brazilian soybean genotypes used in this study.
Table 5. Agronomic characteristics, seed water content (WC), thousand seed weight (SW), and germination rate (GR) of 70 Brazilian soybean genotypes used in this study.
GenotypeAgronomic CharacteristicsWC (%)SW (g)GR (%)
MCRMGGT
5D615 RREarly6.1Ind.9.9717398
5D6215 IPRO.Early6.4Ind.9.2215697
5D690 RREarly6.9Ind.9.0517689
5G 770 RREarly7.7Ind.9.01174100
5G 830 RREarly8.3Ind.9.67167100
95R51Ultraearly7.5Ind.9.6017791
97R21Early7.2Ind.8.8517697
97R50 IPRO.Early7.5Ind.8.15190100
97R73 RRMid7.7Ind.9.6618797
98R31 I.P.R.O.Mid8.3Ind.9.8917597
98R35 I.P.R.O.Mid8.3Ind.9.5718098
AS 3575 IPROUltraearly5.7Ind.8.8418999
AS 3610 IPROUltraearly6.1Ind.9.8117398
BMX Bônus IPROMid7.9Ind.9.42185100
BMX Desafio RREarly7.4Ind.8.7417099
BMX Foco IPRO1107.2Ind.9.1117583
BMX Ponta IPRO.Early6.9Ind.9.5819198
CD 238 RRMid7.1Det.9.4316596
CD 250Mid5.5Ind.9.09159100
CG 67 RR.Mid7.4Semi8.7816598
CG 68 RREarly6.8Ind.9.4318286
CG 7464 RREarly7.4Semi.9.6515996
CG 7665 RRMid7.6Semi.9.8419297
CG 8166 RRMid8.1Ind.9.3417496
FPS Antares RRMid6.8Ind.9.28194100
F.P.S. Atalanta I.P.R.O.Early5.8Ind.9.0718988
FPS Iguaçu RRUltraearly5.0Ind.9.43159100
FPS Júpiter RREarly5.9Ind.8.5913098
FPS Netuno RRMid6.3Ind.9.1913598
FPS Paranapanema RREarly5.6Semi.8.4316493
F.P.S. Solar I.P.R.O.Early6.3Ind.8.4818899
FPS Solimões RREarly5.7Ind.9.3819897
F.P.S. Urano RREarly6.2Ind.8.7427896
HO Cristalino IPROMid8.3Ind.8.93160100
HO Maracaí IPROMid7.7Ind.9.6017087
HO Paranaíba IPROEarly7.4Ind.9.7521093
LG 60,163 IPROEarly6.3Semi.8.9521098
LG 60,177 IPROEarly7.7Ind.9.6119999
M5917 IPROUltraearly5.9Ind.9.4217093
M7110 IPROEarly6.8Ind.9.01195100
NS 5106 IPROUltraearly5.2Ind.9.1120296
NS 5151 IPROUltraearly5.2Ind.9.5017395
NS 5909 RGUltraearly6.9Ind.9.9517780
NS 5959 IPROEarly5.9Ind.9.1817695
NS 6909 IPROUltraearly6.3Ind.8.3416592
NS 7000 IPROEarly7.0Ind.9.4020188
NS 7007 IPROEarly7.1Ind.9.7721099
NS 7209 IPROMid7.3Ind.9.3427297
NS 7300 IPROEarly7.3Ind.9.72190100
NS 7338 IPROEarly7.3Ind.9.3019794
NS 7505 IPROEarly7.5Ind.8.9720084
NS 8399 IPROMid8.3Ind.9.0218589
RK 5813 RRUltraearly5.8Ind.8.7620298
RK 6316 IPROEarly6.3Ind.9.5119491
RK 6719 IPROEarly6.7Ind.9.57190100
RK 6813 RREarly6.8Ind.8.3016899
RK 7214 IPROEarly7.2Ind.8.6017896
RK 7518 IPROEarly7.5Ind.10.08180100
RK 8115 IPROMid8.1Ind.9.0220096
RK 8317 IPROMid8.3Ind.10.4618588
ST 777 IPROEarly7.7Ind.9.41155100
ST 797 IPROEarly7.9Ind.9.45150100
SYN 13,610 IPROEarly6.1Ind.8.5316796
TMG 2165 IPROEarly6.5Ind.9.1418098
TMG 2378 IPROMid7.8Semi.8.9616596
TMG 2381 IPROMid8.1Ind.9.77160100
TMG 7061 IPROEarly6.1Ind.10.1718598
TMG 7063 IPROEarly7.0Ind.9.7517586
TMG 7067 IPROEarly7.2Semi.9.87170100
TMG 716 RREarly5.9Ind.9.51167100
MC: soybean maturity cycle. RMG: relative maturity group. GT: Growth type. Ind.: Indeterminate growing habit. Det.: Determinate growing habit. Semi.: Semideterminate growing habit.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

de Oliveira, B.R.; Zuffo, A.M.; Aguilera, J.G.; Steiner, F.; Ancca, S.M.; Flores, L.A.P.; Gonzales, H.H.S. Selection of Soybean Genotypes under Drought and Saline Stress Conditions Using Manhattan Distance and TOPSIS. Plants 2022, 11, 2827. https://doi.org/10.3390/plants11212827

AMA Style

de Oliveira BR, Zuffo AM, Aguilera JG, Steiner F, Ancca SM, Flores LAP, Gonzales HHS. Selection of Soybean Genotypes under Drought and Saline Stress Conditions Using Manhattan Distance and TOPSIS. Plants. 2022; 11(21):2827. https://doi.org/10.3390/plants11212827

Chicago/Turabian Style

de Oliveira, Bruno Rodrigues, Alan Mario Zuffo, Jorge González Aguilera, Fábio Steiner, Sheda Méndez Ancca, Luis Angel Paucar Flores, and Hebert Hernán Soto Gonzales. 2022. "Selection of Soybean Genotypes under Drought and Saline Stress Conditions Using Manhattan Distance and TOPSIS" Plants 11, no. 21: 2827. https://doi.org/10.3390/plants11212827

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop