Next Article in Journal
Social Simulation Model of the Spread and Prevention of the Omicron SARS-CoV-2 Variant
Next Article in Special Issue
Risk Analysis of Green Supply Chain Using a Hybrid Multi-Criteria Decision Model: Evidence from Laptop Manufacturer Industry
Previous Article in Journal
Hypercomplex Systems and Non-Gaussian Stochastic Solutions with Some Numerical Simulation of χ-Wick-Type (2 + 1)-D C-KdV Equations
Previous Article in Special Issue
How to Incorporate Preference Information in a Weight-Restricted DEA Model: A Straightforward Solution Applied in the Field of Economics, Based on Simos’ Revised Method
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Multi-Criteria Group Decision-Making Models in a Multi-Choice Environment

1
Department of Statistics, Deanship of Educational Services, Qassim University, Buraydah 51452, Saudi Arabia
2
Department of Basic Science, College of Science & Theoretical Studies, Saudi Electronic University, Riyadh 11673, Saudi Arabia
3
Department of Civil Engineering, College of Engineering, Qassim University, Unaizah 56452, Saudi Arabia
*
Author to whom correspondence should be addressed.
Axioms 2022, 11(11), 659; https://doi.org/10.3390/axioms11110659
Submission received: 17 September 2022 / Revised: 11 November 2022 / Accepted: 15 November 2022 / Published: 21 November 2022
(This article belongs to the Special Issue Multiple-Criteria Decision Making II)

Abstract

:
The best–worst method (BWM) has recently demonstrated its applicability in addressing various decision-making problems in a practical setting. The traditional BWM method is based on deterministic information gathered from experts as pairwise comparisons of several criteria. The advantage of BWM is that it uses fewer calculations and analyses while maintaining good, acceptable consistency ratio values. A multi-choice best–worst method (MCBWM), which considers several options for pairwise comparison of preferences between the criteria, has recently been developed. The experts are given the option to select values from several comparison scales. The MCBWM technique has been shown to be better. Presenting the options for which an optimal solution has been found simplifies the calculation and establishes the ideal weight values. This study proposes two different mathematical programming models for solving multi-criteria decision-making problems having multiple decision-makers. The two methods are proposed considering the multi-choice uncertainty assumption in pairwise criteria comparisons. Additionally, it considers the best–worst method as the base model. The multi-choice uncertainty is applied to determine the best choice out of multiple choices. It gives a real-life scenario to the decision-making problems. Although there are many other forms of uncertainty, such as fuzzy, intuitionistic fuzzy, neutrosophic, probabilistic, etc., it focuses on choices instead of ambiguity in terms of the probabilistic or fuzzy nature of parameters. The parameter considered as multi-choice is the pairwise comparison. These parameters are handled by applying the Lagrange interpolating polynomial method. The proposed models are novel in terms of their mathematical structure and group decision-making approach. The models are formulated and further validated by solving numerical examples. It provides a framework for solving mcdm problems where the weightage to the decision-makers is also incorporated. The CR values for all the models of example 1 and 2, and the case study has been found acceptable.

1. Introduction

Multiple-criteria decision-making (MCDM) plays an important role in real-life decision-making problems. The MCDM approach determines the ranking of the options and selects the best option using the appropriate approach based on certain criteria. There are an enormous number of applications of MCDM methods in real-life problems. These methods include elimination and choice expressing reality (ELECTRE) [1,2], data envelopment analysis (DEA) [3,4], analytic hierarchy process (AHP) [5,6], preference ranking organization method for enrichment evaluations (PROMETHEE) [7,8], VlseKriterijumska Optimizacija I Kompromisno Resenje (VIKOR) [9,10], decision-making trial and evaluation laboratory (DEMATEL), the technique for order of preference by similarity to ideal solution (TOPSIS) [7,11], analytic network process (ANP) [12,13], and best–worst method (BWM) [14,15]. The best suitable method to handle an MCDM problem is determined based on the structure of the problem of decision-making. In general, the process of MCDM consists of multiple steps from formulation to identification of criteria to decision metric and, finally, calculation of weights and rank of criteria.
Among the above-mentioned MCDM approaches, In 2015, Rezai [14] developed an MCDM method named as the best–worst method. As compared to the mostly applied MCDM approach, i.e., AHP, BWM has shown a more reliable approach as it takes fewer number pairwise comparisons leading to fewer calculations and, hence, low inconsistency of pairwise comparisons.
Let us consider for AHP [16], a matrix X having x i j ; i , j = 1 , 2 , 3 , , n as a pairwise importance comparison between the i - th criteria and the j - th criteria. from the n criteria C 1 , C 2 , C 3 , , C n , then the comparison matrix X will become as follows:
X = c 1 c 2 c n x 11 x 12 x 1 n x 21 x 22 x 2 n x n 1 x n 2 x n n c 1 c 2 c n
where x i j represents the degree of relative importance (or the relative preference) of criterion C i over criterion C j , the values of x i j range between the 1/9 to 9 scale. For an equal preference of criterion C i over C j , x i j will take value 1. x i j 1 shows that criterion C 1 is relatively more important than criterion C 2 , with x i j = 9 exhibiting the extreme preference of criterion C i over C j . The relative importance of C j over C i is given by x j i . It is essential that the relative importance of C i over C i is ( x i i = 1 ) and x i j = 1 / x j i , i , j . For X to be perfectly consistent x i k × x k j = x i j , i , j .
In comparison to AHP, the BWM approach is based on pairwise comparisons between the best criterion to all other criteria and all others to the worst criterion. All the favorites are assigned to a number through a scale ranging from 1 to 9. Since the secondary comparisons are not performed, the BWM technique seems to be more convenient, very precise, and far less redundant [14]. Meanwhile, executing a pairwise comparison, a decision-maker expresses both direction and the strength of the preference of i over j. In most situations, the decision-maker has no problem in conveying the direction; however, representing the strength of the choice is a difficult task that is almost the primary source of inconsistency. Since the degree of preference relation is assigned with a numeric number, it may be possible that the provided value is insufficient to accommodate the uncertainty with the linguistic term. Based on the above discussion, in this paper, the pairwise reference comparisons are considered multi-choice comparisons [17,18]. While taking responses from decision-makers (DMs), uncertain information may come up in terms of options. When comparing criterion i over j pairwise, the DM may offer many responses.
Multi-choice programming problem [17,18] is a sort of mathematical programming in which the goal is to select the best alternative among multiple potential combinations to optimize an objective function under a number of constraints. A good review of multi-choice mathematical programming is presented in [19]. The situation of multiple choices for a parameter exists in many managerial decision-making problems. Choosing the optimum combination of parameter values from a variety of parameter values is aided by the multi-choice programming approach. Our goal is to better comprehend the supposed multi-choice parameter, which is multiple opinions in the pairwise comparison that forms the foundation of our proposed method. In the MCDM problem, the multi-choice parameters were essential when a specialist was unsure of the significance of a certain criterion. It is due to a lack of information, unclear criteria, unfavorable factors, and the decision-point makers of view and judgment. The reference comparison’s reference parameters with several choices will increase the decision-making problems’ flexibility. It prompts the decision-makers to use not only a single value but more than one benefit to compare criterion i over j. This approach of pairwise comparison results in inconsistency. The decision-makers are supported in their efforts to comprehend accurately and correctly with regard to their final decisions by the obtained value of inconsistency. This approach aids in examining the consistency of the assessments of the decision’s importance. Because there are so many options for criteria, it is possible to take into account every viewpoint when comparing one criterion to another in pairs. The multi-choice best–worst method is a novel MCDM strategy that is introduced in this research to supplement the BWM for multi-choice comparisons.
The BWM method is a well-established, tested, and verified method. Since its inception, it has been applied to various kinds of real-life problems. A lot of extensions, including uncertainty and hybrid methods, have also been proposed in recent years. Additionally, we have seen that there is no extension of BWM with multi-choice parameters in a group decision-making scenario. This motivated us to carry out this proposed work. In recent years, some new methods have also been developed for determining the weights of the criteria, such as the fully consistency method (FUCOM) [20], level-based weight assessment (LBWA) [21], and defining interrelationships between ranked (DIBR) [22]. In literature, it has been shown that these methods are better than the AHP and BWM. The reason behind it is the less number of pairwise comparisons, higher level of consistency, requires an ( n 1 ) number of pairwise comparisons, reliability of results, and simple algorithm. As a limited study has only been carried out using them, so we have incorporated the multi-choice concept for group decision-making in the best–worst method. This work is not yet explored by anyone. The key reasons for the motivation behind this work are as follows:
  • Numerous group decision-making models have been put out in the literature, but no one has ever taken into account pairwise comparisons as multi-choice parameters.
  • Multiple options for a parameter, such as pairwise comparisons, are another type of uncertainty that can be managed in real-world problems utilizing the multi-choice mathematical programming approach in MCDM.
  • The decision that determines whether a solution is optimal is revealed in the solution that results from solving the proposed models. The goal is to reduce inconsistency. Therefore, multiple models can be solved to find the option with the least amount of inconsistency.
Following are the main objectives of this study:
  • This study’s major goal is to provide group decision-making techniques that incorporate the freedom to select several options for pairwise comparisons.
  • To validate the proposed model by applying it to experimental studies.
Rest of this paper is organized as follows: The next Section 2 is about the literature survey. Some preliminaries are presented in the next Section 3. The proposed models incorporating multi-choice in group decision-making are presented in Section 4. In Section 5, an experimental study conducted using the proposed approach is presented. In Section 6, a case study of the piping selection problem has been presented. Finally, the manuscript concludes in Section 7 and discusses the future directions of the work along with the limitations of the proposed work.

2. Literature Survey

When choosing, organizing, and prioritizing various actions, MCDM considers the decision-makers subjectivity. It also examines the acceptability of alternative options in light of the resources at hand. There are multiple kinds of MCDM methods for ranking and prioritization of criteria. In MCDM, the best–worst method [14] has played a key role in solving many kinds of real-life decision-making problems. Initially, it was applied to a mobile selection problem. Later, It was applied in linking supplier segmentation [23] for enhancing the supplier development model. Gupta and Barua [24] worked on micro-small and medium-sized enterprises (MSMEs) in India, where they found the most significant enablers of technological innovation. Recently [25], the flexibility of information granularity is integrated with the best–worst method along with interval and type-2 fuzzy sets in linguistic terms. A novel model by Tavana et al. [26] has proposed a model which combines the compromise solution with the best–worst method. Malakoutikhah et al. [27] have incorporated fuzzy uncertainty in best–worst method and cognitive map and further applied it in the modeling of criteria and subcriteria affecting unsafe behaviors in organizational, individual, and socio-economic domains. Kharola et al. [28] utilized the best–worst method in prioritizing factors associated with green waste management in the food supply chain. They prioritized a total of 5 criteria and 25 sub-criteria. Bilbao et al. [29] incorporated multiple reference point concepts in the best–worst method and showed application in the assessment of non-life insurance companies. Sadaghiani et al. [30] studied the importance of external forces on the supply chain sustainability in the oil and gas industry; Groenendijk et al. [31] applied it to improve the quality of public transportation, water scarcity management [32], failure mode and effects analysis [33], the judgment of investment projects [34] etc. A good review of BWM articles is presented in [35]. Combination of BWM with other MCDM methods, such as TOPSIS [36], MULTIMOORA [37], VIKOR [38], FDA [39], and ELECTRE [40].
Researchers incorporated uncertainties, such as fuzzy, intuitionistic fuzzy, neutrosophic fuzzy [41], hesitant fuzzy [42], spherical fuzzy [43], probabilistic [44], interval type-2 fuzzy [45], and Bayesian [46] in the best–worst method. A Fuzzy hybrid BWM along with the geographic information system has been applied for the power station selection problem [47]. Fuzzy BWM has been applied to assess the potential environmental impacts of the process of ship recycling [48]. A rough BWM has been applied to the problem of prioritizing recovery solutions to the tourism sector after COVID-19 [49]. BWM has been applied for the land valuation model in three different scenarios [50]. An integrated model of BWM with superiority and inferiority ranking applied in an environment of probabilistic dual hesitant fuzzy sets to a Green supplier selection problem [51]. In [52], a probabilistic-based hybrid model has been proposed for solving group decision-making problems by combining BWM and Bayesian approaches to assess the quality index of medical devices. In [53], blockchain technology has been assessed using Bayesian BWM. A cost–benefit analysis of shale development in India has been carried out using the best–worst method approach [54]. In [55], identification and prioritization of criteria to tackle the COVID-19 outbreak has been carried out. Ref. [56] applied fuzzy BWM in prioritizing factors affecting ad hoc wireless networks. There are many applications of BWM, along with uncertainty, that exists in the literature.
The BWM model is a kind of linear mathematical programming model [15]. Linear mathematical programming refers to mathematical models having mathematical equations for an objective function that is needed to be achieved—with an optimal value under some set of constraints. The condition is that all equations should be of linear nature [57]. Multi-choice mathematical programming is a kind of mathematical programming having multi-choice parameters [18]. In the work of Hasan et al. [58], they have assumed a situation where the pairwise comparison parameter is considered multi-choice in nature. Hasan et al. [58] incorporated a type of uncertainty in the multi-choice form in the best–worst method. They have shown that having multiple choices for pairwise comparison of two criteria can be chosen by the experts instead of using any other kind of uncertainty, such as probabilistic, fuzzy, neutrosophic, etc. They have handled it using Lagrange interpolation and chosen those choices for which inconsistency has been minimized. Their approach has shown a significant decrease in inconsistency. This approach has not yet been explored in the case of group decision-making problems. So, on the basis of the above discussion, it can be observed that the researchers have not considered the most critical point, which is employing a multi-choice mathematical programming model to the MCDM problems in a group decision-making scenario. This has motivated me to work on such models, where multi-choice uncertainty can be incorporated into group decision-making problems. The issue, as mentioned above, is vital in the decision-making of real-world problems. Therefore, the present work focuses on a multi-choice mathematical programming model for group decision-making problems. This work presents two mathematical models. Both models are different with respect to the constraints and objective function. The authors have shown the approaches to solving group decision-making problems.

3. Preliminaries

As preliminary, this section provides an overview of Multi-choice mathematical programming models and the Lagrange interpolation method as follows:
  • Multi-choice mathematical programming:
It is a mathematical programming model to determine the solution set X, where X is ( x 1 , x 2 , x 3 , , x n ) . The objective is the maximization of the function denoted by Z. The model is as follows:
M a x Z = j = 1 n C j x j
s u b j e c t t o a i j x j { b i ( 1 ) , b i ( 2 ) , b i ( 3 ) , , b i ( k i ) } , i = 1 , 2 , , m ,
x j 0 , j = 1 , 2 , , n .
The choice set of parameter b is { b i ( 1 ) , b i ( 2 ) , b i ( 3 ) , , b i ( k i ) } with k i number of choices. The solution set will consist of only one choice from the choice set, which is to be selected for the optimized model.
To determine the solution of the above model, it is necessary to convert it into the standard form of mathematical programming. There are many interpolating polynomial methods [17] for handling the multi-choice parameter b, such as using Lagrange, Newton’s divided differences, Newton’s forward difference, and Newton’s backward difference interpolating polynomial. For the proposed extended methods, the Lagrange interpolation method is utilized.
  • Lagrange interpolation:
Let 0 , 1 , 2 , , ( k i 1 ) be k i number of node points, where b i ( 1 ) , b i ( 2 ) , , b i ( k i ) are the associated functional values of the interpolating polynomial at k i different node points. A polynomial P k i 1 ( z ( i ) ) of degree ( k i 1 ) which interpolates the given data is:
P k i 1 ( z ( i ) ) = ( z ( i ) 1 ) ( z ( i ) 2 ) ( z ( i ) k i + 1 ) ( 1 ) k i 1 ( k i 1 ) ! b i ( 1 ) + z ( i ) ( z ( i ) 2 ) ( z ( i ) k i + 1 ) ( 1 ) k i 2 ( k i 2 ) ! b i ( 2 ) + z ( i ) ( z ( i ) 1 ) ( z ( i ) 3 ) ( z ( i ) k i + 1 ) ( 1 ) k i 3 ( k i 3 ) ! 2 ! b i ( 3 ) + + z ( i ) ( z ( i ) 1 ) ( z ( i ) 2 ) ( z ( i ) k i + 2 ) ( k i 1 ) ! b i ( k i ) i = 1 , 2 , 3 , m .

4. The Proposed Multi-Criteria Group Decision-Making Models in Multi-Choice Environment

Suppose k numbers of decision-makers are represented by the set D = { D 1 , D 2 , , D k } , where D k ( k 1 , 2 , , m ) denotes the k-th expert. There are n numbers of decision criteria C = { c 1 , c 2 , , c n } with n 2 , where c j ( j { 1 , 2 , , n } ) indicates the j - th criteria. The expertise of the decision-makers in expressing their importance in comparing criteria may be identical or different. The criterion’s importance is described using finite, pre-specified, and ordered linguistic terms sets, as shown in Table 1. The k-th decision-maker describes the multi-choice preference details S i j k = { 1 , 2 , , s i j } k ; i , j 1 , 2 , , n , where s i j represents the linguistic term of the i - th criterion, over j - th criterion with T k cardinalities, i.e., S k = { s 1 k , s 2 k , s 3 k , , s T k k } .
The notations used in this paper are presented in Table 2. The steps involved in the proposed group multi-choice best–worst method (GMCBWM) to obtain the criteria weights are described as follows.
(I). 
Defining the system of decision-making mechanism.
The decision criteria system comprises a collection of decision criteria essential in making a judgment on diverse alternatives to consider—assuming n number of decision criteria, { c 1 , c 2 , , c n } . Then, the decision matrix can be presented as follows.
X k = c 1 c 2 c n { x 11 ( 1 ) , x 11 ( 2 ) , , x 11 ( s 11 ) } k { x 12 ( 1 ) , x 12 ( 2 ) , , x 12 ( s 12 ) } k { x 1 n ( 1 ) , x 1 n ( 2 ) , , x 1 n ( s 1 n ) } k { x 21 ( 1 ) , x 21 ( 2 ) , , x 21 ( s 21 ) } k { x 22 ( 1 ) , x 22 ( 2 ) , , x 22 ( s 22 ) } k { x 2 n ( 1 ) , x 2 n ( 2 ) , , x 2 n ( s 2 n ) } k { x n 1 ( 1 ) , x n 1 ( 2 ) , , x n 1 ( s n 1 ) } k { x n 2 ( 1 ) , x n 2 ( 2 ) , , x n 2 ( s n 2 ) } k { x n n ( 1 ) , x n n ( 2 ) , , x n n ( s n n ) } k c 1 c 2 c n
where, X k represents the pairwise multi-choice comparison matrix of the k-th decision-maker and { x i j ( s i j ) } k denotes the relative importance of criteria i to criterion j with ( s i j ) multiple reference comparisons. Additionally, X i k = ( { x 11 ( 1 ) , , x 11 ( s 11 ) } k , { x 12 ( 1 ) , , x 12 ( s 12 ) } k , , { x 1 n ( 1 ) , , x 1 n ( s 1 n ) } k ) is the vector of the i - th index’s multi-choice preference relation to other indexes. Furthermore, the multi-choice pairwise comparison matrix X k is deemed entirely consistent if and only if the following conditions are met:
{ x i p s i p } k × { x p j s p j } k = { x i j s i j } k i , j
(II). 
Finding the best and the worst criteria to use.
Decision-makers must recognize the best and worst, typically focused on the built-in decision criteria mechanism of the previous step. The best and worst selection by assigning c B k to the best and c W k to the worst criterion for the k-th decision-maker. Afterward, it can determine whether two criteria experts often used in the great majority, c B k and c W k , are the best and worst criteria. When several experts make recommendations, the best and worst criteria are often subjective, resulting in various c B k and c W k . To eventually incorporate the c B k and c W k of various experts, it is required to choose a set of widely accepted best and worst criteria in front.
(III). 
Conducting multi-choice preference comparisons to determine best-to-others and others-to-worst criteria.
This step defines pairwise multi-choice preference comparisons of best criteria B over other criteria j ( j = 1 , 2 , , n ) , designated by X B k , of the k-th decision-maker. The decision-makers pairwise multi-choice comparisons of all criteria j over the worst criterion W, represented by X W k , are termed others-to-worst. The decision-makers determine pairwise perceptions on the order of 1 to 9, as said in Table 1. Although there are several options possible when it comes to such judgments. Figure 1 depicts the best-to-others X B k and others-to-worst X W k vector multi-choice preferences with many alternatives. The resulting multi-choice best-to-others vector is denoted by X B k in Equation (8) as follows:
X B k = x B 1 S B 1 , x B 2 S B 2 , , x B n S B n , where x B j S B j = { x B j ( 1 ) , x B j ( 2 ) , , x B j ( s B j ) } k j
where x B j S B j is the set of multi-choice reference comparisons for the k-th expert evaluating the best criteria B over other criteria j, such that x B j s B j 1 j = 1 , 2 , , n and s B j 1 .
Similarly, the multi-choice preference comparisons of all criteria j over the worst criterion W are obtained. The multi-choice others-to-worst vector ( X W k ) for k-th decision-maker is expressed by Equation (9) as follows:
X W k = x 1 W S 1 W , x 2 W S 2 W , , x n W S n W , where x j W S j W = { x j W ( 1 ) , x j W ( 2 ) , , x j W ( s j W ) } k j
where x j W S j W is the multi-choice preference of the criterion j ( j = 1 , 2 , , n ) over the worst criterion W, such that x j W s j W 1 j = 1 , 2 , , n and s j W 1 .
(IV). 
Incorporate multi-choice preference comparisons of decision-makers’ evaluations.
Due to the fact that this work makes use of the input-based consistency ratio, first examine the consistency of every decision-maker’s multiple-choice preference comparison vectors. After obtaining the assessment of each decision-maker, now create the decision-maker’s multi-choice pairwise comparison matrix. The multi-choice comparison matrix for the k-th decision-maker is presented below:
X k = { x 1 W ( 1 ) , x 1 W ( 2 ) , , x 1 W ( s 1 W ) } k { x 2 W ( 1 ) , x 2 W ( 2 ) , , x 2 W ( s 2 W ) } k { x B 1 ( 1 ) , x B 1 ( 2 ) , , x B 1 ( s B 1 ) } k { x B 2 ( 1 ) , x B 2 ( 2 ) , , x B 2 ( s B 2 ) } k 1 { x B W ( 1 ) , x B W ( 2 ) , , x B W ( s B W ) } k { x B n ( 1 ) , x B n ( 2 ) , , x B n ( s B n ) } k 1 { x n W ( 1 ) , x n W ( 2 ) , , x n W ( s n W ) } k
There are several techniques for combining the multi-choices of all the decision-makers. The associated method covered is the Lagrange interpolation method.
The main goal of such methods is the aggregation to obtain accurate results from either of the suitable choices from the multi-choice pairwise comparison matrix. There exist various acceptable approaches for handling multi-choice parameters. For multi-choice parameters, interpolating polynomials (IP) are defined by obtaining integer quantities referred to as nodal points or nodes. Each node represents a single functional significance of a multi-choice attribute. If a component includes s i j possibilities, an exactly s i j amount of nodes are required. The proposed interpolating polynomials aggregate the multi-choice comparison vector and obtain the non-linear function precisely at all nodes for multiple-choice. Substitute a multi-choice component with an appropriate polynomial. Lagrange method, Newton’s divided difference method, Newton’s forward difference method, and Newton’s backward difference method are the four significant forms of interpolating polynomials-based methods.
  • Lagrangian method of polynomial interpolation
Lagrange’s interpolating polynomial (LIP) is used to tackle the multi-choice preference comparisons vectors X B k and X W k from Equations (8) and (9), respectively. From Equation (8), for k-th decision-maker, the x B j S B j = { x B j ( 1 ) , x B j ( 2 ) , , x B j ( s B j ) } j where s B j ( s B j 1 ) denotes the number of multiple choices in the comparison of criterion B to criterion j ( j = 1 , 2 , , n ) , assume the z B j variable representing the number of node points whose values are ( 0 , 1 , 2 , , s B j 1 ) . Derive a LIP P L I P k ( z B j ) of degree ( s B j 1 ) as follows:
P L I P k ( z B j ) = ( z B j 1 ) ( z B j 2 ) ( z B j s B j + 1 ) ( 1 ) s B j 1 ( s B j 1 ) ! x B j ( 1 ) + z B j ( z B j 2 ) ( z B j s B j + 1 ) ( 1 ) s B j 2 ( s B j 2 ) ! x B j ( 2 ) + z B j ( z B j 1 ) ( z B j 3 ) ( z B j k + 1 ) ( 1 ) s B j 3 ( s B j 3 ) ! 2 ! x B j ( 3 ) + + z B j ( z B j 1 ) ( z B j 2 ) ( z B j s B j + 2 ) ( s B j 1 ) ! x B j ( s B j ) j
In the same way, suppose z j W represents node points with values ( 0 , 1 , 2 , , ( s j W 1 ) ) with respect to X W k . From Equation (9), for the k-th decision-maker the x j W S j W = { x j W ( 1 ) , x j W ( 2 ) , , x j W ( s j W ) } j where s j W ( s j W 1 ) denotes the number of multiple choices in the other-to-worst, assume z j W representing node points with values ( 0 , 1 , 2 , , ( s j W 1 ) ) . Derive a LIP P L I P k ( z j W ) of degree ( s j W 1 ) as follows:
P L I P k ( z j W ) = ( z j W 1 ) ( z j W 2 ) ( z j W s j W + 1 ) ( 1 ) s j W 1 ( s j W 1 ) ! x j W ( 1 ) + z j W ( z j W 2 ) ( z j W s j W + 1 ) ( 1 ) s j W 2 ( s j W 2 ) ! x j W ( 2 ) + z j W ( z j W 1 ) ( z j W 3 ) ( z j W k + 1 ) ( 1 ) s j W 3 ( s j W 3 ) ! 2 ! x j W ( 3 ) + + z j W ( z j W 1 ) ( z j W 2 ) ( z j W s j W + 2 ) ( s j W 1 ) ! x j W ( s j W ) j
Using the interpolating polynomials, model the multi-choice mathematical programming model as described in step V.
(V). 
Determine the optimal weights ( ω 1 * , ω 2 * , , ω n * ) by utilizing the optimization model.
In this step, determine the optimal weights ( ω 1 * , ω 2 * , , ω n * ) corresponding to each criteria ( c 1 , c 2 , , c n ) . Then the non-linear mathematical optimization models that minimize the sum of the inconsistency variance for all decision-makers in accordance with the original group BWM are proposed. Following group BWM, we present two optimization models, MD-1 and MD-2. Both of them are discussed in detail.
  • MD-1: Mathematical model-1
The optimal weight for each criterion is where, for each multi-choice comparison, ω B / ω j and ω j / ω W should have ω B / ω j = { x B j ( 1 ) , x B j ( 2 ) , , x B j ( s B j ) } k and ω j / ω W = { x j W ( 1 ) , x j W ( 2 ) , , x j W ( s j W ) } k of k-th decision-maker. To identify the best criteria weights with the group decision-making, the maximal differences between the computed weights and the presentation of every decision-maker must be minimal. Every criterion j of the k-th decision-maker fulfills such requirements, the actual discrepancy | ω B / ω j X B k | and | ω j / ω W X W k | for all j could be established as follows.
min k D λ k max j ω B ω j { x B j ( 1 ) , x B j ( 2 ) , , x B j ( s B j ) } k , ω B ω j { x j W ( 1 ) , x j W ( 2 ) , , x j W ( s j W ) } k s . t . j = 1 n ω j = 1 ω j 0 j = 1 , 2 , , n
In the MD-1 model, presented in Equation (13), the objective function includes a parameter λ k for k - th expert having a value in the range [ 0 , 100 ] presenting the individual weight (importance) of the decision-makers. Further, we define ξ k = max j ω B ω j { x B j ( 1 ) , x B j ( 2 ) , , x B j ( s B j ) } k , ω B ω j { x j W ( 1 ) , x j W ( 2 ) , , x j W ( s j W ) } k to simplify the proposed MD-1. Therefore, the proposed MD-1 model is transformed as:
min k D λ k ξ k s . t . ω B ω j { x B j ( 1 ) , x B j ( 2 ) , , x B j ( s B j ) } k ξ k j , k ω B ω j { x j W ( 1 ) , x j W ( 2 ) , , x j W ( s j W ) } k ξ k j , k j = 1 ω j = 1 j ω j 0 j ξ k 0 k j = 1 , 2 , , n k = 1 , 2 , , m
The above mathematical model represents a non-linear multi-choice optimization problem with the multi-choice comparison vectors as multi-choice parameters in the constraints. To tackle the multi-choice pairwise comparison parameters, we apply the polynomial interpolation methods with the aim of integer nodal points by using the previous Step (IV). Thus, the model presented in Equation (14) is transformed as follows:
min k D λ k ξ k s . t . ω B ω j P k ( z B j ) ξ k j , k ω B ω j P k ( z j W ) ξ k j , k j = 1 ω j = 1 j ω j 0 j ξ k 0 k z B j = 0 , 1 , 2 , , ( s B j 1 ) j z j W = 0 , 1 , 2 , , ( s j W 1 ) j j = 1 , 2 , , n k = 1 , 2 , , m
The optimal criteria weights ( ω 1 * , ω 2 * , , ω n * ) are evaluated by solving the above model that is calculated as the actual values. Note that the proposed MD-1 model (as in Equation (15)) not only obtains the optimal criteria weights but also finds the position vectors, that is, integer nodal points z B j , and z j W for all j = 1 , 2 , , n of the polynomial P k for all k = 1 , 2 , , m . Thus, the final solution includes the best pairwise comparison among the multiple choices that are provided by the decision-makers.
  • MD-2: Mathematical model-2
As described in MD-1, each decision-maker has an individual weight component, which is used to calculate their relative relevance in the proposed model. Consequently, the second mathematical model, MD-2, with a min–max objective, is presented as follows:
min max k λ k ξ k s . t . ω B ω j { x B j ( 1 ) , x B j ( 2 ) , , x B j ( s B j ) } k ξ k j , k ω B ω j { x j W ( 1 ) , x j W ( 2 ) , , x j W ( s j W ) } k ξ k j , k j = 1 ω j = 1 j ω j 0 j ξ k 0 k j = 1 , 2 , , n k = 1 , 2 , , m
Here, similar to the mathematical model presented in MD-1 (as in Equation (14)), we simplify the MD-2 model in Equation (16) as ξ = max k λ k ξ k . Additionally, the multi-choice comparisons in the constraints of the model having the multi-choice parameter are interpolated using the previous Step (IV). We transform the model MD-2 as follows:
min ξ s . t . ξ λ k ξ k k ω B ω j P k ( z B j ) ξ k j , k ω B ω j P k ( z j W ) ξ k j , k j = 1 ω j = 1 j ω j 0 j ξ k 0 k z B j = 0 , 1 , 2 , , ( s B j 1 ) j z j W = 0 , 1 , 2 , , ( s j W 1 ) j j = 1 , 2 , , n k = 1 , 2 , , m
The optimal criteria weights ( ω 1 * , ω 2 * , , ω n * ) , integer nodal points z B j , and z j W for all j = 1 , 2 , , n are evaluated by solving the above proposed MD-2 model in Equation (17).
Following the solution of the mathematical models, MD-1 and MD-2, the optimum values of ξ k are used to compute the consistency ratio ( C R k ) for every k-th decision-maker that will apply to evaluate the group consistency ratio ( C R G ) in a group decision-making system. If x B j × x j W = x B W j , where x B j is the preference of best criteria B over the all other criteria j and x j W is the preference of criterion j over the worst criterion B, then comparisons are said to be entirely consistent. Thus, the consistency ratio of the proposed GMCBWM is calculated in the following step.
(VI). 
Consistency ratio for GMCBWM
The consistency ratio (CR) was used to demonstrate the validity of pairwise comparisons. The CR of the proposed GMCBWM of the k-th decision-maker C R k and further the group decision-making C R G are calculated using Equations (18) and (19) given as follows.
C R k = λ k ξ k * C I k = 1 , 2 , , m
C R G = max k { C R k }
In Equation (18), ξ k * is the optimum value of inconsistency achieved by resolving mathematical models (MD-1 or MD-2) for the k-th decision-makers, and λ k is the individual weight vector assigned to the k-th decision-maker depending on their degree of knowledge. The consistency index (CI) is a constant value presented in Table 3 for each decision-maker’s value x B W m a x . The conclusive C R G of the GMCBWM is the maximum C R k among all decision-makers as in Equation (19). If C R G is zero, the result in the form of optimal weights is totally consistent; nevertheless, as C R G grows, the consistency diminishes.

5. Numerical Studies

This section presents two numerical illustrations of group decision-making problems to demonstrate the applicability of the proposed GMCBWM in different circumstances and analyze the outcomes. The proposed models are formulated under each case and evaluated using the AMPL [59] and NEOS [60] to achieve the optimal weights criteria.

5.1. Numerical Example 1

In this example, the responses for four criteria ( c 1 , c 2 , c 3 , c 4 ) with n = 4 are taken from two decision-makers (DMs), i.e., k = 2 as DM1 and DM2 [61]. The criteria c 1 and c 3 are considered best ( B ) and worst ( W ) criteria by both experts having λ 1 and λ 2 individual weights, respectively. The multi-choice best-to-others X B k (Equation (8)) and others-to-worst X W k (Equation (9)) vector preferences on a scale of 1 to 9 are provided by each DM using Table 1. As n = 4 , according to the basic BWM, we require at least 2 n 3 = 2 4 3 = 5 preference responses from each DM [14]. The multi-choice pairwise preference comparing the best-to-others and others-to-worst criteria are presented in Table 4 for both DMs. In Table 4, the response x 13 comparing c 1 to c 3 from DM1 is a multi-choice comparison with two choices 8 and 9, that is, x 13 = { 8 , 9 } and for x 14 comparing c 1 to c 4 from DM2 is 2 and 3, that is, x 14 = { 2 , 3 } with s 13 = 2 and s 14 = 2 , respectively.
Thus, the multi-choice best-to-others vector is X B 1 = { x 12 , { x 13 ( 1 ) , x 13 ( 2 ) } , x 14 } } = { 2 , { 8 , 9 } , 3 } and X B 2 = { x 12 , x 13 , { x 14 ( 1 ) , x 14 ( 2 ) } } = { 2 , 8 , { 2 , 3 } } and others-to-worst vector is X W 1 = { { x 13 ( 1 ) , x 13 ( 2 ) } , x 23 , x 43 } = { { 8 , 9 } , 4 , 2 } and X W 2 = { x 13 , x 23 , x 43 } = { 8 , 4 , 2 } using Table 4 from Step (III) of the proposed GMCBWM. The objective of the proposed models is to determine the best choice or the best pairwise comparison out of all the choices of pairwise comparisons assigned by DM1 and DM2. However, before formulating the mathematical model of the proposed GMCBWM, we first have to derive the polynomial functions that interpolate the multi-choice reference parameters associated with each comparison vector.
Thus, interpolation polynomials (IPs) are derived for the x 13 = { x 13 ( 1 ) , x 13 ( 2 ) } = { 8 , 9 } and x 14 = { x 14 ( 1 ) , x 14 ( 2 ) } = { 3 , 4 } multi-choice reference comparison taking integral values for the nodal points z 13 and z 14 . Each node will have s 13 = s 14 = 2 number of integer values. The Lagrange interpolating polynomial (LIP) functions are derived using Step 4 of Section 4. We formulate LIPs P L I P for ( z 13 ) of degree ( s 13 1 ) and for ( z 14 ) of degree ( s 14 1 ) using Equations (11) and (12) as follows:
P L I P ( z 13 ) = ( z 13 1 ) ( 1 ) s 13 1 ( s 13 1 ) ! x 13 ( 1 ) + z 13 ( 1 ) s 13 2 ( s 13 2 ) ! x 13 ( 2 ) = ( z 13 1 ) ( 1 ) 2 1 ( 2 1 ) ! 8 + z 13 ( 1 ) 2 2 ( 2 2 ) ! 9 = z 13 + 8 P L I P ( z 14 ) = ( z 14 1 ) ( 1 ) s 14 1 ( s 14 1 ) ! x 14 ( 1 ) + z 14 ( 1 ) s 14 2 ( s 14 2 ) ! x 14 ( 2 ) = ( z 14 1 ) ( 1 ) 2 1 ( 2 1 ) ! 2 + z 14 ( 1 ) 2 2 ( 2 2 ) ! 3 = z 14 + 2
Now, to obtain the optimal weights ( ω 1 * , ω 2 * , ω 3 * , ω 4 * ) of the criteria, we present the two proposed mathematical programming model MD-1 and MD-2 from Step (V) of Section 4 using Equations (15) and (17) as follows:
M D 1 min ( λ 1 ξ 1 + λ 2 ξ 2 ) s . t . ω 1 ω 2 2 ξ 1 ω 1 ω 2 2 ξ 2 ω 1 ω 3 ( z 13 + 8 ) ξ 1 ω 1 ω 3 8 ξ 2 ω 1 ω 4 3 ξ 1 ω 1 ω 4 ( z 14 + 2 ) ξ 2 ω 2 ω 3 4 ξ 1 ω 2 ω 3 4 ξ 2 ω 4 ω 3 2 ξ 1 ω 4 ω 3 2 ξ 2 ω 1 + ω 2 + ω 3 + ω 4 = 1 ω 1 , ω 2 , ω 3 , ω 4 0 ξ 1 , ξ 2 0 z 13 , z 14 = 0 , 1 .
M D 2 min ξ s . t . ξ λ 1 ξ 1 ξ λ 2 ξ 2 Rest of constraints are same as in Equation ( 20 )
The non-linear mixed-integer mathematical programming models MD-1 and MD-2, as shown in Equations (20) and (21), are solved to obtain the optimal weights ( ω 1 * , ω 2 * , ω 3 * , ω 4 * ) and the nodal points ( z 13 , z 14 ) corresponding to the multi-choice reference comparison. The optimal ξ * of the MDs are applied to evaluate the inconsistency of the group decision-making of Example 1. Further, the individual weights ( λ 1 , λ 2 ) of DMs have a substantial effect on the resulting consistency ratio (CR). Therefore, we investigate five different pairs (0.1,0.9), (0.3,0.7), (0.5,0.5), (0.7,0.3), and (0.9,0.1) of group decision instances to obtain optimal weights of the criteria. The sensitivity of weight values has been evaluated based on these pairs. Using the data provided in Table 4 of Example 1, we have solved the two models with different combinations of individual weight vectors of DMs.
The optimal results of Example 1 after solving MD-1 and MD-2 are provided in Table 5 and Table 6, respectively. The outcomes of five pairs of ( λ 1 , λ 2 ) with optimal weights of critical, nodal points, inconsistency value ( ξ 1 , ξ 2 ), and consistency ratio ( C R 1 , C R 2 ) are presented for DM1 and DM2 with k = 2 in tables. Importantly, in the last column of Table 5 and Table 6, the group consistency ratio ( C R G ) is presented. It has been found that the optimal weight of criteria is the same for all pairs of λ 1 and λ 2 for both MD-1 and MD-2 for this numerical illustration. However, the C R k of each DMs changes depending upon the values of λ 1 and λ 2 . In other words, the ranking of the criteria is the same for each pair in both models and is c 1 > c 2 > c 4 > c 3 . Moreover, the solutions of both models MD-1 and MD-2 for different combinations of λ 1 and λ 2 shows that the best nodal values are z 13 = 0 , i.e., x 13 = 8 for DM1 comparing c 1 to c 3 and z 14 = 0 , i.e., x 14 = 2 for DM2 comparing c 1 to c 4 . Thus, the best choice of x B W , i.e., x 13 equals eight and remains unchanged for all models. Further, the group consistency ratio of Example 1 is equal to the minimum among all C R G obtained for different values of λ 1 and λ 2 . Therefore, the minimum consistency value of Example 1 using MD-1 is C R G = 0.002982886 (see Table 5) and for MD-2 is C R G = 0.002982886 (see Table 6) for λ 1 = 0.5 and λ 2 = 0.5 . It is worth mentioning that the C R G of the Example 1 with Group-BWM [61] with both model-1 and model-2 is equal to 0.096 with ranking c 1 > c 2 > c 4 > c 3 . Hence, we can say that the proposed models of GMCBWM achieve the best consistency value for Example 1 and also validate the ranking of criteria.

5.2. Numerical Example 2

We have assumed three decision-makers (DM1, DM2, DM3), k = 3 with four criteria ( c 1 , c 2 , c 3 , c 4 ) , n = 4 . The c 1 and c 3 criteria are assumed as best (B) and worst (W) criterion by the all three experts having λ 1 , λ 2 , and λ 3 individual weights, respectively. The pairwise comparisons with the multi-choice response sets are presented in Table 7.
The multi-choice best-to-others X B k (Equation (8)) and others-to-worst X W k (Equation (9)) vector preferences on a scale 1 to 9 are provided by each DM using Table 1. Table 4 shows the multi-choice pairwise comparisons of the worst and the best criteria than the other criteria for the two DMs.
The response from DM1 for x 13 is a multi-choice parameter with two choices 8 and 9, that is, x 13 = { 8 , 9 } and for DM2, the response is 2 and 3, that is, x 14 = { 2 , 3 } with s 13 = 2 and s 14 = 2 , respectively. The objective is to determine the best choice or the best pairwise comparison out of all the choices of pairwise comparisons assigned by DM1 and DM2.
Interpolating polynomials (IPs) are formulated for the { x 13 ( 1 ) , x 13 ( 2 ) } = { 8 , 9 } and { x 14 ( 1 ) , x 14 ( 2 ) } = { 3 , 4 } multi-choice reference comparison taking integral values for the nodal points z 13 and z 14 . Each node will have s 13 = s 14 = 2 number of integer values. The Lagrange IP (LIP) functions are formulated using step 4 for each multi-choice reference comparison. We derive LIPs P L I P for ( z 13 ) of degree ( s 13 1 ) and for ( z 14 ) of degree ( s 14 1 ) using Equations (11) and (12) as follows:
P L I P ( z 13 ) = ( z 13 1 ) ( 1 ) s 13 1 ( s 13 1 ) ! x 13 ( 1 ) + z 13 ( 1 ) s 13 2 ( s 13 2 ) ! x 13 ( 2 ) = ( z 13 1 ) ( 1 ) 2 1 ( 2 1 ) ! 8 + z 13 ( 1 ) 2 2 ( 2 2 ) ! 9 = z 13 + 8 P L I P ( z 14 ) = ( z 14 1 ) ( 1 ) s 14 1 ( s 14 1 ) ! x 14 ( 1 ) + z 14 ( 1 ) s 14 2 ( s 14 2 ) ! x 14 ( 2 ) = ( z 14 1 ) ( 1 ) 2 1 ( 2 1 ) ! 2 + z 14 ( 1 ) 2 2 ( 2 2 ) ! 3 = z 14 + 2
Now, to obtain the optimal weights ( ω 1 * , ω 2 * , ω 3 * , ω 4 * ) of the criteria, we present the two proposed mathematical programming models MD-1 and MD-2 as follows:
M D 1 min ( λ 1 ξ 1 + λ 2 ξ 2 + λ 3 ξ 3 ) s . t . ω 1 ω 2 2 ξ 1 , ω 1 ω 2 2 ξ 2 , ω 1 ω 2 2 ξ 3 ω 1 ω 3 9 ξ 1 , ω 1 ω 3 ( z 13 + 8 ) ξ 2 , ω 1 ω 3 8 ξ 3 ω 1 ω 4 ( z 14 + 3 ) ξ 1 , ω 1 ω 4 4 ξ 2 , ω 1 ω 4 4 ξ 3 ω 2 ω 3 4 ξ 1 , ω 2 ω 3 4 ξ 2 , ω 2 ω 3 ( z 23 + 3 ) ξ 3 ω 4 ω 3 2 ξ 1 , ω 4 ω 3 2 ξ 2 , ω 4 ω 3 2 ξ 3 ω 1 + ω 2 + ω 3 + ω 4 = 1 ω 1 , ω 2 , ω 3 , ω 4 0 ξ 1 , ξ 2 , ξ 3 0 z 13 , z 14 , z 23 = 0 , 1 .
M D 2 min ξ s . t . ξ λ 1 ξ 1 ξ λ 2 ξ 2 Rest of constraints are same as MD - 1
The results of Models 1 and 2 are provided in Table 8 and Table 9. In Table 8, the obtained weights are presented for six different sets of ( λ 1 , λ 2 , λ 3 ). The change in weight values of the criterion has been evaluated based on these sets. It has been found that for model 2, no change is visible for five sets of ( λ 1 , λ 2 , λ 3 ). Whereas, for (0.6, 0.2, 0.2), the weight values of the criterion are different from the other five sets. In Table 9, the inconsistency value ( ξ 1 , ξ 2 , ξ 3 ) and consistency ratio (CR1, CR2, CR3) for decision maker 1, 2, and 3 were presented, respectively. Finally, in the last column, the Group CR is tabulated. All these are evaluated for six sets of λ 1 , λ 2 , and λ 3 . For model 1, the minimum CRG is 0.002065 for set 3, whereas the maximum is for set 6 of λ k . For model 2, the minimum CRG is for sets 2 and 3, i.e., 0.002065. The CRG is maximum for set 4, i.e., 0.002386 of λ 1 = 0.3 , λ 2 = 0.3 , and λ 3 = 0.4 . The ranks of criteria for all models remain the same for all sets of λ 1 , λ 2 , and λ 3 .
After solving all models, for example, 2, we have found that for all models, the ranks of criteria remain unchanged, but there is a little difference in values of weights for some sets of λ 1 , λ 2 , and λ 3 . Additionally, the CR ratio for MD-1 is 0 whereas for MD-2, it is nearby to zero for all values of λ 1 , λ 2 , and λ 3 . The CR values for models are acceptable.

6. Case Study

We have considered a real case study from [61] having 10 decision-makers about a piping selection method. The study consists of four criteria, i.e., total cost, security, social cost, and environmental cost. The total cost is the best criterion, and environmental cost is the worst criterion. The considered criteria, along with respective descriptions, are presented in Table 10. The pairwise comparison data for the case study is presented in Table 11. The multi-choice response sets were also presented in this table. The responses as multi-choice data are presented in the last row of Table 11. This multi-choice row consists of responses from all 10 decision-makers taken as choices. The objective is to determine the optimal weights of criteria by choosing that set of responses from the multi-choice sets, which will minimize the inconsistency. Two models, MD-1 and MD-2, are formulated and solved similarly to previous examples to determine the optimal weights of criteria.
Now modeling and solving, results are obtained. The criteria weights and their respective ranks obtained for MD-1 and MD-2 are presented in Table 12. In Table 12, we can see that in models 1 and 2, although the ranks of criteria are the same, there is a change in the weight values of criteria.
The individual consistency ratio for all 10 experts and respective consistency ratio along with the CR of the group is presented in Table 13. The CRG obtained for model 1 is 0.018015, and for model 2, it is 0.018901. There is a minor difference in obtained consistency ratios. Out of these two models, the consistency ratio is minimum for MD-1 and maximum for MD-2.

7. Limitations, Conclusions and Future Work

This study proposes two different mathematical programming models for solving group MCDM problems. Since there is a large number of variants of mcdm methods, where each method has its own suitability with respect to the assumptions and applications, the proposed methods also have some limitations. The proposed approaches can be applied when the pairwise comparisons collected are multi-choice in nature. The method has some difficulty in its application since no excel or easy-to-apply software is available. The decision-maker needs to code and solve it using optimization solvers, which is difficult for the management or non-technical persons. In the future, this can be rectified by developing easy to calculate excel file. The present work only proposes two models; in the future, these models can be extended to some more models by incorporating more information, such as the confidence level of experts, etc.
The two methods are proposed considering the assumption of multi-choice uncertainty in pairwise comparisons of criteria. The multi-choice uncertainty has been applied to determine the best choice out of multiple choices. It gives a real-life scenario to the decision-making problems. Although there are many other forms of uncertainty, such as rough set, fuzzy, intuitionistic fuzzy, neutrosophic, probabilistic, etc., it focuses on choices instead of the probabilistic or fuzzy nature of parameters. The parameters are considered multi-choice in the pairwise comparison. These parameters are handled by applying the Lagrange interpolating polynomial method. The proposed models are novel in terms of their mathematical structure and group decision-making approach. The models are formulated and further validated by solving numerical examples. It provides a framework for solving MCDM problems and provides weightage to the decision-makers as well. In the results of the numerical example 1 for MD-1 and MD-2, it can be seen that there is no effect on the weights obtained for the criteria due to the weights of the decision-makers, i.e., λ k , also the ranking of criteria is similar to an earlier study conducted in [61]. For numerical example 2, It can be seen that there is no effect of λ k on the weights of criteria using MD-1. For all variations of λ k , weights are the same. Whereas in the case of MD-2, there is a change in weights due to variation in λ k . It has been found that for all models, the ranks of criteria remain unchanged, but there is a little difference in values of weights for some sets of λ 1 , λ 2 , and λ 3 . The CR values for all the models of example 1 and 2 has been found acceptable.
This work is an extension of multi-choice MCDM models to group decision-making models. In the future, the proposed models can be extended to models incorporating other kinds of uncertain parameters, such as rough set theory, fuzzy set theory, probabilistic, etc. The confidence level of decision-makers as probability or weights can also be incorporated in future studies. This can be applied to any case study following similar assumptions of proposed models. The study has shown the real-life application of proposed models in piping selection problem. Similar to it, the proposed models can be applied to other problems.

Author Contributions

All authors have equal contributions in writing this manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

The authors are thankful to Qassim University, represented by the “Deanship of Scientific Research”, Saudi Arabia, for providing financial assistance to carry out this research work.

Data Availability Statement

The sources of secondary data are cited in the manuscript.

Acknowledgments

The author(s) gratefully acknowledge Qassim University, represented by the “Deanship of Scientific Research, on the financial support for this research under the number (10258-des-2020-1-3-I) during the academic year 1442 AH/2020 AD.”

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Yu, X.; Zhang, S.; Liao, X.; Qi, X. Electre methods in prioritized mcdm environment. Inf. Sci. 2018, 424, 301–316. [Google Scholar] [CrossRef]
  2. Roy, B. The outranking approach and the foundations of electre methods. In Readings in Multiple Criteria Decision Aid; Springer: Berlin/Heidelberg, Germany, 1990; pp. 155–183. [Google Scholar]
  3. Ramón, N.; Ruiz, J.L.; Sirvent, I. Two-step benchmarking: Setting more realistically achievable targets in dea. Expert Syst. Appl. 2018, 92, 124–131. [Google Scholar] [CrossRef] [Green Version]
  4. Charnes, A.; Cooper, W.W.; Rhodes, E. Measuring the efficiency of decision making units. Eur. J. Oper. Res. 1978, 2, 429–444. [Google Scholar] [CrossRef]
  5. Saaty, T.L. Analytic hierarchy process. Encyclopedia of Biostatistics, 1st ed.; John Wiley & Sons, Ltd.: Hoboken, NJ, USA, 2005. [Google Scholar]
  6. Saaty, T.L. Group decision making and the ahp. In The Analytic Hierarchy Process; Springer: Berlin/Heidelberg, Germany, 1989; pp. 59–67. [Google Scholar]
  7. Gao, R.; Nam, H.O.; Ko, W.I.; Jang, H. Integrated system evaluation of nuclear fuel cycle options in china combined with an analytical mcdm framework. Energy Policy 2018, 114, 221–233. [Google Scholar] [CrossRef]
  8. Brans, J.-P.; Vincke, P. Note—A preference ranking organisation method: The promethee method for multiple criteria decision-making. Manag. Sci. 1985, 31, 647–656. [Google Scholar] [CrossRef] [Green Version]
  9. Sennaroglu, B.; Celebi, G.V. A military airport location selection by ahp integrated promethee and vikor methods. Transp. Res. Part D Transp. Environ. 2018, 59, 160–173. [Google Scholar] [CrossRef]
  10. Liu, Y.; Chen, Y.; Tzeng, G.-H. Identification of key factors in consumers’ adoption behavior of intelligent medical terminals based on a hybrid modified madm model for product improvement. Int. J. Med. Inform. 2017, 105, 68–82. [Google Scholar] [CrossRef]
  11. Tian, G.; Zhang, H.; Feng, Y.; Wang, D.; Peng, Y.; Jia, H. Green decoration materials selection under interior environment characteristics: A grey-correlation based hybrid mcdm method. Renew. Sustain. Energy Rev. 2018, 81, 682–692. [Google Scholar] [CrossRef]
  12. Saaty, T.L. Decision making—the analytic hierarchy and network processes (ahp/anp). J. Syst. Sci. Syst. Eng. 2004, 13, 1–35. [Google Scholar] [CrossRef]
  13. Wu, W.-Y.; Qomariyah, A.; Sa, N.T.T.; Liao, Y. The integration between service value and service recovery in the hospitality industry: An application of qfd and anp. Int. J. Hosp. Manag. 2018, 75, 48–57. [Google Scholar] [CrossRef]
  14. Rezaei, J. Best-worst multi-criteria decision-making method. Omega 2015, 53, 49–57. [Google Scholar] [CrossRef]
  15. Rezaei, J. Best-worst multi-criteria decision-making method: Some properties and a linear model. Omega 2016, 64, 126–130. [Google Scholar] [CrossRef]
  16. Shameem, M.; Khan, A.A.; Hasan, M.G.; Akbar, M.A. Analytic hierarchy process based prioritisation and taxonomy of success factors for scaling agile methods in global software development. IET Softw. 2020, 14, 389–401. [Google Scholar] [CrossRef]
  17. Biswal, M.; Acharya, S. Solving multi-choice linear programming problems by interpolating polynomials. Math. Comput. Model. 2011, 54, 1405–1412. [Google Scholar] [CrossRef]
  18. Quddoos, A.; Hasan, M.G.u.; Khalid, M.M. Multi-choice stochastic transportation problem involving general form of distributions. SpringerPlus 2014, 3, 565. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Singh, S.S. Multi-choice programming: An overview of theories and applications. Optimization 2017, 66, 1713–1738. [Google Scholar] [CrossRef]
  20. Pamučar, D.; Stević, Ž.; Sremac, S. A new model for determining weight coefficients of criteria in mcdm models: Full consistency method (fucom). Symmetry 2018, 10, 393. [Google Scholar] [CrossRef] [Green Version]
  21. Žižović, M.; Pamucar, D. New model for determining criteria weights: Level based weight assessment (lbwa) model, Decision Making. Appl. Manag. Eng. 2019, 2, 126–137. [Google Scholar] [CrossRef]
  22. Pamucar, D.; Deveci, M.; Gokasar, I.; Işık, M.; Zizovic, M. Circular economy concepts in urban mobility alternatives using integrated dibr method and fuzzy dombi cocoso model. J. Clean. Prod. 2021, 323, 129096. [Google Scholar] [CrossRef]
  23. Rezaei, J.; Wang, J.; Tavasszy, L. Linking supplier development to supplier segmentation using best worst method. Expert Syst. Appl. 2015, 42, 9152–9164. [Google Scholar] [CrossRef]
  24. Gupta, H.; Barua, M.K. Identifying enablers of technological innovation for indian msmes using best–worst multi criteria decision making method. Technol. Forecast. Soc. Chang. 2016, 107, 69–79. [Google Scholar] [CrossRef]
  25. Ma, X.; Qin, J.; Martínez, L.; Pedrycz, W. A linguistic information granulation model based on best-worst method in decision making problems. Inf. Fusion 2022, 89, 210–227. [Google Scholar] [CrossRef]
  26. Tavana, M.; Shaabani, A.; Caprio, D.D.; Bonyani, A. A novel interval type-2 fuzzy best-worst method and combined compromise solution for evaluating eco-friendly packaging alternatives. Expert Syst. Appl. 2022, 200, 117188. [Google Scholar] [CrossRef]
  27. Malakoutikhah, M.; Alimohammadlou, M.; Jahangiri, M.; Rabiei, H.; Faghihi, S.A.; Kamalinia, M. Modeling the factors affecting unsafe behaviors using the fuzzy best-worst method and fuzzy cognitive map. Appl. Soft Comput. 2022, 114, 108119. [Google Scholar] [CrossRef]
  28. Kharola, S.; Ram, M.; Mangla, S.K.; Goyal, N.; Nautiyal, O.; Pant, D.; Kazancoglu, Y. Exploring the green waste management problem in food supply chains: A circular economy context. J. Clean. Prod. 2022, 351, 131355. [Google Scholar] [CrossRef]
  29. Bilbao-Terol, A.; Arenas-Parra, M.; Quiroga-García, R.; Bilbao-Terol, C. An extended best–worst multiple reference point method: Application in the assessment of non-life insurance companies. Oper. Res. 2022, 22, 5323–5362. [Google Scholar] [CrossRef]
  30. Sadaghiani, S.; Ahmad, K.W.; Rezaei, J.; Tavasszy, L. Evaluation of external forces affecting supply chain sustainability in oil and gas industry using best worst method. In Proceedings of the 2015 International Mediterranean Gas and Oil Conference (MedGO), Mechref, Lebanon, 16–18 April 2015; pp. 1–4. [Google Scholar]
  31. Groenendijk, L.; Rezaei, J.; Correia, G. Incorporating the travellers’ experience value in assessing the quality of transit nodes: A rotterdam case study. Case Stud. Transp. Policy 2018, 6, 564–576. [Google Scholar] [CrossRef] [Green Version]
  32. Chitsaz, N.; Azarnivand, A. Water scarcity management in arid regions based on an extended multiple criteria technique. Water Resour. Manag. 2017, 31, 233–250. [Google Scholar] [CrossRef]
  33. Ghoushchi, S.J.; Yousefi, S.; Khazaeili, M. An extended fmea approach based on the z-moora and fuzzy bwm for prioritization of failures. Appl. Soft Comput. 2019, 81, 105505. [Google Scholar] [CrossRef]
  34. Hafezalkotob, A.; Hafezalkotob, A. A novel approach for combination of individual and group decisions based on fuzzy best-worst method. Appl. Soft Comput. 2017, 59, 316–325. [Google Scholar] [CrossRef]
  35. Mi, X.; Tang, M.; Liao, H.; Shen, W.; Lev, B. The state-of-the-art survey on integrations and applications of the best worst method in decision making: Why, what, what for and what’s next? Omega 2019, 87, 205–225. [Google Scholar] [CrossRef]
  36. You, P.; Guo, S.; Zhao, H.; Zhao, H. Operation performance evaluation of power grid enterprise using a hybrid bwm-topsis method. Sustainability 2017, 9, 2329. [Google Scholar] [CrossRef] [Green Version]
  37. Hafezalkotob, A.; Hafezalkotob, A.; Liao, H.; Herrera, F. Interval multimoora method integrating interval borda rule and interval best-worst-method-based weighting model: Case study on hybrid vehicle engine selection. IEEE Trans. Cybern. 2019, 50, 1157–1169. [Google Scholar] [CrossRef]
  38. Gupta, H. Evaluating service quality of airline industry using hybrid best worst method and vikor. J. Air Transp. Manag. 2018, 68, 35–47. [Google Scholar] [CrossRef]
  39. Maghsoodi, A.I.; Mosavat, M.; Hafezalkotob, A.; Hafezalkotob, A. Hybrid hierarchical fuzzy group decision-making based on information axioms and bwm: Prototype design selection. Comput. Ind. Eng. 2019, 127, 788–804. [Google Scholar] [CrossRef]
  40. Yadav, G.; Mangla, S.K.; Luthra, S.; Jakhar, S. Hybrid bwm-electre-based decision framework for effective offshore outsourcing adoption: A case study. Int. J. Prod. Res. 2018, 56, 6259–6278. [Google Scholar] [CrossRef] [Green Version]
  41. Vafadarnikjoo, A.; Tavana, M.; Botelho, T.; Chalvatzis, K. A neutrosophic enhanced best–worst method for considering decision-makers’ confidence in the best and worst criteria. Ann. Oper. Res. 2020, 289, 391–418. [Google Scholar] [CrossRef]
  42. Liao, H.; Mi, X.; Yu, Q.; Luo, L. Hospital performance evaluation by a hesitant fuzzy linguistic best worst method with inconsistency repairing. J. Clean. Prod. 2019, 232, 657–671. [Google Scholar] [CrossRef]
  43. Liu, P.; Wang, D. An extended taxonomy method based on normal t-spherical fuzzy numbers for multiple-attribute decision-making. Int. J. Fuzzy Syst. 2022, 24, 73–90. [Google Scholar] [CrossRef]
  44. Wu, Z.; Zhang, S.; Liu, X.; Wu, J. Best-worst multi-attribute decision making method based on new possibility degree with probabilistic linguistic information. IEEE Access 2019, 7, 133900–133913. [Google Scholar] [CrossRef]
  45. Wu, Q.; Zhou, L.; Chen, Y.; Chen, H. An integrated approach to green supplier selection based on the interval type-2 fuzzy best-worst and extended vikor methods. Inf. Sci. 2019, 502, 394–417. [Google Scholar] [CrossRef]
  46. Mohammadi, M.; Rezaei, J. Bayesian best-worst method: A probabilistic group decision making model. Omega 2019, 96, 102075. [Google Scholar] [CrossRef]
  47. Fard, M.B.; Moradian, P.; Emarati, M.; Ebadi, M.; Chofreh, A.G.; Klemeŝ, J.J. Ground-mounted photovoltaic power station site selection and economic analysis based on a hybrid fuzzy best-worst method and geographic information system: A case study guilan province. Renew. Sustain. Energy Rev. 2022, 169, 112923. [Google Scholar] [CrossRef]
  48. Soner, O.; Celik, E.; Akyuz, E. A fuzzy best–worst method (bwm) to assess the potential environmental impacts of the process of ship recycling. Marit. Policy Manag. 2022, 49, 396–409. [Google Scholar] [CrossRef]
  49. Haqbin, A.; Shojaei, P.; Radmanesh, S. Prioritising covid-19 recovery solutions for tourism small and medium-sized enterprises: A rough best-worst method approach. J. Decis. Syst. 2022, 31, 102–115. [Google Scholar] [CrossRef]
  50. Ertunç, E.; Uyan, M. Land valuation with best worst method in land consolidation projects. Land Use Policy 2022, 122, 106360. [Google Scholar] [CrossRef]
  51. Wang, X.; Wang, H.; Xu, Z.; Ren, Z. Green supplier selection based on probabilistic dual hesitant fuzzy sets: A process integrating best worst method and superiority and inferiority ranking. Appl. Intell. 2022, 52, 8279–8301. [Google Scholar] [CrossRef]
  52. Yazdi, M.; Adumene, S.; Zarei, E. Introducing a probabilistic-based hybrid model (fuzzy-bwm-bayesian network) to assess the quality index of a medical service, In Linguistic Methods Under Fuzzy Information in System Safety and Reliability Analysis; Springer: Berlin/Heidelberg, Germany, 2022; pp. 171–183. [Google Scholar]
  53. Munim, Z.H.; Balasubramaniyan, S.; Kouhizadeh, M.; Hossain, N.U.I. Assessing blockchain technology adoption in the norwegian oil and gas industry using bayesian best worst method. J. Ind. Inf. Integr. 2022, 28, 100346. [Google Scholar] [CrossRef]
  54. Ghaffar, A.R.A.; Nadeem, M.R.; Hasan, M.G. Cost-benefit analysis of shale development in india: A best-worst method based mcdm approach. J. King Saud Univ. Sci. 2022, 33, 101591. [Google Scholar] [CrossRef]
  55. Ahmad, N.; Hasan, M.G.; Barbhuiya, R.K. Identification and prioritization of strategies to tackle covid-19 outbreak: A group-bwm based mcdm approach. Appl. Soft Comput. 2021, 111, 107642. [Google Scholar] [CrossRef]
  56. Ahmad, N.; Hasan, M. Self-adaptive query-broadcast in wireless ad-hoc networks using fuzzy best worst method. Wirel. Networks 2021, 27, 765–780. [Google Scholar] [CrossRef]
  57. Hillier, F.; Lieberman, G.J. Introduction to operations research. J. Oper. Res. Soc. 2006, 57, 330. [Google Scholar]
  58. Hasan, M.G.; Ashraf, Z.; Khan, M.F. Multi-choice best-worst multi-criteria decision-making method and its applications. Int. J. Intell. Syst. 2022, 37, 1129–1156. [Google Scholar] [CrossRef]
  59. Fourer, R.; Gay, D.M.; Kernighan, B.W. AMPL: A Mathematical Programming Language; AT & T Bell Laboratories: Murray Hill, NJ, USA, 1987. [Google Scholar]
  60. Czyzyk, J.; Mesnier, M.P.; Moré, J.J. The neos server. IEEE Comput. Sci. Eng. 1998, 5, 68–75. [Google Scholar] [CrossRef]
  61. Safarzadeh, S.; Khansefid, S.; Rasti-Barzoki, M. A group multi-criteria decision-making based on best-worst method. Comput. Ind. Eng. 2018, 126, 111–121. [Google Scholar] [CrossRef]
Figure 1. Multi-choice pairwise reference comparisons.
Figure 1. Multi-choice pairwise reference comparisons.
Axioms 11 00659 g001
Table 1. Linguistic expression for reference comparison.
Table 1. Linguistic expression for reference comparison.
ValueLinguistic ExpressionValueLinguistic Expression
1EI: Equal important2IEM: Intermediate b/w EI and MI
3MI: Moderate important4IMI: Intermediate b/w MI and I
5I: Important6IVI: Intermediate b/w I and VI
7VI: Very important8IEI: Intermediate b/w VI and EXI
9EXI: Extreme important
Table 2. Symbols/Notations used in this study.
Table 2. Symbols/Notations used in this study.
NotationsDescriptions
nNumber of Criteria in group decision-making system
mnumber of decision-makers in group decision-making system
c 1 , c 2 , , c n Criteria of group decision-making system with indices of i , j = 1 , 2 , , n
D 1 , D 2 , , D k Decision-makers of group decision-making system with index of k = 1 , 2 , , m
S k Number of multi-choices in the reference comparisons of k-th decision-maker
{ x i j s i j } k Multi-choice preference comparison of criterion i with j having s i j 1 number of possibilities
for decision maker k
c B Best criterion with index B
c W Worst criterion with index W
X B k Multi-choice preference comparisons best-to-others vector for k-th decision-maker
X W k Multi-choice preference comparisons others-to-worst vector for k-th decision-maker
P k Interpolation polynomial of k-th decision-maker
λ k Weight of k-th decision-maker ( λ k [ 0 , 1 ] and k λ k = 1 )
ξ k The consistency ratio for the k-th decision-maker
ω i The weight of criterion i
ξ The consistency ratio group decision-making
C I Consistency index
C R k Consistency ratio of k-th DM in the group decision-making problem
C R G Overall consistency ratio of the group decision-making problem
Table 3. CI [14].
Table 3. CI [14].
x B W m a x 123456789
CI (max ξ )0.000.4411.632.3033.734.475.23
Table 4. Multi-choice preference comparisons of four criteria with two decision-makers in Example 1.
Table 4. Multi-choice preference comparisons of four criteria with two decision-makers in Example 1.
DM x 12 x 13 x 14 x 23 x 43
D M 1 2{8, 9}342
D M 2 28{2, 3}42
Table 5. Result of Example 1 solving with MD-1.
Table 5. Result of Example 1 solving with MD-1.
No. ( λ 1 , λ 2 ) ( ω 1 * , ω 2 * , ω 3 * , ω 4 * ) z 13 , z 14 ξ k * CR k CR G
1(0.1, 0.9)(0.506667, 0.26666700.02666670.0005965700.005369134
0.0666667, 0.160000)00.02666670.005369134
2(0.3, 0.7)(0.506667, 0.26666700.02666670.0017897320.004176000
0.0666667, 0.160000)00.02666670.004176040
3(0.5, 0.5)(0.506667, 0.26666700.02666670.0029828860.002982886
0.0666667, 0.160000)00.02666670.002982886
4(0.7, 0.3)(0.506667, 0.26666700.02666670.0041760400.004176040
0.0666667, 0.160000)00.02666670.001789732
5(0.9, 0.1)(0.506667, 0.26666700.02666670.0053691950.005369195
0.0666667, 0.160000)00.02666670.000596577
Table 6. Result of Example 1 solving with MD-2.
Table 6. Result of Example 1 solving with MD-2.
No. ( λ 1 , λ 2 ) ( ω 1 * , ω 2 * , ω 3 * , ω 4 * ) z 13 , z 14 ξ k * CR k CR G
1(0.1, 0.9)(0.506667, 0.26666700.02666670.0005965770.005368993
0.0666667, 0.160000)00.02666560.005368993
2(0.3, 0.7)(0.506667, 0.26666700.02666670.0017897320.004175727
0.0666667, 0.160000)00.02666520.004175727
3(0.5, 0.5)(0.506667, 0.26666700.02666670.0029828860.002982886
0.0666667, 0.160000)00.02666670.002982886
4(0.7, 0.3)(0.506667, 0.26666700.02666520.0041757270.004175772
0.0666667, 0.160000)00.06221890.004175772
5(0.9, 0.1)(0.506667, 0.26666700.02666560.0053689930.005368993
0.0666667, 0.160000)00.23999000.005368904
Table 7. Pairwise comparison of three decision-makers in Example 2.
Table 7. Pairwise comparison of three decision-makers in Example 2.
DM x 12 x 13 x 14 x 23 x 43
DM129(3, 4)42
DM22(8, 9)442
DM3284(3, 4)2
Table 8. Result of Example 2 for MD-1.
Table 8. Result of Example 2 for MD-1.
No. λ k ( ω 1 * , ω 2 * , ω 3 * , ω 4 * ) z 13 , z 14 , z 23 ξ k * CR k CR G
10.2(0.533333, 0.26666710.0666670.0025490.002549
0.20.066667, 0.133333)00.0000000.000000
0.6 10.0000000.000000
20.2(0.533333, 0.26666710.0666670.0025490.002549
0.60.066667, 0.133333)10.0000000.000000
0.2 10.0000000.000000
30.6(0.538462, 0.26153810.0153850.0017650.002065
0.20.061539, 0.138462)10.0153850.000688
0.2 00.0461540.002065
40.3(0.533333, 0.26666710.0666670.0038240.003824
0.30.066667, 0.133333)10.0000000.000000
0.4 10.0000000.000000
50.3(0.533333, 0.26666710.0666670.0038240.003824
0.40.066667, 0.133333)10.0000000.000000
0.3 10.0000000.000000
60.4(0.533333, 0.26666710.0666670.0050990.005099
0.30.066667, 0.133333)10.0000000.000000
0.3 10.0000000.000000
Table 9. Result of Example 2 for MD-2.
Table 9. Result of Example 2 for MD-2.
No. λ k ( ω 1 * , ω 2 * , ω 3 * , ω 4 * ) z 13 , z 14 , z 23 ξ k * CR k CR G
10.2(0.528000, 0.27200010.0480000.0018360.002148
0.20.064000, 0.136000)10.0160000.000612
0.6 10.0160000.002148
20.2(0.538462, 0.26153800.0461540.0017650.002065
0.60.061539, 0.138462)10.0153850.002065
0.2 10.0461540.002065
30.6(0.538462, 0.26153810.0153850.0017650.002065
0.20.061539, 0.138462)10.0461540.001765
0.2 10.0461540.002065
40.3(0.524444, 0.27555610.0355560.0020400.002386
0.30.062222, 0.137778)10.0266670.001530
0.4 10.0266670.002386
50.3(0.527473, 0.27252700.0351650.0020170.002360
0.40.061539, 0.138462)10.0263740.002360
0.3 10.0351650.002360
60.4(0.527473, 0.27252710.0263740.0020170.002360
0.30.061539, 0.138462)10.0351650.002017
0.3 10.0351650.002360
Table 10. Criteria and their description for piping selection.
Table 10. Criteria and their description for piping selection.
TitleDescription
Total cost ( C 1 )Direct costs employer pays to the contractor
Security ( C 2 )Security of less damage to underground pipes
Social costs ( C 3 )Problems due to noise and traffic limitations
Environmental costs ( C 4 )Environmental pollution such as air and soil pollution.
Table 11. Case study.
Table 11. Case study.
x 12 x 13 x 14 x 24 x 34
D M 1 {6, 7}674{2, 3}
D M 2 77{7,9}{4, 6}5
D M 3 7{6, 7}9{8, 9}8
D M 4 {2, 3, 5}4{6,7}43
D M 5 348{3,4,5}5
D M 6 5{6, 7}75{2, 3, 5}
D M 7 9{4, 6}998
D M 8 9{7, 9}9{6, 8}2
D M 9 {8, 9}99{3, 4}1
D M 10 {7, 9}99{3, 5}{1, 2, 3}
Table 12. Optimal weights obtained for case study using MD-1, and -2.
Table 12. Optimal weights obtained for case study using MD-1, and -2.
CriteriaMD-1RankMD-2Rank
10.75433510.7438331
20.078034730.08670273
30.098265920.1034892
40.069364240.06597584
Table 13. Result of case study for MD-1, and -2.
Table 13. Result of case study for MD-1, and -2.
MD-1MD-2
ExpertWeight x BW CRCRGWeight x BW CRCRG
10.26878670.018015147 0.28200370.018901005
20.47687970.003835488 0.44110370.003547745
30.47687990.002735444 0.44110390.002530228
40.36416260.004855493 0.57042860.007605707
50.52023180.0081467940.0180150.48372580.0075751120.018901
60.36416270.007810445 0.3103270.006655657
70.54624390.010444417 0.50707990.009695583
80.75433590.014423231 0.70500790.013480057
90.13005890.003730153 0.18756490.005379465
100.3381590.009698375 0.47000490.013480038
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ahmad, Q.S.; Khan, M.F.; Ahmad, N. Multi-Criteria Group Decision-Making Models in a Multi-Choice Environment. Axioms 2022, 11, 659. https://doi.org/10.3390/axioms11110659

AMA Style

Ahmad QS, Khan MF, Ahmad N. Multi-Criteria Group Decision-Making Models in a Multi-Choice Environment. Axioms. 2022; 11(11):659. https://doi.org/10.3390/axioms11110659

Chicago/Turabian Style

Ahmad, Qazi Shoeb, Mohammad Faisal Khan, and Naeem Ahmad. 2022. "Multi-Criteria Group Decision-Making Models in a Multi-Choice Environment" Axioms 11, no. 11: 659. https://doi.org/10.3390/axioms11110659

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop