Next Article in Journal
Conditions Driving Youth Employment in Key Sectors of the Nigerian Economy
Next Article in Special Issue
Determinants of Low-Carbon Logistics Capability Based on Dynamic fsQCA: Evidence from China’s Provincial Panel Data
Previous Article in Journal
Promoting Responsible Sustainable Consumer Behavior through Sustainability Marketing: The Boundary Effects of Corporate Social Responsibility and Brand Image
Previous Article in Special Issue
The Influence of Green Supply Chain Management Practices on Corporate Sustainability Performance
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Identifying Critical Indicators in Performance Evaluation of Green Supply Chains Using Hybrid Multiple-Criteria Decision-Making

1
School of Economic & Management, Beijing Information Science & Technology University, Beijing 100192, China
2
Beijing Key Lab of Big Data Decision Making for Green Development, Beijing Information Science & Technology University, Beijing 100192, China
*
Author to whom correspondence should be addressed.
Sustainability 2023, 15(7), 6095; https://doi.org/10.3390/su15076095
Submission received: 9 February 2023 / Revised: 16 March 2023 / Accepted: 27 March 2023 / Published: 31 March 2023

Abstract

:
Performance evaluation of green supply chains (GSC) is an important tool to improve their comprehensive management. Identifying critical indicators is crucial to evaluation. This study examines the critical indicators in performance evaluations of GPC and provides relevant suggestions for managers to improve GSCs’ performances. Firstly, we summarized 24 evaluation indicators from five dimensions—financial value, customer service-level, business processes, innovation and development, and the so-called green level. Secondly, the Delphi method was used to determine the formal research framework. The fuzzy decision-making trial and evaluation laboratory based analytic network process (fuzzy DEMATEL-based ANP) model was applied. The weighted prominence of each indicator was calculated to identify those that were critical, and a causality diagram was constructed for them. Finally, corresponding countermeasures and implications regarding those were put forward. The research results show that the critical indicators include the return rate of net assets, the growth rate of profit, the rate of service satisfaction, market share, production flexibility, and the green consensus. Among them, the green consensus, the growth rate of profit and the rate of service satisfaction form a virtuous circle, leading to the improvement of the overall performance of GSC.

1. Introduction

A supply chain is a customer-oriented organizational form that aims to improve quality and efficiency by integrating resources for efficient collaboration in product design, procurement, production, sales, and service. In recent years, with the increasingly severe global climate problem, the construction of a green supply chain (GSC) has received increased attention. Based on the traditional supply chain, the GSC integrates concepts of sustainable development such as green manufacturing, product life-cycle management, and producer responsibility for enterprise value-chain activities. The GSC comprehensively considers the economic, social, and ecological benefits of enterprises through the entire supply chain process from raw material acquisition, processing, packaging, storage, transportation, use and recycling, and green sustainable development [1,2]. The GSC has the characteristics of integrity, purpose, hierarchy, environmental adaptability, and complexity [3].
Performance evaluation of the GSC is important for its construction and management. Since the GSC is based on the concept of the whole life cycle, its performance evaluation pertains to all aspects of planning, procurement, production, logistics, marketing, and recycling [1]. The GSC management process is more complex than that in traditional supply chains because the GSC involves longer evaluation cycles with diverse evaluation attributes. As such, evaluating its performance is challenging.
The traditional methods used for evaluating supply chain performance include the supply chain operation reference (SCOR) model and the balanced scorecard (BSC) model. The SCOR model is an effective tool for diagnosing the performance of a GSC [4]. The model is vertically divided into four levels (the process level, configuration level, practice level, and implementation level) and horizontally divided into five links (planning, procurement, production, distribution, and return management) [5]. The SCOR model is usually process-oriented, and the efficiency of the process is considered the key to the efficiency of the enterprise, which conforms to the GSC business framework. However, the model does not analyze the overall supply chain participants, and it does not take into account the indicators of all links of the supply chain [6]. The BSC model can explain the relationship between strategy and process through four dimensions: finance, customers, internal processes, learning, and growth [7]. The model comprehensively measures the balance between financial and non-financial, long-term and short-term, cause and result, internal and external, and qualitative and quantitative indicators [8]. It provides a comprehensive framework for measuring performance. However, the BSC model is guided by the overall strategy and focuses on the comprehensive development of enterprises. There are defects in process-oriented organizational performance evaluations of supply chains [9].
Thus, whereas the BSC model provides a basic framework for GSC performance evaluations from a macro-perspective, the SCOR model provides clear business divisions for the GSC. The combination of the two models can thus make the construction of an evaluation index system more comprehensive and scientific [10]. To construct such a GSC performance evaluation index system, we introduce a combined BSC-SCOR model that merges the evaluation dimension with the operation process. On the one hand, according to the core idea of the BSC model, we introduce a multi-dimensional index, and on the other hand, business processes are divided and decomposed according to the SCOR model [11].
Having constructed the evaluation index system, we identify the key indicators of performance evaluation of a GSC. The interaction between these indicators plays a vital role in improving performance. The identification of key indicators of a GSC performance evaluation is a typical multi-criteria decision-making (MCDM) problem. For this kind of problem, commonly used methods include the analytic hierarchy process (AHP) method, the entropy weight method, the analytic network process (ANP) method, and the decision-making trial and evaluation laboratory (DEMATEL), among others. However, the AHP and entropy weight method are only applicable when the indicators are independent of each other, without considering the interaction between them. In reality, there are interactions between different types of performance evaluation indicators. In the ANP model, each indicator has a network structure that affects other ones, and this method offers a consistency check and complex modeling for comparing indicators [12,13]. The DEMATEL method calculates the causality and prominence of each indicator to determine the key indicators. It then builds a causal relationship diagram of the indicators to reflect the interaction of each indicator. The total influence matrix and causality diagram obtained by the DEMATEL provide basic data for ANP, thus avoiding the consistency test and complex modeling problems that arise from only using the ANP. In our study, to capture the ambiguity and uncertainty of various indicators, we combine the fuzzy DEMATEL method with the ANP method to form the fuzzy DEMATEL-based ANP model to identify the key performance evaluation indicators for a GSC [14,15].
In our study, we explore the answers to the following research questions: What dimensions and indicators should be considered in the performance evaluation of GSC? Which are the critical indicators and how do they affect each other? Furthermore, which are the critical driving factors that affect the GSC’s performance most? Answering these questions has certain theoretical and practical implications. Theoretically, we sort out the performance evaluation indicators of a GSC systematically and comprehensively by combining the BSC and SCOR models. Furthermore, we analyze the interaction between any two indicators and identify the critical driving indicators with the adoption of the fuzzy DEMATEL-based ANP model. Practically, as shown in the case study, the findings are conducive to scientific evaluation and effective improvement of a GSC’s performance.
The rest of this paper is arranged as follows: Section 2 reviews and summarizes previous research results on GSC performance evaluation. In Section 3, we introduce the Delphi method and the fuzzy DEMATEL-based ANP model used in the study. Section 4 presents our empirical research, which selects and analyzes the key performance evaluation indicators of a GSC. Section 5 discusses relevant countermeasures and offers suggestions for performance evaluation of GSC based on the empirical research results. Section 6 concludes.

2. Literature Review

A GSC is essentially an endorsement by green suppliers that the green attributes of supply chain management processes have been satisfied. They are an important means of optimizing the market environment, establishing a trust mechanism, and developing international green trade. Evaluations of GSC performance are a powerful guarantee for ensuring the greenness and effectiveness of the whole supply chain operation process. The GSC is a hot topic in the field of supply chain research. As the world continues to advocate for environmental awareness, the issue of evaluating GSC performance is also being studied and expanded upon by scholars.
On the selection of GSC performance evaluation indicators, scholars have conducted in-depth research from different perspectives. One focus is the supply chain business process, which includes all aspects of the supply chain operation process. Business process performance evaluation indicators are extracted according to the construction principles of the supply chain process performance evaluation indicator system. Liao analyzed the links at all levels of the resource input level, operation level, product (service) output level, and feedback level, and then screened out specific evaluation indicators [16]. Feng and Li constructed corresponding indicators from three aspects: the result level, operation level, and support level. They used the entropy method and AHP method to determine the weight of indicators for evaluating performance [17]. Jin selected 21 indicators from four dimensions related to the supply chain process to conduct research on evaluating the GSC performance of automobile enterprises in the carbon peak and carbon neutral backgrounds [18]. Osintsev et al. conducted a detailed study on the performance evaluation of GSC logistics processes based on a combined DEMATEL-ANP method to achieve the goal of sustainable development [19]. Effendi et al. and Divsalar et al. used the SCOR model to evaluate the performance of GSCs [20,21].
Another focus of research is capital operations and the financial management requirements of supply chain enterprises. Hou and Wang respectively analyzed the financial performance of A-share listed logistics supply chains and forestry logistics enterprises and built an enterprise financial performance evaluation index system based on four dimensions: enterprise profitability, debt paying ability, operating ability, and development ability [22,23]. Based on the concept of green development, Liu et al. added indicators that reflected low-carbon capacity to the four traditional dimensions of enterprise financial evaluation systems. They focused on measuring the efficiency of energy consumption, pollutant emissions, and post-production waste recycling [24]. Based on the concept of green development, Yu and Li built a comprehensive financial analysis index system that includes five dimensions: solvency, operating ability, profitability, development ability, and environmental protection and governance ability [25].
From the perspective of ecological civilization, some scholars argue that the impact of the whole life cycle of products on the environment should be considered in addition to economic and social benefits. Chang et al. started from the external value chain of enterprises, and comprehensively analyzed the impact of the upstream suppliers and downstream vendors (customers) outside the enterprise. Based on this, they built a set of performance evaluation indicators to comprehensively manage the environmental performance of enterprises [26]. Wang et al. extracted 20 environmental performance evaluation indicators from six perspectives: ecological design, cleaner production, resource and energy utilization, waste recycling, environmental impact, and financial performance related to environmental activities [27]. Yu et al. analyzed the environmental performance of automobile enterprises from both internal and external aspects [28]. Zhou et al. evaluated green indicators such as green design, green procurement, and the green production of enterprises based on the Delphi and fuzzy AHP methods [29]. Huang et al. used AHP and three-stage DEA methods to conduct comprehensive performance evaluation research on China’s energy supply chain in the context of double carbon goals [30]. Wicher et al. used multi-criteria decision-making to evaluate the sustainability performance of industrial enterprises [31].
There has also been extensive research done on various supply chain performance evaluation indicators, and on refining performance evaluation indicator systems. Some of this research pertains to the selection of critical performance evaluation indicators. In research on performance evaluation indicator segmentation, Wan, Xiao, and Gu considered the perspective of corporate stakeholders and added sustainable development indicators on the basis of the four dimensions: the financial situation, customer service, operation process, and innovative learning. Their green development indicators were subdivided into five categories: environmental governance investment, the environmental protection investment ratio, the environmental protection material utilization rate, the resource utilization rate, and the resource recovery rate. Based on these indicators, they established a GSC performance evaluation index system [32,33,34]. Du studied the performance evaluation of GSC from four dimensions—finance, customers, processes, and sustainable development—and subdivided each aspect (e.g., dividing sustainable development into new product development capability, technology investment, and the community environmental protection level) [35]. Wang and Lu, Bai et al. and Huang et al. considered the target benefits of GSC combined with the actual operations of GSC. They built a performance evaluation index system based on three aspects—economic benefits, social benefits, and environmental benefits—and on this basis, subdivided these into a secondary evaluation index system for comprehensive evaluations [36,37,38]. Wang and Yang studied the characteristics of green agricultural product transportation and built a green agricultural product supply chain performance evaluation index system with six dimensions: financial status, customer service, business processes, the logistics technology level, innovative learning, and green environmental protection. In order to meet the requirements for agricultural product transportation, the logistics technology level was subdivided into four aspects: delivery timeliness, loss rate, service flexibility, and order completion rate [39].
In terms of selecting critical performance evaluation indicators, Zhang et al. used the fuzzy technique for order preference by similarity to an ideal solution (TOPSIS) method to evaluate the performance of the GSC [40]. Jiao used the multi-objective evaluation analysis method to construct an indicator system and used the fuzzy comprehensive evaluation method to evaluate the environmental management performance of GSC [41]. Cao and Fan studied the performance evaluation of green agricultural product supply chains based on DEA and principal component analysis [42]. Ma et al., constructed a GSC performance evaluation index system from the aspects of process, customer service, finance, environmental protection, information, and knowledge, and proposed a method to identify the critical performance evaluation indicators of GSC based on the DEMATEL method [43]. Dai and Ye adopted a low-carbon perspective and analyzed and evaluated the key indicators of GSC optimization and supervision from five dimensions regarding property value and internal supply chain processes [44]. Nozari et al., conducted quantitative analysis on critical performance evaluation indicators of GSC in the fast-moving consumer goods industry based on a nonlinear fuzzy method [45]. Chang et al., used the mixed MCDM model to analyze the supply chain performance indicators of Indian mining and earth-moving equipment manufacturing companies through the DEMATEL method [46].
The above research results provided certain guidance for the construction of the initial evaluation index in our study. According to the principles of systematicness, comprehensiveness, a combination of static and dynamic indicators, and a combination of qualitative and quantitative indicators, we integrated and optimized the indicators involved in previous studies considering the actual requirements of a performance evaluation of a GSC. Firstly, referring to the BSC model, we summarized the previous evaluation indicators into four dimensions: financial value, customer service level, business process, innovation and development. Secondly, considering the characteristics performance evaluation of the GSC, indicators related to green, low-carbon, and sustainable aspects were summarized into the dimension of green level. Thirdly, the supply chain is the integration of all processes and activities from the initial supplier to the final customer. In order to reflect the characteristics, the business process was further decomposed in combination with SCOR model. Finally, the initial performance evaluation index system of the GSC was established as shown in Table 1.
The previous literature offers many evaluation indicators for analyzing the performance evaluation process of GSCs from different perspectives. However, due to the limited resources in the actual supply chain management process, it is unrealistic to study and analyze all the performance evaluation indicators one by one. Thus, it is necessary to select only the critical indicators. To do so, the AHP method, gray evaluation method, and catastrophe progression method were used for quantitative analysis. These methods share a common problem, that is, the various evaluation indicators in the evaluation process are treated in isolation, without taking into account the interaction between them. For a comprehensive performance evaluation, various indicators should be understood in terms of their interaction with each other, forming a complex evaluation indicator system. Therefore, in what follows, we propose a new method of selecting critical performance evaluation indicators for GSCs.

3. Methodologies

3.1. Delphi Method

The Delphi method was initiated and implemented by the RAND Corporation in the 1950s and has the characteristics of anonymity, feedback, and statistics. It is essentially a method of anonymous inquiry by experts that involves soliciting opinions and feedback repeatedly until consensus is reached. The Delphi method adopts a back-to-back approach, which enables each expert to make independent judgments. It overcomes the subjective differences caused by different expert fields, experiences, personal cognition, etc. It is a scientific and practical analysis method [47]. When using the Delphi method to screen indicators, we first select representative scholars with professional knowledge and rich experience in decision-making issues. Anonymity ensures that the experts can freely and independently put forward their own opinions on decision-making issues. The experts are provided with as much information as possible to make judgments. Consistent opinions are sought through multiple rounds of feedback.
The specific implementation process of the Delphi method is shown in Figure 1.
Implementation steps of the Delphi method:
(1)
Determine the subject of investigation and draw up an outline of the investigation.
(2)
Establish an expert group to determine the number of experts and the background of each expert.
(3)
Present the research questions, relevant requirements, and background material to the expert group, and provide as much information as possible for the experts to make judgments.
(4)
The experts make their own judgment based on this information.
(5)
Summarize the expert opinions and ensure that they are consistent.
If the experts’ opinions are consistent, the final results are analyzed. If the experts’ opinions are inconsistent, they are provided with feedback and additional information, and another round of investigation is conducted until the expert opinions are consistent. The consensus deviation index (CDI) was used to calculate the consensus degree of the expert panel. The CDI value was equal to the standard deviation divided by the mean. A threshold was needed in advance. If the CDI values were greater than the threshold, it indicated a significant divergence in the experts’ opinions, and the next round of expert scoring is required until all the CDI values were lower than the threshold.

3.2. Fuzzy DEMATEL-Based ANP Model

The DEMATEL method was first proposed by A. Gabus and E. Fontela to understand complex and difficult decision-making problems in the real world. It is a systematic analysis method based on graph theory and matrix tools. When using the DEMATEL method for performance evaluation, we first analyze the composition of the indicators in the system and the logical relationship between the indicators. Then, we build a direct impact matrix. After calculations, we can obtain a comprehensive impact matrix, with which we can calculate the influence of each indicator on other indicators and determine the causality and prominence of each indicator as the basis for constructing the model. Thus, the causal relationship between indicators and the position of each indicator in the system are determined, and a causal relationship diagram of the indicators is generated [48].
The ANP method is combined with the DEMATEL method to form the DEMATEL-ANP method, which plays an important role in determining critical factors and causal relationships. The causal relationship diagram of indicators formed by the DEMATEL method lays the foundation for ANP modeling. At the same time, the total influence matrix obtained by the DEMATEL method can be directly used as an unweighted super-matrix in the ANP model, which avoids the cumbersome work of comparing two indicators in the ANP method and the problem of consistency testing. The weights of the indicators are determined by comprehensively considering the prominence calculated by the DEMATEL method and the weight calculated by ANP method. The final ranking of each indicator is thus obtained.
In our study, considering the ambiguity and uncertainty of various indicators, we explore the fuzzy DEMATEL-based ANP model for selecting key performance evaluation indicators. The specific operation steps are as follows:
First, we determined the interaction among the evaluation indicators through a questionnaire. Using the triangular blur number, we obtained the fuzzy direct influence matrix Z ˜ , including Z l ,     Z m ,   Z u as the direct influence matrix of the lower limit, median, and the upper limit respectively. In Equation (1), Z ˜ ij represents the fuzzy impact of the indicator i on the indicator j.
Z ˜ = z ˜ 11 z ˜ 12 z ˜ 1 n z ˜ 21 z ˜ 22 z ˜ 2 n z ˜ n 1 z ˜ n 2 z ˜ n n
Second, we normalized the fuzzy direct influence matrix Z ˜ to obtain the normalized fuzzy direct influence matrix X ˜ . The calculation formula is shown in Equation (2), and the calculation of λ is shown in Equation (3).
X ˜ = λ Z ˜
λ = 1 max 1 i n j = 1 n z ˜ i j i , j = 1 , 2 , , n
Third, we calculated the fuzzy total influence matrix T ˜ according to the normative fuzzy direct influence matrix X ˜ . The calculation formula is shown in Equation (4), where I was the unit matrix. Then, we created the crisp total influence matrix T based on T ˜ . The crisp total influence matrix T is directly used as the unweighted super-matrix of the ANP model. After the ANP operation, the weighted super-matrix and limited super-matrix were obtained successively.
T ˜ = X ˜ I X ˜ 1
Fourth, we determined the causal relationship of the performance evaluation indicators. In the total influence matrix T, we used di to represent the sum of evaluation indicators in each row and ri to represent the sum of the evaluation indicators in each column. Here, di represents the total influence value of the i-th indicator on other indicators, and ri represents the total influence value of the i-th indicator on all other indicators. The difference between the influence degree and the affected degree of the i-th indicator is the causality of this indicator, which is recorded as diri. If diri > 0, this indicates that the impact of this indicator on other indicators is greater than that of other indicators on itself, so this indicator is called a driving factor. The greater the difference, the greater the impact of this indicator on other indicators. Conversely, if diri < 0, this indicator is called a result factor. Therefore, we built a causal relationship diagram based on the classification of all indicators.
Finally, we sorted the indicators, and then determined the critical evaluation indicators. The prominence of each indicator was obtained by adding the influence degree di and the affected degree ri of the i-th indicator. This represents the role of the evaluation indicator in the whole performance evaluation system, such that the importance of the indicator can be obtained by sorting the prominence. At the same time, we calculated the weight of each evaluation indicator according to the ANP model, expressed by wi. Further, we calculated the weighted prominence of each evaluation indicator through the formula wi(di + ri), and, finally, ranked the indicators according to the weighted prominence and determined the critical indicators in the evaluation index system.
To sum up, the key indicator selection process based on the fuzzy DEMATEL-based ANP model is shown in Figure 2.

4. Empirical Study

4.1. Establishing the Formal Decision Structure Based on the Delphi Method

The Delphi method was used to screen and optimize the initial performance evaluation index system of GSCs. Six experts, with rich practical experience and theoretical background in green supply chain operation were selected, as shown in Table 2.
In the first round of the Delphi questionnaire, an initial research framework, as shown in Table 1, was provided to experts. Experts judged whether the listed indicators were suitable for the performance evaluation of GSCs according to their experience, and checked whether the description of the indicators was clear.
In the second round of the Delphi questionnaire, the experts scored the necessity of each indicator on a scale of 0~10. A score of 0 denoted that the indicator was absolutely unnecessary and one of 10 indicated that it was absolutely necessary. The consensus deviation index (CDI) was used to calculate the consensus degree of the expert panel. Taking 0.2 as the threshold of CDI, if it was greater than 0.2, it indicated a significant divergence in the experts’ opinions, and the next round of expert scoring was required until all the CDI values were lower than 0.2. As shown in Table 3, the CDI values of 12 indicators were lower than 0.2, indicating that experts agreed on the 12 evaluation indicators. And the CDI values of the other 12 indicators were greater than 0.2. To reach a consensus, the third round of the Delphi questionnaire was conducted.
In the third round, the mean value and standard deviation of the second-round questionnaire filled out by all experts were presented. Experts who scored, in the previous round, outside the average value (plus or minus one standard deviation) were asked to provide reasons for their scores to avoid errors caused by unnecessary factors. The scoring results of the third round of the Delphi survey showed that the CDI values of 24 indicators were all less than 0.2. After the discussion, the experts agreed to take the average score of 6 as the critical value. As a result, indicators whose mean values were less than 6 were judged to be unnecessary and discarded from further consideration. A total of 12 evaluation indicators were eliminated, including the rate of return on total assets, the rate of total asset liability, the rate of total asset turnover in the financial value level, the rate of customer complaint, the speed of response in the customer service level, the rate of sale of marketed goods, and the information communication ability in the business process. The final index system for performance evaluation of GSC was shown in Table 4.

4.2. Identification and Analysis of Critical Performance Evaluation Indicators

We used the fuzzy DEMATEL method to study the causal relationship between the indicators. The internal influence relationship of the indicators was obtained through a questionnaire. We designed 132 paired comparative questions in the questionnaire, with scores 0, 1, and 2, where 0 represents no impact, 1 represents a general impact, and 2 represents a significant impact. We applied the fuzzy linguistic scale as (0, 0, 1), (0, 1, 2), and (1, 2, 2) corresponding to 0, 1, and 2. The question posed was: “how is the impact of the return rate of net assets on the growth rate of profit”. Part of the questionnaire was shown in Table A1 in Appendix A.
The questionnaire was filled out by six experts in the field of GSCs. When processing the data, the opinions of each expert were treated equally. The results of the questionnaire were summarized, and the average value was calculated. The direct influence matrix of the lower limit, the median, and the upper limit were as shown in Table 5, Table 6 and Table 7.
We used Equation (2) to normalize the initial fuzzy direct influence matrix, and further calculated the fuzzy total influence matrix T ˜ according to Equation (4). The fuzzy total influence matrix T   ˜ was shown in Table 8, Table 9 and Table 10.
On the basis of the fuzzy total influence matrix T ˜ , we created the crisp total influence matrix T as shown in Table 11.
We summarized and summed the row and column elements in the crisp total influence matrix to obtain the influence degree d and the affected degree r of each indicator. We then calculated the prominence degree (d + r) and the cause degree (d − r) of each indicator, and finally determined the type of each indicator, as shown in Table 12.
According to the analysis of the results in Table 12, we divided the indicators into two categories: driving factors and result factors. The driving factors included the rate of product qualification (C1), production flexibility (C2), logistics capability (C3), the rate of waste recovery (E2), and green consensus (E3). These five indicators constitute the direct elements of the performance evaluation of GSCs.
We took the crisp total influence matrix in Table 11 as the unweighted super-matrix of the ANP model. The structure of the ANP model was shown in Figure 3.
Through further calculation, we derived a weighted super-matrix and a limited super-matrix. The weight coefficient of each indicator is shown in Table 13.
We combined the prominence of each indicator in Table 12 with the weight coefficient in Table 13 to obtain the weighted prominence of each indicator. The results were sorted to obtain a comprehensive ranking of the performance evaluation indicators of GSCs, as shown in Table 14.
According to the final ranking results in Table 14, the six most critical indicators in the performance evaluation of GSC were as follows: the rate of profit growth (A2), the green consensus of GSCs (E3), the return rate of net assets (A1), the rate of service satisfaction (B1), the production flexibility (C2), and market share (B2).
Combining the crisp total influence matrix in Table 11 and the weighted prominence in Table 14, a causal relationship diagram of the six critical indicators was generated, as shown in Figure 4. In Figure 4, we took the relation (d − r) as the vertical axis and the weighted prominence (d + r) as the horizontal axis. We determined the most influential indicator for each critical indicator from the crisp total influence matrix. For example, (E3→B1) indicated that E3 affected B1 the most. As shown in Figure 4, E3 affected B1 and B2 the most. A2 affected A1, C2 and E3 the most. B1 affected A2 the most. Since E3 was the critical driving factor, the improvement of E3 would improve B1, then A2 would be improved by B1, and E3 would be improved by A2, forming a virtuous circle as ‘E3→B1→A2→E3’. The performance of the overall GSC could be improved.

4.3. Analysis of the Implementation Effect of the Case Enterprise

Since China put forward the “Double Carbon” target in 2020, coal mining enterprises, which were traditionally high energy-consuming and high-emissions, had been under pressure to conform with green transformation. Achieving green design and green procurement of coal from mines, green mining and green transportation of coal, and ultimately achieving the goal of green mine construction were the only way for coal enterprises to achieve green transformation.
Company A was an enterprise with coal mining as its main business under Jinneng Holding Group, which paid special attention to improving the performance of the GSC in the practice of the construction of eco-friendly mines. It had promoted the construction of a GSC from various aspects such as green procurement, green mining, and green transportation of coal. In the previous process of GSC construction, due to the inadequate understanding of the key indicators affecting the performance of the GSC, the managerial measures were not targeted, and the implementation was not satisfactory. Referring to the conclusions of our study, Company A strengthened the green consensus in the process of selecting raw material suppliers and coal transportation companies. Due to the improvement of green consensus, the rate of service satisfaction and market share were significantly improved. The improvement of the service satisfaction level made the growth rate of profit increase by 5%. Meanwhile, the growth of profit further enhanced the green consensus, forming a positive cycle. In addition, the profit enhancement also promoted the optimization of the return rate on net assets and production flexibility. All in all, the construction of a GSC in Company A was more targeted.

5. Discussion and Implications

The empirical results showed that financial value, customer service level, business processes, and the green level were important dimensions of GSC performance evaluations. Critical performance evaluation indicators included the return rate of net assets (A1), the growth rate of profit (A2), the rate of service satisfaction (B1), market share (B2), production flexibility (C2), and the green consensus (E3). We divided the indicators in the evaluation index system into driving factors and result factors by calculating the cause degree. The detailed analysis of the results are as follows:
(1)
The production flexibility (C2) and the green consensus (E3) are the critical driving factors. The latter (E3) has a decisive impact on the rate of resource utilization (E1), the rate of waste recovery (E2), the rate of service satisfaction (B1), market share (B2), and new service development efforts (D1).
(2)
The rate of profit growth (A2) has an important impact on the financial value performance of GSC performance evaluations. The profit growth rate is an important indicator that reflects the operating efficiency and development prospects of enterprises. It further reflects the development potential of enterprises. However, the profit growth rate is a result factor that is mainly affected by the green degree of the enterprise. The public’s high recognition of GSC helps to improve the image, popularity, and influence of the green demonstration enterprise, thus bringing economic benefits. Enterprises should adhere to the principles of green development over a sustained period.
(3)
The return rate of net assets (A1) is a critical factor in performance evaluations of GSC enterprises. It reflects the input–output level and profit quality of enterprises in a certain production cycle, and it further reflects the level of investment income of enterprises. It is the most comprehensive financial indicator when studying the operation status of enterprises and measuring the asset structure and operating capacity of enterprises, and it has an important impact on performance evaluations of supply chains. However, the return on net assets is a result factor that is mainly affected by the profit growth rate.
(4)
The rate of service satisfaction (B1) plays an important role in performance evaluations of GSCs. Customers are located at the end of the supply chain and provide objective feedback for the operation effect of the enterprise supply chain. Service satisfaction reflects customers’ recognition of the enterprise and satisfaction with products and services, which is the key factor when measuring customer performance evaluation. It can be seen from Figure 1 that service satisfaction is a result factor that is mainly affected by the green consensus of GSCs.
(5)
Market share (B2) is a critical indicator in GSC performance evaluation, reflecting the share of supply chain end products in the market and the product service capability of enterprises. However, the market share is a result factor that is mainly affected by the green consensus of GSCs. That is, those enterprises with a high green consensus of GSCs also have a large share of their products at the end of the supply chain.
Based on the above analysis, we propose the following managerial implications to enhance the performance of GSCs.
To improve the performance of GSCs, enterprises should basically focus on the green consensus by strengthening the selection and evaluation of supply chain partners. Partners who accept and implement the green concept should be selected and encouraged. With the improvement of the green consensus, the service satisfaction level and the market share will all be optimized directly. The improvement of the service satisfaction level can lead to an improvement of the growth rate of profit. With the improvement of the growth rate of profit, participants of the GSC can utilize more financial resources to strengthen the green consensus. These three indicators form a virtuous circle. Additionally, the production flexibility and the return rate of net assets will be directly improved by the increasing financial support. That is, the whole GSC system will be improved through the improvement of green consensus and the virtuous circle.

6. Conclusions

Based on the improved BSC-SCOR model, we constructed a GSC performance evaluation index system to ensure comprehensiveness and performance of the evaluation process. Then, according to the fuzzy DEMATEL-based ANP model, we selected critical indicators for evaluating GSC performance, and we proposed corresponding countermeasures according to the empirical research results. Our conclusions are as follows:
First, we sorted out the existing research results in this field, and on that basis, we reviewed an initial index system for performance evaluation of GSCs. The initial indicator set comprised 24 evaluation indicators in five dimensions: financial value, customer service level, business processes, innovation and development, and the green level. The initial indicators were screened and optimized based on an expert questionnaire survey. After calculating the average score and CDI values of each indicator, 12 unnecessary indicators were eliminated, and a GSC performance evaluation indicator system with 12 indicators in five dimensions was ultimately obtained.
Second, we used the fuzzy DEMATEL method to calculate the prominence and causality of the indicators and analyzed the causal relationship between the indicators. Six experts with rich practical experience and professional theoretical backgrounds in the field of GSCs were invited to complete the questionnaire. By summarizing the data and calculating average values, an initial fuzzy direct influence matrix was obtained. The fuzzy and crisp total influence matrices were further calculated. The indicators were divided into driving factors and result factors according to the relationship. The driving factors included the product qualification rate, production flexibility, the logistics capacity, the rate of waste recovery, and the green consensus.
Third, we selected critical indicators for evaluating GSC performance according to the fuzzy DEMATEL-based ANP model. The weighted prominence of each indicator was obtained by combining the prominence with the weight coefficient calculated by the ANP model. Then, we ranked the calculation results to determine the critical evaluation indicators in GSC performance evaluation.
Finally, according to the analysis results, some countermeasures and suggestions were put forward regarding the process of evaluating GSC performance.
Compared with previous studies [5,11,31,49], four basic dimensions of the index system were the same, including financial value, customer service, business process, and innovation and development. We all took the growth rate of profit as a typical reflection of financial performance, the rate of service satisfaction as an important reflection of customer service level, and we all emphasized the importance of logistics capability in the supply chain. In the dimension of innovation and development, we all considered new service development and R&D investment. The differences lie in the following two aspects: firstly, our study fully considered the characteristics of a GSC, adding the green level as the fifth dimension. The green level dimension included three indicators: the rate of resource utilization, the rate of waste recovery, and the green consensus. Secondly, considering the complexity of the business process of a GSC, we included the SCOR model to optimize and adjust the business process dimension. We integrated the three indicators of time flexibility, variety flexibility, and quantity flexibility into production flexibility. At the same time, the logistics capability was incorporated into the business process dimension.
In terms of the identification of critical indicators, Shafiee et al. [5] and Wang et al. [31] obtained the critical indicators from three dimensions: financial, customer service, and business process, using the gray clustering and fuzzy comprehensive evaluation methods. Jia et al. [49] identified that customer service and logistics capacity were the two most important indicators, using the extension goodness evaluation method. These conclusions are consistent with our study. Unlike from the previous studies, we not only extracted critical indicators, but also identified the critical driving indicators through the interaction analysis of any two indicators. We considered the green consensus as the most important indicator to enhance the overall performance of a GSC. We also discovered the virtuous circle among the green consensus, the service satisfaction level, and the growth rate of profit. Only if all the participants in the whole supply chain wholly accept the green development concept, can they maintain the synergy and consistency in their business and drive the improvement of financial indicators and customer satisfaction.
There were some limitations to this study. Although we classified the 24 indicators into five dimensions according to the BSC-SCOR joint model, we did not consider an exhaustive set of indicators. Such indicators should be checked one by one in consideration of innovations in supply chain models and recent research, and the selection of evaluation indicators should be further expanded. In addition, when processing the data, we treated the opinions of each expert equally, even though the theoretical experience of each expert differed. In future research, we will consider a weighted ratio to distinguish the experience of the experts.

Author Contributions

Conceptualization, C.Z. and J.Z.; methodology, C.Z.; software, L.T.; validation, C.Z., J.Z. and L.T.; formal analysis, C.Z.; investigation, L.T.; resources, J.Z.; data curation, L.T.; writing—original draft preparation, L.T.; writing—review and editing, C.Z.; visualization, C.Z.; supervision, J.Z.; project administration, J.Z.; funding acquisition, J.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by The Project of Cultivation for young top-motch Talents of Beijing Municipal Institutions under Grant BPHR202203236, and the operating funding for Beijing Key Lab of Big Data Decision Making for Green Development under grant 5026023502.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of the School of Economics and Management, Beijing Information Science and Technology University (31 March 2023).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

All data that support the findings of this study are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Part of the questionnaire.
Table A1. Part of the questionnaire.
1. What do you think about the impact of the return rate of net assets on its growth rate of profit?
-
no impact (0)
-
a general impact (1)
-
a significant impact (2)
2. What do you think about the impact of the return rate of net assets on its rate of service satisfaction?
-
no impact (0)
-
a general impact (1)
-
a significant impact (2)
3. What do you think about the impact of the return rate of net assets on its market share?
-
no impact (0)
-
a general impact (1)
-
a significant impact (2)
4. What do you think about the impact of the return rate of net assets on its rate of product qualification?
-
no impact (0)
-
a general impact (1)
-
a significant impact (2)

References

  1. Cheng, H.J.; Ding, H.; Ma, Y.C. Supply chain risk assessment and application of export-oriented enterprises based on improved SCOR. Enterp. Econ. 2020, 39, 80–89. [Google Scholar]
  2. Lima, F.R.; Carpinetti, L. Evaluating Supply Chain Performance based on SCOR model and Fuzzy-TOPSIS. In Proceedings of the IEEE International Conference on Fuzzy Systems, Vancouver, BC, Canada, 24–29 July 2016; pp. 2075–2082. [Google Scholar]
  3. Tang, Y.L. Research on supply chain performance based on SCOR and balanced scorecard. Think Tank Times 2019, 24, 149–150. [Google Scholar]
  4. Chen, Y.J.; Hu, W.L.; Wu, Z.X. Construction and evaluation method of performance evaluation index system for BaiJiu enterprises—Improved TOPSIS model based on BSC and entropy weight. J. Sichuan Univ. Light Chem. Technol. 2020, 35, 68–87. [Google Scholar]
  5. Shafiee, M.; Lotfi, F.H.; Saleh, H. Supply chain performance evaluation with data envelopment analysis and balanced scorecard approach. Appl. Math. Model. 2014, 38, 5092–5112. [Google Scholar] [CrossRef]
  6. Qiu, W.N.; Zhang, X.G.; Wang, B. Introduction, evaluation and selection of performance evaluation methods. Mod. Manag. Sci. 2008, 3, 81–82. [Google Scholar]
  7. Wang, H.C. The application of BSC-SCOR joint model in agricultural product logistics performance evaluation under the supply chain environment. Logist. Technol. 2014, 33, 242–246. [Google Scholar]
  8. Yi, L.; Jie, X.; Xu, M. Green Construction Supply Chain Performance Evaluation Based on BSC-SCOR. In Proceedings of the International Conference on Service Systems and Service Management (ICSSSM), Beijing, China, 21–22 July 2018. [Google Scholar]
  9. Zhu, Q.H.; Zhao, Q.H. Review of green supply chain management and its performance evaluation. Sci. Res. Manag. 2005, 4, 93–98. [Google Scholar]
  10. Zhou, L.J.; Li, H. Study on Green Supply Chain Management Based on Circular Economy. Appl. Mech. Mater. 2012, 84, 761–764. [Google Scholar] [CrossRef]
  11. Zhao, T.; Li, X.P. Research on performance evaluation of green supply chain management. J. Beijing Univ. Technol. 2010, 12, 80–83. [Google Scholar]
  12. Liu, J.; Hou, J.J.; Qi, Y. Research on the optimization evaluation of China’s tourism industry structure based on DEMATEL-ANP model. Geogr. Geogr. Inf. Sci. 2021, 37, 102–112. [Google Scholar]
  13. Zha, S.S.; Guo, Y.; Huang, S.H.; Tang, P.Z. A Hybrid MCDM Approach Based on ANP and TOPSIS for Facility Layout Selection. Trans. Nanjing Univ. Aeronaut. Astronaut. 2018, 35, 1027–1037. [Google Scholar]
  14. Zhang, C.L.; Zhang, J.; Yang, Q. Identifying Critical Risk Factors in Green Product Certification Using Hybrid Multiple-Criteria Decision-Making. Sustainability 2022, 14, 4513. [Google Scholar] [CrossRef]
  15. Wang, F.W.; Xu, Y.S.; Wang, Z.K.; Yin, Z.X.; Ma, Y. Selection of navigation safety indicators for major ships in heavy winds and waves based on DEMATEL-ANP. J. Saf. Environ. 2021, 21, 62–69. [Google Scholar]
  16. Liao, J.L. Review of supply chain business process performance evaluation. Logist. Technol. 2019, 38, 88–93. [Google Scholar]
  17. Feng, Y.Z.; Li, Y. Research on performance evaluation of green supply chain process docking under e-commerce environment. Logist. Eng. Manag. 2018, 40, 77–79. [Google Scholar]
  18. Jin, B.H. Research on performance evaluation of green supply chain of automobile enterprises under the background of carbon peak and carbon neutralization. Energy Rep. 2021, 7, 594–604. [Google Scholar] [CrossRef]
  19. Osintsev, N.; Rakhmangulov, A.; Baginova, V. Evaluation of Logistic Flows in Green Supply Chains Based on the Combined DEMATEL-ANP Method. Facta Univ. Ser. Mech. Eng. 2021, 19, 473–498. [Google Scholar] [CrossRef]
  20. Effendi, U.; Dewi, C.F.; Mustaniroh, S.A. Evaluation of supply chain performance with green supply chain management approach (GSCM) using SCOR and DEMATEL method (case study of PG Krebet Baru Malang). Earth Environ. Sci. 2019, 230, 12065. [Google Scholar] [CrossRef]
  21. Divsalar, M.; Ahmadi, M.; Nemati, Y. A SCOR-Based Model to Evaluate LARG Supply Chain Performance Using a Hybrid MADM Method. IEEE Trans. Eng. Manag. 2022, 69, 1101–1120. [Google Scholar] [CrossRef]
  22. Hou, X.D. Financial performance evaluation of A-share listed logistics supply chain enterprises—Based on factor analysis. J. Shanxi Univ. Financ. Econ. 2021, 43, 53–57. [Google Scholar]
  23. Wang, X.Y. Evaluation and analysis of financial performance of forestry logistics enterprises—Taking Wanlin Logistics as an example. Logist. Eng. Manag. 2022, 44, 160–162. [Google Scholar]
  24. Liu, X.T.; Li, Q.; Li, Y.; Tao, X. Construction and application of enterprise financial performance evaluation system based on the concept of green development. China Rural. Enterp. Account. 2020, 1, 80–83. [Google Scholar]
  25. Yu, W.; Li, A.H. Construction and implementation of enterprise financial comprehensive evaluation system under the concept of green development—Taking AG Group as an example. China Collect. Econ. 2022, 5, 149–150. [Google Scholar]
  26. Chang, Y.; Xiong, Y.T.; Wang, M.L. Design of enterprise environmental performance evaluation indicators from the perspective of external value chain. Financ. Account. Mon. 2016, 26, 44–47. [Google Scholar]
  27. Wang, Y.; Wang, X.; Zhao, L.Y. Research on the environmental performance evaluation index system of iron and steel enterprises—Based on the perspective of ecological civilization. Ecol. Econ. 2016, 32, 46–50. [Google Scholar]
  28. Yu, K.; Zhang, W.; Zhang, Y. Carbon Performance Evaluation of Automobile Manufacturing Industry in Green Supply Chain. In Proceedings of the International Conference on Robots & Intelligent System (ICRIS), Haikou, China, 15–16 June 2019; pp. 405–408. [Google Scholar]
  29. Zhou, Y.; Xu, L.; Muhammad Shaikh, G. Evaluating and Prioritizing the Green Supply Chain Management Practices in Pakistan: Based on Delphi and Fuzzy AHP Approach. Symmetry 2019, 11, 1346. [Google Scholar] [CrossRef] [Green Version]
  30. Huang, X.; Lu, X.; Sun, Y.; Yao, J.; Zhu, W. A Comprehensive Performance Evaluation of Chinese Energy Supply Chain under “Double-Carbon” Goals Based on AHP and Three-Stage DEA. Sustainability 2022, 14, 10149. [Google Scholar] [CrossRef]
  31. Wicher, P.; Zapletal, F.; Lenort, F. Sustainability performance assessment of industrial corporation using Fuzzy Analytic Network Process. J. Clean. Prod. 2019, 241, 118132. [Google Scholar] [CrossRef]
  32. Wan, Y.C. Analysis of green supply chain performance evaluation from the perspective of low carbon. Mark. Res. 2017, 7, 36–37. [Google Scholar]
  33. Xiao, Z.C. Construction of green supply chain performance evaluation system for large chain supermarkets. China Manag. Informatiz. 2017, 20, 89–90. [Google Scholar]
  34. Gu, T.Y. Construction of green supply chain performance evaluation system based on the perspective of enterprise stakeholders. Mod. Econ. Inf. 2020, 1, 12–13 + 15. [Google Scholar]
  35. Du, L.X. Research on green supply chain performance evaluation based on balanced scorecard. Bus. Econ. 2017, 11, 124–125 + 128. [Google Scholar]
  36. Wang, W.J.; Lu, X.X. Green supply chain performance evaluation of thermal power plants based on FANP. Value Eng. 2016, 35, 80–82. [Google Scholar]
  37. Bai, S.Z.; Guo, Q.X.; Wang, Y.Y. Performance evaluation of pork green supply chain based on grey evaluation model. Jiangsu Agric. Sci. 2017, 45, 307–311. [Google Scholar]
  38. Huang, W.H.; Jiang, Z.G.; Zhu, S.; Yan, W.; Wang, Y. A comprehensive method for performance analysis of green supply chain management in steel enterprises integrating TAHP, LMBP and DEMATEL. Int. J. Logist. Res. Appl. 2020. [CrossRef]
  39. Wang, K.X.; Yang, Y.Z. Grey clustering of green agricultural product supply chain performance evaluation—Fuzzy comprehensive model and application. Pract. Underst. Math. 2020, 50, 111–119. [Google Scholar]
  40. Zhang, B.X.; Zhang, M.Z.; Han, Z.T. Green supply chain performance evaluation based on fuzzy TOPSIS. J. Tianjin Univ. Technol. 2014, 33, 76–79. [Google Scholar]
  41. Jiao, R. Research on environmental management performance in green supply chain based on fuzzy comprehensive evaluation method. J. Southwest Norm. Univ. 2020, 45, 71–77. [Google Scholar]
  42. Cao, B.R.; Fan, Y.Q. Research on performance evaluation of green agricultural product supply chain based on DEA and principal component analysis. Sci. Technol. Manag. Res. 2017, 37, 72–77. [Google Scholar]
  43. Ma, F.; Chen, H.J.; Yang, H. Selection of key performance evaluation indicators for green supply chain based on DEMATEL method. J. Soc. Sci. Jilin Univ. 2011, 51, 126–131. [Google Scholar]
  44. Dai, Z.H.; Ye, C.M. Analysis and Evaluation of Key Elements of Optimal Regulation of Green Supply Chain from the Perspective of Low Carbon. Wirel. Commun. Mob. Comput. 2022, 2022, 8196756. [Google Scholar] [CrossRef]
  45. Nozari, H.; Najafi, E.; Fallah, M.; Hosseinzadeh Lotfi, F. Quantitative Analysis of Key Performance Indicators of Green Supply Chain in FMCG Industries Using Non-Linear Fuzzy Method. Mathematics 2019, 7, 1020. [Google Scholar] [CrossRef] [Green Version]
  46. Chand, P.J.; Thakkar, J.; Ghosh, K.K. Analysis of supply chain performance metrics for Indian mining & earth moving equipment manufacturing companies using hybrid MCDM model. Resour. Policy 2020, 68, 101742. [Google Scholar]
  47. Mahajan, V.; Linstone, H.A.; Turoff, M. The Delphi Method: Techniques and Applications. J. Mark. Res. 1976, 13, 317. [Google Scholar] [CrossRef]
  48. Leksono, E.B.; Suparno, S.; Vanany, I. Integration of a Balanced Scorecard, DEMATEL, and ANP for Measuring the Performance of a Sustainable Healthcare Supply Chain. Sustainability 2019, 11, 3626. [Google Scholar] [CrossRef] [Green Version]
  49. Jia, P.; Dong, J. Extension goodness evaluation on performance index of BSC-based logistics service supply chain. Stat. Decis. 2018, 3, 44–48. [Google Scholar]
Figure 1. Implementation process of the Delphi method.
Figure 1. Implementation process of the Delphi method.
Sustainability 15 06095 g001
Figure 2. The framework of the fuzzy DEMATEL-based ANP model.
Figure 2. The framework of the fuzzy DEMATEL-based ANP model.
Sustainability 15 06095 g002
Figure 3. The structure of the ANP model.
Figure 3. The structure of the ANP model.
Sustainability 15 06095 g003
Figure 4. Causality diagram of critical indicators.
Figure 4. Causality diagram of critical indicators.
Sustainability 15 06095 g004
Table 1. The initial performance evaluation index system of the GSC.
Table 1. The initial performance evaluation index system of the GSC.
DimensionIndicatorIndicator DescriptionReferences
Financial
value
Return rate of net assetsEnterprise profitability[22,23,24,26,34,35]
Return rate of total assetsOverall profitability of all assets including net assets and liabilities[17,24,33,34,37,39]
Total asset–liability ratioAbility to repay debt[22,23,24,25,32,34,36,37,39]
Turnover rate of total assetOperating capacity of overall assets[22,23,24,25,32,34,35,37,39]
Growth rate of profitMeasure of the business benefits and development prospects of the enterprise[22,25,32,35,36,39]
Customer service levelRate of service satisfactionCustomer’s recognition of the enterprise and satisfaction with products and services[32,33,34,36,38,39,43,46]
Rate of customer complaintCustomers are not satisfied with the product quality or service of the enterprise[17,33,37,39]
Speed of responseRespond quickly to unknown market demands[17,34,40]
Market shareShare of supply chain end products in the market[32,35,38]
Business processRate of sale of marketed goodsProduction and marketing operation in a certain period of time[32,39]
Rate of product qualificationProduct quality level[32,34,35,36,37,38]
Production flexibilityProduction flexibility, that is, the elasticity of the production capacity of the supply chain, can react quickly according to the market demand[18,19,36,39]
Information communication abilityInternal information sharing[17,35,39]
Logistics capabilityTransportation of raw materials, storage and distribution of finished products, collaborative production and procurement, intelligent replenishment, etc.[17,19,34,35,39]
Innovation
and development
Rate of market forecast accuracyAccuracy of scientific estimation of unknown market development trend[32,34]
New service development effortsDesign new or improved service concepts to meet customers’ unmet needs[17,34,35,43]
Rate of R&D investmentResearch and development of new products, new processes, and new materials[27,35]
Innovative ability of member learningStimulate and enhance the innovative consciousness of employees and improve the comprehensive quality of workers[39,40]
Proportion of scientific research personnelPersonnel specialized in scientific research and technical research[32,34,39]
Green levelEnvironmental impact degreePossible environmental impact of project implementation[24,26,27,39]
Environmental benefitsProceeds from environmental protection and environmental impact reduction activities[17,28]
Rate of resource utilizationThe amount of value that a certain number of resources can create[27,28,33,37,38,39]
Rate of waste recoveryDegree of waste recycling[16,17,27,34,35]
Green consensusPublic recognition of green concepts such as “green win-win and sustainable development” of enterprises[34,37,39,41]
Table 2. Professional backgrounds of the selected six experts for the Delphi survey.
Table 2. Professional backgrounds of the selected six experts for the Delphi survey.
ExpertDutiesGenderAgeSpecializes InWorking AreaSeniority
ProfessorMale46LogisticsShandong15~20
ProfessorMale45Supply chain managementBeijing15~20
Associate ProfessorMale35Supply chain managementShandong10~15
Associate Research FellowMale43Green logistics and supply chainShandong15~20
Senior ManagerMale50Enterprise managementShanxi20~30
Purchasing ManagerFemale38Purchasing managementShanxi15~20
Table 3. Necessity analysis of indicators in the second round of Delphi questionnaire.
Table 3. Necessity analysis of indicators in the second round of Delphi questionnaire.
DimensionIndicatorNecessity ScoringMean ValueStandard DeviationCDI
ABCDEF
Financial valueReturn rate of net assets8866887.33331.03280.1408
Return rate of total assets4556865.66671.36630.2411
Rate of total asset liability3674454.83331.47200.3045
Turnover rate of total asset 5846645.50001.51660.2757
Growth rate of profit6866786.83330.98320.1439
Customer service
level
Rate of service satisfaction10688877.83331.32920.1697
Rate of customer complaint 5856876.50001.37840.2121
Speed of response8456866.16671.60210.2598
Market share9788787.83330.75280.0961
Business processRate of sale of marketed goods5526634.50001.64320.3651
Rate of product qualification7678987.50001.04880.1398
Production flexibility810778108.33331.36630.1640
Information communication ability6366354.83331.47200.3045
Logistics capability89810998.83330.75280.0852
Innovation and developmentRate of market forecast accuracy7546935.66672.16020.3812
New service development efforts8678787.33330.81650.1113
Rate of R&D investment7966787.16671.16900.1631
Innovative ability of member learning4649766.00001.89740.3162
Proportion of scientific research personnel7696376.33331.96640.3105
Green levelEnvironmental impact degree6525744.83331.72240.3564
Environmental benefits6978566.83331.47200.2154
Rate of resource utilization108107888.50001.22470.1441
Rate of waste recovery87771098.00001.26490.1581
Green consensus7986677.16671.16900.1631
Table 4. Necessity analysis of indicators in the third round of Delphi questionnaire.
Table 4. Necessity analysis of indicators in the third round of Delphi questionnaire.
DimensionIndicatorNecessity ScoringMean ValueStandard DeviationCDIVariable Number
ABCDEF
Financial valueReturn rate of net assets8866887.33331.03280.1408A1
Return rate of total assets5556755.50000.83670.1521-
Rate of total asset liability5654465.00000.89440.1789-
Turnover rate of total asset turnover5646665.50000.83670.1521-
Growth rate of profit 6866786.83330.98320.1439A2
Customer service levelRate of service satisfaction10688877.83331.32920.1697B1
Rate of customer complaint 5556765.66670.81650.1441-
Speed of response6456545.00000.89440.1789-
Market share9788787.83330.75280.0961B2
Business processRate of sale of marketed goods5546645.00000.89440.1789-
Rate of product qualification7678987.50001.04880.1398C1
Production flexibility810778108.33331.36630.1640C2
Information communication ability5546465.00000.89440.1789-
Logistics capability89810998.83330.75280.0852C3
Innovation and developmentRate of market forecast accuracy6556765.83330.75280.1290-
New service development efforts8678787.33330.81650.1113D1
Rate of R&D investment7966787.16671.16900.1631D2
Innovative ability of member learning5646675.66671.03280.1823-
Proportion of scientific research personnel6676455.66671.03280.1823-
Green levelEnvironmental impact degree4545464.66670.81650.1750-
Environmental benefits5675555.50000.83670.1521-
Rate of resource utilization108107888.50001.22470.1441E1
Rate of waste recovery 87771098.00001.26490.1581E2
Green consensus 7986677.16671.16900.1631E3
Table 5. The direct influence matrix of the lower limit.
Table 5. The direct influence matrix of the lower limit.
IndicatorA1A2B1B2C1C2C3D1D2E1E2E3
A10.00000.83330.33330.50000.16670.50000.33330.50000.83330.33330.16670.1667
A20.83330.00000.33330.83330.66670.50000.50000.50000.83330.50000.16670.3333
B10.66671.00000.00001.00000.33330.33330.16670.33330.00000.16670.00000.1667
B20.66670.66670.00000.00000.00000.16670.16670.33330.33330.50000.16670.3333
C10.66670.83331.00000.83330.00000.00000.00000.00000.16670.33330.33330.3333
C20.33330.33330.66670.16670.66670.00000.33330.33330.16670.50000.33330.0000
C30.50000.50001.00000.50000.16670.50000.00000.16670.16670.33330.33330.3333
D10.33330.50000.33330.50000.00000.50000.33330.00000.50000.33330.16670.3333
D20.16670.50000.33330.33330.33330.33330.00000.33330.00000.33330.16670.3333
E10.50000.50000.33330.16670.16670.33330.16670.33330.33330.00000.16670.5000
E20.16670.33330.50000.16670.16670.50000.16670.33330.33330.66670.00000.5000
E30.50000.16671.00000.83330.50000.33330.33330.66670.83330.66670.83330.0000
Table 6. The direct influence matrix of the median.
Table 6. The direct influence matrix of the median.
IndicatorA1A2B1B2C1C2C3D1D2E1E2E3
A10.00001.66671.16671.50001.00001.50001.16671.50001.83331.16670.83331.1667
A21.83330.00001.16671.66671.50001.50001.33331.33331.83331.33331.00001.3333
B11.50002.00000.00002.00001.16671.16670.83331.33331.00001.00000.83331.0000
B21.66671.66670.83330.00000.66670.83331.00001.33331.16671.50001.00001.1667
C11.66671.83332.00001.83330.00000.66670.33330.66670.66671.33331.16671.0000
C21.16671.16671.66671.16671.66670.00001.33331.16671.00001.50001.33331.0000
C31.50001.50002.00001.33330.66671.33330.00001.00001.00001.16671.00001.1667
D11.33331.50001.33331.50000.33331.33331.00000.00001.50001.00000.83331.1667
D21.00001.33331.16671.33331.16671.16670.66671.16670.00001.16670.83331.0000
E11.33331.50001.16671.00001.00001.16670.83331.16671.00000.00000.83331.3333
E21.00001.33331.50001.16671.00001.16670.66671.16671.33331.66670.00001.5000
E31.33331.16672.00001.83331.00001.33330.83331.66671.66671.50001.83330.0000
Table 7. The direct influence matrix of the upper limit.
Table 7. The direct influence matrix of the upper limit.
IndicatorA1A2B1B2C1C2C3D1D2E1E2E3
A10.00001.83331.83332.00001.83332.00001.83332.00002.00001.83331.66672.0000
A22.00000.00001.83331.83331.83332.00001.83331.83332.00001.83331.83332.0000
B11.83332.00000.00002.00001.83331.83331.66672.00002.00001.83331.83331.8333
B22.00002.00001.83330.00001.66671.66672.00002.00001.66672.00001.83331.8333
C12.00002.00002.00002.00000.00001.66671.33331.66671.50002.00001.83331.6667
C21.83331.83332.00002.00002.00000.00002.00001.83331.83332.00002.00002.0000
C32.00002.00002.00001.83331.50001.83330.00001.83331.83331.83331.66671.8333
D12.00002.00002.00002.00001.33331.83331.66670.00002.00001.66671.66671.8333
D21.83331.83331.83332.00001.83331.83331.66671.83330.00001.83331.66671.6667
E11.83332.00001.83331.83331.83331.83331.66671.83331.66670.00001.66671.8333
E21.83332.00002.00002.00001.83331.66671.50001.83332.00002.00000.00002.0000
E31.83332.00002.00002.00001.50002.00001.50002.00001.83331.83332.00000.0000
Table 8. The total influence matrix of the lower limit.
Table 8. The total influence matrix of the lower limit.
IndicatorA1A2B1B2C1C2C3D1D2E1E2E3
A10.13810.27080.17300.21640.11050.17320.11580.17180.23580.16200.08830.1076
A20.28840.20270.21060.29900.19400.19550.15250.19540.26460.21330.10770.1520
B10.23120.28880.11230.28060.12520.14160.09220.14380.12100.13290.06050.1007
B20.19630.20810.09620.10850.06450.10480.07860.12800.14740.15840.07500.1116
C10.24100.28220.25820.27400.08320.10260.07040.10690.14850.16240.10960.1311
C20.16580.18550.20360.15170.16130.08230.10160.12670.11650.16210.09880.0710
C30.21090.23080.26410.22120.10850.17090.06790.12580.13870.15960.11040.1268
D10.16250.19930.15390.19120.07280.15650.10520.08620.17030.14430.08010.1160
D20.12520.18160.13900.15480.10860.11810.04950.11990.08540.12990.07210.1067
E10.18020.19420.15250.14500.09330.12980.08010.13090.14700.09210.07940.1357
E20.14050.17740.18220.14830.09700.15600.08130.13400.14560.19050.05770.1409
E30.25620.24590.31070.31510.17700.18550.13480.22940.27040.24920.20360.1168
Table 9. The total influence matrix of the median.
Table 9. The total influence matrix of the median.
IndicatorA1A2B1B2C1C2C3D1D2E1E2E3
A10.47840.60830.54740.59020.41520.50000.39890.51280.54100.51130.40830.4692
A20.62100.55850.58860.64140.47150.53390.43450.53940.57680.55770.44770.5117
B10.54810.60860.46100.59930.41080.46660.36970.48880.48130.48670.39500.4462
B20.52410.55620.48050.45340.35970.42350.36580.46150.45420.48410.38050.4298
C10.53750.58040.55200.57100.32990.42220.32750.43620.44510.48630.39770.4300
C20.53560.57240.56550.56200.44280.40400.39800.48390.48390.51930.42720.4517
C30.54220.57740.56980.55940.38140.47270.31700.46760.47650.49070.40070.4511
D10.50490.54630.50550.53790.34240.44910.35680.38500.47920.45650.37110.4280
D20.46050.50890.47030.50080.36700.41450.31760.42600.36690.44030.35080.3959
E10.49210.53220.48520.49810.36860.42790.33680.43930.43970.38570.36180.4257
E20.50660.55900.53570.54150.39330.45580.34950.46890.48660.51090.33750.4628
E30.60200.63540.63940.65910.45030.53220.41290.56560.57560.57470.49810.4436
Table 10. The total influence matrix of the upper limit.
Table 10. The total influence matrix of the upper limit.
IndicatorA1A2B1B2C1C2C3D1D2E1E2E3
A11.98232.06032.03062.06771.84901.95651.82351.99971.97091.98931.89871.9843
A22.02572.02492.03122.06151.84981.95711.82391.99341.97161.99001.90621.9850
B12.00402.05261.98012.05301.83611.93571.80351.98551.95711.97521.89201.9634
B21.99682.03822.00191.99561.81601.91531.80481.97161.92961.96811.87861.9497
C11.92641.96641.93791.96671.72341.84731.71371.88841.85421.89911.81261.8740
C22.06072.10382.08022.11101.89481.95431.86832.03462.00512.03811.95252.0258
C31.96952.01041.98142.00391.78451.89611.73771.93801.91031.93441.84621.9231
D11.95591.99641.96761.99691.76511.88291.75461.88871.90411.91401.83341.9098
D21.93271.97281.94431.98021.77111.86681.73951.90821.84471.90501.81791.8866
E11.93331.98041.94501.97391.77161.86761.74001.90881.87451.86961.81861.8943
E22.00352.05232.02262.05271.83591.92851.79611.97841.95671.98181.85581.9700
E31.99182.04032.01092.04081.81131.93111.78601.97381.93881.96341.88781.9159
Table 11. The crisp total influence matrix of indicators.
Table 11. The crisp total influence matrix of indicators.
IndicatorA1A2B1B2C1C2C3D1D2E1E2E3
A10.86630.97980.91700.95810.79160.87660.77940.89480.91590.88760.79840.8537
A20.97840.92870.94351.00060.83840.89550.80360.90940.93770.92030.82050.8829
B10.92770.98330.85110.97770.79070.84790.75510.87270.85310.86490.78250.8367
B20.90570.93420.85960.85250.74680.81450.74970.85370.84380.87020.77800.8304
C10.90170.94300.91600.93720.71220.79070.70390.81050.81590.84930.77330.8117
C20.92070.95390.94980.94160.83290.81360.78930.88170.86850.90650.82620.8495
C30.90750.93950.93850.92820.75820.84660.70750.84380.84190.86160.78580.8337
D10.87440.91400.87570.90870.72680.82950.73890.78660.85120.83830.76150.8179
D20.83950.88780.85120.87860.74890.79980.70220.81800.76570.82510.74690.7964
E10.86850.90230.86090.87230.74450.80840.71900.82640.82040.78250.75330.8186
E20.88350.92960.91350.91420.77540.84680.74230.86040.86300.89440.75030.8579
E30.95000.97390.98701.00500.81290.88290.77790.92300.92830.92910.86320.8254
Table 12. Analysis of prominence and causality of indicators.
Table 12. Analysis of prominence and causality of indicators.
Indicatordrd + rd − rType
A110.519110.823921.3430−0.3048Result factor
A210.859411.269922.1293−0.4104Result factor
B110.343710.863721.2074−0.5201Result factor
B210.039011.174621.2137−1.1356Result factor
C19.96539.279219.24450.6861Driving factor
C210.534210.052920.58700.4813Driving factor
C310.19268.968819.16141.2238Driving factor
D19.923510.280920.2044−0.3574Result factor
D29.660110.305319.9654−0.6452Result factor
E19.777010.429620.2066−0.6527Result factor
E210.23139.439919.67120.7913Driving factor
E310.858410.014820.87320.8436Driving factor
Table 13. The limited super-matrix of performance evaluation indicators of GSCs.
Table 13. The limited super-matrix of performance evaluation indicators of GSCs.
IndicatorA1A2B1B2C1C2C3D1D2E1E2E3
A10.08560.08560.08560.08560.08560.08560.08560.08560.08560.08560.08560.0856
A20.08840.08840.08840.08840.08840.08840.08840.08840.08840.08840.08840.0884
B10.08410.08410.08410.08410.08410.08410.08410.08410.08410.08410.08410.0841
B20.08170.08170.08170.08170.08170.08170.08170.08170.08170.08170.08170.0817
C10.08100.08100.08100.08100.08100.08100.08100.08100.08100.08100.08100.0810
C20.08580.08580.08580.08580.08580.08580.08580.08580.08580.08580.08580.0858
C30.08290.08290.08290.08290.08290.08290.08290.08290.08290.08290.08290.0829
D10.08080.08080.08080.08080.08080.08080.08080.08080.08080.08080.08080.0808
D20.07860.07860.07860.07860.07860.07860.07860.07860.07860.07860.07860.0786
E10.07960.07960.07960.07960.07960.07960.07960.07960.07960.07960.07960.0796
E20.08320.08320.08320.08320.08320.08320.08320.08320.08320.08320.08320.0832
E30.08830.08830.08830.08830.08830.08830.08830.08830.08830.08830.08830.0883
Table 14. Comprehensive ranking of performance evaluation indicators of GSCs.
Table 14. Comprehensive ranking of performance evaluation indicators of GSCs.
IndicatorProminenceWeightWeighted ProminenceSorting
Return rate of net assets (A1)12.32340.08561.8273
Growth rate of profit (A2)13.31600.08841.9561
Rate of service satisfaction (B1)12.15090.08411.7854
Market share (B2)12.07250.08171.7346
Rate of product qualification (C1)10.24350.08101.55912
Production flexibility (C2)11.34000.08581.7655
Logistics capability (C3)10.00830.08291.58810
New service development efforts (D1)11.03060.08081.6328
Rate of R&D investment (D2)10.89370.07861.57011
Rate of resource utilization (E1)11.08970.07961.6099
Rate of waste recovery (E2)10.37670.08321.6377
Green consensus (E3)11.92540.08831.8432
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zhang, C.; Tang, L.; Zhang, J. Identifying Critical Indicators in Performance Evaluation of Green Supply Chains Using Hybrid Multiple-Criteria Decision-Making. Sustainability 2023, 15, 6095. https://doi.org/10.3390/su15076095

AMA Style

Zhang C, Tang L, Zhang J. Identifying Critical Indicators in Performance Evaluation of Green Supply Chains Using Hybrid Multiple-Criteria Decision-Making. Sustainability. 2023; 15(7):6095. https://doi.org/10.3390/su15076095

Chicago/Turabian Style

Zhang, Changlu, Liqian Tang, and Jian Zhang. 2023. "Identifying Critical Indicators in Performance Evaluation of Green Supply Chains Using Hybrid Multiple-Criteria Decision-Making" Sustainability 15, no. 7: 6095. https://doi.org/10.3390/su15076095

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop