Next Article in Journal
A Cross-Cultural Analysis for Plastic Waste Perception of Students from Romania and Turkey
Previous Article in Journal
Mapping the Landscape of ESG Strategies: A Bibliometric Review and Recommendations for Future Research
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Laboratory Risk Assessment Based on SHELL-HACCP-Cloud Model

1
College of Information and Electrical Engineering, Hebei University of Engineering Main, Handan 056038, China
2
Hebei Key Laboratory of Security Information Sensing and Processing, Handan 056038, China
3
School of Chemistry, Beihang University of Aeronautics and Astronautics, Beijing 100191, China
*
Authors to whom correspondence should be addressed.
Sustainability 2023, 15(24), 16590; https://doi.org/10.3390/su152416590
Submission received: 25 October 2023 / Revised: 22 November 2023 / Accepted: 23 November 2023 / Published: 6 December 2023

Abstract

:
With the increasing demand and expanding scale of laboratories in colleges and universities, laboratory accidents frequently occur, seriously impacting personal health, schools, society, and the environment. Scientific and effective risk assessment is crucial to prevent accidents. Therefore, in order to effectively reduce the risk of chemical laboratories and minimize the frequency of accidents. This study employs the combination of the SHELL model and HACCP system to analyze the potential sources of hazards in hazardous chemical laboratories and establish a risk assessment index system. Based on the Cloud model, a dynamic risk assessment model for the laboratory is established to quantitatively evaluate the risk level of the evaluation results. In order to ensure the rationality of the assessment results, the subjective and objective weights are combined by the principle of minimizing information entropy. Case analysis proves the scientific validity of the evaluation results of the model, which can assist laboratory managers in formulating emergency plans and risk management mechanisms to reduce or eliminate the occurrence of experimental accidents. This approach ensures the safe and sustainable development of schools and laboratories, which is conducive to the progress of researchers’ scientific research results.

1. Introduction

Laboratories in colleges and research institutions are characterized by a wide variety of dangerous chemicals, high mobility of personnel, and complex equipment, making the potential risks highly likely and difficult to manage. However, there is no national mandatory standard for laboratories. Once a safety accident occurs, it will have irreversible impacts on human health, schools, society, and property. In 2018, an explosion occurred in a laboratory at Beijing Jiaotong University during the treatment of landfill leachate, resulting in the ignition of magnesium powder dust and the tragic loss of three students [1]. In 2021, a laboratory at Nanjing University of Aeronautics and Astronautics experienced magnesium-aluminum powder deflagration, resulting in two deaths and nine injuries [2]. Research shows that the frequency of accidents in chemical laboratories is 65.2%, and the highly explosive nature of hazardous chemicals can trigger various safety hazards, exacerbating the scope and impact of accidents [3]. Therefore, how to ensure the long-term stable operation of the experiment in a safe environment is an important topic of concern for university laboratory safety management personnel and researchers. At the same time, improving the ability of risk management is of great significance for the health and safety of humans, machine, materials, environment, and other factors in university laboratories, and the sustainable development of major laboratories in universities.
In recent years, as an effective method to prevent accidents, risk assessment has been widely used in various fields. To conduct a safety risk assessment, key risk factors affecting laboratory safety should be identified and analyzed. The main methods of risk identification and analysis are the Questionnaire Survey method (QA) [4], Failure Mode and Effect Analysis (FMEA) [5], Failure Analysis Tree (FAT) [6], Fuzzy Bayesian Network (FBN) [7], Bow-Tie technique (BT) [8], Human Factors and Classification System (HFACS) [9] and so on. Among them, methods such as QA, HFACS, FAT, and FMEA need to organize different participants to conduct causal analysis together when applying them and require higher expertise. Due to the complexity of the coupling between laboratory risk factors, common risk analysis methods cannot be directly used in hazardous chemical laboratories. In recent research, the SHELL model is widely used in accident risk analysis of aviation and military industries, which transcends the causal relationship and analyzes the correlation and influence between risk factors from the interaction process between humans and software, hardware, and the environment [10]. Meanwhile, the Hazard Analysis and Critical Point Control (HACCP) system has been widely adopted in the accident risk analysis of food [11] and agriculture [12], which verifies the effectiveness of the HACCP system for critical factor analysis. This shows that SHELL and HACCP have achieved good results in the process of risk analysis.
There are a variety of risk factors in hazardous chemicals laboratories. These factors are interrelated and influence each other. Also, they belong to the decision-making problem of multi-objective attributes, and the decision-making information is ambiguous and complex. The assessment methods for such problems mainly include Analytic Hierarchy Process (AHP) [13], Analytical Network Process (ANP) [14], Fuzzy Comprehensive Evaluation Method (FCEM) [15], FMEA [16], Bayesian Network (BN) [17,18], and Truoket theory [19]. Among them, AHP is a classic multi-objective decision-making method, which is widely used in the evaluation of flood disasters [13], hazardous materials transportation [20], the cement industry [21], and other aspects of evaluation, which illustrate the effectiveness of this method. FCEM is a comprehensive evaluation method based on fuzzy mathematics theory, which has been widely used in seawater desalination projects [22], oil tanker truck driving risk assessments [23], low carbon operation risk assessments of distribution grids [24], landslide sensitivity assessments [25] and so on. However, the AHP often relies on the results of experts’ scoring, which is subjective and inaccurate for decision-making on certain issues. Although the FCEM can solve the problem of vagueness, it has some limitations in dealing with randomness.
In order to solve the problems of subjectivity, complexity, and uncertainty in the multi-objective decision-making process, many scholars incorporate fuzzy set theory in risk assessment. The safety of the construction industry is evaluated through the integration of the Interval-Valued Intuitionistic Fuzzy Decision-Making Test and Evaluation Laboratory (IVIF-DEMATEL) and the Interval-Valued Intuitionistic Fuzzy Analysis Network Process (IVIFANP) methods. By considering the interdependence weight between causal factors to determine the level of influencing factors, the method overcomes the subjectivity and uncertainty of relevant decision-making information [14]. A quality function deployment (QFD) method based on the Delphi method and fuzzy logic method is used to improve the safety assessment ability of equipment in the agricultural sector. This effectively reduces the subjective influence of decision-making and increases the consistency of judgment [26]. The authors also proposed an evaluation method integrating Quality Function Deployment (QFD) and Analytic Network Process (ANP) and used Fuzzy Failure Mode and Effects Analysis (FMEA) to improve the accuracy of risk analysis [27]. The study found that the DEMATEL method based on Pythagoras fuzzy set theory (PFDEMATEL) not only improved the accuracy of the evaluation results in complex environments but also visualized the relationship between direct and indirect factors in the construction supply chain system, increasing the intuitiveness of the evaluation method [28]. However, these methods are specific to certain fields, limiting their universal applicability. In the study of laboratory risk assessment, the Petri net model based on Interval Type-2 Fuzzy Sets (IT2FSs) simulates the dynamic development process of accidents, intuitively illustrating the internal relationship between factors and qualitatively evaluating laboratory risks. This model provides a reference value for risk assessment researchers in other fields [29]. Similarly, the FMEA method based on IT2FSs is used to deal with the uncertainty of evaluation information. This method fully considers the relevant information of the laboratory and improves the accuracy and robustness of the risk assessment results [16]. The grey AHP-TOPSIS model is used to quantitatively evaluate the risk of chemical laboratory, clearly reflecting the risk of chemical laboratory while omitting factors such as personnel and management in the laboratory [30].
In 1995, Li Deyi et al. proposed a cloud model based on fuzzy mathematics and statistics, integrating uncertainty, fuzziness, and randomness. This model achieved the qualitative and quantitative transformation through specific algorithms [31]. Given the high mobility of laboratory personnel, there exists considerable uncertainty and randomness. The cloud model effectively addresses the challenge of converting qualitative factors into quantitative ones, rendering assessment results more scientific and reliable. The Cloud model is widely used in the risk assessment of rice processing chain [32], fishing capacity assessment of fishing vessels [33], and benefit assessment of the South-to-North Water Diversion East Route Project [34]. However, only limited research based on the Cloud model was applied in the risk assessment of hazardous chemicals laboratory. For the calculation of indicator weights, most studies use a single method such as AHP, Entropy Weight method (EW), Anti-Entropy Weight method (AEW), Important Criterion of Inter-Layer Correlation (CRITLC), etc., or simple linear combinations of two or more methods to derive fixed weights, which cannot be dynamically adjusted when the indicator information is changed, and it will affect the accuracy and reliability of the assessment results.
Based on the above problems and challenges, dynamic risk assessment research on chemical laboratories with hazards is conducted through the integration of SHELL, HACCP, and the cloud model. Firstly, when analyzing the potential hazard sources of hazardous chemical laboratories, the SHELL model and HACCP system are introduced for the first time to determine the key risk factors through combinatorial analysis, leading to the construction of a risk assessment index system for hazardous chemical laboratories. Secondly, the principle of minimum information entropy is introduced by combining the improved AHP method with the AEW method to derive the dynamic comprehensive weight of each index. This integration improves the accuracy of the weight results. Finally, the weighted results are combined with the cloud digital characteristics of the indicators to obtain the final cloud digital characteristics, and the cloud map of risk assessment is drawn. In addition, the model is applied to the chemical laboratory of colleges and universities to determine the key factors affecting the safety of the laboratory and the comprehensive risk level, which proves the feasibility and effectiveness of the method adopted by the model. It can help laboratory managers formulate emergency plans and risk-handling mechanisms to reduce or alleviate the occurrence of laboratory accidents.

2. Methodology

2.1. SHELL Model

SHELL model was first proposed by Prof. Edward in 1972, which consists of four elements, namely, Software(S), Hardware(H), Environment(E), and Liveware(L), forming a “liveware-centered” security management. Subsequently, Hawkins implemented a graphical representation of the model in 1975 [35], as shown in Figure 1.
In order to explore the applicability of the SHELL model in the safety management of chemical laboratories and ensure the well-being of laboratory personnel, this study employs the SHELL model’s perspective on “human”, “hazardous chemicals and equipment”, “environment”, and “management”. The SHELL model is utilized to analyze potential hazards centered around “human” from the four dimensions: “human”, “hazardous materials and equipment”, “environment”, and “management”. This analysis includes 11 typical safety accidents in chemical laboratories from 2015 to 2021, aiming to identify the potential risk factors in the laboratory. At this point, the core of the model is the researchers and managers of the hazardous chemical laboratory, following the concept of the SHELL model, and the meaning of S, H, E, and L in the analysis process is as follows:
  • Software(S): management, in which risk mainly comes from mistakes in laboratory management, such as inadequate safety rules and regulations, and lack of safety education and training in the laboratory.
  • Hardware(H): hazardous chemicals and equipment, the risk mainly comes from two aspects. On the one hand, the unsafe state of hazardous chemicals, such as excessive storage of hazardous chemicals, leakage of substances, etc., and on the other hand, the unsafe state of equipment, such as the aging or damage of the instruments, and defects in the safety management system, etc.
  • Environment(E): the environment, where the risk mainly comes from three aspects, the first is the working environment, such as aging and short circuits of wires, unreasonable environmental layout, etc. The second is the storage conditions, such as temperature, humidity, pressure, etc. The third is the natural environment, heavy rains, high temperatures, etc.
  • Liveware(L): the personnel of the laboratory, in which risks mainly originate from researchers and managers, such as violation of operating procedures and lack of safety knowledge, etc.

2.2. HACCP Methodology

In the 1960s, Dr. Bauman from Pillsbury, NASA, and the U.S. Army Natick Research Center jointly developed a new food safety supervision and management system, namely Hazard Analysis and Critical Control Points (HACCP) [36]. HACCP is an advanced management system, which is widely used in food safety management. By identifying hazards in the food production process and evaluating the level of hazards, the critical control points and control limits are determined, the monitoring methods and corrective measures are formulated, the document retention system is established, and food quality control is carried out to ensure food safety [37]. At the same time, the HACCP system is also widely used in medicine, environmental monitoring, and other industries, as it is one of the important means for society to realize scientific management and quality control.
This study adopts the methods in the HACCP system to analyze the daily safety management of hazardous chemical laboratories. By identifying key factors that pose risks, this study effectively reduces or eliminates the possibility of accidents in the laboratory, thus ensuring the safety of laboratory operations. The critical control points in the HACCP system refers to the behavior or states that either cause harm or exhibit weak preventive measures in laboratory management operation. These critical control points are analyzed and confirmed through the decision tree in Figure 2.

2.3. Analytical Hierarchical Process

Analytical Hierarchical Process (AHP) is a multi-objective decision analysis method proposed by T.L. Satty, an expert from the University of Pittsburgh in the U.S. It has the advantages of being operational and relatively simple in calculation. It is essentially a subjective assignment method, and its weight calculation results are often affected by experts’ decision-making, which affects the reliability of the assessment results. In order to reduce the subjectivity of the AHP method, an improved AHP method is adopted, that is, the IAHP (based on the 3-scalar theory) [38], and its calculation steps are as follows:
  • Constructing a comparison matrix
The 3-scale theory is used to compare the relative importance of each index, which can effectively reduce the influence of experts’ subjective knowledge. Therefore, the comparison matrix C is constructed for n indexes by using the 3-scale theory.
C = c 11 c 1 j c i 1 c i j ( i , j = 1 , 2 , , n )
where is cij:
c i j = 1 ,       I n d i c a t e s   t h a t   i   i s   m o r e   i m p o r t a n t   t h a n   j 0 ,     I n d i c a t e s   t h a t   i   i s   a s   i m p o r t a n t   a s   j                       1 ,     I n d i c a t e s   t h a t   j   i s   m o r e   i m p o r t a n t   t h a n   i  
2.
Constructing the optimal transfer matrix
The optimal transfer matrix P is
P = p 11 p 1 j p i 1 p i j ( i , j = 1 , 2 , , n )
where p i j = 1 n n = 1 n ( c i n + c n i ) , n represents the number of indicators and further compute the synthesized judgment matrix S as:
S = s 11 s 1 j s i 1 s i j ( i , j = 1 , 2 , , n )
where s i j = e x p ( p i j ) , n represents the number of indicators.
3.
Calculation the subjective weight
Calculate the weights of i indicator based on the product square root method with the formula:
w i = ( j = 1 n s i j ) 1 k / j = 1 n ( j = 1 n s i j ) 1 k
where k is the number of indices, i.e., k = n and then W I A H P = ( w 1 , w 2 , , w n ) is a vector of subjective weights for n indicators.

2.4. Anti-Entropy Weight

The entropy weight method is an objective assignment method that mainly utilizes the utility value of information to determine the weight of indicators. The entropy weight function model proves effective in assessing the safety risk of significant events by accurately discerning and categorizing the risk factors influencing laboratory safety through entropy value. However, the entropy weight method’s sensitivity to the disorder degree of each index during the calculation process can lead to the generation of extreme weights. In order to avoid this phenomenon, this paper adopts the anti-entropy weight method to calculate the objective weight of each index, and its calculation steps are as follows:
  • Building a standardized matrix
With m indicators and n assessment objects, an evaluation matrix Xm×n can be obtained, which is normalized to reduce the differences in dimensions, order of magnitude, and quality of the data indicators:
y i j = x i j i = 1 m x i j , j = 1 , 2 , , n
Y = ( y i j ) m × n , i = 1 , 2 , , m ; j = 1 , 2 , , n
where xij is the j-th indicator value for the i-th indicator.
2.
Calculate the anti-entropy value of the indicator
The anti-entropy value of the j-th indicator is:
e j = i = 1 m y i j l n ( 1 y i j ) , j = 1 , 2 , , n
3.
Calculation the objective weights
The difference between the entropy of the index and 1 in the evaluation system hj is used to determine the utility value of the index:
h j = 1 e j , i = 1 , 2 , , n
As the core of the entropy method, the information utility value has a significant impact on the importance of the assessment results. Each indicator is assigned a weight based on the degree of utility of each indicator:
W A E W = h j i = 1 n h j , j = 1 , 2 , , n
where WAEW is the objective weight of the indicator.

2.5. Minimize Information Entropy

By introducing the principle of minimizing information entropy and integrating subjective weights and objective weights, a dynamic comprehensive weight that changes with the specific situation of the evaluated object is established. The dynamic comprehensive weighting method can dynamically adjust the comprehensive weights according to the value of the indicators in each evaluation target, which overcomes the shortcomings of the traditional evaluation method in assigning fixed weights to the indicators. At the same time, the dynamic comprehensive weighting method can not only reflect the opinions of experts and decision-makers but also make full use of the original information [26]. The dynamic comprehensive weight of each indicator is determined by the following formula:
m i n   F = i = 1 n w i ( l n w i l n w I A H P ) + i = 1 n w i ( l n w i l n w A E W ) s . t . i = 1 m w i = 1 ( w i > 0 )
where i = 1, 2, 3, …, n represents the indicator and the final weight w i = w A H P w A E W i = 1 m w A H P w A E W is calculated by the Lagrange method.

2.6. Cloud Model

Cloud Model is a model based on probability theory and fuzzy set theory that converts qualitative concepts into quantitative representations by means of a specific algorithm [34]. The numerical features in the cloud model are described as C[Ex,En,He], where Ex is the value that best represents the qualitative concepts in the argument space, En is the acceptable range of the qualitative concepts, and He is the degree of discretization of the qualitative concepts, presenting the stochastic nature of the qualitative concepts.

Determine the Numerical Characteristics of the Rating Set

The benchmark for risk assessment in hazardous chemical laboratories is the delineation of the grade evaluation sets. According to the “Safety management guidelines for chemistry and chemical engineering laboratories (T/CCSAS 005-2019)”, “Guidelines of safety assessment for chemistry and chemical engineering laboratories (T/CCSAS 011-2021 [39])” [40], and the standards for university laboratories, we divided the risk level of university chemistry laboratory into five levels, namely, very high risk, high risk, medium risk, low risk, and very low risk, with corresponding intervals of [0.8, 1], [0.6, 0.8], [0.4, 0.6], [0.2, 0.4], and [0, 0.2], and the domain of the comment set is represented by the equal membership degree of the upper and lower boundary values of the evaluation domain, which is calculated by the formula:
E x = c i m i n + c i m a x 2 , i = 1 , 2 , , 5 E n = c i m a x c i m i n 2 2 l n 2 , i = 1 , 2 , , 5 H e = γ
where c i m i n denotes the lower boundary value of the ith interval and c i m a x denotes the upper boundary value of the ith interval; γ > 0 is a constant, which is taken as 0.01 in this paper.
When the risk level interval is [0.8, 1], E x = ( 0.8 + 1 ) / 2 = 0.9 , E n = ( 1 0.8 ) / 2 2 l n 2 = 0.08 . Other calculations are similar. The calculation results of digital characteristics of standard cloud corresponding to the evaluation set interval are shown in Table 1. The cloud map is drawn with Python 3.7 software, as shown in Figure 3. Here, the horizontal axis is the index risk value, and the vertical axis is the measure of the degree that the index belongs to a certain level, which is the degree of affiliation. The generation process of the cloud image is as follows:
  • Generate a normal random number xi with expectation Ex and standard deviation En.
  • Generate a normal random number Enn with the expectation of En and standard deviation of He.
  • Calculate the membership degree, yi = exp[−(xiEx)2/2Enn2].
  • Repeat steps 1–3 until the required number of cloud droplets is generated, where (xi, yi) is a cloud droplet.

3. Risk Assessment for Chemical Laboratory in the University

The cloud model can well solve the problem of transforming qualitative factors into quantitative factors, making the evaluation results more scientific and reliable. Before applying the cloud model to risk assessment, it is necessary to establish a reliable and comprehensive risk index system. This can be achieved by combining the SHELL model with the HACCP system, and the reliability of the indicators can be determined in the form of questionnaires. On this basis, the principle of minimizing information entropy is used to combine the IAHP and AEW methods to balance the subjective and objective influence of the weight of risk indicators. At the same time, the variability of risk indicators is taken into account, and the accuracy of evaluation is improved. Finally, a risk assessment model based on the SHELL-HACCP-cloud model was established, as shown in Figure 4.

3.1. Constructing an Index System for Risk Assessment of Hazardous Chemical Laboratories

To comprehensively and accurately analyze laboratory risk factors, the SHELL model will be employed to assess risks in “human”, “hazardous chemicals and equipment”, “environment”, and “management”. This analysis, combined with the HACCP system’s examination of key control points, facilitates the identification and analysis of potential risk sources in the daily safety management of hazardous chemical laboratory operations. The hazardous chemicals laboratory risk assessment index system is summarized, as depicted in Figure 5.
In order to assess the reliability of the indicator system obtained through the model analysis, a reliability test of the index system will be conducted. In 1904, reliability was introduced into psychometrics by Spearman, which refers to the degree of consistency or reliability of the test results. The higher the reliability coefficient, the higher the questionnaire’s credibility. Usually, the reliability coefficient ranges from 0 to 1 [41], and its corresponding meaning is shown in Table 2.
A questionnaire comprising 32 questions is designed to transform the index system into a measurable format. Each question was measured on a 5-point Likert scale, assigning a score of 1–5 to “not serious”, “generally serious”, “moderately serious”, “more serious”, and “very serious”, respectively. This questionnaire is distributed to domain experts and laboratory safety managers. Data collected from the questionnaire are analyzed for reliability using Cronbach’s α reliability test in SPSS25.0 statistical software. The Cronbach’s α reliability test coefficient is 0.894, signifying the reliability of the questionnaire is very good.

3.2. Determination of the Indicator Importance Matrix

Expert i is invited to analyze the importance of each indicator at each level based on the 3-scaled theory, and an evaluation matrix is given as follows, in which L i ,   H i , and E i and S i denote the relative importance matrix among level II indicators, and A i represent the relative importance matrix among level I indicators.
L i = 0 1 1 0 8 8 H i = 0 0 0 0 8 8 E i = 0 0 0 0 8 8 S i = 0 1 1 0 8 8 A i = 0 1 1 0 4 4

3.3. Determination the Indicator Risk Values

According to the laboratory situation and expertise, the risk scores for the minimum and maximum values of the indicators given by the experts in the interval [0, 1] are shown in Table 3.

3.4. Calculation of Weights for Indicator Combinations

According to the matrix L i ,   H i , E i , S i and A i , the subjective weights corresponding to indicators II and I are calculated by Equations (3)–(5), the objective weights of the indicators are calculated by Equations (6)–(10) based on the laboratory safety. Formula (11) combines the subjective and objective weights to calculate the dynamic combination weights of the indicators.

3.5. Determine the Numerical Characteristics of Evaluation Indicators

Expert i evaluates the evaluation indicator H i ( i = 1 , 2 , , 8 ) , the constructed evaluation matrix M i i ( i = 1 , 2 , . . . , 8 ) as shown below:
M = M 11 M 18 M 81 M 88
For the obtaining evaluation matrix M , Equation (13) is used to calculate the cloud digital features of the indicator, and the calculation process is the same for the rest of the indicators. Finally, the cloud digital features evaluated by m experts are combined and calculated to obtain the comprehensive cloud digital features of the index. The equation is as follows:
E x = ( E x 1 E n 1 + E x 2 E n 2 + + E x m E n m ) / E n E n = E n 1 + E n 2 + + E n m H e = ( H e E n 1 + H e E n 2 + + H e E n m ) / E n

3.6. Cloud Mapping for Integrated Risk Assessment

The cloud digital features of level II indicators and their corresponding weights are weighted and calculated to obtain the cloud digital features of level I indicators. Similarly, the cloud digital features of level I indicators and their weights are weighted and calculated to finally obtain the cloud digital features. Python software is utilized to draw the cloud diagram and compare it with the cloud diagram of standard assessment (Figure 4) to determine risk grade. Among them, the weighting operation formula is:
E x = i = 1 n E x i × w i E n = i = 1 n E n i 2 × w i H e = i = 1 n H e i × w i

4. Case Study

Using the chemical laboratory of a university as an example, following the above risk assessment index system, six experts were invited to give the importance evaluation of the indexes and the risk evaluation value of the laboratory. This process included assigning digital characteristics to the indexes, determining the final risk assessment results, and utilizing Python to create the cloud diagram.

4.1. Indicator Importance Matrix

Due to the large data volume, this paper only shows the results of an expert’s assessment of the importance of indicators, as follows:
L i = 0 - 1 - 1 0 - 1 1 0 - 1 1 0 1 1 0 1 1 0 1 1 0 1 1 1 1 1 0 1 1 0 0 1 1 0 1 0 1 0 0 1 1 1 1 1 1 1 1 0 1 1 0 1 1 1 1 1 0 1 1 0 1 0 1 1 1 0 H i = 0 0 1 1 1 1 1 0 0 0 1 1 1 1 1 0 1 1 0 1 0 0 1 0 1 1 1 0 1 0 1 1 1 1 0 1 0 0 1 1 1 1 0 0 0 0 1 0 1 1 1 1 1 1 0 1 0 0 0 1 1 0 1 0 E i = 0 0 1 1 1 0 1 0 0 0 1 1 1 1 1 1 1 1 0 1 1 0 1 1 1 1 1 0 0 0 1 1 1 1 1 0 0 1 1 1 0 1 0 0 1 0 0 1 1 1 1 1 1 0 0 1 0 1 1 1 1 1 1 0 S i = 0 0 1 1 1 0 1 1 0 0 0 1 1 1 1 1 1 0 0 1 0 0 1 1 1 1 1 0 0 0 0 1 1 1 0 0 0 0 0 1 0 1 0 0 0 0 0 1 1 1 1 0 0 0 0 1 1 1 1 1 1 1 1 0 A i = 0 1 1 1 1 0 1 1 1 1 0 1 1 1 1 0
where Li, Hi, Ei, and Si respectively represent the relative importance evaluation of the sub-indicators of the four indicators of the personnel, hazardous chemicals and equipment, and the environment and management of the laboratory by expert i. Ai denotes the relative importance matrix among the four indicators.

4.2. Indicator Risk Values

The risk scores of the minimum and maximum values of the indicators given by 6 experts are shown in Table 4.

4.3. Indicator Weights

Combined with the index calculation process and the obtained data introduced in Section 3.4, the final weight calculation results are shown in Figure 6a,b. It can be seen that the index weights calculated by IAHP and AEW differ greatly in individual indicators, while the combination weights obtained after minimizing the information entropy are in the middle of the two. The principle of minimum information entropy introduced in this paper can well combine the weight values calculated by subjective and objective methods to improve the reliability of weight calculation and improve the accuracy of risk assessment.

4.4. Results and Discussion

Combined with the expert evaluation results, the cloud digital characteristics of the indicators are calculated by Equations (12) and (14). Equation (15) is used to weight the level II indicators to obtain the cloud digital features of the level I indicators:
C L [ 0.094,0.080,0.003 ] , C H [ 0.009,0.086,0.004 ] , C E [ 0.050,0.063,0.002 ] , C S [ 0.079,0.077,0.002 ] .
Drawing a comprehensive cloud diagram as in Figure 7a, it can be seen that the risk level is ranked as H-L-S-E, indicating a relatively high potential risk associated with hazardous chemicals and equipment. This is attributed to the inherent toxic, hazardous, and flammable properties of the chemicals, posing unpredictable hazards with even slight negligence. Moreover, the aging failure of the experimental equipment has a great impact on the normal operation of the equipment, because ensuring the fluency of the experiment is also the key to preventing accidents. The results are consistent with those of Li Xiangong [42], who analyzed the laboratory accidents by correlation rules, affirming the validity of the model. Therefore, we believe that in the daily management process of the laboratory, there should be a strong emphasis on managing hazardous chemicals and equipment to prevent compromising the laboratory’s safety. In addition, Figure 6b shows that among the factors, such as hazardous chemicals and equipment, H1 (unreasonable storage of hazardous chemicals) has the largest weight among all indicators and is the most influential risk factor. This suggests a certain degree of inadequate understanding among laboratory personnel regarding drug storage rules, coupled with the substantial risks associated with dangerous chemicals, posing a significant impact on laboratory safety. Another influential factor is L3 (violation of operating procedures), which is the direct cause of chemical accidents. Some researchers, either pressured by work and study or aiming for efficiency, tend to neglect operational norms. Any negligence in the process of chemical experiments may bring serious losses. It is of great significance to strictly abide by the experimental design and corresponding operational norms in the process of the experiment.
Similarly, Equation (15) is used to calculate the cloud digital features for comprehensive risk assessment of hazardous chemical laboratories: C [ 0.086,0.079,0.003 ] . A composite cloud was similarly plotted, as shown in Figure 7b. The observation shows that the risk level of this laboratory (Diamond Mark) lies between the cloud ranges of very low and low-risk criteria cloud ranges, indicating that the current laboratory risk is low. In this study, the fuzzy comprehensive evaluation method was also used to obtain the evaluation results of this laboratory as [0, 0, 0.023, 0.284, 0.018]. According to the principle of maximum affiliation, the assessment result is 0.284, which corresponds to the risk level of low risk. It can be seen that the calculation results of the two methods are basically consistent, proving the feasibility and effectiveness of the method proposed in this research.
Compared with other multi-decision risk assessment studies across various design fields [14,16,26,27,28,29,30], the method proposed in this paper has the following advantages: Firstly, this study integrates the SHELL model and HACCP system for the first time for the identification and analysis of laboratory influencing factors. It eliminates redundant factors to establish an index system including S, H, E, and L aspects of risk assessment. The reliability of the index is clarified through the form of a questionnaire, which not only improves the reliability but also enhances the robustness of risk assessment. Secondly, this study integrates IAHP and AEW to calculate the comprehensive weight of the index by minimizing the information entropy. On the one hand, it balances the subjectivity and objectivity of the obtained data. On the other hand, it fully considers the variability of the data and realizes the adjustment of the weight, which is more in line with the dynamic and complex environmental characteristics of the laboratory. Finally, the final cloud map drawing results revealed that the comprehensive evaluation results obtained by the cloud model are consistent with the fuzzy comprehensive evaluation method. On the one hand, it proves the feasibility and effectiveness of the proposed method. On the other hand, the cloud model also reflects the uncertainty and fuzziness in the evaluation process and can intuitively present the key factors affecting safety and classification to managers. In summary, the advantage of the model proposed in this study is that it can capture the variability of relevant data, and at the same time deal with the subjectivity and ambiguity of experts in relevant evaluations.

4.5. Implications

The IAHP-AEW-Cloud model proposed in this paper provides some different theoretical references and practical significance for laboratory risk management. In terms of theoretical reference, SHELL and HACCP are integrated for the first time to analyze laboratory risk factors, and a laboratory risk assessment index system including human, hazardous chemicals and equipment, the environment, and management is constructed. This system not only provides a solid foundation for other laboratory assessment or research fields but also allows for a comprehensive analysis and understanding of current environmental risk factors, laying the groundwork for the establishment of new index models. In addition, the research results demonstrate the application of the minimum information entropy principle to combine the subjective and objective weights of IAHP and AEW, which effectively solves the problem of unbalanced subjective and objective weights of indicators and the influence of dynamic change factors. It provides a new idea for the safety assessment of a dynamic complex environment. In practice, the utilization of the cloud model in the risk analysis method and risk index system proposed in this paper visually represents the randomness and fuzziness of risk occurrence through cloud maps. It intuitively communicates the key factors influencing the laboratory and the ranking of risk levels to managers. On the one hand, it can encourage managers to quickly grasp the cause of the accident or potential risks, and improve the ability to prevent accidents or respond to emergencies. Moreover, the ranking of risks provides a reference for risk management decision-making and facilitates the orderly execution of activities to reduce the occurrence or further expansion of laboratory accidents, effectively ensuring the safety and sustainable development of laboratories.

5. Conclusions

In recent years, the frequency of laboratory accidents has increased, and the serious consequences have always reminded us to strengthen the risk management capabilities of laboratories. In order to effectively reduce the risk in laboratories, protect the safety of laboratory personnel and property, and minimize the environmental impact of chemical substances, this study introduced the combination of the SHELL model and HACCP system into the risk analysis with respect to four aspects of human, hazardous chemicals and equipment, the environment, and management. A risk assessment system for chemical laboratories with hazards was constructed, which included 4 level I indicators and 32 level II indicators.
Then, a risk assessment method based on the combination of the IAHP-AEW-Cloud model was proposed. By incorporating the principle of minimum information entropy and combining the subjective and objective weights calculated by IAHP and AEW, this method not only balances the subjectivity and objectivity of the index but also dynamically adjusts the evaluation results according to the changes of the index. This dynamic adjustment effectively increases the accuracy and rationality of the index weight calculation. Moreover, the utilization of cloud digital characteristics and cloud images of the indicator represents the risk assessment results, effectively presenting the uncertainty and ambiguity associated with the occurrence of risks and making the evaluation results more intuitive.
Finally, the model was applied to the hazardous chemicals laboratory in colleges and universities to verify the effectiveness and feasibility of the method. The model can provide ideas and methods for risk analysis and evaluation of university laboratories. This model can assist laboratory managers in formulating emergency plans and risk management mechanisms, reducing the occurrence, and mitigating the severity of laboratory accidents. As a result, it effectively alleviates the losses caused by accidents and ensures the continued and sustainable operation of the laboratory.
Building on the findings of this study, there is still some subjectivity in our index system, and some index analysis may not be thorough enough, the laboratory risk index system will undergo further analysis and refinement to enhance the accuracy of risk assessment. At the same time, this method is only based on the construction of hazardous chemicals laboratories, which may have certain limitations for the risk assessment application of various laboratories in universities and needs further adjustment. Future research endeavors will focus on conducting emergency management studies specific to hazardous chemicals laboratories. The results of risk assessments will be integrated with early warning systems, emergency decision-making processes, and mitigation measures. This holistic approach aims to ensure laboratories’ safety consistently and effectively, offering ongoing safety assurances. Ultimately, it seeks to diminish threats to human health, society, and the environment.

Author Contributions

Conceptualization, X.Z. and Z.W.; methodology, X.Z.; software, X.Z.; validation, X.Z., Z.W. and P.Y.; formal analysis, Y.G.; investigation, X.Z., Z.W., Y.G. and P.Y.; data curation, X.Z. and Y.G.; writing—original draft preparation, X.Z.; writing—review and editing, X.Z. and Y.G. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Natural Science Foundation of China (grant number 12274017).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

While not publicly available due to confidentiality, the data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Yang, Y.; Reniers, G.; Chen, G.; Goerlandt, F. A bibliometric review of laboratory safety in universities. Saf. Sci. 2019, 120, 14–24. [Google Scholar] [CrossRef]
  2. Yang, J.; Xuan, S.; Hu, Y.; Liu, X.; Bian, M.; Chen, L.; Dou, Z. The framework of safety management on university laboratory. J. Loss Prev. Process Ind. 2022, 80, 104871. [Google Scholar] [CrossRef]
  3. Yang, Z.; Deng, L.; Yang, Y. Laboratory Explosion Accidents: Case Analysis and Preventive Measures. ACS Chem. Health Saf. 2023, 30, 72–82. [Google Scholar] [CrossRef]
  4. Zhao, J.; Cui, H.; Wang, G.; Zhang, J.; Yang, R. Risk assessment of safety level in university laboratories using questionnaire and Bayesian network. J. Loss Prev. Process Ind. 2023, 83, 105054. [Google Scholar] [CrossRef]
  5. Maggiulli, R.; Giancani, A.; Fabozzi, G.; Dovere, L.; Tacconi, L.; Amendola, M.G.; Cimadomo, D.; Ubaldi, F.M.; Rienzi, L. Assessment and management of the risk of SARS-CoV-2 infection in an IVF laboratory. Reprod. Biomed. Online 2020, 41, 385–394. [Google Scholar] [CrossRef] [PubMed]
  6. Zhu, C.; Tang, S.; Li, Z.; Fang, X. Dynamic study of critical factors of explosion accident in laboratory based on FTA. Saf. Sci. 2020, 130, 104877. [Google Scholar] [CrossRef]
  7. Chen, P.; Zhang, Z.; Huang, Y.; Dai, L.; Hu, H. Risk assessment of marine accidents with Fuzzy Bayesian Networks and causal analysis. Ocean. Coast. Manag. 2022, 228, 106323. [Google Scholar] [CrossRef]
  8. Jafari, M.J.; Pouyakian, M.; Mozaffari, P.; Laal, F.; Mohamadi, H.; Pour, M.T.; Hanifi, S.M. A new approach to chemicals warehouse risk analysis using computational fluid dynamics simulation and fuzzy Bayesian network. Heliyon 2022, 8, e12520. [Google Scholar] [CrossRef]
  9. Li, Z.; Wang, X.; Gong, S.; Sun, N.; Tong, R. Risk assessment of unsafe behavior in university laboratories using the HFACS-UL and a fuzzy Bayesian network. J. Saf. Res. 2022, 82, 13–27. [Google Scholar] [CrossRef]
  10. Wong, L.S.; Ram, S.; Scahill, S.L. Understanding the Risk Factors and Stressors Impacting Optimal Work Practices in New Zealand Pharmacies: A SHELL Model Analysis. Pharmacy 2023, 11, 90. [Google Scholar] [CrossRef]
  11. Subramaniam, R.; Jambari, N.N.; Hao, K.C.; Abidin, U.F.U.Z. Microbiological quality and safety assessment in selected HACCP-certified dine-in and hospital facilities in Klang Valley, Malaysia. Food Control 2023, 148, 109647. [Google Scholar] [CrossRef]
  12. Oishi, W.; Vinnerås, B.; Sano, D. Resource recovery technologies as microbial risk barriers: Towards safe use of excreta in agriculture based on hazard analysis and critical control point. Environ. Sci. Water Res. Technol. 2023, 9, 1008–1029. [Google Scholar] [CrossRef]
  13. Zheng, Q.; Shen, S.L.; Zhou, A.; Lyu, H.M. Inundation risk assessment based on G-DEMATEL-AHP and its application to Zhengzhou flooding disaster. Sustain. Cities Soc. 2022, 86, 104138. [Google Scholar] [CrossRef]
  14. Mohandes, S.R.; Karasan, A.; Erdoğan, M.; Sabet, P.G.P.; Mahdiyar, A.; Zayed, T. A comprehensive analysis of the causal factors in repair, maintenance, alteration, and addition works: A novel hybrid fuzzy-based approach. Expert Syst. Appl. 2022, 208, 118112. [Google Scholar] [CrossRef]
  15. Akter, M.; Jahan, M.; Kabir, R.; Karim, D.S.; Haque, A.; Rahman, M.; Salehin, M. Risk assessment based on fuzzy synthetic evaluation method. Sci. Total Environ. 2019, 658, 818–829. [Google Scholar] [CrossRef] [PubMed]
  16. Ozdemir, Y.; Gul, M.; Celik, E. Assessment of occupational hazards and associated risks in fuzzy environment: A case study of a university chemical laboratory. Hum. Ecol. Risk Assess. Int. J. 2017, 23, 895–924. [Google Scholar] [CrossRef]
  17. Sezer, S.I.; Elidolu, G.; Akyuz, E.; Arslan, O. An integrated risk assessment modelling for cargo manifold process on tanker ships under FMECA extended Dempster–Shafer theory and rule-based Bayesian network approach. Process Saf. Environ. Prot. 2023, 174, 340–352. [Google Scholar] [CrossRef]
  18. Chen, X.; Bose, N.; Brito, M.; Khan, F.; Zou, T. A copula-based method of risk prediction for autonomous underwater gliders in dynamic environments. Risk Anal. 2023. [Google Scholar] [CrossRef]
  19. Li, X.; Zhang, L.; Zhang, R.; Yang, M.; Li, H. A semi-quantitative methodology for risk assessment of university chemical laboratory. J. Loss Prev. Process Ind. 2021, 72, 104553. [Google Scholar] [CrossRef]
  20. Ayyildiz, E.; Taskin Gumus, A. Pythagorean fuzzy AHP based risk assessment methodology for hazardous material transportation: An application in Istanbul. Environ. Sci. Pollut. Res. 2021, 28, 35798–35810. [Google Scholar] [CrossRef]
  21. Marenco-Porto, C.A.; Nieto-Londoño, C.; Lopera, L.; Escudero-Atehortua, A.; Giraldo, M.; Jouhara, H. Evaluation of Organic Rankine Cycle alternatives for the cement industry using Analytic Hierarchy Process (AHP) methodology and energy-economic-environmental (3E) analysis. Energy 2023, 281, 128304. [Google Scholar] [CrossRef]
  22. Zhang, Y.; Wang, R.; Huang, P.; Wang, X.; Wang, S. Risk evaluation of large-scale seawater desalination projects based on an integrated fuzzy comprehensive evaluation and analytic hierarchy process method. Desalination 2020, 478, 114286. [Google Scholar] [CrossRef]
  23. Ma, T.; Wang, Z.; Yang, J.; Huang, C.; Liu, L.; Chen, X. Real-time risk assessment model for hazmat release accident involving tank truck. J. Loss Prev. Process Ind. 2022, 77, 104759. [Google Scholar] [CrossRef]
  24. Siyang, X.; Zexiang, C.; Ping, L. Fuzzy comprehensive evaluation of low carbon operation of distribution network based on AHP anti entropy weight method. J. Electr. Power Sci. Technol. 2019, 34, 69–76. [Google Scholar]
  25. Yang, X.; Hao, Z.; Liu, K.; Tao, Z.; Shi, G. An Improved Unascertained Measure-Set Pair Analysis Model Based on Fuzzy AHP and Entropy for Landslide Susceptibility Zonation Mapping. Sustainability 2023, 15, 6205. [Google Scholar] [CrossRef]
  26. Fargnoli, M.; Lombardi, M.; Haber, N. A fuzzy-QFD approach for the enhancement of work equipment safety: A case study in the agriculture sector. Int. J. Reliab. Saf. 2018, 12, 306–326. [Google Scholar] [CrossRef]
  27. Fargnoli, M.; Lombard, M.; Haber, N.; Guadagno, F. Hazard function deployment: A QFD-based tool for the assessment of working tasks–A practical study in the construction industry. Int. J. Occup. Saf. Ergon. 2018, 26, 348–369. [Google Scholar] [CrossRef]
  28. Singh, A.K.; Kumar, V.P.; Dehdasht, G.; Mohandes, S.R.; Manu, P.; Rahimian, F.P. Investigating barriers to blockchain adoption in construction supply chain management: A fuzzy-based MCDM approach. Technol. Forecast. Soc. Chang. 2023, 196, 122849. [Google Scholar] [CrossRef]
  29. Kan, Z.; Liang, Y.; Zhao, T.; Wang, X. Risk Assessment Model of Chemical Process Based on Interval Type-2 Fuzzy Petri Nets. Processes 2023, 11, 1304. [Google Scholar] [CrossRef]
  30. Bao, Y.; Wu, J.; Bai, Y.; Ren, Q.; Yang, M. Quantitative Risk Assessment for Chemical Laboratory Based on Grey Ahp-Topsis Methods. Available online: https://ssrn.com/abstract=4421331 (accessed on 20 March 2023).
  31. Li, D.; Meng, H.; Shi, X. Belonging to Cloud and Belonging to Cloud Generator. Comput. Res. Dev. 1995, 6, 15–20. [Google Scholar]
  32. Yu, J.; Chen, H.; Zhang, X.; Cui, X.; Zhao, Z. A Rice Hazards Risk Assessment Method for a Rice Processing Chain Based on a Multidimensional Trapezoidal Cloud Model. Foods 2023, 12, 1203. [Google Scholar] [CrossRef] [PubMed]
  33. Lyu, C.; Zhang, H.X.; Liu, S.; Guo, Y. Fishing capacity evaluation of fishing vessel based on cloud model. Sci. Rep. 2022, 12, 8976. [Google Scholar] [CrossRef] [PubMed]
  34. Yang, Z.; Huang, X.; Fang, G.; Ye, J.; Lu, C. Benefit evaluation of East Route Project of South to North Water Transfer based on trapezoid cloud model. Agric. Water Manag. 2021, 254, 106960. [Google Scholar] [CrossRef]
  35. Gong, T. Research on Risk Management of Civil Aviation Dangerous Goods Transportation and Warehousing. D; Civil Aviation University of China: Tianjin, China, 2018. [Google Scholar]
  36. Xing, N.; Zhang, X.; He, G. Hazard Analysis and Critical Control Point (HACCP) and Its Application in Food; Chemical Industry Press: Beijing, China, 2004. [Google Scholar]
  37. Zhou, H.; Ren, T. Application of HACCP in food production and processing. Food Saf. Guide 2019, 21, 50. [Google Scholar]
  38. Fan, W.; Ming, X.; Fu, X. Research on safety risk assessment model of prefabricated building construction based on game theory-regret theory. J. Saf. Environ. 2022, 22, 1132–1139. [Google Scholar]
  39. T/CCSAS 011-2021; Guidelines of Safety Assessment for Chemistry and Chemical Engineering Laboratories. China Chemical Safety Association: Beijing, China, 2021.
  40. China Chemical Safety Association. The Safety Management Guidelines for Chemistry and Chemical Engineering Laboratories. 2019. Available online: https://law.chemicalsafety.org.cn (accessed on 20 March 2023).
  41. Li, C.; Xin, L. Research on the evaluation method of reliability and validity of the questionnaire. China Health Stat. 2008, 5, 541–544. [Google Scholar]
  42. Li, X.; Wu, Z.; Zhang, C. Laboratory accident analysis based on association rules. Exp. Tech. Manag. 2022, 39, 218–222. [Google Scholar]
Figure 1. SHELL model.
Figure 1. SHELL model.
Sustainability 15 16590 g001
Figure 2. Judgment process of critical control points in laboratory management operation.
Figure 2. Judgment process of critical control points in laboratory management operation.
Sustainability 15 16590 g002
Figure 3. Standard evaluation cloud chart.
Figure 3. Standard evaluation cloud chart.
Sustainability 15 16590 g003
Figure 4. Flow chart of laboratory risk assessment method.
Figure 4. Flow chart of laboratory risk assessment method.
Sustainability 15 16590 g004
Figure 5. Laboratory risk assessment index system.
Figure 5. Laboratory risk assessment index system.
Sustainability 15 16590 g005
Figure 6. Weight of indicators. (a) Represents the weight of level Ⅰ index; (b) represents the weight of level II index.
Figure 6. Weight of indicators. (a) Represents the weight of level Ⅰ index; (b) represents the weight of level II index.
Sustainability 15 16590 g006
Figure 7. Laboratory risk assessment cloud map. (a) Represents the risk assessment cloud chart of each index of L-H-E-S; (b) presents the risk level for the current laboratory risk assessment cloud map.
Figure 7. Laboratory risk assessment cloud map. (a) Represents the risk assessment cloud chart of each index of L-H-E-S; (b) presents the risk level for the current laboratory risk assessment cloud map.
Sustainability 15 16590 g007
Table 1. Evaluation of cloud digital features.
Table 1. Evaluation of cloud digital features.
Risk LevelIntervalDigital Characteristic
ExEnHe
Very high[0.8, 1]0.90.080.01
High[0.6, 0.8]0.70.080.01
Medium[0.4, 0.6]0.50.080.01
Low[0.2, 0.4]0.30.080.01
Very low[0, 0.2]00.080.01
Table 2. The range and meaning of reliability coefficient.
Table 2. The range and meaning of reliability coefficient.
MarkHidden Meaning
0.8–1Indicates that the credibility of the indicator system is very good.
0.7–0.8Indicates that the credibility of the indicator system is better.
0.6–0.7Indicates that the indicator system needs to be revised.
0–0.6Indicates that some items in the indicator system need to be eliminated.
Table 3. Laboratory risk score table.
Table 3. Laboratory risk score table.
ExpertExtreme ValueIndex
L1 H1 E1 S1
1cmin0.30 0.24 0.08 0.35
cmax0.42 0.30 0.15 0.40
2cmin0.33 0.25 0.12 0.33
cmax0.44 0.30 0.18 0.39
cmin
cmax
mcmin0.30 0.25 0.14 0.38
cmax0.38 0.29 0.19 0.42
Table 4. Laboratory risk score table by 6 experts.
Table 4. Laboratory risk score table by 6 experts.
Expert123456
Extreme ValueMinMaxMinMaxMinMaxMinMaxMinMaxMinMax
IndexL10.300.420.330.440.320.400.350.390.340.400.300.38
L20.360.400.390.430.360.450.360.400.380.420.340.40
L30.370.430.390.440.350.400.350.390.370.450.300.39
L40.400.460.360.430.340.390.360.410.430.450.390.42
L50.280.330.250.360.270.330.250.290.320.350.300.38
L60.250.300.230.290.230.300.280.310.210.290.250.29
L70.180.220.200.250.240.300.200.240.230.300.220.30
L80.180.230.200.260.210.250.220.260.260.290.200.27
H10.240.300.250.300.250.290.260.310.220.290.250.29
H20.300.400.350.410.290.390.330.380.290.330.320.36
H30.200.250.300.340.200.290.260.290.270.310.240.30
H40.200.280.260.290.210.290.230.260.230.260.270.31
H50.250.350.300.380.280.330.300.340.330.370.240.30
H60.250.300.230.320.260.310.290.320.260.320.260.33
H70.230.300.260.290.220.280.200.260.180.220.100.20
H80.2930.50.290.340.280.330.300.360.190.280.250.30
E10.080.150.120.180.130.180.100.160.110.200.140.19
E20.450.550.460.520.390.450.400.460.380.450.390.44
E30.280.350.330.380.320.360.310.360.300.380.300.40
E40.330.420.410.450.390.450.360.410.390.460.410.45
E50.360.400.380.420.350.390.400.440.370.460.300.38
E60.260.300.250.290.280.320.250.320.280.350.250.29
E70.220.280.250.290.240.270.230.300.250.310.260.32
E80.100.150.140.180.090.130.150.200.100.180.160.22
S10.350.400.330.390.320.360.380.420.300.370.380.42
S20.200.250.220.260.190.230.220.280.190.260.240.29
S30.300.360.320.380.320.360.330.370.330.390.370.40
S40.360.400.380.420.410.460.400.450.390.460.390.45
S50.340.420.380.450.330.370.330.410.360.420.360.42
S60.500.600.500.580.480.580.550.590.450.560.470.55
S70.230.290.220.290.220.300.250.310.210.270.270.31
S80.360.450.330.420.380.420.330.390.370.400.330.40
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zhao, X.; Wei, Z.; Gao, Y.; Yin, P. Laboratory Risk Assessment Based on SHELL-HACCP-Cloud Model. Sustainability 2023, 15, 16590. https://doi.org/10.3390/su152416590

AMA Style

Zhao X, Wei Z, Gao Y, Yin P. Laboratory Risk Assessment Based on SHELL-HACCP-Cloud Model. Sustainability. 2023; 15(24):16590. https://doi.org/10.3390/su152416590

Chicago/Turabian Style

Zhao, Xiaoning, Zhongcheng Wei, Yukun Gao, and Penggang Yin. 2023. "Laboratory Risk Assessment Based on SHELL-HACCP-Cloud Model" Sustainability 15, no. 24: 16590. https://doi.org/10.3390/su152416590

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop