Next Article in Journal
Short- and Medium-Term Power Demand Forecasting with Multiple Factors Based on Multi-Model Fusion
Previous Article in Journal
Mining and Evolution Analysis of Network Public Opinion Concerns of Stakeholders in Hot Social Events
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Innovative Digital Stochastic Methods for Multidimensional Sensitivity Analysis in Air Pollution Modelling

1
Institute of Mathematics and Informatics, Bulgarian Academy of Sciences, 1113 Sofia, Bulgaria
2
Institute of Information and Communication Technologies, Bulgarian Academy of Sciences, 1113 Sofia, Bulgaria
*
Author to whom correspondence should be addressed.
Mathematics 2022, 10(12), 2146; https://doi.org/10.3390/math10122146
Submission received: 18 May 2022 / Revised: 8 June 2022 / Accepted: 11 June 2022 / Published: 20 June 2022

Abstract

:
Nowadays, much of the world has a regional air pollution strategy to limit and decrease the pollution levels across governmental borders and control their impact on human health and ecological systems. Environmental protection is among the leading priorities worldwide. Many challenges in this research area exist since it is a painful subject for society and a fundamental topic for the healthcare system. Sensitivity analysis has a fundamental role during the process of validating a large-scale air pollution computational models to ensure their accuracy and reliability. We apply the best available stochastic algorithms for multidimensional sensitivity analysis of the UNI-DEM model, which plays a key role in the management of the many self-governed systems and data that form the basis for forecasting and analyzing the consequences of possible climate change. We develop two new highly convergent digital sequences with special generating matrices, which show significant improvement over the best available existing stochastic methods for measuring the sensitivity indices of the digital ecosystem. The results obtained through sensitivity analysis will play an extremely important multi-sided role.

1. Introduction

Mathematical models [1,2] are utilized in many areas as compelling instruments for studying composite processes, but our understanding is generally restricted by uncertainties: inexact data, imperfect understanding, and subjective estimates, etc. Because of that, tools are necessary to estimate how uncertainties [3] in the input affect certain output model results.
The goal of our work is in the field of environmental security [4,5,6]. To establish itself as a reliable simulation tool, modern mathematical models of remote transport of air pollutants should involve lots of chemical and photochemical reactions [7]. Monte Carlo algorithms [8,9,10,11] are the best apparatus for multidimensional air pollution modeling [6].
By definition, Sensitivity analysis (SA) [12,13,14,15] is the study of how much the uncertainty in the input data of a model (because of inaccurate evaluations, estimations, and data compression, etc.) is reflected in the accuracy of the output results.
SA is a powerful procedure that verifies and improves the mathematical models [16,17]. It specifies the key role of SA when mathematical modeling is frequently the only strategy to investigate a complicated phenomenon. Furthermore, the authentic explanation of SA calculations relies on the effectiveness of methods supplying SA.
The input data for SA has been derived during runs of a large-scale model of long-range transport of pollutants in the air—Unified Danish Eulerian Model (UNI-DEM) [18,19,20,21]), which includes a large geographical region (4800 × 4800 km) covering the whole Mediterranean, Europe, and parts of Asia and Africa.
The main physical, chemical and photochemical processes between the investigating species, contaminations, and rapidly changing meteorological conditions are taken into account by UNI-DEM. The reason for selecting it is because, in UNI-DEM, the chemical processes are taken into account in a very precise way. UNI-DEM is described mathematically [19,21] by the following system of partial differential equations:
c s t = ( u c s ) x ( v c s ) y ( w c s ) z + x K x c s x + y K y c s y + z K z c s z + E s + Q s ( c 1 , c 2 , , c q ) ( k 1 s + k 2 s ) c s , s = 1 , 2 , , q ,
where
  • c s —pollutant concentrations,
  • u , v , w —wind components along the coordinate axes,
  • K x , K y , K z —diffusion coefficients,
  • E s —space emissions,
  • k 1 s , k 2 s —dry and wet deposit coefficients, ( s = 1 , , q ),
  • Q s ( c 1 , c 2 , , c q ) —nonlinear functions expressed the reactions between pollutants.
A fundamental role in UNI-DEM is played by the chemical reactions, and they connect the equations in the model in the system precisely. The presence of chemical processes determines the nonlinearity and the ‘stiffness’ property of the system of equations (see [7]). The model’s chemical scheme is the condensed CBM-IV (Carbon Bond Mechanism) proposed in [1] and improved in [19]. UNI-DEM involves 35 pollutants and 116 chemical reactions—69 are time-dependent and 47 are time-independent.
Let us assume that the model can be introduced by a model function [22]:
u = f ( x ) , x = ( x 1 , x 2 , , x d ) U d [ 0 ; 1 ] d .
The concept of the Sobol approach is given by the following representation of f ( x ) and a constant f 0 [22]:
f ( x ) = f 0 + ν = 1 d l 1 < < l ν f l 1 l ν ( x l 1 , x l 2 , , x l ν ) .
The description (1) is noted to as the ANOVA-representation of f ( x ) if [22]:
0 1 f l 1 l ν ( x l 1 , x l 2 , , x l ν ) d x l k = 0 , 1 k ν , ν = 1 , , d .
It guarantees that the right-hand side functions of (1) are determined in a distinctive way, where f 0 = U d f ( x ) d x . The quantities
D = U d f 2 ( x ) d x f 0 2 , D l 1 l ν = f l 1 l ν 2 d x l 1 d x l ν
are called total and partial variances [22]. An analogical decomposition is fulfilled for the total variance:
D = ν = 1 d l 1 < < l ν D l 1 l ν .
Sobol global sensitivity indices [22,23] are determined by:
S l 1 l ν = D l 1 l ν D , ν { 1 , , d } .
Then the total sensitivity index (TSI) of input parameter x i , i { 1 , , d } is determined by [24]:
T S I ( x i ) = S i + l 1 i S i l 1 + l 1 , l 2 i , l 1 < l 2 S i l 1 l 2 + + S i l 1 l d 1 ,
where S i l 1 l j 1 is the j t h order SI for x i ( 2 j d ) .
By definition [13], if j = 1 , then the quantity S i is named the main effect of x i ; if j = 2 , then S i j are named two-way interactions (second-order SIs); if j = 3 , then S i j k are the three-way interactions (third-order SIs) and so on. The set of input parameters is categorized with respect to their TSI [13]: very important if 0.8 < T S I ; important if 0.5 < T S I < 0.8 ; unimportant if 0.3 < T S I < 0.5 and irrelevant if T S I < 0.3 .
To introduce the total sensitivity of the output variance to an input parameter x i , i { 1 , , d } one can exhibited its TSI: S T i = S i + j i S i j + j i , k i , j < k S i j k + (see [2]). Therefore, performance SA using Sobol’s approach is turned into a problem for high-dimensional numerical integration [25].

2. Algorithms and Methods

Let us examine the following high-dimensional problem:
S ( f ) : = I = U s f ( x ) d x ,
x ( x 1 , , x d ) U s R s and f C ( U s ) .
Let 0 t m be two integers. By definition [26,27], an elementary s-interval in base b as a subset of U s of the form E s = j = 1 s a j b d j , a j + 1 b d j , a j , d j 0 , a j < b d j for all j { 1 , . . . , s } . A ( t , m , s ) -net in base b is a sequence x ( i ) of b m points of U s such that C a r d E { x ( 1 ) , , x ( b m ) } = b t of λ ( E ) = b t m . A ( t , s ) -sequence in base b is an infinite points sequence x ( i ) in such a way that for all k 0 , m t , the sequence { x ( k b m ) , , x ( ( k + 1 ) b m 1 ) } is a ( t , m , s ) -net in base b.
I. M. Sobol [26] determines the Π τ -meshes and Λ Π τ sequences, which are ( t , m , s ) -nets and ( t , s ) -sequences in base 2, introduced in 1988 by H. Niederreiter [27].
Now let us introduce the first algorithm that we are going to use; the well-known Sobol sequence (SOBOL-SEQ) [28,29]. To generate its j-th component, we will choose a polynomial: P j = x s j + a 1 , j x s j 1 + a 2 , j x s j 2 + + a s j 1 , j x + 1 , and a 1 , j , , a s j 1 , j are either 0 or 1. The sequence { m 1 , j , m 2 , j , } is defined by
m k , j = 2 a 1 , j m k 1 , j 2 2 a 2 , j m k 2 , j 2 s j m k s j , j m k s j , j ,
⊕ is the bit-by-bit exclusive-or operator. For the merits m 1 , j , , m s j , j is fulfilled in that every m k , j 2 k , 1 k s j is odd. The direction numbers { v 1 , j , v 2 , j , } are determined with v k , j = m k , j 2 k . Then the j-th component of the i-th point in a SOBOL-SEQ, is determined with x i , j = i 1 v 1 , j i 2 v 2 , j , where i k is the k-th binary digit of i = ( i 3 i 2 i 1 ) 2 . For generating the SOBOL-SEQ, the algorithm with Gray code implementation [30] and SIMD-oriented Fast Mersenne Twister (SFMT) [31] has been used.
We now briefly describe the three algorithms based on modified Sobol sequences. They produced the best results for the problem under consideration up to now [32]. We use the shortcut MCA-MSS for the Monte Carlo algorithms based on Modified Sobol Sequences.
In the first algorithm MCA-MSS-1 [32], we choose a Sobol point (SP) x and a pseudorandom point (p.p.) ξ U s uniformly distributed (u.d.) over the sphere. The sphere has a centrum x and a radius ρ < 1 . If the i-th SP is
x i = ( x i , 1 , x i , 2 x i , d ) E i s , i = 1 , , n ,
then ξ i ( ρ ) with a p.d.f. p ( x ) is determined in the following way
ξ i ( ρ ) = x i + ρ ω i ,
where ω i is a unique u.d. vector in U s and ρ is the shaking radius.
It is assumed that n = m s , m 1 . The unit cube U s is divided into m s disjoint sub-domains:
U s = j = 1 m s K j , where K j = i = 1 s [ a i ( j ) , b i ( j ) ) ,
with b i ( j ) a i ( j ) = 1 m for all i = 1 , , s .
Now in every s-dimensional sub-domain K j exactly one Λ Π τ point x ( j ) is taken and ξ ( j ) ( ρ ) = x ( j ) + ρ ω ( j ) K j . Then MCA-MSS-1 gives the following approximate value of (2):
I ( f ) 1 m s j = 1 n f ( ξ ( j ) ) .
For the second algorithm MCA-MSS-2 [33], two SP ξ ( j ) and ξ ( j ) are taken so that ξ ( j ) is chosen in the same way as used in MCA-MSS-1. The ξ ( j ) is selected to be symmetric to ξ ( j ) in correspondence with the central point s ( j ) in K j . Now there are exactly 2 m d points. Now, we evaluate all f ( ξ ( j ) ) and f ( ξ ( j ) ) , for j = 1 , , m d , and MCA-MSS-2 gives the following approximate value of (2):
I ( f ) 1 2 m s j = 1 2 n f ( ξ ( j ) ) + f ( ξ ( j ) ) .
For MCA-MSS-1 and MCA-MSS-2, the Box–Muller transform is applied for the s-dimensional vector y [34]: if s is even, then
y 2 i 1 = 2 l n γ 2 i 1 c o s ( 2 π γ 2 i ) , y 2 i = 2 l n γ 2 i 1 s i n ( 2 π γ 2 i ) , i = 1 , , s / 2 ,
and γ is a random point in ( 0 , 1 ) s . Therefore, a random point ξ over the s-dimensional sphere is determined by ξ = x + ρ y / | y | .
In the third algorithm MCA-MSS-2-S [35], the original domain of integration is divided into m s disjoint subdomains with equal volumes K i s , i = 1 , , m s . Now, the first p.p. ξ i is generated u.d. inside the subdomain K i s . The second point ξ i is computed to be symmetric to ξ i in correspondence with the central point s i in K i s . This is similar to MCA-MSS-2 as the shaking is with different radiuses ρ in each subdomain. This algorithm is similar to the stratified symmetrized Monte Carlo [26], which is why we use the notation MCA-MSS-2-S. The value of (2) obtained approximately with MCA-MSS-2-S is given by:
I ( f ) 1 2 m s i = 1 m s f ( ξ i ) + f ( ξ i ) .
The algorithms MCA-MSS-2 and MCA-MSS-2-S have an optimal rate of convergence ( n 1 2 2 s ) for the class of continuous functions with continuous first derivatives and bounded second derivatives [35].
Now to introduce lattice rules, let z N s , and N is a natural number. By definition [36], the point set P = x 1 , , x N in U s with x k = k z / N for all 1 k N is named a lattice point set and z is named its generating vector. The algorithm that uses a lattice point set is named a lattice sequence [37].
We will use this rank-1 lattice sequence [38]:
x k = k N z , k = 1 , , N ,
where N 2 is an integer, z = ( z 1 , z 2 , z s ) is the generating vector and { z } denotes the fractional part of z.
There exists an optimal choice of z according to [39]:
1 N k = 1 N f k N z [ 0 , 1 ) s f ( u ) d u c d ( s , α ) ( log N ) β ( s , α ) N α ,
for the function f E s α ( c ) [39], α > 1 and d ( s , α ) , β ( s , α ) do not depend on N.
When s = 2 , the following optimal construction exists [40].
Consider the following generating vector [38]:
z = ( 1 , F n ( s ) ( 2 ) , , F n ( s ) ( s ) ) ,
using F n ( s ) ( j ) : = F n + j 1 ( s ) i = 0 j 2 F n + i ( s ) and F n + l ( s ) ( l = 0 , , j 1 , j is   an   integer , 2 j s ) is the corresponding number of the generalized Fibonacci series [38]. Then
F n ( s ) ( 2 ) = F n + 1 ( s ) F n ( s ) = ( F n ( s ) + F n 1 ( s ) + + F n s + 1 ( s ) ) F n ( s ) = F n 1 ( s ) + + F n s + 1 ( s ) .
Our generating vector (3) is transformed into [40]:
z = ( 1 , F n 1 ( s ) + F n 2 ( s ) + + F n s + 1 ( s ) , , F n 1 ( s ) + F n 2 ( s ) , F n 1 ( s ) ) .
We construct a special lattice sequence with the generating vector (4), namely LATTICE-FIBO.
Now we will improve the convergence of the lattice sequence using the recently developed component and the Component Fast Construction method (CBC) [41,42,43]. Now we construct a special lattice sequence LATTICE-CBC with an optimal generating vector following the idea in [44,45]. At the first step of LATTICE-CBC, z = ( z 1 , z 2 , z s ) is generated by the CBC. After that, the points of LATTICE-CBC are obtained by the formula
x k = k N z , k = 1 , , N .
The approximate value I N of (2) is evaluated in the following way:
I N = 1 N k = 1 N f k N z .
Let F b be the finite field with b elements for a prime power b (when b is a prime, F b is the residue class ring modulo b) [46]. Using F b and a bijection ϕ : 0 , , b 1 F b with ϕ ( 0 ) = 0 ¯ , we generate a digital ( t , s ) -sequence over F b . Now we take N × N matrices C 1 , , C s over F b . The matrices are of the form
c 11 c 12 c 13 c 21 c 22 c 23 c 31 c 32 c 33 F b N × N .
To now generate one of the points x n = ( x n , 1 , , x n , s ) , of the ( t , s ) -sequence, we record n in its b-adic (i.e., base b) expansion
n = i = 0 a i b i
with a i 0 , , b 1 and a i = 0 for all i large enough. Now we choose the column vector
ϕ ( a 0 ) ϕ ( a 1 ) ϕ ( a 2 ) ( F b N )
To generate the point x n = ( x n , 1 , , x n , s ) , for the i-th coordinate x n , i , the value of x n , i is derived by multiplying the i-th matrix C i by n in F b m , which derives a column vector over F b :
C i n y ¯ n , i , 1 y ¯ n , i , 2 ( F b N )
The elements ϕ 1 y ¯ n , i , j 0 , . . . , b 1 , for j N , are now the b-adic digits of x n , i , i.e.,
x n , i = ϕ 1 y ¯ n , i , 1 b + ϕ 1 y ¯ n , i , 2 b 2 +
Now the sequence derived in this way ( x 0 , x 1 , ) defines a digital sequence by generating matrices C 1 , , C s [47].
Now we will consider two possible choices for the generating matrices. The first digital sequence is generating matrices based on an implementation of the Sobol sequence from [48] with 21201 dimensions, and we called it DIGITAL-SOBOL. The second digital sequence uses the construction of Xing and Niederreiter [49]. This sequence was implemented by Pirsic [50] and can be considered as the currently optimal low-discrepancy sequences with a rate of convergence O ( s log b s ) . We will call this sequence DIGITAL-XINGN.

3. Calculations and Results

The efficient stochastic algorithms, namely SOBOl-SEQ, MCA-MSS-1, MCA-MSS-2, MCA-MSS-2-S, LATTICE-FIBO, LATTICE-CBC, DIGITAL-SOBOL and DIGITAL-XINGN, have been applied to sensitivity studies with respect to emission levels and some chemical reactions rates of the concentration variations of UNI-DEM pollutants. The estimated quantity is denoted by EQ and its reference value by RV. The relative error is denoted by RE and the approximate evaluation by AE.
In the case of the sensitivity studies with respect to emission levels, we will study the sensitivity of the model output (in terms of mean monthly concentrations of several important pollutants—in our case, this is ammonia in Milan) with respect to a variation of input emissions from the anthropogenic pollutants, which consists of four different components E = ( E A , E N , E S , E C ) as follows:
E A ammonia ( N H 3 ) ; E S sulphur   dioxide ( S O 2 ) ; E N nitrogen   oxides ( N O + N O 2 ) ; E C anthropogenic   hydrocarbons .
The output of the model is the mean monthly concentration of the following three pollutants:
  • s 1 —ozone ( O 3 );
  • s 2 —ammonia ( N H 3 );
  • s 3 —ammonium sulfate and ammonium nitrate ( N H 4 S O 4 + N H 4 N O 3 ).
In the case of the sensitivity studies with respect to emission levels, the results for REs for the AE of the f 0 , D , S i and S i t o t , using SOBOl-SEQ, MCA-MSS-1, MCA-MSS-2, MCA-MSS-2-S, LATTICE-FIBO, LATTICE-CBC, DIGITAL-SOBOL and DIGITAL-XINGN are shown in Table 1, Table 2, Table 3, Table 4 and Table 5, respectively. The quantity f 0 is represented by a four-dimensional integral, whereas the rest are represented by eight-dimensional integrals.
In the case of the sensitivity studies with respect to chemical reactions rates, we will study the ozone concentration in Genova according to the rate variation of these chemical reactions: ## 1 , 3 , 7 , 22 (time-dependent) and 27 , 28 (time-independent) of the CBM-IV scheme ([19]) given as follows:
[ # 1 ] N O 2 + h ν N O + O ; [ # 22 ] H O 2 + N O O H + N O 2 ; [ # 3 ] O 3 + N O N O 2 ; [ # 27 ] H O 2 + H O 2 H 2 O 2 ; [ # 7 ] N O 2 + O 3 N O 3 ; [ # 28 ] O H + C O H O 2 .
Here, “hv” represents the sunlight in the photochemical reactions and indicates that a photon is proportional to its frequency by Plank’s constant.
In the case of the sensitivity studies with respect to chemical reactions rates, the results for REs for the AE of the f 0 , D , S i , S i j and S i t o t , using SOBOl-SEQ, MCA-MSS-1, MCA-MSS-2, MCA-MSS-2-S, LATTICE-FIBO, LATTICE-CBC, DIGITAL-SOBOL and DIGITAL-XINGN, are shown in Table 6, Table 7, Table 8, Table 9 and Table 10, respectively. As in the first case study, the quantity f 0 is represented by a six-dimensional integral, whereas the rest are represented by twelve-dimensional integrals.

4. Discussion of the Results

In the case of the sensitivity studies with respect to emission levels, a detailed discussion has been made with the previous best available approaches described in [51,52,53].
For the number of samples n = 2 16 for the model function f 0 , the best algorithm is the DIGITAL-XINGN, followed by MCA-MSS-2-S and MCA-MSS-1—see the results in Table 1 and Table 2 for the maximum number of samples. A big improvement over the older best available result is obtained—the new result is 3e-10 vs. 2e-08 [32,35]. For a number of samples n = 2 16 for the total variance D, the best algorithm is the DIGITAL-XINGN, followed by MCA-MSS-2-S and DIGITAL-SOBOL—see the results in Table 3 and Table 4 for the maximum number of samples [32,35].
Our discussion here includes a detailed comparison with the previous results in the field in [54,55]. For the total and first-order sensitivity indices in Table 5, it can be seen that the two digital sequences improve the results produced by the best available approaches up to now [32,33]. The DIGITAL-SOBOL gives the best results for S 1 , S 2 , S 3 , S 1 t o t and S 2 t o t , while the DIGITAL-XING gives the best results for S 4 , S 3 t o t and S 4 t o t . The general conclusion is that our methods significantly improved the accuracy of the sensitivity indices described in [56]. According to [33,54,56], the best available approaches up to now were the SOBOL-SEQUENCE and MCA-MSS-1 for S 4 , S 1 t o t (these two give exactly the same result for all quantities except S 2 t o t ), and MCA-MSS-2 was the best available algorithm for S 1 , S 2 , S 3 , S 2 t o t , S 3 t o t , S 4 t o t . From Table 5, one can conclude that between the two lattice sequences, LATTICE-CBC is more accurate by at least 1. Furthermore, we can observe that the worst are MCA-MSS-2-S and LATTICE-FIBO, and the last method gives unsatisfactory relative errors. According to [32,54,56], the best improvements for the sensitivity indexes are obtained for S 2 , the new result is 4e-06 vs. 4e-03; for S 4 , the new result is 1e-05 vs. 1e-02. For all total sensitivity indices, there are serious improvements over the existing best available results. For S 1 t o t , the new result is 3e-07 vs. 1e-05; for S 2 t o t , 1e-05 vs. 1e-03; for S 3 t o t , 2e-06 vs. 4e-05; and for S 4 t o t , 1e-06 vs. 1e-02. In [24], it is mentioned that having the smallest possible sensitivity indices is the most important aspect of the model. In our case, these are S 4 and S 4 t o t , and the improvement is with three and four orders, respectively, which will be crucial for taking into account the reliability of the results of the model.
The performance of the algorithms can be generalized in such a way: the two digital sequences proposed by the authors yield the smallest relative errors for all sensitivity indices; algorithm MCA-MSS-2 is after that, followed by SOBOL-SEQUENCE, MCA-MSS-1 and LATTICE-CBC. The worst results are produced by the MCA-MSS-2-S and LATTICE-FIBO. Comparing our results with the results obtained in [32,35,54,56] the main advantages of our methods include the significant improvement in the accuracy and lower computational complexity.
In the case of sensitivity studies with respect to chemical reaction rates, a precise discussion has been made with the previous best available approaches from [4,57,58].
For the number of samples n = 2 16 for the model function f 0 , the best algorithm is the DIGITAL-XINGN, followed by MCA-MSS-2-S and MCA-MSS-1—see the results in Table 6 and Table 7 for the maximum number of samples. There is a huge improvement according to the sensitivity studies in [32,35]—the new result is 6e-11 vs. 2e-07. For the number of samples n = 2 16 for the total variance D, the best algorithm is the DIGITAL-SOBOL, followed by DIGITAL-XINGN, MCA-MSS-2 and SOBOL-SEQUENCE—see the results in Table 8 and Table 9 for the maximum number of samples [4].
The discussion in this case includes a comparison between our obtained results with other studies and other papers already published [32,59,60]. For all sensitivity indices in Table 10, it can be seen that the two digital sequences improve the results produced by the best available approaches except for the sensitivity index S 5 t o t obtained in [32,33]. The DIGITAL-SOBOL gives the best results for S 1 , S 2 , S 4 , S 5 , S 6 , S 1 t o t , S 1 t o t , S 2 t o t , S 4 t o t , S 12 , S 14 , S 24 and S 45 , while the DIGITAL-XING gives the best results for S 3 , S 4 , S 3 t o t , S 4 t o t and S 6 t o t . The general conclusion is that our methods show a significant improvement in the accuracy vs. the other calculations in this field [61]. According to [4,33,59], the best available approaches up to now were the SOBOL-SEQEUNCE for S 1 , S 2 , S 6 , S 2 t o t , S 3 t o t , S 4 t o t , S 12 , S 14 , S 24 , MCA-MSS-1 was the best for S 4 and S 1 t o t , and MCA-MSS-2 was the most accurate for S 5 , S 6 , S 4 t o t , S 5 t o t , S 6 t o t , S 14 , S 45 . According to [35,59,60], the best improvement for the relative error is that for the sensitivity index S 6 , the new result is 4e-06 vs. 3e-04; for S 1 t o t , the new is 8e-07 vs. 4e-05; and for S 14 , the new result is 2e-05 vs. 2e-03. From Table 10, focusing on the relative errors, one can conclude that between the two lattice sequences, LATTICE-CBC is more accurate by at least two orders. Furthermore, we can observe that MCA-MSS-2-S is one order better than LATTICE-FIBO and one order worse than the LATTICE-CBC.
We can conclude that the two digital sequences proposed by the authors yield the smallest relative errors for all sensitivity indices except S 5 t o t , and DIGITAL-SOBOL has the edge; the algorithm MCA-MSS-2 is closely behind them, followed by SOBOL-SEQUENCE, MCA-MSS-1, LATTICE-CBC and MCA-MSS-2-S. The lattice sequence LATTICE-FIBO gives unsatisfactory relative errors for most of the quantities.
Based on the described comparison with other sensitivity studies and other papers already published in the field [16,17,62,63], the general conclusion from our discussion is that the main advantages of the proposed methods LATTICE-FIBO, LATTICE-CBC, DIGITAL-SOBOL and DIGITAL-XINGN for the very important large-scale air pollution model UNI-DEM are the much higher accuracy and lower computational complexity.

5. Conclusions

The present study is in a very important area of environmental safety. High levels of pollution can damage ecosystems and harm plants, animals and humans, and it is of great importance to study the levels of pollution precisely. That is why it is of great importance to recognize whether the pollution levels are below some critical values and, if so, to establish a well-founded control system to retain the pollution levels within these limits. These problems can be accomplished successfully by the proposed highly efficient stochastic approaches for studying the sensitivity of various pollution-related processes.
The computational efficiency in terms of relative error of one of the best available stochastic methods for high-dimensional integration has been performed for the sensitivity of the UNI-DEM model output to find the variation of rate constants of chosen chemical reactions and the variation of selected input emissions of the anthropogenic pollutants.
The two proposed digital sequences based on Sobol and Xing-Niederreiter matrices show an essential improvement over the existing best available results produced by the modified Sobol sequences. The proposed approaches by the authors LATTICE-CBC, DIGITAL-SOBOL and DIGITAL-XNING are established as the new best available stochastic methods for this particular very important large-scale air pollution model UNI-DEM.
The obtained results will help test and improve the mathematical models and enable a well-founded explanation by the relevant specialists. By recognizing the main chemical reactions that influence the performance of the system, physicists and chemists will be able to gather important information to improve the model, which will increase the reliability and sustainability of forecasts. Therefore, through our sensitivity results, the mathematical model will contribute to a more accurate evaluation of losses in agriculture and, most importantly, enable an estimation of the effects of harmful emissions on human health.

Author Contributions

Conceptualization, V.T. and I.D.; methodology, V.T.; software, V.T.; validation, V.T.; formal analysis, V.T.; investigation, V.T.; resources, V.T.; data curation, V.T.; writing—original draft preparation, V.T.; writing—review and editing, V.T.; visualization, V.T.; supervision, I.D.; project administration, I.D.; funding acquisition, I.D. All authors have read and agreed to the published version of the manuscript.

Funding

The presented work was supported by the Bulgarian National Science Fund under the Bilateral Project KP-06-Russia/17 “New Highly Efficient Stochastic Simulation Methods and Applications” and by the Bulgarian National Science Fund under Project KP-06-N52/5 “Efficient methods for modeling, optimization and decision making”. Venelin Todorov is supported by the Bulgarian National Science Fund under Project KP-06-M32/2—17.12.2019 “Advanced Stochastic and Deterministic Approaches for Large-Scale Problems of Computational Mathematics”.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Gery, M.; Whitten, G.; Killus, J.; Dodge, M. A photochemical kinetics mechanism for urban and regional scale computer modelling. J. Geophys. Res. 1989, 94, 12925–12956. [Google Scholar] [CrossRef]
  2. Homma, T.; Saltelli, A. Importance measures in global sensitivity analysis of nonlinear models. Reliab. Eng. Syst. Saf. 1996, 52, 1–17. [Google Scholar] [CrossRef]
  3. Cukier, R.; Fortuin, C.; Shuler, K.; Petschek, A.; Schaibly, J. Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. I. Theory. J. Chem. Phys. 1973, 59, 3873–3878. [Google Scholar] [CrossRef]
  4. Ostromsky, T.; Dimov, I.T.; Georgieva, R.; Zlatev, Z. Air pollution modelling, sensitivity analysis and parallel implementation. Int. J. Environ. Pollut. 2011, 46, 83–96. [Google Scholar] [CrossRef]
  5. Havasi, Á.; Bartholy, J.; Faragó, I. Splitting method and its application in air pollution modeling. Időjárás 2001, 105, 39–58. [Google Scholar]
  6. Fidanova, S.; Zhivkov, P.; Roeva, O. InterCriteria Analysis Applied on Air Pollution Influence on Morbidity. Mathematics 2022, 10, 1195. [Google Scholar] [CrossRef]
  7. Zlatev, Z.; Dimov, I.T.; Georgiev, K. Modeling the long-range transport of air pollutants. IEEE Comput. Sci. Eng. 1994, 1, 45–52. [Google Scholar] [CrossRef]
  8. Dimov, I.T. Monte Carlo Methods For Applied Scientists; World Scientific: New York, NY, USA; London, UK; Singapore, 2007. [Google Scholar]
  9. Caflisch, R.E. Monte Carlo and quasi-Monte Carlo methods. Acta Numer. 1998, 7, 1–49. [Google Scholar] [CrossRef] [Green Version]
  10. Kalos, M.A.; Whitlock, P.A. Monte Carlo Methods, Volume 1: Basics; Wiley: New York, NY, USA, 1986. [Google Scholar]
  11. Berntsen, J.; Espelid, T.; Genz, A. An adaptive algorithm for the approximate calculation of multiple integrals. ACM Trans. Math. Softw. 1991, 17, 437–451. [Google Scholar] [CrossRef]
  12. Ferretti, F.; Saltelli, A.; Tarantola, S. Trends in Sensitivity Analysis Practice in the Last Decade Journal. Sci. Total Environ. Spec. Issue Hum. Biota Expo. 2016, 568, 666–670. [Google Scholar] [CrossRef]
  13. Chan, K.; Saltelli, A.; Tarantola, S. Sensitivity analysis of model output: Variance-based methods make the difference. In Proceedings of the 1997 Winter Simulation Conference, Atlanta, GA, USA, 7–10 December 1997; pp. 261–268. [Google Scholar]
  14. Saltelli, A.; Chan, K.; Scott, M. Sensitivity Analysis; John Wiley & Sons Publishers: London, UK, 2000. [Google Scholar]
  15. Saltelli, A.; Tarantola, S.; Chan, K. A quantitative model-independent method for global sensitivity analysis of model output. Source. Technometrics Arch. 1999, 41, 39–56. [Google Scholar] [CrossRef]
  16. Iooss, B.; Van Dorpe, F.; Devictor, N. Response surfaces and sensitivity analyses for an environmental model of dose calculations. Reliab. Eng. Syst. Saf. 2006, 91, 1241–1251. [Google Scholar] [CrossRef]
  17. Jacques, J.; Lavergne, C.; Devictor, N. Sensitivity analysis in presence of modele uncertainty and correlated inputs. Reliab. Eng. Syst. Saf. 2006, 91, 1126–1134. [Google Scholar] [CrossRef]
  18. The Danish Eulerian Model. General Description and References. Available online: http://www2.dmu.dk/AtmosphericEnvironment/DEM/ (accessed on 28 January 1999).
  19. Zlatev, Z. Computer Treatment of Large Air Pollution Models; KLUWER Academic Publishers: Dorsrecht, The Netherlands; Boston, MA, USA; London, UK, 1995. [Google Scholar]
  20. Zlatev, Z.; Dimov, I.T.; Georgiev, K. Three-dimensional version of the Danish Eulerian model. Z. Angew. Math. Mech. 1996, 76, 473–476. [Google Scholar]
  21. Zlatev, Z.; Dimov, I. Computational and Numerical Challengies in Environmental Modelling; Elsevier: Amsterdam, The Netherlands, 2006. [Google Scholar]
  22. Sobol, I.M. Sensitivity estimates for nonlinear mathematical models. Math. Model. Comput. Exp. 1993, 4, 407–414. [Google Scholar]
  23. Saltelli, A.; Tarantola, S.; Campolongo, F.; Ratto, M. Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models; Halsted Press: New York, NY, USA, 2004. [Google Scholar]
  24. Archer, G.; Saltelli, A.; Sobol, I. Sensitivity measures, ANOVA-like techniques and the use of bootstrap. J. Stat. Comput. Simul. 1997, 58, 99–120. [Google Scholar] [CrossRef]
  25. Saltelli, A. Making best use of model valuations to compute sensitivity indices. Comput. Phys. Commun. 2002, 145, 280–297. [Google Scholar] [CrossRef]
  26. Sobol, I.M. Monte Carlo Numerical Methods; Nauka: Moscow, Russia, 1973. [Google Scholar]
  27. Niederreiter, H. Low-discrepancy and low-dispersion sequences. J. Number Theory 1988, 30, 51–70. [Google Scholar] [CrossRef] [Green Version]
  28. Sobol, I.M. Distribution of points in a cube and approximate evaluation of integrals. USSR Comput. Maths. Math. Phys. 1967, 7, 86–112. [Google Scholar] [CrossRef]
  29. Joe, S.; Kuo, F. Remark on Algorithm 659: Implementing Sobol’s Quasirandom Sequence Generator. ACM Trans. Math. Softw. 2003, 29, 49–57. [Google Scholar] [CrossRef]
  30. Antonov, I.; Saleev, V. An Economic Method of Computing LPτ-sequences. USSR Comput. Math. Phys. 1979, 19, 252–256. [Google Scholar] [CrossRef]
  31. Saito, M.; Matsumoto, M. SIMD-oriented fast Mersenne Twister: A 128-bit pseudorandom number generator. In Monte Carlo and Quasi-Monte Carlo Methods 2006; Keller, A., Heinrich, S., Niederreiter, H., Eds.; Springer: Berlin/Heidelberg, Germany, 2008; pp. 607–622. [Google Scholar]
  32. Dimov, I.T.; Georgieva, R. Monte Carlo Method for Numerical Integration based on Sobol’ Sequences. In Numerical Methods and Applications; Dimov, I., Dimova, S., Kolkovska, N., Eds.; Springer: Berlin/Heidelberg, Germany, 2011; pp. 50–59. [Google Scholar]
  33. Dimov, I.T.; Georgieva, R.; Ostromsky, T.; Zlatev, Z. Advanced algorithms for multidimensional sensitivity studies of large-scale air pollution models based on Sobol sequences. Comput. Math. Appl. 2013, 65, 338–351. [Google Scholar] [CrossRef]
  34. Ökten, G.; Göncüb, A. Generating low-discrepancy sequences from the normal distribution: Box–Muller or inverse transform? Math. Comput. Model. 2011, 53, 1268–1281. [Google Scholar] [CrossRef]
  35. Dimov, I.T.; Georgieva, R. Multidimensional Sensitivity Analysis of Large-scale Mathematical Models. In Numerical Solution of Partial Differential Equations: Theory, Algorithms, and Their Applications; Springer Proceedings in Mathematics & Statistics 45; Iliev, O., Margenov, S., Minev, P., Vassilevski, P., Zikatanov, L., Eds.; Springer Science+Business Media: New York, NY, USA, 2013; pp. 137–156. [Google Scholar]
  36. Sloan, I.H.; Joe, S. Lattice Methods for Multiple Integration; Oxford University Press: Oxford, UK, 1994. [Google Scholar]
  37. Sloan, I.H.; Kachoyan, P.J. Lattice methods for multiple integration: Theory, error analysis and examples. SIAM J. Numer. Anal. 1987, 24, 116–128. [Google Scholar] [CrossRef]
  38. Wang, Y.; Hickernell, F.J. An historical overview of lattice point sets. In Monte Carlo and Quasi-Monte Carlo Methods 2000; Fang, K.T., Niederreiter, H., Hickernell, F.J., Eds.; Springer: Berlin/Heidelberg, Germany, 2002; pp. 158–167. [Google Scholar]
  39. Bahvalov, N. On the Approximate Computation of Multiple Integrals. Vestn. Mosc. State Univ. 1959, 4, 3–18. [Google Scholar]
  40. Hua, L.K.; Wang, Y. Applications of Number Theory to Numerical Analysis; Springer: Beijing, China; New York, NY, USA, 1981. [Google Scholar]
  41. Sloan, I.H.; Reztsov, A.V. Component-by-component construction of good lattice rules. Math. Comp. 2002, 71, 263–273. [Google Scholar] [CrossRef] [Green Version]
  42. Baldeaux, J.; Dick, J.; Leobacher, G.; Nuyens, D.; Pillichshammer, F. Efficient calculation of the worst-case error and (fast) component-by-component construction of higher order polynomial lattice rules. Numer. Algorithms 2012, 59, 403–431. [Google Scholar] [CrossRef] [Green Version]
  43. Nuyens, D.; Cools, R. Fast algorithms for component-by-component construction of rank-1 lattice rules in shift-invariant reproducing kernel Hilbert spaces. Math. Comp. 2006, 75, 903–920. [Google Scholar] [CrossRef] [Green Version]
  44. Kuo, F.Y.; Nuyens, D. Application of quasi-Monte Carlo methods to elliptic PDEs with random diffusion coefficients—A survey of analysis and implementation. Found. Comput. Math. 2016, 16, 1631–1696. [Google Scholar] [CrossRef] [Green Version]
  45. Cools, R.; Kuo, F.; Nuyens, D. Constructing Embedded Lattice Rules for Multivariate Integration. SIAM J. Sci. Comput. 2006, 28, 2162–2188. [Google Scholar] [CrossRef] [Green Version]
  46. Dick, J.; Pillichshammer, F. Digital Nets and Sequences: Discrepancy Theory and Quasi–Monte Carlo Integration; Cambridge University Press: Cambridge, UK, 2010. [Google Scholar]
  47. Goda, T.; Suzuki, K.; Yoshiki, T. Digital nets with infinite digit expansions and construction of folded digital nets for quasi-Monte Carlo integration. J. Complex. 2016, 33, 30–54. [Google Scholar] [CrossRef]
  48. Joe, S.; Kuo, F.Y. Constructing Sobol’ sequences with better two-dimensional projections. SIAM J. Sci. Comput. 2008, 30, 2635–2654. [Google Scholar] [CrossRef] [Green Version]
  49. Xing, C.P.; Niederreiter, H. A construction of low-discrepancy sequences using global function fields. Acta Arith. 1995, 73, 87–102. [Google Scholar] [CrossRef]
  50. Pirsic, G. A software implementation of Niederreiter–Xing sequences. In Monte Carlo and Quasi-Monte Carlo Methods 2000; Fang, K.T., Niederreiter, H., Hickernell, F.J., Eds.; Springer: Hong Kong, China; Berlin, Germany, 2002; pp. 434–445. [Google Scholar]
  51. Karaivanova, A.; Dimov, I. Error analysis of an adaptive Monte Carlo method for numerical integration. Math. Comput. Simul. 1998, 47, 201–213. [Google Scholar] [CrossRef]
  52. Atanassov, E.; Durchova, M. Generating and testing the modified Halton sequences. Lect. Notes Comput. Sci. 2007, 2542, 91–98. [Google Scholar]
  53. Dimov, I.T.; Atanassov, E. Exact error estimates and optimal randomized algorithms for integration. Lect. Notes Comput. Sci. 2007, 4310, 131–139. [Google Scholar]
  54. Ostromsky, T.; Dimov, I.T.; Marinov, P.; Georgieva, R.; Zlatev, Z. Advanced sensitivity analysis of the Danish Eulerian Model in parallel and grid environment. In Proceedings of the 3rd Int. Conf. Application of Mathematics in Technical and Natural Sciences, Albena, Bulgaria, 20–25 June 2011; pp. 225–232. [Google Scholar]
  55. Dimov, I.; Karaivanova, A.; Georgieva, R.; Ivanovska, S. Parallel Importance Separation and Adaptive Monte Carlo Algorithms for Multiple Integrals. In Numerical Methods and Applications. NMA 2002; Lecture Notes in Computer Science; Dimov, I., Lirkov, I., Margenov, S., Zlatev, Z., Eds.; Springer: Berlin/Heidelberg, Germany; New York, NY, USA, 2003; Volume 254, pp. 99–107. [Google Scholar]
  56. Dimov, I.T.; Georgieva, R.; Ostromsky, T.; Zlatev, Z. Sensitivity Studies of Pollutant Concentrations Calculated by UNI-DEM with Respect to the Input Emissions. Cent. Eur. J. Math. Methods Large Scale Sci. Comput. 2013, 11, 1531–1545. [Google Scholar] [CrossRef] [Green Version]
  57. Akgungor, A.; Yildiz, O. Sensitivity analysis of an accident prediction model by the fractional factorial method. Accid. Anal. Prev. 2007, 39, 63–68. [Google Scholar] [CrossRef]
  58. Helton, J.C. Uncertainty and sensitivity analysis techniques for use in performance assessment for radioactive waste disposal. Reliab. Eng. Syst. Saf. 1993, 42, 327–367. [Google Scholar] [CrossRef]
  59. Dimov, I.T.; Georgieva, R.; Ostromsky, T.; Zlatev, Z. Variance-based Sensitivity Analysis of the Unified Danish Eulerian Model According to Variations of Chemical Rates. In Proceedings of the Numerical Analysis and Its Applications—5th International Conference, NAA 2012, Lozenetz, Bulgaria, 15–20 June 2012; Lecture Notes in Computer Science. Dimov, I., Faragó, I., Vulkov, L., Eds.; Springer: Berlin/Heidelberg, Germany, 2013; Volume 8236, pp. 247–254. [Google Scholar]
  60. Ostromsky, T.; Dimov, I.T.; Georgieva, R.; Zlatev, Z. Parallel computation of sensitivity analysis data for the Danish Eulerian Model. In Proceedings of the 8th International Conference on “Large-Scale Scientific Computations”, Sozopol, Bulgaria, 6–10 June 2011; Lecture Notes in Computer Science. Springer: Berlin/Heidelberg, Germany, 2012; Volume 7116, pp. 301–309. [Google Scholar]
  61. Dimov, I.; Zlatev, Z. Testing the sensitivity of air pollution levels to variations of some chemical rate constants. Notes Numer. Fluid Mech. 1997, 62, 167–175. [Google Scholar]
  62. Sandewall, E. Combining logic and differential equations for describing real-world system. In Proceedings of the First International Conference on Principles of Knowledge Representation and Reasoning, Toronto, ON, Canada, December 1989; Brachmann, R.J., Levesque, H., Reiter, R., Eds.; Morgan Kaufmann: Los Altos, CA, USA, 1989; pp. 412–420. [Google Scholar]
  63. Tang, Y.; Reed, P.; Wagener, T.; van Werkhoven, K. Comparing sensitivity analysis methods to advance lumped watershed model identification and evaluation. Hydrol. Earth Syst. Sci. 2007, 11, 793–817. [Google Scholar] [CrossRef] [Green Version]
Table 1. RE for AE of f 0 0.048 .
Table 1. RE for AE of f 0 0.048 .
nDIGITAL-SOBOLLATTICE-CBCLATTICE-FIBODIGITAL-XINGN
Rel.Rel.Rel.Rel.
ErrorErrorErrorError
2 10 3e-044e-042e-042e-06
2 14 1e-052e-052e-051e-06
2 16 4e-064e-069e-063e-10
Table 2. RE for AE of f 0 0.048 .
Table 2. RE for AE of f 0 0.048 .
# of Points nSOBOL-SEQMCA-MSS-1MCA-MSS-2MCA-MSS-2-S
Rel. ρ Rel. ρ Rel.Rel.
Error Error ErrorError
2 8 2e-032e-025e-04
2 × 2 8 8e-053e-031e-05
2 10 4e-047e-043e-05
2 × 2 10 7e-041e-044e-06
2 14 3e-051e-043e-06
2 × 2 14 1e-054e-052e-07
2 16 7e-061e-046e-07
2 × 2 16 9e-058e-042e-08
Table 3. RE for AE of D 0.0002 .
Table 3. RE for AE of D 0.0002 .
# of Points nSOBOL-SEQMCA-MSS-1MCA-MSS-2MCA-MSS-2-S
Rel. ρ Rel. ρ Rel.Rel.
Error Error ErrorError
2 10 4e-037e-049e-03
( 2 × 2 10 ) 7e-043e-043e-04
2 14 4e-041e-043e-04
( 2 × 2 14 ) 1e-052e-042e-05
2 16 4e-051e-042e-05
( 2 × 2 16 ) 9e-057e-042e-06
Table 4. RE for AE of D 0.0002 .
Table 4. RE for AE of D 0.0002 .
nDIGITAL-SOBOLLATTICE-CBCLATTICE-FIBODIGITAL-XINGN
Rel.Rel.Rel.Rel.
ErrorErrorErrorError
2 10 3e-048e-032e-011e-04
2 14 1e-056e-043e-039e-07
2 16 2e-064e-053e-041e-06
Table 5. RE for AE of SIs ( n = 2 16 ).
Table 5. RE for AE of SIs ( n = 2 16 ).
EQRVSOBOL-SEQMCA-MSS-1MCA-MSS-2MCA-MSS-2-SDIGIT-SOBOLLAT-CBCLAT-FIBODIGIT-XINGN
S 1 9e-018e-058e-056e-065e-044e-076e-054e-041e-06
S 2 2e-043e-023e-024e-037e-024e-064e-022e-016e-03
S 3 1e-018e-048e-047e-051e-022e-063e-053e-031e-05
S 4 4e-057e-027e-021e-026e-012e-048e-035e-011e-05
S 1 t o t 9e-018e-058e-051e-051e-033e-072e-055e-041e-06
S 2 t o t 2e-045e-032e-031e-033e-031e-055e-023e-013e-04
S 3 t o t 1e-017e-047e-044e-054e-033e-066e-042e-032e-06
S 4 t o t 5e-056e-026e-021e-021e-014e-043e-025e-011e-06
Table 6. RE for AE of f 0 0.27 .
Table 6. RE for AE of f 0 0.27 .
nDIGITAL-SOBOLLATTICE-CBCLATTICE-FIBODIGITAL-XINGN
Rel.Rel.Rel.Rel.
ErrorErrorErrorError
2 12 1e-053e-041e-043e-08
2 14 5e-063e-054e-047e-11
2 16 1e-063e-063e-046e-11
Table 7. RE for AE of f 0 0.27 .
Table 7. RE for AE of f 0 0.27 .
# of Points nSOBOL-SEQMCA-MSS-1MCA-MSS-2MCA-MSS-2-S
Rel. ρ Rel. ρ Rel.Rel.
Error Error ErrorError
2 12 5e-053e-026e-06
2 × 2 12 4e-047e-053e-06
2 14 2e-052e-041e-05
2 × 2 14 2e-049e-069e-08
2 16 2e-062e-042e-07
2 × 2 16 2e-054e-065e-07
Table 8. RE for AE of D 0.0025 .
Table 8. RE for AE of D 0.0025 .
# of Points nSOBOL-SEQMCA-MSS-1MCA-MSS-2MCA-MSS-2-S
Rel. ρ Rel. ρ Rel.Rel.
Error Error ErrorError
2 6 1e-027e-041e-02
( 2 × 2 6 ) 7e-039e-038e-03
2 12 6e-044e-033e-05
( 2 × 2 12 ) 4e-044e-045e-04
2 14 1e-042e-041e-04
( 2 × 2 14 ) 2e-042e-046e-06
2 16 2e-052e-047e-05
( 2 × 2 16 ) 2e-052e-051e-04
Table 9. RE for AE of D 0.0025 .
Table 9. RE for AE of D 0.0025 .
nDIGITAL-SOBOLLATTICE-CBCLATTICE-FIBODIGITAL-XINGN
Rel.Rel.Rel.Rel.
ErrorErrorErrorError
2 12 3e-048e-035e-012e-03
2 14 6e-053e-031e-014e-05
2 16 1e-052e-042e-032e-05
Table 10. RE for AE of SIs ( n = 2 16 ).
Table 10. RE for AE of SIs ( n = 2 16 ).
EQRVSOBOL-SEQMCA-MSS-1MCA-MSS-2MCA-MSS-2-SDIGIT-SOBOLLAT-CBCLAT-FIBODIGIT-XINGN
S 1 4e-011e-044e-042e-042e-025e-061e-034e-022e-05
S 2 3e-013e-052e-043e-046e-026e-064e-041e-022e-05
S 3 5e-022e-042e-039e-048e-021e-041e-035e-011e-05
S 4 3e-013e-042e-052e-044e-031e-055e-041e-021e-05
S 5 4e-073e-017e+007e-022e+027e-023e+013e+034e-01
S 6 2e-023e-041e-033e-044e-024e-061e-021e+003e-05
S 1 t o t 4e-011e-044e-052e-045e-028e-078e-048e-024e-05
S 2 t o t 3e-014e-055e-042e-043e-023e-061e-033e-023e-05
S 3 t o t 5e-023e-042e-038e-044e-021e-042e-031e+003e-05
S 4 t o t 3e-012e-045e-042e-044e-022e-051e-034e-012e-05
S 5 t o t 2e-047e-031e-024e-031e+009e-031e-019e+016e-03
S 6 t o t 2e-024e-041e-033e-044e-021e-051e-022e+007e-06
S 12 6e-032e-045e-031e-037e-011e-044e-023e+003e-04
S 14 5e-032e-032e-022e-031e+002e-059e-028e+006e-04
S 24 3e-031e-032e-026e-031e+002e-046e-031e+011e-03
S 45 1e-054e-021e-012e-024e+001e-029e-014e+012e-02
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Todorov, V.; Dimov, I. Innovative Digital Stochastic Methods for Multidimensional Sensitivity Analysis in Air Pollution Modelling. Mathematics 2022, 10, 2146. https://doi.org/10.3390/math10122146

AMA Style

Todorov V, Dimov I. Innovative Digital Stochastic Methods for Multidimensional Sensitivity Analysis in Air Pollution Modelling. Mathematics. 2022; 10(12):2146. https://doi.org/10.3390/math10122146

Chicago/Turabian Style

Todorov, Venelin, and Ivan Dimov. 2022. "Innovative Digital Stochastic Methods for Multidimensional Sensitivity Analysis in Air Pollution Modelling" Mathematics 10, no. 12: 2146. https://doi.org/10.3390/math10122146

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop