Next Article in Journal
A Hybrid Estimation of Distribution Algorithm for the Quay Crane Scheduling Problem
Next Article in Special Issue
How Do Financial Development and Renewable Energy Affect Consumption-Based Carbon Emissions?
Previous Article in Journal
On a Special Weighted Version of the Odd Weibull-Generated Class of Distributions
Previous Article in Special Issue
Uncertainty, Spillovers, and Forecasts of the Realized Variance of Gold Returns
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

On the Elicitability and Risk Model Comparison of Emerging Markets Equities

1
Department of Finance, School of Business, University of Cape Coast, Cape Coast, Ghana
2
Wits Business School, University of the Witwatersrand, 2 St David’s Place, Parktown, Johannesburg 2193, South Africa
3
Simon Diedong Dombo University of Integrated Development Studies, Wa, Ghana
4
Rajagiri Business School, Kochi 682039, India
*
Author to whom correspondence should be addressed.
Math. Comput. Appl. 2021, 26(3), 63; https://doi.org/10.3390/mca26030063
Submission received: 3 August 2021 / Revised: 29 August 2021 / Accepted: 1 September 2021 / Published: 6 September 2021
(This article belongs to the Special Issue Mathematical and Computational Applications in Finance and Economics)

Abstract

:
The need for comparative backtesting in the Basel III framework presents the challenge for ranking of internal value-at-risk (VaR) and expected shortfall (ES) models. We use a joint loss function to score the elicitable joint VaR and ES models to select competing tail risk models for the top 9 emerging markets equities and the emerging markets composite index. We achieve this with the model confidence set (MCS) procedure. Our analysis span two sub-sample periods representing turbulent (Eurozone and Global Financial crises periods) and tranquil (post-Global Financial crisis period) market conditions. We find that many of the markets risk models are time-invariant and independent of market conditions. But for China and South Africa this is not true because their risk models are time-varying, market conditions-dependent, percentile-dependent and heterogeneous. Tail risk modelling may be difficult compared to other markets. The resemblance between China and South Africa can stem from the closeness between their equities composition. However, generally, there is evidence of more homogeneity than heterogeneity in risk models. This is indicated by a minimum of three models (out of six) per equity in most of the countries. This may ease the burden for risk managers to find the optimal set of models. Our study is important for internal risk modelling, regulatory oversight, reduce regulatory arbitrage and may bolster confidence in international investors with respect to emerging markets equities.
JEL Classification:
C10; C14; C8; G1

1. Introduction

Value-at-risk (VaR) and expected shortfall (ES) have been the two main regulatory capital requirement and portfolio risk measures for a long time. However, both of them suffer practical and coherent risk weaknesses (Burzoni et al. [1]; Cont et al. [2]; Fissler & Ziegel [3]; Fissler et al. [4]; Nolde & Ziegel [5]). Though, ES may have been espoused as a coherent measure of risk, it is sensitive to tails and can lead to greater periodic capital charges unlike VaR (Chang et al. [6]). Large ES values also tend to be more sensitive toward regulatory arbitrage and parameter specification (Kellner and Rösch [7]). But more importantly, it is the lack of elicitability of the ES that poses concerns (Fissler & Ziegel [3]; Nolde & Ziegel [5]). Elicitability can be defined as the property that allows competing risk measures to be comparable (Fissler & Ziegel [3]).
On the other hand, modeling tail risks of financial assets continue to be a daunting task for risk managers. There are a myriad of distributional innovations to choose from in the quest to address stylised facts of assets returns. The past decade has seen a proliferation of competing models (Bernardi & Catania [8]), not only for use by econometricians, but also for internal risk managers of financial firms. Hence, in recent time, the objective of any risk manager has not been to find a single best model but to find a relatively small set of ordered superior models, at a certain confidence level (Hansen et al. [9]).
Nonetheless, choosing a set of risk models should not only be an internal affair, but it should be in line with regulatory framework. The Basel III framework is expected to be fully phased by 1 January 2027 (Patton et al. [10], https://www.bis.org/press/p181004.htm, accessed on 31 August 2021). The Basel III framework requires VaR and ES models to be likened to their standardised approach known as comparative backtesting (i.e., where a bank’s internal risk model is a comparable standardised approach (Fissler, Ziegel, & Gneiting [4]. The approach involves ranking a set of competing models based on the forecast ability). While VaR models lend themselves to be ranked, ES lacks this property. However, at the higher level, the VaR and ES, hereafter referred to as (VaR, ES), is jointly elicitable. The Fissler & Ziegel [3] Loss (FZL) function is an appropriate associated score. This property of the (VaR, ES) offers the possibility to rank competing risk models based on a consistent scoring function. Elicitable risk measures, therefore, serve as the bridge between internal models of financial institutions and standardised regulatory approaches. This has opened a fledgling area in financial risk model selection in direct agreement with regulatory standards.
It is clear that risk modelling of EMs equities abound in the literature. Notable among them include Bao et al. [11], Del Brio et al. [12], Hwang & Satchell [13], Ji et al. [14], Miletic & Miletic [15], etc. Risk modelling of EMs equities has become important because the financial imprudence of both developed markets and EMEs can put the global financial system in despair. There are undeniable reasons for this assertion. The EMEs have become a large and important component of international finance since they connected with each other and with developed markets. For instance, the Organisation for Economic Corporation and Development Centre indicates that, economic and political power have moved towards EMEs over the last two decades (Kharas [16]). This indicated by an increasing number of EMEs becoming strong centres of growth as their share of global income have risen significantly (Kharas [16]). Further, given the explicit indication in the literature that EMs equities are high risk despite their high returns, a strong risk management process that aligns with regulatory framework is desirable. Some episodes of capital flight from EMEs can be attributed to this feature (see Aizenman et al. [17]; Enginar et al. [18]; Ghosh & Saggar [19]; Mishra et al. [20]). This risk modelling and management practice for EMs equities may elicit international investors, motivated not only by high returns, but also with the knowledge that risks are adequately quantified. It is for these reasons that our study is focused on EMEs to contribute to the literature on the best practice risk modelling and management on equities.
Nonetheless, many studies on model ranking and selection that are consistent with the current regulatory framework are largely missing. In this study, we seek to model and forecast tail risk of sampled emerging market equities using the (VaR, ES) model in light of the current regulatory framework. In doing so, we further employ the Hansen et al’s [9] model confidence set (MCS) procedure in ranking and selection of superior set models (SSMs) of the forecasted GAS models based on the FZL function. We use the 95% confidence level in selecting SSMs.
In the emerging market economies (EMEs) literature, several studies have used the Akaike, Consistent Akaike, Bayesian and Hannan-Quinn Information Criteria; AIC, BIC and HQIC, respectively, for risk model ranking and selection in the univariate case. Others also include the Log-likelihood (LogL), root mean squared error (RMSE), mean absolute error (MAE), etc. (Blazsek & Hernández [21]; Gong et al. [22]; Troster et al. [23]; Owusu Junior & Alagidede [24]). In light of recent arguments on combined tests, Khalaf et al. [25] and Kratz et al. [26] introduce multilevel and multinomial backtesting of ES based on series of VaR forecasts, respectively. Regression-based backtest approach has for both VaR and ES is also becoming popular in the literature (see Pradhan & Tiwari [27]; Barendse [28]; Dimitriadis & Bayer [29]; Couperier & Leymarie [30]; etc.).
However, these approaches have important shortcomings. First, they do not rank all models concurrently as a set. Model criteria values are compared after they have been estimated independent of each other. This approach plays down on the interdependence that may exist in the competing risk models (Han & Hausman [31]). Second, the criteria do not possess any consistent scoring function to allow for model ranking. Ranking based on only their magnitude may be inadequate.
Testing procedures for “best” fitting models include; Reality Check (White [32]), Stepwise Multiple Testing (Romano & Wolf [33]), Superior Predictive Ability (Hansen & Lunde [34]) and Conditional Predictive Ability (Giacomini & White [35]), are among the recent ones in the literature. These approaches lack a consistent scoring function such as the FZL function. Even though, the studies of Barendse [28], Dimitriadis & Bayer [29] and Couperier & Leymarie [30] employ a consistent scoring function, their regressions require the specification of covariates which may be arbitrary or complicate the models. Lastly, Taylor’s study [36] is also weak in the sense that it only applies the asymmetric Laplace distribution. We employ the model confidence set (MCS) technique of Hansen et al. [9] to construct a ‘superior’ set of competing (VaR, ES) models based on the FZL function of emerging markets (EMs) equities. To have a complete picture, we also analyse the Morgan Stanley Capital International (MSCI) emerging markets index (EM index). This is used in the absence of a portfolio consisting of the top 9 EMs equities. The MCS follows a sequence of tests to perform the dual task of creating a superior set model (SSM) and ranking the models therein. The null hypothesis of equal predictive ability (EPA) (Diebold & Mariano [37]) is used in selecting SSM.
Our study makes important contributions to the literature on EMs equities risk analysis. First, this is among the first studies to model tail risks in EMs equities with the joint (VaR, ES) model based on FZL function, hence, conforming to the current regulatory framework (i.e., Basel III). The number of available risk models has never been greater and hence intensifies the dilemma of risk managers to ascertain the “best” model while adhering to regulatory requirements. Moreover, it remains a concern for both internal risk managers and regulators to quantify tail risks to safeguard financial catastrophes that may result from inaccurate estimates and forecasts. We offer some novel insights to perform this task on EMs equities in order to reduce regulatory arbitrage.
Second, we surmise that risk modelling and selection that are consistent with regulatory standards may bolster confidence in the vogue international investor concerning EMs equities. One can imagine the prospects of capital flows into EMEs under the circumstance. Third, given that EMEs which are prone to episodes of turbulent market dynamics, this study is particularly useful as we perform analysis across both turbulent and tranquil market conditions. These are Eurozone crisis and global financial crisis (EC-GFC) and post-crisis (PC). The EC-GFC period spans between 5 January 2007 and 7 June 2013 and the PC period spans between 10 June 2012 and 18 January 2019. The selected sub-samples are supported in the literature (see, Dimitrakopoulos et al. [38]; Mollah & Mobarek [39]). This provides a time-varying assessment of EMs risk dynamics and mitigates the problem of model misspecification. Further, we use different distributional innovations to fit the risk models to sidestep single model misspecification as well as improve forecasting performance (Bernardi & Catania [8]).
Four, our study provides an opportunity to classify EMs equities portfolios as well diversified or not. It can be inferred from the MCS procedure that equities which exhibit a large SSM size are homogeneous and those with small SSM sizes are heterogeneous. We find that SSMs with at least one half of the initial set of models to be homogeneous. Similarly, we take SSMs with less than one half of the initial set of models to be heterogeneous. Empirically, homogeneity in the SSM is suggestive of well diversified portfolios. This knowledge is critical to inform international investors in asset selection and risk management (see Bernardi & Catania [8]).
Our empirical results show that, for many of the equities, most of the six initial models selected make the SSM. The least number of members in the SSM recorded is three. However, the EM index has SSM of one across sub-periods and percentiles and hence the most heterogeneous. We also find that model ranks differ for many markets in the different sub-periods. This suggests the need to be mindful of market dynamics when modelling tail risk. Although six may not be a large number, large SSM is important for portfolio selection under different market conditions.

2. Theoretical Models and Empirical Methodology

This study partly reproduces the methods description of Owusu Junior & Alagidede [24]) since the section uses parts of the methods employed in that paper. The selected techniques appeal to the elicitability of the joint (VaR, ES) model (Gneiting [40]; Weber [41]). They permit model selection, estimation, forecast comparison and forecast ranking, etc. (Fissler et al. [4]).

2.1. Univariate GAS Model Specification

The relationship between the FZL function and the generalised autoregressive score (GAS) models (Creal et al. [42]; Harvey [43]) is exploited as they both use loss function as an impetus of time-variation in the parameters (Ardia et al. [44]).
Let N × 1 vector y t be the dependent variable, f t the time-varying parameter vector, x t a vector of covariates, and θ a vector of static parameters; the filtration { f t , F t } t is given as
t = { Y t 1 , F t 1 ,   X t } ,   f o r   t = 1 ,   ,   n
where Y t = { y 1 ,   ,   y t } ,   F t = { f 0 , f 1 ,   ,   f t } , and X t = { x 1 ,   ,   x t } . Further, y t is generated by observation density and parameter vector θ driven by
y t ~ p ( y t | f t ,   t ; θ )
as the score of the conditional distribution. f t is updated by an autoregressive mechanism in (3):
f t + 1 = ω + i = 1 p A i s t i + 1 + j = 1 q B j f t j + 1 ,   i = 1 ,   ,   p ,   j = 1 ,   ,   q ,
where A i and B j are matrices of requisite dimensions, ω is a vector of constants and s t = s t ( y t , f t ,   t ; θ ) is the function of past data. The unknown parameters ( p + q + 1 ) are all functions of θ ( ω = ω ( θ ) ,   A i = A i ( θ ) ,   B i = B i ( θ ) ) evaluated at r t = l n P t l n P t 1 , log-return in conventional notations). f t is updated to f t + 1 in (3) via (4) with a realised y t where S ( . ) is a matrix.
s t = S t t ,         t = l n p ( y t | f t ,   t ; θ ) f t ,             S t = S ( t , f t ,   t ; θ )
The Equations (2)–(4) define the GAS with orders p and q . G A S ( p , q ) gives dependence of the driving mechanism in (3) on the scaled score vector in (4). We use G A S ( 1 , 1 ) in this study for all estimations (see Creal et al. [42]; Ardia et al. [44]). It may be worthwhile to compare the GAS models with generalised autoregressive conditional heteroscedasticity (GARCH) models of various dimensions, however, the outputs from our estimations in this study are overly voluminous (the tables presented are compressed) for brevity reasons. Further, we do not want deviate from the focus of the study by over-populating results. The GARCH models can be explored for further research purposes.

2.2. The FZL Function

For a forecast x k issued in the occurrence of the event y d , the forecasting model is penalised by the real value S ( x , y ) , and k ,   d are dimensions. Thus S ( . ) is a squared error inversely relating forecast values and their original counterparts. Fissler and Ziegel [3] vouched for a strictly -consistent for functional T ( F ) of a random variable X . This should be the unique minimiser of the expected loss E F [ S ( x , y ) ] for every F if the probability distribution of is in the domain of T . Given a non-strictly consistent scoring function S : 2 , for any random variable X with finite mean, and for α ( 0 , 1 ) , ES can be defined as
E S α ( X ) = 1 α 0 α V a R β ( X ) d β ,  
where V a R α ( X ) = inf { x : ( X x ) } . Unlike ES, VaR at α ( 0 , 1 ) has a strictly consistent scoring function of the form
S V ( v , x ) = ( I { x v } α ) ( G ( v ) G ( x ) ) ,
and thus, elicitable with a unique α -quantile, where G is strictly increasing. Nonetheless, ( V a R α ,   E S α ) is conjointly elicitable as shown in (7)
( V a R α ( X ) ,   E S α ( X ) ) = a r g m i n v , e 2 E [ S V , E ( v , e , X ) ] ,  
with a scoring function, specifically the FZL function given in (8)
S V , E ( v , e , x ) = ( I { x v } α ) ( G 1 ( v ) G 1 ( x ) ) + 1 α G 2 ( e ) I { x v } ( v x ) + G 2 ( e ) ( e v ) G 2 ( e ) ,
where V ,   E ,   v and e denote V a R α ,   E S α and their corresponding estimates.
It is obvious from (7) that G 1 and G 2 are strictly increasing continuously differentiable functions such that E [ G 1 ( X ) ] exists, l i m x G 2 ( x ) = 0 , and G 2 = G 2 (Fissler et al. [4]). The second part of S V , E shows the dependence of E S α on V a R α to be elicitable. The FZL used in the GAS framework is the parameterisation of Patton et al. [10] by specifying the difference for two forecasts ( v 1 t ,   e 1 t ) and ( v 2 t ,   e 2 t ) as L F Z ( X t ,   v 1 t ,   e 1 t ; α ,   G 1 , G 2 ) L F Z ( X t ,   v 2 t ,   e 2 t ; α ,   G 1 , G 2 ) . The resulting loss function FZ0 is given as
L F Z 0 ( X ,   v , e ; α ) = 1 α e I { X v } ( v X ) + v e + log ( e ) 1 .
For (9) to be valid the strictly negative and homogeneous loss differences assumptions must hold for VaR and ES (see, Fissler et al. [4]; Fissler & Ziegel [3]; Patton et al. [10]).

2.3. The MCS Procedure

Because of elicitability of the (VaR, ES) model, the FZL function permits the MCS procedure to construct a SSM and ranks them based on a loss function that satisfies generic weak stationarity conditions (Bernardi & Catania [8]). We employ the Mariano and Preve [45] (MDM) as well as West [46] to examine the equal predictive ability (EPA) hypothesis. The MDM is the multivariate version of Diebold & Mariano [37] which is only for the bivariate case. Together with the MCS procedure, these fit well with the multiple competing models in this models in this study.
In formal terms let r t ,   r ^ i , t denote the log-return at time t and the output of model i at time t , respectively. Then the loss function
i , t = ( r t ,   r ^ i , t ) ,
can be defined as the difference between r ^ i , t and r t . Following González-Rivera et al. [47] and Bernardi et al. [48], the FZL loss function (under MCS) can be defined as
( r t , F Z L t τ ) = ( τ d t τ ) ( r t F Z L t τ ) ,
where F Z L t τ signifies the τ -level predicted FZL at time t , in the filtration t 1 , and d t τ = I ( r t < F Z L t τ ) is the τ -level FZL loss function. The MCS algorithm begins with an all-encompassing initial set of alternative models of m dimension, M 0 at a confidence level α . It then builds m * M 0 set models called the superior set model (SSM). The SSM, M ^ 1 α * comprises all models with superior predictive ability as per the selected loss function.
For model selection, let
d i j , t = i , t j , t ,     i , j = 1 , , m ,     t = 1 , , n
denote the loss differential between models i and j at time t . Also let
d i . , t = ( m 1 ) 1 j M d i j , t   i = 1 , , m ,
denote the sample loss of model i relative of another model j at time t and M is the number of models. The hypothesis for EPA can be formulated as
H o , M = c i , j = 0 ,       i , j = 1 , , m , H A , M = c i , j 0 ,    f o r   s o m e    i , j = 1 , , n ,
where c i , j is the estimated loss of model i relative of other set of models j . The required test statistic is
t i , j = d ¯ i j v a r ^ ( d ¯ i j ) ,   f o r   i , j M ,
where d ¯ i j = m 1 t = 1 m d i j , t denotes the relative sample loss between the i t h and j t h models, and v a r ^ ( d ¯ i j ) is the bootstrapped estimate of v a r ( d ¯ i j ) . We use the MCS package in R (Bernardi & Catania [49]) to perform a block-bootstrap with 5000 re-samples. Significant parameters are obtained by fitting an autoregressive ( A R ( p ) ) process on all d i , j terms with a maximum block length p . Lastly, according to (Hansen et al. [9]), H o , M naturally fits into the test statistic:
T R , M = max i , j M | t i j |
For a complete description of the MCS procedure one may refer to (Bernardi & Catania [8,49]; Hansen & Lunde [34]; West [46]; White [32]; etc.).
With support from the literature that financial returns exhibit heavy-tails as well as volatility clusters (Cajueiro & Tabak [50]; McNeil & Frey [51]; McNeil et al. [52]), we select distributions that can capture these features. We use six different asymmetric distributions of fit (VaR, ES) in the GAS model. These are skewed-Gaussian (SNORM), student-t (STD), skewed-student-t (SSTD) (Fernández & Steel [53]); asymmetric student-t with two tail decay parameters (AST), asymmetric student-t with one tail decay parameter (AST1) (Zhu & Galbraith [54,55]); and asymmetric Laplace distribution (ALD) (Kotz et al. [56]). These distribution have been proven to work in the baseline GAS framework (Benardi & Catania [49]).

3. Data and Preliminary Analysis

We use the daily log-returns r t = l n P t l n P t 1 , where P t and P t 1 are index prices (in US dollars) at time t   and t 1 , respectively. Our data are the top nine (9) emerging markets (EMs) indices according to Morgan Stanley Capital International (MSCI) classification from 5 January 2007 to February 18, 2019. The top 9 EMs index country constituents are China (33%), South Korea (13.02%), Taiwan (11.35%), India (9.16%), Brazil (7.23%), South Africa (5.89%), Russia (3.77%), Mexico (2.65%) and Thailand (2.34%). All others take up the remaining 11.59%. The price data were gleaned from the Bloomberg Terminal. Our analysis span across Eurozone crisis and global financial crisis (EC-GFC) and post-crisis (PC). The EC-GFC period spans between 5 January 2007 and 7 June 2013 and the PC period span between 10 June 2012 and 18 January 2019, representing stressed and tranquil market periods, respectively. Our selection of sub-sample periods are informed by the fact that both the EZC and GFC affected EMEs alike (Cheung et al. [57]; Crotty [58]; Martin [59]; Mollah et al. [60]; Nguyen & Pontell [61]).
We follow a typical out-of-sample exercise (i.e., estimates are made using in-sample period of length M , predictions on the conditional distribution in the out-of-sample period H , and model comparison made according to their out-of-sample performance). Hence h -step ahead prediction of the return distribution at time M + h along corresponding (VaR, ES) model level are generated in a recursive manner in line with Marcellino et al. [62] until the end of the series T . We use h = 1 for one-step ahead daily forecasting.
The estimation and forecasting windows are chosen as follows:
EC-GFC gets M = 1117 (5 January 2007–18 April 2011), H = 559 (19 April 2011–7 June 2013) and PC has M = 740 (21 November 2014–14 July 2017), H = 368 (22 July 2017–19 February 2019), where M denotes in-sample (IS) and H denotes out-of-sample (OOS) forecast lengths. The OOS is chosen such that it is a minimum of one trading year. The loss functions are also estimated at the 97.5 and 99 percentiles, a standard requirement by the Bank for International Settlements (BIS [63]).

Descriptive Statistics

In Figure 1 and Figure 2 we show both the price and log-return plots of our two sub-samples. We see that the fluctuations in the plots are typical of high frequency financial data of daily periodicity. They exhibit varied levels of volatility across sub-sample periods. Log-returns also exhibit volatility clusters which conform to the price fluctuations as expected. The summary statistics in Table 1 and Table 2 show skewness and excess kurtosis values. This validates non-normality and leptokurtic behaviour in the equities. The mixture of positive (negative) skewness values indicate the possibility of positive (negative) returns are more than negative (positive) returns for the different equities between the IS and OOS periods. Leptokurtoses also suggest the presence of extreme returns across the board but of different magnitudes. These do not only suggest non-normality in the equities, but they also indicate time-varying dynamics. Further, the Shapiro–Wilk test of normality corroborate these as it rejects the Gaussian assumption for all significance levels. These support the need to use time-varying and asymmetric distributional approaches in modelling the tail risks of equity returns.
In Table 3 we present the SSM from MCS algorithm for both 1% and 2.5% (VaR, ES) forecasts. Individual p-values can be interpreted as the level of belongingness in the SSM. Similarly, overall p-values indicate that the SSM contains true models with a probability no less than 1 α ( α = 0.01 for both 1% and 2.5% (VaR, ES) forecasts). All the p-values support the belongingness of the models in the SSM at all levels of significance. However, it is interesting to note that the magnitude of p-values do not correspond with the size of SSMs. It implies that the number of true models (in SSM) does not have to be large for the respective equity risk to be sufficiently modelled.
Though the SSM shows ranking of the models, we focus on the number of models it contains. This provides insight into the extent of heterogeneity and/or homogeneity among the risk models for a specific equity. If SSM contains a larger portion of M 0 then the competing models are statistically significant with respect to the forecast capability of (VaR, ES) for the particular equity, and vice versa (Bernardi & Catania [8]). It is worth noting that the models in the SSM are those characterised by very strong non-linear dynamics for their conditional volatility process.
Our SSMs reveal that there seems not to be any general distinct differences in the model heterogeneity/homogeneity during turbulent market (EC-GFC periods) and tranquil times (PC period) conditions for both 97.5 and 99 percentiles. The (VaR, ES) model in the SSM range between six (6) and three (3) for both EC-GFC and PC periods. We note that 6 is the initial set M 0 . Thus, for those equities, all the initial models, SSM which suggest a great deal of model homogeneity. Equities with all six models in the SSM during the turbulent market (EC-GFC) periods are Brazil, Mexico, India, Korea, Taiwan and Thailand. However, in the tranquil (PC) period, they are Brazil, Mexico, Russia, India, Taiwan and Thailand. These drive home the point that, except for Russia and South Korea, tail risk modelling in the EMs equities may be indifferent to market dynamics and thus time-invariant. They exhibit homogeneity (with respect to the size of SSMs) between the two market periods. We find that Russia has SSM of size four (4) in during EC-GFC but 6 in PC period. South Korea exhibits the exact opposite of Russia (SSM of size 6 in EC-GFC and size 4 in PC period).
China and South Africa also present different patterns. First, in EC-GFC periods the two markets have smaller SSMs of size 4 (99% level) and 3 (97.5% level). Compared to M 0 , these countries show model heterogeneity. In the PC, South Africa has 6 models (at the 99% level) and 3 models (at the 97.5% level), whereas China has 4 models (at the 99% level) and 6 models (at the 97.5% level). These indicate that in this period, while South Africa demonstrate model homogeneity at the 99th percentile, but for China it is at the 97.5th percentile. In essence, during the PC period, China and South Africa portray percentile-dependent tail risk model dynamics. But we also can confirm time-dependent tail risk modelling in the two markets because of the difference in SSMs between EC-GFC and PC periods.
The implications for tail risk modelling in China and South Africa may not be trivial. We can infer that it is more difficult to model tail risks in these equities as compared to the other seven markets. This is because, not only should specific market dynamics be considered, but risk managers may be wary of specific confidence levels. The pattern between China and South Africa may be explained by the composition of their respective equity indices. For instance, Tencent Holdings Limited, a Chinese Information Technology company, is first of the top ten (10) constituents of the MSCI EMs index. The South African giant, Naspers Limited (5th of the top 10 MSCI EMs index constituents) owns 31.1% of Tencent Holdings Limited (Morgan [64]). It is, therefore, no surprise that the two markets exhibit similar tail risk features.
For the EM index, we find only the SSM contains the ALD for both 1% and 2.5% levels and sub-periods. This confirms the superiority of the ALD as suggested by Taylor [36]. It also shows that EM index exhibits the most heterogeneous set and thus not a diversified portfolio. The reason for the glaring difference between the SSMs for EM index and the individual equities may be attributed to the size of the data. It sends a clear message that the risk dynamics of the index is different from the constituent equities and portfolio decisions should take this into account.
We surmise from the results that the ease/difficulty with which to model tail risks does not depend on the actual conditions of the financial markets for an equity except for China and South Africa. Bernardi & Catania [8] made similar remarks in using the MCS algorithm to compare VaR models of four major global stock indices from Asia, North America and Europe. It follows that risk managers would prefer a SSM with a size closer to M 0 to those that are smaller. The latter shows models are statistically equivalent in their (VaR, ES) forecasting abilities and thus reduce the task of finding the singular best model. Moreover, given that SSMs are ranked, risk managers are at the same time, at ease of choosing the best ranked model for their equities.
Furthermore, that many of the SSMs are independent of market conditions is instructive for tail risk modelling for those equities. That is to say each EM equity may have to be subjected to the rigour of tail risk modelling, irrespective of the market condition. This brings to the fore an important difference and/or similarity amongst emerging markets. We evidence that despite the fact that EMEs are bracketed into one market class, the tail risks in their equities could not be more different. As a consequence, we suggest that portfolio diversifications benefits involving EMs equities are promising given the right combinations.
Empirically, the homogeneity in the SSM is suggestive of well diversified portfolios for the respective equity, given that different distributional assumptions are applied to the returns. This applies to all the equities with the exception of China and South Africa. Bernardi & Catania [8] opine that, the fact that diversified portfolios are characterised by inversely related risks and returns properties, so does diversification mitigate against negative and positive tail events that affect conditional distribution and kurtosis of equity returns.
It is worthwhile to note that the specific distributional innovations in each SSMs bear some important implications. Different distributional innovations are employed to capture the complex and unpredictable data-generating process in equities. These are reflected in the tails of distributions and are largely dependent on market dynamics which are also time-dependent. Hence, fitting a single distribution to the data is at a high risk of model misspecification as suggested in Bernardi & Catania [8]. It is clear from Table 3 that is it only the EM index where a single distributions fits that data across the different market periods, yet at different loss levels. It is almost impossible to hold down the exact reason why the model fits better with different distributions between the two periods and at what levels of predictive ability. The important signal is that, like many equities, the EM equities exhibit varying price and return dynamics which can be captured by using many distributional of diverse tail properties.

4. Conclusions and Recommendations

In this paper we constructed different sets of models for (VaR, ES) based on the FZL function to examine the forecast performance of the top 9 EMs equity returns. Our study period was between 5 January 2007 and 19 February 2019, further split into EC-GFC and PC periods. The superior set model (SSM) for each equity was constructed using the MCS procedure of Hansen et al. [9]. Among other things, it is appropriate to quantify, rank and select competing risks models. In this study, we fit different asymmetric distributional innovations in the GAS framework to the (VaR, ES) to forecast risks in the EMs equities. We combine the elicitability the joint (VaR, ES) scored by the FZL function, its richness in drawing from both VaR and ES and the ability of MCS to rank models to select the superior set of tail risk models.
Not only does this work contribute to growing need to correctly model and forecast tail risk for internal risk management purposes, but it also fits well with the Basel III framework for comparative backtesting. We also use both the 99 and 97.5 percentiles in the risk forecasting as suggested in the Basel III framework. This is a new study for EMs equities as far as risk analysis is concerned. The practice of aligning internal models with standardised approaches improves regulatory oversight and hence may bolter confidence in international investors about EMs equities.
Our results show that for many of the markets, risk models are time-invariant (with respect to the number of models in the SSM, but not with the rank of the models) between turbulent and tranquil market periods. The SSMs are of size 6 which is equal to the original set of models. This implies homogeneity in risk modelling and hence reduces the burden of risk managers. We opine that, this hints at usefulness of the MCS procedure in choosing from a large number of models with ease. This further implies that the MCS procedure offers more flexibility in modelling, forecasting and comparing competing tail models. However, for China and South Africa, the risk models are more time-varying, percentile-dependent and more heterogeneous than homogeneous. We infer that the pattern in China and South African may be attributed to their respective equity index compositions. We find that the largest equity in South Africa Naspers Limited own 31.1% stake in Tencent Holdings Limited which is the largest Chinese equity and the biggest constituents of the MSCI EMs index (Morgan [64]).
Empirically, the homogeneity in the SSM is suggestive of well diversified portfolios for the respective equity, given that different distributional assumptions are applied to the returns. This applies to all the equities with the exception of Russia (in EC-GFC periods), South Korea (in PC period) and China and South Africa (in both periods). Bernardi & Catania [8] opine that, the fact that diversified portfolios are characterised by inversely related risks and returns properties, so does diversification mitigate against negative and positive tail events that affect conditional distribution and kurtosis of equity returns.
For further research, GAS volatility models can be compared with GARCH with asymmetric/leverage effects. Specifically, the robust bootstrap forecast densities for GARCH returns and volatilities (Trucíos et al. [65]) can be applied on the data. In addition, it would be interesting to see the dynamics of the data under the semi-nonparametric backtesting techniques applied with VaR, ES and Median Shortfall (see Jiménez et al. [66]). Finally, while this study captures two crises periods, it could further be expanded to reflect the effects of the ongoing COVID-19 pandemic of EMs equities and risks.

Author Contributions

Conceptualization, P.O.J. and I.P.A.; methodology, P.O.J. and A.K.T.; software, P.O.J.; validation, I.P.A. and A.K.T.; formal analysis, P.O.J.; investigation, P.O.J.; resources, I.P.A.; data curation, P.O.J.; writing—original draft preparation, P.O.J.; writing—review and editing, P.O.J., I.P.A. and A.K.T.; visualization, P.O.J.; supervision, I.P.A.; project administration, P.O.J. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

The indices data were downloaded from the Bloomberg Terminal under license and so cannot be made freely available.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Burzoni, M.; Peri, I.; Ruffo, C.M. On the properties of the Lambda value at risk: Robustness, elicitability and consistency. Quant. Financ. 2017, 17, 1735–1743. [Google Scholar] [CrossRef] [Green Version]
  2. Cont, R.; Deguest, R.; He, X.D. Loss-based risk measures. Stat. Risk Model. Appl. Financ. Insur. 2013, 30, 133–167. [Google Scholar] [CrossRef] [Green Version]
  3. Fissler, T.; Ziegel, J.F. Higher order elicitability and Osband’s principle. Ann. Stat. 2016, 44, 1680–1707. [Google Scholar] [CrossRef]
  4. Fissler, T.; Ziegel, J.F.; Gneiting, T. Expected Shortfall is jointly elicitable with Value at Risk-Implications for backtesting. arXiv 2015, arXiv:1507.00244. [Google Scholar]
  5. Nolde, N.; Ziegel, J.F. Elicitability and backtesting: Perspectives for banking regulation. Ann. Appl. Stat. 2017, 11, 1833–1874. [Google Scholar] [CrossRef]
  6. Chang, C.-L.; Jimenez-Martin, J.-A.; Maasoumi, E.; McAleer, M.; Pérez-Amaral, T. Choosing expected shortfall over VaR in Basel III using stochastic dominance. Int. Rev. Econ. Financ. 2019, 60, 95–113. [Google Scholar] [CrossRef] [Green Version]
  7. Kellner, R.; Rösch, D. Quantifying market risk with Value-at-Risk or Expected Shortfall?—Consequences for capital requirements and model risk. J. Econ. Dyn. Control 2016, 68, 45–63. [Google Scholar] [CrossRef]
  8. Bernardi, M.; Catania, L. Comparison of Value-at-Risk models using the MCS approach. Comput. Stat. 2016, 31, 579–608. [Google Scholar] [CrossRef]
  9. Hansen, P.R.; Lunde, A.; Nason, J.M. The Model Confidence Set. Econometrica 2011, 79, 453–497. [Google Scholar] [CrossRef] [Green Version]
  10. Patton, A.J.; Ziegel, J.F.; Chen, R. Dynamic semiparametric models for expected shortfall (and Value-at-Risk). J. Econ. 2019. [Google Scholar] [CrossRef] [Green Version]
  11. Bao, Y.; Lee, T.-H.; Saltoglu, B. Evaluating predictive performance of value-at-risk models in emerging markets: A reality check. J. Forecast. 2006, 25, 101–128. [Google Scholar] [CrossRef]
  12. Del Brio, E.B.; Mora-Valencia, A.; Perote, J. VaR performance during the subprime and sovereign debt crises: An application to emerging markets. Emerg. Mark. Rev. 2014, 20, 23–41. [Google Scholar] [CrossRef]
  13. Hwang, S.; Satchell, S.E. Modelling emerging market risk premia using higher moments. Int. J. Financ. Econ. 1999, 4, 271–296. [Google Scholar] [CrossRef]
  14. Ji, Q.; Liu, B.-Y.; Zhao, W.-L.; Fan, Y. Modelling dynamic dependence and risk spillover between all oil price shocks and stock market returns in the BRICS. Int. Rev. Financ. Anal. 2020, 68, 101238. [Google Scholar] [CrossRef]
  15. Miletic, M.; Miletic, S. Performance of Value at Risk models in the midst of the global financial crisis in selected CEE emerging capital markets. Econ. Res.-Ekon. Istraž. 2015, 28, 132–166. [Google Scholar] [CrossRef] [Green Version]
  16. Kharas, H. The Emerging Middle Class in Developing Countries. Available online: https://www.oecd-ilibrary.org/development/the-emerging-middle-class-in-developing-countries_5kmmp8lncrns-en (accessed on 30 August 2021).
  17. Aizenman, J.; Binici, M.; Hutchison, M.M. The Transmission of Federal Reserve Tapering News to Emerging Financial Markets (Working Paper No. 19980); National Bureau of Economic Research: Cambridge, MA, USA, 2014. [Google Scholar] [CrossRef]
  18. Enginar, O.; Karan, M.B.; Büyükkara, G. Performances of Emerging Stock Exchanges During the Fed’s Tapering Announcements. In Global Approaches in Financial Economics, Banking, and Finance; Dincer, H., Hacioglu, Ü., Yüksel, S., Eds.; Springer: Berlin, Germany, 2018; pp. 415–443. [Google Scholar] [CrossRef]
  19. Ghosh, S.; Saggar, M. Volatility spillovers to the emerging financial markets during taper talk and actual tapering. Appl. Econ. Lett. 2017, 24, 122–127. [Google Scholar] [CrossRef]
  20. Mishra, P.; Moriyama, K.; N’Diaye, P.M.P.; Nguyen, L. Impact of Fed Tapering Announcements on Emerging Markets; International Monetary Fund: Washington, DC, USA, 2014. [Google Scholar]
  21. Blazsek, S.; Hernández, H. Analysis of electricity prices for Central American countries using dynamic conditional score models. Empir. Econ. 2018, 55, 1807–1848. [Google Scholar] [CrossRef]
  22. Gong, X.-L.; Liu, X.-H.; Xiong, X. Measuring tail risk with GAS time varying copula, fat tailed GARCH model and hedging for crude oil futures. Pac. Basin Financ. J. 2019, 55, 95–109. [Google Scholar] [CrossRef]
  23. Troster, V.; Tiwari, A.K.; Shahbaz, M.; Macedo, D.N. Bitcoin returns and risk: A general GARCH and GAS analysis. Financ. Res. Lett. 2018, 30, 187–193. [Google Scholar] [CrossRef]
  24. Owusu Junior, P.; Alagidede, I. Risks in emerging markets equities: Time-varying versus spatial risk analysis. Phys. A Stat. Mech. Appl. 2020, 542, 123474. [Google Scholar] [CrossRef]
  25. Khalaf, L.; Leccadito, A.; Urga, G. Multilevel and Tail Risk Management. J. Financ. Econom. 2021. [Google Scholar] [CrossRef]
  26. Kratz, M.; Lok, Y.H.; McNeil, A.J. Multinomial VaR backtests: A simple implicit approach to backtesting expected shortfall. J. Bank. Financ. 2018, 88, 393–407. [Google Scholar] [CrossRef] [Green Version]
  27. Pradhan, A.K.; Tiwari, A.K. Estimating the market risk of clean energy technologies companies using the expected shortfall approach. Renew. Energy 2021, 177, 95–100. [Google Scholar] [CrossRef]
  28. Barendse, S. Interquantile Expectation Regression (SSRN Scholarly Paper No. ID 2937665). Available online: https://papers.ssrn.com/abstract=2937665 (accessed on 30 August 2021).
  29. Dimitriadis, T.; Bayer, S. A Joint Quantile and Expected Shortfall Regression Framework. arXiv 2017, arXiv:1704.02213. [Google Scholar] [CrossRef]
  30. Couperier, O.; Leymarie, J. Backtesting Expected Shortfall via Multi-Quantile Regression. Available online: https://halshs.archives-ouvertes.fr/halshs-01909375/document (accessed on 30 August 2021).
  31. Han, A.; Hausman, J.A. Flexible parametric estimation of duration and competing risk models. J. Appl. Econom. 1990, 5, 1–28. [Google Scholar] [CrossRef]
  32. White, H. A Reality Check for Data Snooping. Econometrica 2000, 68, 1097–1126. [Google Scholar] [CrossRef]
  33. Romano, J.P.; Wolf, M. Stepwise Multiple Testing as Formalized Data Snooping. Econometrica 2005, 73, 1237–1282. [Google Scholar] [CrossRef] [Green Version]
  34. Hansen, P.R.; Lunde, A. A forecast comparison of volatility models: Does anything beat a GARCH (1, 1)? J. Appl. Econom. 2005, 20, 873–889. [Google Scholar] [CrossRef] [Green Version]
  35. Giacomini, R.; White, H. Tests of Conditional Predictive Ability. Econometrica 2006, 74, 1545–1578. [Google Scholar] [CrossRef] [Green Version]
  36. Taylor, J.W. Forecasting Value at Risk and Expected Shortfall Using a Semiparametric Approach Based on the Asymmetric Laplace Distribution. J. Bus. Econ. Stat. 2019, 37, 121–133. [Google Scholar] [CrossRef]
  37. Diebold, F.X.; Mariano, R.S. Comparing Predictive Accuracy. J. Bus. Econ. Stat. 1995, 13, 253–263. [Google Scholar] [CrossRef] [Green Version]
  38. Dimitrakopoulos, D.N.; Kavussanos, M.G.; Spyrou, S.I. Value at risk models for volatile emerging markets equity portfolios. Q. Rev. Econ. Financ. 2010, 50, 515–526. [Google Scholar] [CrossRef]
  39. Mollah, S.; Mobarek, A. Global Stock Market Integration: Co-Movement, Crises, and Efficiency in Developed and Emerging Markets; Springer: Berlin, Germany, 2016. [Google Scholar]
  40. Gneiting, T. Making and Evaluating Point Forecasts. J. Am. Stat. Assoc. 2011, 106, 746–762. [Google Scholar] [CrossRef] [Green Version]
  41. Weber, S. Distribution-Invariant Risk Measures, Information, and Dynamic Consistency. Math. Financ. 2006, 16, 419–441. [Google Scholar] [CrossRef]
  42. Creal, D.; Koopman, S.J.; Lucas, A. Generalized autoregressive score models with applications. J. Appl. Econom. 2013, 28, 777–795. [Google Scholar] [CrossRef] [Green Version]
  43. Harvey, A.C. Dynamic Models for Volatility and Heavy Tails: With Applications to Financial and Economic Time Series (Volume 52); Cambridge University Press: Cambridge, UK, 2013. [Google Scholar]
  44. Ardia, D.; Boudt, K.; Catania, L. Downside Risk Evaluation with the R Package GAS (SSRN Scholarly Paper No. ID 2871444). Available online: https://papers.ssrn.com/abstract=2871444 (accessed on 30 August 2021).
  45. Mariano, R.S.; Preve, D. Statistical tests for multiple forecast comparison. J. Econom. 2012, 169, 123–130. [Google Scholar] [CrossRef]
  46. West, K.D. Asymptotic inference about predictive ability. Econom. J. Econom. Soc. 1996, 64, 1067–1084. [Google Scholar] [CrossRef]
  47. González-Rivera, G.; Lee, T.-H.; Mishra, S. Forecasting volatility: A reality check based on option pricing, utility function, value-at-risk, and predictive likelihood. Int. J. Forecast. 2004, 20, 629–645. [Google Scholar] [CrossRef]
  48. Bernardi, M.; Catania, L.; Petrella, L. Are news important to predict the Value-at-Risk? Eur. J. Financ. 2017, 23, 535–572. [Google Scholar] [CrossRef]
  49. Bernardi, M.; Catania, L. The Model Confidence Set Package for R. arXiv 2014, arXiv:1410.8504. [Google Scholar]
  50. Cajueiro, D.O.; Tabak, B.M. Testing for time-varying long-range dependence in volatility for emerging markets. Phys. A Stat. Mech. Appl. 2005, 346, 577–588. [Google Scholar] [CrossRef]
  51. McNeil, A.J.; Frey, R. Estimation of tail-related risk measures for heteroscedastic financial time series: An extreme value approach. J. Empir. Financ. 2000, 7, 271–300. [Google Scholar] [CrossRef]
  52. McNeil, A.J.; Frey, R.; Embrechts, P. Quantitative Risk Management: Concepts, Techniques and Tools—Revised Edition; Princeton University Press: Princeton, NJ, USA, 2015. [Google Scholar]
  53. Fernández, C.; Steel, M.F.J. On Bayesian Modeling of Fat Tails and Skewness. J. Am. Stat. Assoc. 1998, 93, 359–371. [Google Scholar] [CrossRef] [Green Version]
  54. Zhu, D.; Galbraith, J.W. A generalized asymmetric Student-t distribution with application to financial econometrics. J. Econom. 2010, 157, 297–305. [Google Scholar] [CrossRef]
  55. Zhu, D.; Galbraith, J.W. Modeling and forecasting expected shortfall with the generalized asymmetric Student-t and asymmetric exponential power distributions. J. Empir. Financ. 2011, 18, 765–778. [Google Scholar] [CrossRef]
  56. Kotz, S.; Kozubowski, T.; Podgorski, K. The Laplace Distribution and Generalizations: A Revisit with Applications to Communications, Economics, Engineering, and Finance; Springer Science & Business Media: Berlin, Germany, 2012. [Google Scholar]
  57. Cheung, Y.-W.; Fatum, R.; Yamamoto, Y. The exchange rate effects of macro news after the global Financial Crisis. J. Int. Money Financ. 2019, 95, 424–443. [Google Scholar] [CrossRef]
  58. Crotty, J. Structural causes of the global financial crisis: A critical assessment of the ‘new financial architecture’. Camb. J. Econ. 2009, 33, 563–580. [Google Scholar] [CrossRef] [Green Version]
  59. Martin, R. The local geographies of the financial crisis: From the housing bubble to economic recession and beyond. J. Econ. Geogr. 2011, 11, 587–618. [Google Scholar] [CrossRef] [Green Version]
  60. Mollah, S.; Quoreshi, A.M.M.S.; Zafirov, G. Equity market contagion during global financial and Eurozone crises: Evidence from a dynamic correlation analysis. J. Int. Financ. Mark. Inst. Money 2016, 41, 151–167. [Google Scholar] [CrossRef] [Green Version]
  61. Nguyen, T.H.; Pontell, H.N. Mortgage origination fraud and the global economic crisis. Criminol. Public Policy 2010, 9, 591–612. [Google Scholar] [CrossRef]
  62. Marcellino, M.; Stock, J.H.; Watson, M.W. A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series. J. Econom. 2006, 135, 499–526. [Google Scholar] [CrossRef] [Green Version]
  63. Fundamental Review of the Trading Book. Available online: https://www.bis.org/publ/bcbs265.htm (accessed on 30 August 2021).
  64. Emerging Markets. Available online: https://www.msci.com/documents/10199/c0db0a48-01f2-4ba9-ad01-226fd5678111 (accessed on 30 August 2021).
  65. Trucíos, C.; Hotta, L.K.; Ruiz, E. Robust bootstrap forecast densities for GARCH returns and volatilities. J. Stat. Comput. Simul. 2017, 87, 3152–3174. [Google Scholar] [CrossRef]
  66. Jiménez, I.; Mora-Valencia, A.; Perote, J. Risk quantification and validation for Bitcoin. Oper. Res. Lett. 2020, 48, 534–541. [Google Scholar] [CrossRef]
Figure 1. Price and log-return plots of the top 9 EMs equities in EC-GFC periods.
Figure 1. Price and log-return plots of the top 9 EMs equities in EC-GFC periods.
Mca 26 00063 g001
Figure 2. Price and log-return plots of the top 9 EMs equities in PC period.
Figure 2. Price and log-return plots of the top 9 EMs equities in PC period.
Mca 26 00063 g002
Table 1. Summary statistic of top 9 EMs equities.
Table 1. Summary statistic of top 9 EMs equities.
ChinaS. KoreaTaiwanIndiaBrazilS. AfricaRussiaMexicoThailand
EC-GFC periods
In-sample: 5 January 2007 to 18 April 2011
Mean0.00030.00030.00010.00030.00050.0002−0.00020.00010.0006
Variance0.00050.00060.00030.00050.00080.00050.00090.00040.0004
Skewness0.03−0.13–0.200.19−0.34−0.26−0.400.02−0.59
Excess kurtosis5.0217.112.406.897.394.3113.796.466.17
Normtest.W*0.940.860.960.940.900.950.850.910.94
Observations111711171117111711171117111711171117
Out-of-sample: 19 April 2011 to 7 June 2013
Mean−0.0003−0.0002−0.0001−0.0004−0.0008−0.0003−0.00070.0000.0003
Variance0.00020.00030.00020.00020.00030.00030.00030.00020.0002
Skewness−0.077−0.248−0.1670.030−0.401−0.082−0.477−0.5330.034
Excess kurtosis2.8962.4571.9311.3342.8151.5622.6423.7952.959
Normtest.W*0.9590.9650.9700.9850.9710.9820.9630.9610.967
Observations559559559559559559559559559
Post-crises period
In-sample: 10 June 2013 to 21 July 2017
Mean0.00020.00010.00020.0002−0.00030.0001−0.0002−0.0002−0.0001
Variance0.00020.00010.00010.00010.00040.00030.00040.00020.0002
Skewness−0.17−0.16−0.15−0.510.18−0.25−0.03−0.60−0.07
Excess kurtosis3.071.452.314.221.822.947.264.973.87
Normtest.W*0.960.980.970.950.980.970.930.960.95
Observations990990990990990990990990990
Out-of-sample: 22 July 2017 to 18 February 2019
Mean0.00030.00010.00010.00010.0004−0.00020.0001−0.00030.0004
Variance0.00010.00010.00010.00010.00030.00030.00020.00020.0001
Skewness−0.12−0.36−0.96−0.37−1.26−0.22−1.82−0.57−0.09
Excess kurtosis0.571.716.980.8712.681.2117.033.082.23
Normtest.W*0.990.980.930.990.920.990.910.970.96
Observations497497497497497497497497497
Note: Normtest.W* indicate that normality is rejected at all levels of significance. S. Korea and S. Africa denote South Korea and South Africa, respectively.
Table 2. Summary statistic of EM index.
Table 2. Summary statistic of EM index.
MeanVarianceSkewnessExcess KurtosisNormtest.W*Observations
EC-GFC periods
In-sample: 5 January 2007 to 18 April 2011
0.00020.0003−0.41596.32060.921117
Out-of-sample: 19 April 2011 to 7 June 2013
−0.00030.0001−0.38983.41020.96559
Post-crises period
In-sample: 10 June 2013 to 21 July 2017
−0.00010.0001−0.29121.93010.98990
Out-of-sample: 22 July 2017 to 18 February 2019
0.00020.0001−0.59111.08840.98497
Note: Normtest.W* indicate that normality is rejected at all levels of significance.
Table 3. SSM of univariate GAS (VaR, ES) model forecasts per market.
Table 3. SSM of univariate GAS (VaR, ES) model forecasts per market.
ModelRankR,Mtip-ValueR,MLoss ModelRankR,Mtip-ValueR,MLoss
Eurozone and Global Financial Crises (EC-GFC) Periods:19 April 2011 to 7 June 2013
Brazil 1% Brazil 2.5%
SNORM2−1.981.00−3.05SNORM3−1.431.00−3.16
STD3−1.501.00−2.93STD1−2.561.00−3.16
SSTD1−2.231.00−2.97SSTD2−2.491.00−3.13
AST61.810.11−2.51AST61.950.08−2.89
AST151.810.11−2.51AST151.950.08−2.89
ALD4−1.121.00−2.96ALD4−1.151.00−3.13
p-value0.105 p-value0.084
Mexico 1% Mexico 2.5%
SNORM2−1.321.00−3.17SNORM4−0.771.00−3.32
STD40.131.00−3.05STD2−1.171.00−3.33
SSTD1−2.961.00−3.13SSTD1−3.471.00−3.32
AST61.430.29−2.93AST61.680.22−3.21
AST151.430.29−2.93AST151.680.22−3.21
ALD3−0.931.00−3.15ALD3−0.871.00−3.32
p-value0.292 p-value0.223
Russia 1% Russia 2.5%
SNORM2−1.111.00−2.69SNORM2−0.211.00−2.88
STD31.080.44−2.60STD30.540.83−2.86
SSTD42.060.06−2.54SSTD41.890.10−2.82
ALD1−1.501.00−2.76ALD1−1.781.00−2.93
p-value0.059 p-value0.095
South Africa 1% South Africa 2.5%
SNORM1−0.961.00−2.92SNORM31.540.18−3.03
STD30.560.86−2.86STD2−0.161.00−3.07
SSTD41.190.43−2.85ALD1−1.101.00−3.10
ALD2−0.661.00−2.93
p-value0.425 p-value0.180
China 1% China 2.5%
SNORM1−0.521.00−3.06SNORM31.030.44−3.21
STD3−0.271.00−3.04STD2−0.301.00−3.24
SSTD41.410.30−2.98ALD1−0.571.00−3.25
ALD2−0.341.00−3.05
p-value0.300 p-value0.443
India 1% India 2.5%
SNORM40.230.97−2.90SNORM40.860.62−3.08
STD1−5.011.00−3.17STD1−5.551.00−3.33
SSTD2−3.921.00−3.08SSTD2−4.111.00−3.22
AST62.170.06−2.66AST62.620.02−2.95
AST152.170.06−2.66AST152.620.02−2.95
ALD3−1.311.00−3.06ALD3−2.661.00−3.28
p-value0.061 p-value0.016
South Korea 1% South Korea 2.5%
SNORM4−0.861.00−2.87SNORM4−0.981.00−3.05
STD1−2.951.00−2.99STD1−3.531.00−3.14
SSTD2−1.731.00−2.88SSTD3−1.531.00−3.04
AST61.980.09−2.52AST62.430.03−2.81
AST151.980.09−2.52AST152.430.03−2.81
ALD3−1.261.00−2.95ALD2−1.581.00−3.09
p-value0.087 p-value0.031
Taiwan 1% Taiwan 2.5%
SNORM3−1.361.00−3.12SNORM3−1.261.00−3.28
STD1−3.521.00−3.08STD1−4.681.00−3.31
SSTD4−1.311.00−2.89SSTD4−1.211.00−3.16
AST62.030.06−2.25AST62.500.02−2.78
AST152.030.06−2.25AST152.500.02−2.78
ALD2−2.021.00−3.09ALD2−3.081.00−3.32
p-value0.064 p-value0.022
Thailand 1% Thailand 2.5%
SNORM40.740.80−2.96SNORM61.320.37−3.17
STD1−4.271.00−3.20STD1−5.551.00−3.41
SSTD2−2.491.00−3.13SSTD2−2.871.00−3.34
AST61.080.58−2.93AST51.020.55−3.20
AST151.080.58−2.93AST141.020.55−3.20
ALD3−0.361.00−3.07ALD3−0.281.00−3.28
p-value0.584 p-value0.367
Post−crises (PC) period:22 July 2017 to 18 February 2019
Brazil 1% Brazil 2.5%
SNORM2−1.621.00−2.59SNORM4−0.851.00−2.95
STD4−0.911.00−2.57STD1−3.301.00−3.02
SSTD1−1.811.00−2.60SSTD3−1.091.00−2.96
AST62.170.06−2.32AST62.050.06−2.75
AST152.170.06−2.32AST152.050.06−2.75
ALD3−0.931.00−2.64ALD2−1.141.00−2.98
p-value0.058 p-value0.062
Mexico 1% Mexico 2.5%
SNORM40.840.72−2.91SNORM40.840.74−3.26
STD1−3.261.00−3.18STD1−3.741.00−3.41
SSTD30.011.00−3.02SSTD3−0.711.00−3.34
AST61.110.54−2.92AST61.450.35−3.23
AST151.110.54−2.92AST151.450.35−3.23
ALD2−1.091.00−3.17ALD2−1.621.00−3.40
p-value0.536 p-value0.349
Russia 1% Russia 2.5%
SNORM4−0.321.00−2.75SNORM40.260.97−3.08
STD2−2.061.00−2.82STD1−3.941.00−3.22
SSTD1−2.991.00−2.82SSTD2−3.241.00−3.20
AST61.200.40−2.48AST61.030.54−3.01
AST151.200.40−2.48AST151.030.54−3.01
ALD3−0.561.00−2.79ALD3−0.611.00−3.16
p-value0.402 p-value0.536
South Africa 1% South Africa 2.5%
SNORM3−0.771.00−2.72SNORM30.011.00−2.97
STD1−3.821.00−2.81STD1−3.481.00−3.06
SSTD4−0.311.00−2.63SSTD42.190.06−2.87
AST62.160.06−2.37ALD2−0.461.00−2.99
AST152.160.06−2.37
ALD2−1.491.00−2.78
p-value0.063 p-value0.059
China 1% China 2.5%
SNORM2−0.911.00−3.40SNORM4−1.581.00−3.50
STD3−0.151.00−3.38STD1−4.801.00−3.55
SSTD1−1.121.00−3.41SSTD3−1.581.00−3.50
ALD41.380.26−3.31AST62.780.01−3.25
AST152.780.01−3.25
ALD2−1.691.00−3.48
p-value0.264 p-value0.010
India 1% India 2.5%
SNORM2−1.241.00−3.53SNORM4−0.721.00−3.67
STD1−3.211.00−3.59STD1−3.111.00−3.75
SSTD3−1.211.00−3.52SSTD3−0.801.00−3.67
AST51.920.09−3.18AST61.950.09−3.47
AST161.920.09−3.18AST151.950.09−3.47
ALD4−1.101.00−3.51ALD2−1.951.00−3.71
p-value0.08 p-value0.094
South Korea 1% South Korea 2.5%
SNORM3−0.401.00−3.18SNORM3−0.781.00−3.42
STD41.920.09−3.02STD42.080.06−3.30
SSTD1−1.771.00−3.21SSTD2−1.221.00−3.42
ALD2−1.181.00−3.26ALD1−1.971.00−3.48
p-value0.093 p-value0.063
Taiwan 1% Taiwan 2.5%
SNORM4−0.941.00−3.04SNORM4−1.421.00−3.44
STD1−2.101.00−3.13STD1−2.611.00−3.48
SSTD3−1.211.00−3.06SSTD3−1.491.00−3.45
AST51.730.14−2.56AST62.070.06−3.08
AST161.730.14−2.56AST152.070.06−3.08
ALD2−2.061.00−3.15ALD2−1.971.00−3.48
p-value0.140 p-value0.065
Thailand 1% Thailand 2.5%
SNORM4−0.241.00−3.55SNORM41.050.47−3.67
STD1−4.421.00−3.75STD1−5.341.00−3.95
SSTD2−2.801.00−3.64SSTD2−2.611.00−3.83
AST61.520.19−3.26AST61.440.24−3.63
AST151.520.19−3.26AST151.440.24−3.63
ALD3−0.861.00−3.60ALD3−1.061.00−3.81
p-value0.188 p-value0.245
Eurozone and Global Financial Crises (EC-GFC) Periods:19 April 2011 to 7 June 2013
EM index 1% EM index 2.5%
ALD1−6.031.00−0.02ALD1−5.841.00−0.02
p-value0.000 p-value0.000
Post−crises (PC) period:22 July 2017 to 18 February 2019
EM index 1% EM index 2.5%
ALD1−6.001.00−0.024ALD1−5.921.00−0.02
p-value0.000 p-value0.000
Note: (VaR, ES) models are of the GAS(1,1) specification. SNORM, STD, SSTD, ALD, AST and AST1 denote Skewed Gaussian, Student t, Skewed Student t, asymmetric Laplace, asymmetric student-t with two tail decay parameters and asymmetric student-t with one tail decay parameter innovations in the models, respectively. Eliminated models are not listed since they can easily be inferred from the SSM listed. ti denotes the test statistic derived from sample loss of the i t h model relative to the average across models in M * (Hansen et al. [9]). Values in bold print are overall p-value for the respective SSM (selected at the 95% confidence level).
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Owusu Junior, P.; Alagidede, I.P.; Tiwari, A.K. On the Elicitability and Risk Model Comparison of Emerging Markets Equities. Math. Comput. Appl. 2021, 26, 63. https://doi.org/10.3390/mca26030063

AMA Style

Owusu Junior P, Alagidede IP, Tiwari AK. On the Elicitability and Risk Model Comparison of Emerging Markets Equities. Mathematical and Computational Applications. 2021; 26(3):63. https://doi.org/10.3390/mca26030063

Chicago/Turabian Style

Owusu Junior, Peterson, Imhotep Paul Alagidede, and Aviral Kumar Tiwari. 2021. "On the Elicitability and Risk Model Comparison of Emerging Markets Equities" Mathematical and Computational Applications 26, no. 3: 63. https://doi.org/10.3390/mca26030063

Article Metrics

Back to TopTop