Next Article in Journal
Information and Self-Organization II: Steady State and Phase Transition
Next Article in Special Issue
A New First-Order Integer-Valued Autoregressive Model with Bell Innovations
Previous Article in Journal
Two Chebyshev Spectral Methods for Solving Normal Modes in Atmospheric Acoustics
Previous Article in Special Issue
Ordinal Pattern Dependence in the Context of Long-Range Dependence
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A New Overdispersed Integer-Valued Moving Average Model with Dependent Counting Series

School of Statistics, Southwestern University of Finance and Economics, Chengdu 611130, China
*
Author to whom correspondence should be addressed.
Entropy 2021, 23(6), 706; https://doi.org/10.3390/e23060706
Submission received: 30 April 2021 / Revised: 28 May 2021 / Accepted: 31 May 2021 / Published: 2 June 2021
(This article belongs to the Special Issue Time Series Modelling)

Abstract

:
A new integer-valued moving average model is introduced. The assumption of independent counting series in the model is relaxed to allow dependence between them, leading to the overdispersion in the model. Statistical properties were established for this new integer-valued moving average model with dependent counting series. The Yule–Walker method was applied to estimate the model parameters. The estimator’s performance was evaluated using simulations, and the overdispersion test of the INMA(1) process was applied to examine the dependence between counting series.

1. Introduction

Integer-valued time series can be encountered in numerous fields, such as epidemiology, insurance, and intraday stock transitions. The most widely used model is the integer-valued autoregressive (INAR) model, a recursive model first introduced by Alzaid and Al-Osh [1] and is similar to the traditional autoregressive (AR) model. Du and Li [2] generalized the model to the p-th order (which was called INAR(p) model) and proved the ergodic and Markov properties of the model. Similar to the continuous-valued moving average model, the q-th order integer-valued moving average model INMA(q) was introduced by Al-Osh and Alzaid [3], which is a slightly different form proposed by McKenzie [4].
Many researchers generalize the INAR model to deal with different real-life situations. Weiß [5] presented a new INAR(p) model showing possible marginal distributions of the DSD family. This model overcomes the difficulty of choosing the appropriate marginal distribution. Monteiro and Scotto [6] defined the periodic integer-valued autoregressive model, driven by a periodic sequence of independent Poisson-distributed random variables. Weiß [7] proposed the extended Poisson INAR(1) model, where the innovations are assumed to be serially dependent. Zhu [8] introduced a negative binomial INGARCH model to handle integer-valued time series with overdispersion and potential extreme observations. The study by Weiß [9] discussed threshold models for integer-valued time series with infinite range and briefly discussed new models for counting data time series with a finite range. Kang and Wang [10] generalized the mixture INAR(1) model based on mixing Pegram and binomial thinning operator. Li and Wang [11] proposed the first-order mixed integer-valued autoregressive process with zero-inflated generalized power series innovations, which contains the commonly used zero-inflated Poisson and geometric distributions. To handle the non-stationary integer-valued time series with a large dispersion, Kim and Park [12] introduced an integer-valued autoregressive process with a signed binomial thinning operator (INARS(p)).
Various modified thinning operators have been proposed to capture the specificity of real data, and many new INAR-type models have been defined. For example, Zheng and Basawa [13] introduced the random coefficient thinning operator while Ristić and Bakouch [14] proposed the negative binomial thinning operator. The pth-order integer-valued autoregressive process with signed generalized power series thinning operator was proposed by Zhang et al. [15].
The most significant generalization of the thinning operator was made by Ristić et al. [16] which they called the dependent Bernoulli thinning operator. They constructed the new sequence of the Bernoulli random variable allowing correlation between counting series. Based on this, Miletić Ilić et al. [17] proposed the new model, based on the mix of regular binomial thinning and dependent thinning operator. For more details of thinning operators, refer to Weiß [18].
MA-type models are very important in time series analysis. The method of moving average is generally popular in statistical and mathematical analyses. Some researchers study forecasting using the moving average method. Winters [19] analyzed the exponentially weighted moving average method for forecasting sales. Cox [20] proposed the weighted moving average method to predict the Markov series. Landauskas et al. [21] introduced an algebraic approach to select the appropriate weight coefficients for weight moving averages performing better than classical moving average predictors. Wind speed prediction using combined time series model and neural network prediction was studied by Nan et al. [22]. Other applied weight moving average methods in control charts. Alevizakos et al. [23] proposed the triple exponentially weighted moving average control chart (TEWMA), which improves the detection ability of the classical control chart. Capizzi and Masarotto [24] proposed the adaptive exponentially weighted moving average control chart (AEWMA), which weights past observations of the monitored process using a suitable function of the current error. Adegoke et al. [25] studied the multivariate homogeneously weighted moving average (MHWMA) control chart for monitoring a process mean vector.
Some researchers constructed MA-type models from the perspective of count time series. Brännäs and Quoreshi [26] used the INMA process to model the number of transactions for intraday stocks and extended the model to include explanatory variables. Brännäs and Hall [27] mainly focused on the estimation in the INMA model. The construction of the thinning operation from these studies is based on independent counting series, which is a strong assumption. Thus, to make the model more flexible in capturing the specificity of different data types, this assumption should be relaxed.
For small counts of intraday transactions in stocks per minute, the decision of buyer or seller could be affected by the public news, which means decisions from different individuals may not be uncorrelated. The change in inventories can sometimes be described as an INMA process. However, during a certain period, the change can be influenced by the same external factor. For the INMA model applying a discrete risk model, the number of claims for certain insurance will be affected by the same factor, such as natural disasters. Thus, these claims are no longer independent. The independence between counting series should be relaxed. Allowing the correlation between counting series is natural, and therefore the INMA model based on dependent counting series can be derived to handle different real data situations.
The rest paper is organized as follows. Section 2 presents the model construction and discussions on some relevant statistical properties, and Section 3 discussed the estimation of unknown parameters. Section 4 shows the numerical simulation results and give dispersion test for dependence between counting series, while the conclusions are given in Section 5.

2. The Model and Basic Properties

2.1. The Model Construction

The counting series { U } i N of the integer-valued model is defined as:
U i = ( 1 V i ) W i + V i Z
{ W } i N is a sequence of i . i . d random variable with W i B ( 1 , β ) , β [ 0 , 1 ] . { V } i N is a sequence of i . i . d random variable with V i B ( 1 , θ ) , θ [ 0 , 1 ] . Z is a random variable with Z B ( 1 , β ) . The operator θ is defined by β θ ε t = i = 1 ε t U i , it is the dependent Bernoulli thinning operator, where ε t is a non-negative integer-valued random variable. Based on this construction, we can easily verify that E ( U i ) = β , V a r ( U i ) = β ( 1 β ) , c o r r ( U i , U j ) = θ 2 , which has promising dependence between the counting series. Now we generalize the dependent count series to the INMA(q) process, For convenience, we use ∘ instead of θ to simplify the notation.
Definition 1
(Dependent Counting series Integer-valued Moving Average Model (DCINMA)). The DCINMA(q) model is defined as:
X t = ε t + β 1 ε t 1 + + β q ε t q
β j ε t j , j = 1 , 2 , , q is the dependent Bernoulli thinning operator, and the following conditions should be satisfied.
A1. { ε t } t N is a sequence of i. i. d non-negative random variables.
A2. The counting variable { U i } i N is independent of ε t for any i , t .
A3. β j ε t j , for any j = 1 , 2 , , q are mutually independent.

2.2. The Numerical Properties for DCINMA(q) Model

We denote μ ε and σ ε 2 as the mean and variance of term ε t .
Theorem 1.
The numerical characteristics of { X t } in Definition 1 are as follows:
(i) 
E ( X t ) = μ ε ( 1 + i = 1 q β i )
(ii) 
V a r ( X t ) = σ ε 2 + i = 1 q [ μ ε β i + μ ε 2 θ 2 β i ( 1 β i ) μ ε ( θ 2 β i θ 2 β i 2 + β i 2 ) + β i 2 σ ε 2 ]
(iii) 
c o v ( X t , X t k ) = σ ε 2 i = 0 q k β i β i + k k = 1 , , q 0 k q + 1
Proof. 
See Appendix A. ☐
Theorem 2.
{ X t } is the process defined in Definition 1, then { X t } is a covariance stationary process.
Proof. 
It can be seen from the Theorem 1 that the unconditional mean and unconditional variance of X t is a finite constant given the distribution of ε t . Thus, X t is a stationary process. ☐
Theorem 3.
{ X t } is the process defined in Definition 1, then { X t } is ergodic in mean and autocovariance function.
Proof. 
See Appendix A. ☐

2.3. The Probability Generating Functions for DCINMA Model

Ristić et al. [16] derived the probability generating function of the i = 1 n U i as follows:
Φ U = E [ s ( U 1 + U 2 + + U n ) ] = ( 1 β ) ( 1 β ( 1 θ ) ( 1 s ) ) n + β ( 1 ( β + θ β θ ) ( 1 s ) ) n
The above equation implies that the term i = 1 n U i has a distribution of:
U 1 + U 2 + + U n = B i n ( n , β ( 1 θ ) ) w . p 1 β B i n ( n , β + θ β θ ) w . p β
Then the probability generating function (PGF) of { X t } is:
ϕ X n ( s ) = [ ( 1 β ) · ϕ ε ( 1 β ( 1 θ ) ( 1 s ) ) + β · ϕ ε ( 1 ( β + θ β θ ) ( 1 s ) ) ] · ϕ ε ( s )
ϕ ε ( s ) is the probability generating function of the ε t . Given the distribution of ε t , the explicit expression of the probability generating function can be derived. Suppose Poisson distribution of ε t , then
ϕ X n ( s ) = [ ( 1 β ) · e λ β ( 1 θ ) ( 1 s ) + β e λ ( β + θ β θ ) ( 1 s ) ] · e ( λ ( s 1 ) )
The probability generating function is defined by the probabilities. The uniqueness of a power series expansion implies that the probability generating function in turn defines probabilities.
Therefore, we can derive the probability of { X t } . For X t = j , the probability mass function of X t is:
P ( X t = j ) = [ 1 j ! d j ϕ ( s ) d s j ] s = 0
The bivariate probability generating function of { X t } is Φ X t , X t 1 ( s 1 , s 2 ) . Thus, deriving the explicit expression of bivariate probability generating function with Poisson innovation is easy for DCINMA(1) process.
E ( s 1 X t s 2 X t 1 ) = E ( s 1 β ε t 1 + ε t · s 2 β ε t 2 + ε t 1 ) = E ( s 1 β ε t 1 · s 1 ε t · s 2 β ε t 2 · s 2 ε t 1 ) = E ( s 1 ε t ) · E ( s 1 β ε t 2 ) · E ( s 1 β ε t 2 · s 2 ε t 1 )
Given the Poisson distribution of the innovation term, we can obtain:
E ( s 1 ε t ) = e λ ( s 1 1 ) , E ( s 2 β ε t 1 ) = ( 1 β ) · e λ β ( 1 θ ) ( 1 s 2 ) + β · e λ ( β + θ β θ ) ( 1 s 2 )
E ( s 1 β ε t 1 · s 2 ε t 1 ) = ( 1 β ) · e λ s 2 [ 1 β ( 1 θ ) ( 1 s 2 ) ] + β · e λ s 2 [ ( 1 β θ β θ ) ( 1 s 1 ) ] .

2.4. Compare with the INMA(q) Model

The mean and the covariance of the q-th order integer-valued moving average model has the same expression, and the variance of the INMA(q) process is:
V i n m a = σ ε 2 + i = 1 q [ σ ε 2 β i + μ ε β i ( 1 β i ) ]
From Theorem 1, the variance of the DCINMA process presents a more complicated expression than the INMA(q) process due to the correlation between the counting series of parameter θ . For the Poisson innovation, the overdispersion index of the INMA and DCINMA model is as follows:
I i n m a = 1 , I d i n m a = 1 + β + β λ θ 2 ( 1 β ) 1 + β
Since the value of λ , β and θ are all non-negative, the term 1 + β λ θ 2 ( 1 β ) > 1 . When two models (INMA(1) and DCINMA(1)) share the same λ and β , the θ will determine whether there is dependence between counting series ( θ 0 ). Thus, if we want to test θ = 0 , it is equivalent to evaluating whether the model is overdispersed. If the value of θ is 0, the model degenerates to INMA model.

2.5. Compare the Entropy with INMA(1) Model

Entropy is an important concept in physics, but it can also be applied to other disciplines, including cosmology and economics. Entropy is a measure of the randomness or disorder of a system. In our case, entropy can be seen as a dispersion measure for the model. Thus, we evaluate the model from the perspective of entropy. The definition of Shannon entropy as follows:
H ( Y ) = i = 1 n p ( y i ) · l n p ( y i )
where Y is a discrete random variable with probability mass function taking values on y 1 , , y n . We denote the ϕ d i n m a ( s ) and ϕ i n m a ( s ) as probability generating functions of the DCINMA(1) and INMA(1) process, respectively. Suppose the same innovation term for the two models follows the Poisson distribution. We can rewrite the probability generating function of them as:
ϕ d i n m a ( s ) = ( 1 β ) · e ( s 1 ) · [ λ β ( 1 θ ) + λ ] + β · e ( s 1 ) · [ λ ( β + θ β θ + λ ) ] ϕ i n m a ( s ) = e ( s 1 ) · ( λ β + λ )
Thus, we can conclude the distribution of DCINMA(1) and INMA(1) process based on the definition of the probability generating function. X t i n m a ( 1 ) and X t d i n m a ( 1 ) denote the sample from INMA(1) model and DCINMA(1) model.
X t i n m a ( 1 ) P o i ( λ β + λ ) X t d i n m a ( 1 ) P o i ( λ β ( 1 θ ) + λ ) w . p 1 β P o i ( λ ( β + θ β θ ) + λ ) w . p β
The Shannon entropy for both models can be derived as follows:
H ( X t i n m a ( 1 ) ) = ( λ β + λ ) [ 1 l o g ( ( λ β + λ ) ) ] + e ( λ β + λ ) · k = 0 ( λ β + λ ) k l o g ( k ! ) k ! H ( X t d i n m a ( 1 ) ) = ( 1 β ) · { ( λ β ( 1 θ ) + λ ) [ 1 l o g ( ( λ β ( 1 θ ) + λ ) ) ] + e ( λ β ( 1 θ ) + λ ) · k = 0 ( λ β ( 1 θ ) + λ ) k l o g ( k ! ) k ! } + β · { ( λ ( β + θ β θ ) + λ ) [ 1 l o g ( ( λ ( β + θ β θ ) + λ ) ) ] + e ( λ ( β + θ β θ ) + λ ) · k = 0 ( λ ( β + θ β θ ) + λ ) k l o g ( k ! ) k ! }
The expression of entropy for the DCINMA(1) model is more complicated than the INMA(1) model due to the additional parameter θ .

3. Parameter Estimation

The estimation of the INMA model is complicated. Brännäs and Hall [27] discussed the Yule–Walker estimator, generalized moment method (GMM) based on the probability generating function (PGF) function, and the conditional least square method. Here, we did not attempt to use maximum likelihood estimation, which requires density functions that are generally not easily obtained in the INMA model, especially for this dependent situation. The results of generalized moments method-based probability generating function (PGF) function estimator are highly correlated with the values of z 1 and z 2 in Φ k ( z 1 , z 2 ) , which are not stable. On the other hand, for the conditional least square method, the number of estimation equations are less than the number of parameters. This means that there is an additional parameter θ to be estimated.
Therefore, we derive the Yule–Walker estimator to obtain the unknown parameters for the Poisson DCINMA(q) model. We denote the following symbols: μ X is the sample mean of { X t } , μ ε is the mean of innovation term ε t . γ 0 is the sample variance of { X t } , γ 1 , γ 2 , , γ q are the sample covariance of 1-th, 2-th,…, q-th order. The β 0 for the equations below is 1.
Then, the unknown parameters in the DCINMA(q) model can be solved by equations through the sample moments function, which is as follows:
μ X = μ ε ( 1 + β 1 + β 2 + + β q ) γ 0 = σ ε 2 + i = 1 q [ μ ε β i + μ ε 2 θ 2 β i ( 1 β i ) μ ε ( θ 2 β i θ 2 β i 2 + β i 2 ) + β i 2 σ ε 2 ] γ 1 = λ ( β 0 β 1 + β 1 β 2 + + β q 1 β q ) γ 2 = λ ( β 0 β 2 + β 1 β 3 + + β q 2 β q ) γ q 1 = λ ( β 0 β q 1 + β 1 β q ) γ q = λ ( β 0 β q )

4. Simulation Study

4.1. Estimation of the Model Parameters

In this section, we present some simulation results to show the performance of the estimator using different sample sizes. ( n = 100 , 300 , 700 , 1000 ). We focused on the Poisson DCINMA(1) model. The three group parameter values considered in this model are as follows:
Model   A : ( λ = 1 ,   θ = 0.6 ,   β = 0.2 ) Model   B : ( λ = 4 ,   θ = 0.7 ,   β = 0.1 ) Model   C : ( λ = 5 ,   θ = 0.5 ,   β = 0.1 )
We used the above parameter groups to generate the data and applied Yule–Walker method, then computed the bias and standard error based on 10,000 replications for each parameter group. The estimation results and their performance are reported in Table 1.
As shown in Table 1, we obtained nearly convergent estimators in all cases. In all cases, as the sample size increased, the bias decreased.

4.2. Testing for Dependence between Counting Series

From Section 2.5, when the two processes have the same λ and β , the DCINMA model always presents overdispersion due to θ . We tested whether the value of θ is 0, which is equivalent to assessing whether the DCINMA process presents overdispersion. Aleksandrov and Weiß [28] proposed the diagnostic test for the INMA process. In this section, only the overdispersion test was applied. Under the null hypothesis H 0 : θ = 0 (the process does not present overdispersion), the distribution of index dispersion has the following form:
I ^ d i s p d N ( 1 1 T 1 + 3 β 1 + β , 1 T ( 2 + 4 ( β 1 + β ) 2 ) )
We then analyzed the simulation results to assess the performance of the overdispersion test. The nominal level α = 0.05 was employed, for sample sizes, n = 100 , 150 , 250 . We did 1000 replications to calculate the size and power of the test. The following parameter groups were considered:
Model   D : ( λ = 3 ,   θ = 0.4 ,   β = 0.5 ) Model   E : ( λ = 5 ,   θ = 0.4 ,   β = 0.3 ) Model   F : ( λ = 6 ,   θ = 0.3 ,   β = 0.4 ) Model   G : ( λ = 7 ,   θ = 0.7 ,   β = 0.8 )
From Table 2, given the same values for λ and β , under the null hypothesis, θ = 0 , the size of I ^ d i s p are close to nominal level. Under the alternative situation, θ 0 , for all cases, as n increase the power quickly increases to 1.

5. Real Data Example

We then applied the proposed model to a real dataset. Unlike the integer-valued autoregressive model, since the density function of this DCINMA process is hard to obtain, the Akaike information criterion (AIC) is difficult to use in measuring the fitness of such an INMA-type model. To assess the performance of the model, we adapted the parametric resampling method by Jung et al. [29].
We used crime data available from the Forecasting Principles site. The data consist of 144 observations of monthly larceny counts for the City of Pittsburgh from January of 1990 to December of 2001. It would be highly improbable for criminals to remain in the same place for a long time. They probably would flee in various directions to commit offenses, so that the INMA-type model is appropriate in this case.
The calculated of sample mean ( 4.73 ) and variance ( 6.40 ) suggest that the dataset is overdispersed. In addition, the sample autocorrelation function (ACF) in Figure 1 shows that the order of the model should be set to one. We fitted the data set into the DCINMA(1) model and INMA(1) model to evaluate the model performance for overdispersed data. The estimation results for the two models are presented in Table 3.
The parametric resampling method can be performed in several steps:
Step 1: Generate samples with length equal to the original dataset from the fitted model for R times.
Step 2: Compute the autocorrelation function (ACF) for each sample series. Then derive the empirical sample autocorrelation function (ACF) for the different lag orders.
Step 3: Using the results from Step 2, compute the 100 ( 1 α / 2 ) and 100 ( α / 2 ) quantiles.
For the given example, R was set to 5000, and α was set to 0.05 . We plotted the acceptance envelope for DCINMA(1) model and INMA(1) model, and the results are shown in Figure 2 and Figure 3. The sample autocorrelations for the real dataset lie within the acceptance envelopes of the DCINMA(1) model except for only one point, while the important second order of the autocorrelation function (ACF) exceed the upper bound of the acceptance envelopes of the INMA(1) model. It is clear that the acceptance envelopes of the DCINMA(1) model performs better than the acceptance envelopes of the INMA(1) model. Thus, the proposed model is suitable for this dataset, adequately representing the autocorrelation for real dataset.

6. Conclusions

In this paper, we constructed a new integer-valued moving average model with dependent counting series. The statistical properties of the proposed model were discussed and evaluated. The parameter estimation of the proposed model is based on the Yule–Walker method. The new model presents overdispersion due to the dependence parameter θ , which means the dependence between counting series can be verified by an overdispersion test. Numerical simulation results were used to evaluate the performance of the estimation and overdispersion test.
Future extensions for this study are as follows. First, we only focused on the stationary DCINMA(1) model in this paper. However, cases with non-stationary series are more common. The switched system is an important model in studying hybrid systems, particularly from the perspective of control science and engineering. Refer to ([30,31,32]) for more detailed discussion. The mechanism conducts the transformation between different subsystems, providing an approach to generalize the DCINMA process into a non-stationary case. A function can be introduced to control the change for different parameter values of the stationary case, which characterize non-stationary in series. Second, the parameter θ in our model provides a probability for overdispersion. In a switched system, the switching signal is a piecewise constant function, depending on time, external signal, output, and its own past value. Thus, the weighted switching signal function with weights θ and ( 1 θ ) can be considered, where the weight θ gives the probability for switching to different subsystems.

Author Contributions

Conceptualization, K.Y. and H.W.; methodology, K.Y.; software, H.W.; validation, K.Y. and H.W.; formal analysis, K.Y.; investigation, H.W.; resources, K.Y.; data curation, K.Y.; writing—original draft preparation, H.W.; writing—review and editing, K.Y.; visualization, H.W.; supervision, K.Y.; project administration, K.Y.; funding acquisition, K.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

The data used to support the findings of this study are included within the article.

Acknowledgments

This research was supported by the National Social Science Fund of China (No. 18BTJ039) and Fundamental Research Funds for the Central Universities (No. JBK2102021). In addition, the authors will be grateful for the editor and reviewers’ comments and suggestions, which led to improvements of the paper.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Proof of Theorem 1.
we give the detailed derivation process for 1-th order, the q-th order can be derived in the same manner. term ( i ) and ( i i ) of the Theorem 1 are easy to verify, so we focus on the term ( i i i ) .
V a r ( X t ) = V a r ( β ε t 1 ) + V a r ( ε t ) = V [ E [ β ε t 1 | ε t 1 ] ] + E [ V [ β ε t 1 | ε t 1 ] ] + V a r ( ε t )
Then, we focus on the term V [ β ε t 1 | ε t 1 ] .
V [ β ε t 1 | ε t 1 ] = E [ ( i = 1 ε t 1 U i ) 2 | ε t 1 ] [ E [ i = 1 ε t 1 U i | ε t 1 ] ] 2 = ε t 1 · E [ U 1 2 ] + ( ε t 1 1 ) · ε t 1 · E [ U 1 · U 2 ] [ ε t 1 · β ] 2 = ε t 1 · ( β · ( 1 β ) + β 2 ) + ε t 1 · ( ε t 1 1 ) · ( θ 2 · β · ( 1 β ) + β 2 ) β 2 · ε t 1 2
E [ V [ β ε t 1 | ε t 1 ] ] = ( β · ( 1 β ) + β 2 ) · E [ ε t 1 ] E [ β 2 · ε t 1 2 ] + E [ ε t 1 · ( ε t 1 1 ) ] · ( θ 2 · β · ( 1 β ) + β 2 ) = λ · ( β · ( 1 β ) β 2 ) β 2 · ( λ + λ 2 ) + ( λ + λ 2 λ ) · ( θ 2 · β · ( 1 β ) + β 2 ) = λ 2 · β · ( 1 β ) · θ 2 + β · λ β 2 · λ
V a r ( X t ) = V [ β · ε t 1 ] λ 2 · β · ( 1 β ) · θ 2 + β · λ β 2 · λ + λ = β · λ + λ 2 · β · ( 1 β ) · θ 2 + λ
 ☐
Proof of Theorem 3.
let Y t = X t μ X , { X t } is the process defined in Section 2. To prove the Y t is ergodic in autocovariance function, it is sufficient to show that:
l i m T 1 T l = 0 T { E ( Y t Y t + v Y t + l Y t + v + l ) R 2 ( v ) } = 0
It is obvious E ( Y t i ) < . For i = 1 , 2 , 3 , 4 , let E ( Y t 2 ) = c 2 , E ( Y t 4 ) = c 4 .
The case v = 0 :
E ( Y t Y t + v Y t + l Y t + v + l ) = E ( Y t 2 Y t + l 2 )
If l = 1 ,
E ( Y t Y t + v Y t + l Y t + v + l ) = E ( Y t 2 Y t + l 2 ) ( E ( | Y t 2 | 2 | Y t + l 2 | 2 ) ) 1 / 2 = c 4
If l > 1 , Y t and Y t + l are irrelevant, then
E ( Y t Y t + v Y t + l Y t + v + l ) = E ( Y t 2 Y t + l 2 ) = c 2 2 = γ Y 2 ( 0 ) 1 T l = 0 T { E ( Y t Y t + v Y t + l Y t + v + l ) R 2 ( v ) } 1 T { c 4 γ Y 2 ( 0 ) } 0
The case v 1 :
If l v + 1 :
E ( Y t Y t + v Y t + l Y t + v + l ) [ E ( | Y t Y t + v | 2 | Y t + l Y t + l + v | 2 ] 1 2 [ E ( | Y t | 4 | Y t + v | 4 | Y t + l | 4 | Y t + l + v | 4 ] 1 4 = c 4
If l > v + 1 , Y t Y t + l and Y t + l Y t + l + v are irrelevant, then
E ( Y t Y t + v Y t + l Y t + v + l ) = E ( Y t Y t + v ) E ( Y t + l Y t + l + v ) = R 2 ( v ) 1 T l = 0 T { E ( Y t Y t + v Y t + l Y t + v + l ) R v 2 } 1 T { ( c 4 R 2 ( v ) ) ( v + 1 ) } 0
We can obtain:
l i m T E [ ( R ^ n 2 ( v ) R 2 ( v ) ) 2 ] = 0
Which implies:
R ^ 2 ( v ) p R 2 ( v )
The above equation is holding for variable Y t :
Y t = X t μ X , R ^ Y 2 ( v ) p R Y 2 ( v )
We need to prove that
P ( | R ^ X 2 ( v ) R X 2 ( v ) | ϵ ) 0
Because of R X 2 ( v ) = R Y 2 ( v ) , rewriting the above equation as
P ( | R ^ X 2 ( v ) R X 2 ( v ) | ϵ ) = P ( | R ^ X 2 ( v ) R ^ Y 2 ( v ) + R ^ Y 2 ( v ) R X 2 ( v ) | ϵ ) P ( | R ^ X 2 ( v ) R ^ Y 2 ( v ) | ϵ / 2 ) + P ( | R ^ Y 2 ( v ) R Y 2 ( v ) | ϵ / 2 )
R ^ Y 2 ( v ) and R ^ X 2 ( v ) expressing as
R ^ X 2 ( v ) = 1 T t = 1 T k ( X t + k X ¯ ) ( X t X ¯ ) , R ^ Y 2 ( v ) = 1 T t = 1 T k Y t + k Y t = 1 T t = 1 T k ( X t + k μ X ) ( X t μ X )
Then the following expression can be derived
P ( | R ^ X 2 ( v ) R ^ Y 2 ( v ) | ϵ / 2 ) = P ( ( X ¯ 2 μ X 2 ) + ( μ X X ¯ ) ( X ¯ t + k + X ¯ T ) ϵ / 2 ) P ( X ¯ 2 μ X 2 ε / 4 ) + P ( ( μ X X ¯ ) ( X ¯ t + k + X ¯ T ) ε / 4 )
Since X ¯ p μ X , by Slutsky’s theorem
X ¯ 2 μ X 2 p 0 , ( μ X X ¯ ) ( X ¯ t + k + X ¯ T ) p 0
Consequently,
P ( | R ^ X 2 ( v ) R X 2 ( v ) | ϵ ) 0 , T
 ☐

References

  1. Alzaid, A.A.; Al-Osh, M.A. An integer-valued pth-order autoregressive structure (INAR(p)) process. J. Appl. Probab. 1990, 27, 314–324. [Google Scholar] [CrossRef]
  2. Du, J.; Li, Y. The integer-valued autoregressive (INAR(p)) model. J. Time Ser. Anal. 1991, 12, 129–142. [Google Scholar]
  3. Al-Osh, M.A.; Alzaid, A.A. Integer-valued moving average (INMA) process. Stat. Pap. 1988, 29, 281–300. [Google Scholar] [CrossRef]
  4. McKenzie, E. Some ARMA models for dependent sequences of Poisson count. Adv. Appl. Probab. 1988, 20, 822–835. [Google Scholar] [CrossRef]
  5. Weiß, C.H. The combined INAR(p) models for time series of counts. Stat. Probab. Lett. 2008, 78, 1817–1822. [Google Scholar] [CrossRef]
  6. Monteiro, M.; Scotto, M.G.; Pereira, I. Integer-valued autoregressive processes with periodic structure. J. Stat. Plan. Infer. 2010, 140, 1529–1541. [Google Scholar] [CrossRef] [Green Version]
  7. Weiß, C.H. A Poisson INAR(1) model with serially dependent innovations. Metrika 2015, 78, 829–851. [Google Scholar] [CrossRef]
  8. Zhu, F. Modeling time series of counts with com-poisson INGARCH models. Math. Comput. Model. 2012, 56, 191–203. [Google Scholar] [CrossRef]
  9. Möller, T.; Weiß, C.H. Threshold models for integer-valued time series with infinite or finite range. In Stochastic Models, Statistics and Their Applications; Steland, A., Rafajłowicz, E., Szajowski, K., Eds.; Springer: Geneva, Switzerland, 2015; pp. 327–334. [Google Scholar]
  10. Yao, K.; Wang, D. A new INAR(1) process with bounded support for counts showing equidispersion, underdispersion and overdispersion. Stat. Pap. 2019, 62, 745–767. [Google Scholar]
  11. Li, C.; Wang, D. First-order mixed integer-valued autoregressive processes with zero-inflated generalized power series innovations. J. Korean Stat. Soc. 2015, 44, 232–246. [Google Scholar] [CrossRef]
  12. Kim, H.Y.; Park, Y. A non-stationary integer-valued autoregressive model. Stat. Pap. 2008, 49, 485. [Google Scholar] [CrossRef]
  13. Zheng, H.; Basawa, I.V. Inference for pth-order random coefficient integer-valued autoregressive processes. J. Time Ser. Anal. 2006, 27, 411–440. [Google Scholar] [CrossRef]
  14. Ristić, M.M.; Bakouch, H.S. A new geometric first-order integer-valued autoregressive (NGINAR(1)) process. J. Stat. Plan. Infer. 2009, 139, 2218–2226. [Google Scholar] [CrossRef]
  15. Zhang, H.; Wang, D.; Zhu, F. Inference for INAR(p) processes with signed generalized power series thinning operator. J. Stat. Plan. Infer. 2010, 140, 667–683. [Google Scholar] [CrossRef]
  16. Ristić, M.M.; Nastić, A.S.; Miletić Ilić, A.V. A geometric time series model with dependent Bernoulli counting series. J. Time Ser. Anal. 2013, 34, 466–476. [Google Scholar] [CrossRef]
  17. Miletić Ilić, A.V.; Ristić, M.M.; Nastić, A.S.; Bakouch, H.S. An INAR(1) model based on a mixed dependent and independent counting series. J. Stat. Comput. Simul. 2018, 88, 290–304. [Google Scholar] [CrossRef]
  18. Weiß, C.H. Thinning operations for modeling time series of counts—A survey. Adv. Appl. Probab. 2008, 92, 319. [Google Scholar] [CrossRef]
  19. Winters, P.R. Forecasting sales by exponentially weighted moving averages. Manag. Sci. 1960, 6, 231–362. [Google Scholar] [CrossRef]
  20. Cox, D.R. Prediction by exponentially weighted moving averages and related methods. J. R. Stat. Soc. Ser. B-Stat. Methodol. 1961, 23, 414–422. [Google Scholar] [CrossRef]
  21. Landauskas, M.; Navickas, Z.; Vainoras, A.; Ragulskis, M. Weighted moving averaging revisited—An algebraic approach. Comput. Appl. Math. 2017, 36, 1545–1558. [Google Scholar] [CrossRef]
  22. Nan, X.; Li, Q.; Qiu, D.; Zhao, Y.; Guo, X. Short-term wind speed syntheses correcting forecasting model and its application. Int. J. Electr. Power Energy Syst. 2013, 49, 264–268. [Google Scholar] [CrossRef]
  23. Alevizakos, V.; Chatterjee, K.; Koukouvinos, C. The triple exponentially weighted moving average control chart. Qual. Technol. Quant. Manag. 2021, 18, 326–354. [Google Scholar] [CrossRef]
  24. Capizzi, G.; Masarotto, G. An adaptive exponentially weighted moving average control chart. Technometrics 2003, 45, 199–207. [Google Scholar] [CrossRef] [Green Version]
  25. Adegoke, N.A.; Abbasi, S.A.; Smith, A.N.H.; Anderson, M.J.; Pawley, M.D.M. A multivariate homogeneously weighted moving average control chart. IEEE Access 2019, 7, 9586–9597. [Google Scholar] [CrossRef]
  26. Brännäs, K.; Quoreshi, A.M.M.S. Integer-valued moving average modelling of the number of transactions in stocks. Appl. Financ. Econ. 2010, 20, 1429–1440. [Google Scholar] [CrossRef]
  27. Brännäs, K.; Hall, A. Estimation in integer-valued moving average models. Appl. Stoch. Models. Bus. Ind. 2001, 17, 277–291. [Google Scholar] [CrossRef]
  28. Aleksandrov, B.; Weiß, C.H. Parameter estimation and diagnostic tests for INMA(1) processes. Test 2019, 29, 196–232. [Google Scholar] [CrossRef]
  29. Jung, R.C.; McCabe, P.M.; Tremayne, A.R. Model validation and diagnostics. In Handbook of Discrete-Valued Time; Davis, R.A., Holan, S.H., Lund, R., Ravishanker, N., Eds.; Chapman & Hall/CRC Press: Boca Raton, FL, USA, 2015; pp. 189–218. [Google Scholar]
  30. Liberzon, D.; Morse, A.S. Basic problems in stability and design of switched systems. IEEE Control Syst. Mag. 1999, 19, 59–70. [Google Scholar]
  31. Blanchini, F.; Miani, S. Set-Theoretic Methods in Control, 2nd ed.; Birkhäuser: Basle, Switzerland, 2015. [Google Scholar]
  32. Jin, C.; Wang, R.; Wang, Q. Stabilization of switched systems with time-dependent switching signal. J. Frankl. Inst.-Eng. Appl. Math. 2020, 357, 13552–13568. [Google Scholar] [CrossRef]
Figure 1. Time series plot (top figure) and autocorrelation function (below figure panel) for actual Larceny dataset.
Figure 1. Time series plot (top figure) and autocorrelation function (below figure panel) for actual Larceny dataset.
Entropy 23 00706 g001
Figure 2. Acceptance envelope of the DCINMA(1) model for the autocorrelation function for the larceny dataset.
Figure 2. Acceptance envelope of the DCINMA(1) model for the autocorrelation function for the larceny dataset.
Entropy 23 00706 g002
Figure 3. Acceptance envelope of the INMA(1) model for the autocorrelation function for the larceny dataset.
Figure 3. Acceptance envelope of the INMA(1) model for the autocorrelation function for the larceny dataset.
Entropy 23 00706 g003
Table 1. Some numerical results of the estimates for true values of the parameters λ , θ and β .
Table 1. Some numerical results of the estimates for true values of the parameters λ , θ and β .
Sample Size λ ^ θ ^ β ^
(a) True values: λ = 1, θ = 0.6, β = 0.2
1000.98750.59990.2641
Bias0.01240.0001−0.0641
Standard Error0.17550.20650.1705
3000.98580.61920.2627
Bias0.0141−0.0192−0.0627
Standard Error0.10820.20490.1085
7000.98310.64890.2663
Bias0.0168−0.0489−0.0663
Standard Error0.06990.19220.0717
10000.98170.67180.2684
Bias0.0182−0.0718−0.0684
Standard Error0.05970.18290.0600
(b) True values: λ = 4, θ = 0.7, β = 0.1
1003.78160.61730.1690
Bias0.21830.0826−0.0690
Standard Error0.52960.20310.1353
3003.88720.66110.1394
Bias0.11270.0388−0.0394
Standard Error0.33640.17670.0855
7003.91230.72080.1324
Bias0.0876−0.0208−0.0324
Standard Error0.23370.13530.0599
10003.91440.74300.1322
Bias0.0855−0.0430−0.0322
Standard Error0.20120.11420.0514
(c) True values: λ = 5, θ = 0.5, β = 0.1
1004.77990.57090.1556
Bias0.2200−0.0709−0.0556
Standard Error0.57770.20590.1142
3004.91290.57030.1279
Bias0.0870−0.0703−0.0279
Standard Error0.37150.18520.0730
7004.93430.56880.1243
Bias0.0656−0.0688−0.0243
Standard Error0.26150.15290.0520
10004.93400.57380.1245
Bias0.0659−0.0738−0.0245
Standard Error0.22110.13300.0442
Table 2. Size and power of DCINMA(1) and INMA(1) model.
Table 2. Size and power of DCINMA(1) and INMA(1) model.
λ β θ n
100250500
30.400.0540.0570.058
0.50.4310.8770.937
50.400.0530.0570.047
0.30.4470.8240.901
60.300.0520.0550.047
0.40.630.80.99
70.700.0520.0460.053
0.80.99811
Table 3. Estimation results of DCINMA(1) and INMA(1) model.
Table 3. Estimation results of DCINMA(1) and INMA(1) model.
λ β θ
DCINMA(1)3.210.470.80
INMA(1)3.820.240
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Yu, K.; Wang, H. A New Overdispersed Integer-Valued Moving Average Model with Dependent Counting Series. Entropy 2021, 23, 706. https://doi.org/10.3390/e23060706

AMA Style

Yu K, Wang H. A New Overdispersed Integer-Valued Moving Average Model with Dependent Counting Series. Entropy. 2021; 23(6):706. https://doi.org/10.3390/e23060706

Chicago/Turabian Style

Yu, Kaizhi, and Huiqiao Wang. 2021. "A New Overdispersed Integer-Valued Moving Average Model with Dependent Counting Series" Entropy 23, no. 6: 706. https://doi.org/10.3390/e23060706

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop