Frequency-Based Adaptive Interpolation Filter in Intra Prediction

Abstract

This paper proposes a method to improve the fractional interpolation of reference samples in the Versatile Video Coding (VVC) intra prediction. The proposed method uses additional interpolation filters which use more integer-positioned reference samples for prediction according to the frequency information of the reference samples. In VVC, a 4-tap Discrete Cosine Transform-based interpolation filter (DCT-IF) and 4-tap Smoothing interpolation filter (SIF) are alternatively performed on the block size and block directional prediction mode for reference sample interpolation. This paper uses four alternative interpolation filters such as 8-tap/4-tap DCT-IFs, and 4-tap/8-tap SIFs and an interpolation filter selection method using a high-frequency ratio calculated from one-dimensional (1D) transform of the reference samples are proposed. The proposed frequency-based Adaptive Filter allows to achieve the overall Bjøntegaard Delta (BD) rate gains of −0.16%, −0.13%, and −0.09% for Y, Cb, and Cr components, respectively, compared with VVC.

1. Introduction

As video resolution increases, so does the need for a more efficient and high-compressed video codec. ITU-T Video Coding Experts Group (VCEG) and ISO/IEC Moving Picture Experts Group (MPEG) formed the Joint Video Exploration Team (JVET) in October 2015 to develop the next generation video coding standard, and VVC/H.266 standardization [1] was completed in July 2020. VVC is a video codec developed after High-Efficiency Video Coding (HEVC/H.265) and achieves a 39% reduction in bit rate compared with HEVC. Similar to Advanced Video Coding (AVC/H.264) [2,3] and HEVC [4,5,6,7], VVC is also a block-based video codec. It was developed with a codec in mind that can be used for various types of videos such as higher resolution, screen content, and 360° video [8,9,10].

In VVC, the picture is first divided into coding tree units (CTUs), and then the CTUs are recursively divided into coding units (CUs) [11]. During CU encoding, intra or inter prediction is performed. Intra prediction [12] is a method that generates sample values of a prediction block using the spatial similarity between the current block and adjacent blocks. The adjacent blocks above and to the left of the current block are used as the prediction reference blocks. Intra prediction plays an important role in increasing coding efficiency. The inter prediction [13,14] utilizes temporal redundancy between the current block and reference blocks to improve coding efficiency. After the prediction blocks are generated of intra or inter prediction, the prediction block is subtracted from the current block to be coded, which is called the residual block. The transform [15] and quantization processes [16] are applied to the residual block. The transform process decorrelates the residual samples using basis vectors in the frequency domain and the quantization process discards the high-frequency data depending on the QP values. Since all CTUs are encoded in the picture, an in-loop filtering process, which consists of a deblocking filter, a sample adaptive offset, and an adaptive loop filter, is applied to the reconstructed block to reconstruct the filtered picture which reduces the coding noise.

VVC uses rectangular blocks of various shapes and advanced new tools are used for intra prediction. Once the block shape has become diversified, the wide-angle intra prediction mode with 65 directional prediction modes is available. Therefore, there are 87 intra prediction modes including DC and planar modes. In addition, the multiple reference line (MRL) has been added which uses two non-adjacent reference lines. A new intra sub-partition (ISP) mode is included in VVC, where the prediction block is divided into smaller blocks of the same size to perform prediction and transform on these small blocks. It splits 4 × 8 and 8 × 4 blocks into two small blocks and the remaining blocks into four small blocks, where the blocks are partitioned horizontally or vertically. Reference sample filtering is also performed to generate more accurate prediction values from reference samples of adjacent blocks of the current block. When the intra prediction mode has integer-slope modes, reference sample smoothing is applied to the integer reference samples. For fractional-slope modes, an interpolation filter is applied to integer reference samples to create fractional positioned reference samples. In Position Dependent Prediction Combination (PDPC), unfiltered or filtered reference samples are used according to the intra prediction mode and position-dependent weighting is applied to correct the prediction value of the current CU. In Matrix-Based Intra Prediction (MIP) using a predefined data-driven matrix in VVC, the upper reference samples and left CU reference samples are used to generate the current block prediction samples by matrix multiplication and linear interpolation. Since the Cross Component Linear Model (CCLM) uses the relationship between luma samples and chroma samples, the linear model parameters for chroma samples are obtained using the down-sampled luma sample values and the coding efficiency is improved due to the accurate prediction values of the chroma samples. The Most Probable Mode (MPM) list increased from the three (3) intra prediction modes in HEVC to the six (6) intra prediction modes in VVC.

In this paper, first, we design and propose two 8-tap interpolation filters with better high-pass filter (HPF) characteristics and low-pass filter (LPF) characteristics which are designed to generate the fractional prediction samples considering the frequency characteristic of the integer reference samples. One 8-tap DCT-IF with HPF characteristics is designed with DCT and the other 8-tap SIF with LPF characteristics is designed with the convolution of a linear filter and [1, 6, 15, 20, 15, 6, 1] low-pass filter which comes from a three times convolution of [1, 2, 1]. Second, a filter selection method is proposed, that uses transformed reference samples to investigate energy in the frequency domain. Finally, the proposed frequency-based Adaptive Filter, which uses the 8-tap DCT-IF and SIF and frequency domain filter selection, is combined with a conventional VVC filter. The proposed method brings better coding efficiency than VVC intra coding.

This paper is structured as follows: Section 2 provides an overview of reference sample filtering for video coding standards and related studies are described. The proposed method based on both the two 8-tap interpolation filters and the filter selection in the frequency domain is explained in Section 3. Then, the experimental results of the proposed method are reported in Section 4. Finally, Section 5 concludes the paper.

2. Previous Works

2.1. An Overview of Reference Sample Filtering for Video Coding Standards

In intra prediction, a prediction block is generated using the reference samples from adjacent blocks. During the prediction process, filtering is applied to remove discontinuities in the reference samples and to generate accurate prediction sample values. There are two types of reference sample smoothing on integer samples in HEVC [17], whether to use a strong reference filter or a weak reference filter. The filter is determined by the block size and the continuity of the reference samples. HEVC interpolation filters use a 2-tap linear interpolation filter to generate a fractional position sample value [18].

In VVC, reference sample smoothing is applied in the integer-slope mode and interpolation filtering is applied in the fractional-slope mode [9,10,12]. Figure 1 shows the integer-slope modes and fractional-slope modes in the VVC intra prediction modes. Out of 87 intra prediction modes, the vertical and horizontal modes do not use filters when generating the prediction samples. Planar and −14, −12, −10, −6, 2, 34, 66, 72, 76, 78, or 80 modes corresponding to multiple 45 degrees angles with an integer slope use [1, 2, 1] reference sample filter without interpolation filter. The other fractional-slope modes generate fractional reference samples of the current prediction samples by applying an interpolation filter to integer position reference samples. In this case, 4-tap interpolation filters are used for the luma samples to generate fractional positioned samples. There are two interpolation filters in VVC: 4-tap DCT-IF and 4-tap SIF [19,20,21]. The 4-tap DCT-IF coefficients in VVC are derived from the DCT-II in Equation (1) and IDCT-II (Inverse DCT-II) in Equation (2).

$$X\left(k\right)=\sqrt{\frac{2}{N}}{{\displaystyle \sum }}_{n=0}^{N-1}{c}_{k}x\left(n\right)\cos \frac{\left(n+1/2\right)\pi k}{N}$$

(1)

$$x\left(n\right)=\sqrt{\frac{2}{N}}{\displaystyle \sum }_{k=0}^{N-1}{c}_{k}X\left(k\right)\cos \frac{\left(n+1/2\right)\pi k}{N}$$

(2)

$$c_k=\{\begin{array}{c}\frac{1}{\sqrt{2}}, k=0\\ 1, k=1,2,\dots ,N-1\end{array}$$

where X(k) is the N-point of DCT-II and x(n) is its inverse transform.

The DCT-IF coefficients [1] in

Table 1. The 4-tap DCT Interpolation Filter (DCT-IF) coefficients in VVC.

Index i	0	1	2	3
0/32-pixel filter[i]	0	64	0	0
1/32-pixel filter[i]	−1	63	2	0
2/32-pixel filter[i]	−2	62	4	0
3/32-pixel filter[i]	−2	60	7	−1
4/32-pixel filter[i]	−2	58	10	−2
5/32-pixel filter[i]	−3	57	12	−2
6/32-pixel filter[i]	−4	56	14	−2
7/32-pixel filter[i]	−4	55	15	−2
8/32-pixel filter[i]	−4	54	16	−2
9/32-pixel filter[i]	−5	53	18	−2
10/32-pixel filter[i]	−6	52	20	−2
11/32-pixel filter[i]	−6	49	24	−3
12/32-pixel filter[i]	−6	46	28	−4
13/32-pixel filter[i]	−5	44	29	−4
14/32-pixel filter[i]	−4	42	30	−4
15/32-pixel filter[i]	−4	39	33	−4
16/32-pixel filter[i]	−4	36	36	−4

were obtained from Equations (1) and (2). The 4-tap SIF is derived from a convolution of [1, 2, 1] filter and a 1/32 linear interpolation on the reference samples as shown in

Table 2. The 4-tap Smoothing Interpolation Filter (SIF) coefficients in VVC.

Index i	0	1	2	3
0/32-pixel filter[i]	16	32	16	0
1/32-pixel filter[i]	16	32	16	0
2/32-pixel filter[i]	15	31	17	1
3/32-pixel filter[i]	15	31	17	1
4/32-pixel filter[i]	14	30	18	2
5/32-pixel filter[i]	14	30	18	2
6/32-pixel filter[i]	13	29	19	3
7/32-pixel filter[i]	13	29	19	3
8/32-pixel filter[i]	12	28	20	4
9/32-pixel filter[i]	12	28	20	4
10/32-pixel filter[i]	11	27	21	5
11/32-pixel filter[i]	11	27	21	5
12/32-pixel filter[i]	10	26	22	6
13/32-pixel filter[i]	10	26	22	6
14/32-pixel filter[i]	9	25	23	7
15/32-pixel filter[i]	9	25	23	7
16/32-pixel filter[i]	8	24	24	8

[1]. Table 1 and Table 2 show the 4-tap DCT-IF coefficients and the 4-tap SIF coefficients, respectively. In Table 1 and Table 2, the index I represents the position of the integer pixel. In VVC, the CU size and directional mode in Equations (3) and (4) are used to select a 4-tap DCT-IF or 4-tap SIF for fractional reference samples interpolation.

$$nTbS=\left( Log2 \left(W\right)+Log2 \left(H\right)\right)\gg 1$$

(3)

$$minDistVerHor=Min\left(\begin{array}{c} Abs\left( predModeIntra-50 \right),\\ Abs\left( predModeIntra-18 \right)\end{array}\right)$$

(4)

where W and H are the width and height of CU. nTbS is determined at Equation (3) according to W and H. predModeIntra represents the prediction mode of the current CU, and minDistVerHor is determined as the minimum difference value between the prediction mode of the current CU and the vertical mode 50 or between the prediction mode of the current CU and the horizontal mode 18.

The filter is selected using nTbS and minDistVerHor of the CU calculated by Equations (3) and (4). If the minDistVerHor is greater than the intraHorVerDistThres[nTbS] in each nTbS in

Table 3. Specification of intraHorVerDistThres[nTbS] for various transform block size nTbS in VVC.

nTbS	2	3	4	5	6
intraHorVerDistThres[nTbS]	24	14	2	0	0

, a 4-tap SIF is used, otherwise, a 4-tap DCT-IF is used. If an MRL or ISP is used in the CU, only the 4-tap DCT-IF is applied for the CU reference samples.

The fractional sample position is derived from the angle of the intra prediction mode and the fractional position of the current predicted sample. The derivation of the prediction sample pred(x, y) on (x, y) position in the current CU using 4-tap intra fractional prediction is shown in Equation (5) as follows:

$$pred\left(x,y\right)=\left({{\displaystyle \sum }}_{i=0}^{3}f\left[p\right]\left[i\right]·r\left[i_0+i\right]+32\right)\gg 6$$

(5)

$$p=\left(\left(y+1+refIdx\right) \ast intraPredAngle\right) \& 31$$

(6)

where f[p][i] are the filter coefficients; where p, p = 0, 1, 2, …, 31, is the horizontal or vertical projection of the fractional part of the predicted sample; and i is the index of the integer reference sample in Table 1 and Table 2. p is computed in Equation (6), where refIdx is the MRL index and intraPredAngle depends on the intra prediction mode of the current CU. When the intra prediction mode is less than 34, y is replaced by x in Equation (6). r[i + i₀], i = 0, 1, 2, 3, is the reference sample projected onto the CU boundary where $i_0$ is the start integer reference sample index.

2.2. Related Studies

Various studies have been conducted to improve the performance of interpolation filters. There are several approaches to improving prediction performance by increasing the length of the filters or by suggesting a filter selection method. Matsuo et al. [22] proposed a 4-tap DCT-iFs for small prediction units (PUs) for intra prediction in HEVC. Kim et al. [23] used 12-point Discrete Sine Transform (DST) interpolation filters and 11-point DST interpolation filters to replace 8-point DCT-iFs and 7-point DCT-iFs for inter prediction in motion compensation in HEVC to improve inter coding efficiency. Zhao et al. [24] proposed 6-tap filters to replace 4-tap DCT-IF filters, where the coefficients of 6-tap filters were obtained from a polynomial regression model. Chang et al. [25] proposed 6-tap DCT-iFs and 6-tap Gaussian interpolation filters for blocks larger than 32 × 32 blocks. In [22] and [23], the interpolation filters derived from DCT and DST highlight the high-frequency responses of integer samples in the prediction block. References [23,24,25] extend the interpolation filter to use more integer reference samples to apply long-tap DCT-IF and Gaussian IF compared with the existing interpolation filters in HEVC and VVC. Kim et al. [26] proposed a method of selecting interpolation filters, which consists of 4-tap interpolation filters and 3-tap intra smoothing filters according to the smoothness of the reference samples. In this method, [1, −2, 1] the HPF filter is used as the reference samples for the integer-slope modes to compute the difference between the filtered samples and the unfiltered reference samples, where the pixel domain difference value determines which interpolation filters are applied or if none are applied. In VVC, alternative interpolation filters for half-pixel position depending on the motion vector accuracy for inter prediction are proposed by Henkel et al. [27]. Kidani et al. [28] proposed a filter selection to characterize the reference samples based on the block-size and QP value for the 4-tap DCT-IF and SIF selection. Chiang et al. [29] proposed a method of selecting filters for horizontal and vertical directions in AV1. In [26,27,28,29], a filter selection method is proposed for selecting an interpolation filter that is better suited to the current block to improve the accuracy of the prediction block. Moreover, there are studies that apply filtering using a trained model based on Deep Convolutional Neural Network (CNN) rather than fixed filters. Pham et al. [30] proposed a CNN-based fractional interpolation filter for Luma and Chroma components for inter prediction in HEVC. Yan et al. [31] proposed an invertibility-driven interpolation filter using CNN in HEVC. The authors in [30,31] alternatively applied both DCT-IF and CNN-based iFs to generate fractional positioned samples more accurately. They achieved better coding efficiency than using fixed filters in HEVC inter prediction with more parameters and complexity.

These studies show that the interpolation filter plays an important role in intra and inter coding to obtain better coding efficiency in video coding. Most of the methods applied long-tap filters or alternative filters based on filter selection methods in pixel domain to improve the video coding efficiency in intra and inter coding. However, in this study, we propose a new method that uses the newly derived 8-tap DCT-IF/SIF in this paper and the existing 4-tap DCT-IF/SIF which is used in the VVC standard based on high-frequency information after 1-D transform on reference samples. Finally, the proposed method improves coding efficiency in intra coding compared with the VVC standard.

3. Proposed Method

3.1. Design of 8-Tap Interpolation Filter

A method is proposed that addresses more integer samples using 8-tap DCT-IF and 8-tap SIF to generate fractional reference samples based on the frequency information of the reference samples. The 8-tap DCT-IF coefficients are derived from DCT-II and IDCT-II (Inverse DCT-II) in Equations (1) and (2) of Section 2, where N is set to 8. The 8-tap DCT-IF is derived by substituting Equation (1) into Equation (2).

p/32-pixel interpolation filter, p = 0, 1, 2, 3, …, 31, in the case of using 1/32 fractional samples, is derived by substituting n = 3 + p/32 from 8-tap DCT-IF as a linear combination of discrete cosine coefficients and x(m), m = 0, 1, 2, …, 7. The 8-tap DCT-IF coefficients derived for (0/32, 1/32, 2/32, …, 16/32) fractional sample positions are shown in

Table 4. The 8-tap DCT Interpolation Filter (DCT-IF) coefficients for interpolation.

Index i	0	1	2	3	4	5	6	7
0/32-pixel filter[i]	0	0	0	128	0	0	0	0
1/32-pixel filter[i]	0	1	−3	127	4	−2	1	0
2/32-pixel filter[i]	−1	3	−7	127	8	−4	2	0
3/32-pixel filter[i]	−1	4	−10	126	13	−6	3	−1
4/32-pixel filter[i]	−1	5	−12	124	17	−7	3	−1
5/32-pixel filter[i]	−2	6	−15	122	23	−9	4	−1
6/32-pixel filter[i]	−2	7	−17	120	28	−11	5	−2
7/32-pixel filter[i]	−2	8	−19	117	33	−13	6	−2
8/32-pixel filter[i]	−3	9	−21	114	38	−14	7	−2
9/32-pixel filter[i]	−3	9	−22	111	43	−16	8	−2
10/32-pixel filter[i]	−3	10	−23	107	49	−18	8	−2
11/32-pixel filter[i]	−3	10	−24	104	54	−19	9	−3
12/32-pixel filter[i]	−3	11	−24	99	59	−20	9	−3
13/32-pixel filter[i]	−3	11	−25	95	65	−22	10	−3
14/32-pixel filter[i]	−3	11	−25	90	70	−22	10	−3
15/32-pixel filter[i]	−3	11	−24	85	75	−23	10	−3
16/32-pixel filter[i]	−3	11	−24	80	80	−24	11	−3

by substituting n = 3 + (0/32, 1/32, 2/32, …, 16/32), respectively, from 8-tap DCT-IF. The 8-tap DCT-IF coefficients for (17/32, 18/32, 19/32, …, 31/32) are obtained in the same way as above, where filter coefficients are scaled to an integer implementation.

The 8-tap SIF coefficients are derived from the convolution of z[n] and 1/32 fractional linear filter, where z[n] in Figure 2 is derived from the convolution of h[n] and y[n] in Equations (7) and (8), in which h[n] is a 3-point [1, 2, 1] LPF. Equations (7) and (8) show the procedure for deriving y[n] and z[n]. Figure 2 shows h[n], y[n], and z[n], and the 8-tap SIF coefficients are obtained from linear interpolation of z[n] and 1/32 fractional linear filter.

$$y\left[n\right]=h\left[n\right]\ast h\left[n\right]={{\displaystyle \sum }}_{k=-1}^{1}h\left[k\right]h\left[n+k\right]$$

(7)

$$z\left[n\right]=h\left[n\right]\ast y\left[n\right]={{\displaystyle \sum }}_{k=-1}^{1}h\left[k\right]y\left[n+k\right]$$

(8)

Equations (9) and (10) describe the procedure for calculating 8-tap SIF coefficients, where g[n] = z[n − 3], n = 0, 1, 2, …, 6.

$${{\displaystyle \sum }}_{i=0}^{6}g\left[i\right]\left(\frac{32-p}{32}r[i_0+i\left]+\frac{p}{32}r\right[i_0+1+i]\right)\ll 2$$

(9)

Equation (10) shows an example of the SIF coefficient derivation at the position i₀ + 3 + 16/32-pixel, when p = 16. The bold integer numbers shown in Equation (10) are the filter coefficients, which are derived at 16/32-pixel filter[i] in

Table 5. The 8-tap Smoothing Interpolation Filter (SIF) coefficients for interpolation.

Index i	0	1	2	3	4	5	6	7
0/32-pixel filter[i]	4	24	60	80	60	24	4	0
1/32-pixel filter[i]	4	24	60	80	60	24	4	0
2/32-pixel filter[i]	4	23	58	79	61	26	5	0
3/32-pixel filter[i]	4	23	58	79	61	26	5	0
4/32-pixel filter[i]	3	21	58	78	62	28	6	0
5/32-pixel filter[i]	3	21	58	78	62	28	6	0
6/32-pixel filter[i]	3	20	53	76	64	31	8	1
7/32-pixel filter[i]	3	20	53	76	64	31	8	1
8/32-pixel filter[i]	3	19	51	75	65	33	9	1
9/32-pixel filter[i]	3	19	51	75	65	33	9	1
10/32-pixel filter[i]	3	18	49	74	66	35	10	1
11/32-pixel filter[i]	3	18	49	74	66	35	10	1
12/32-pixel filter[i]	3	17	47	73	67	37	11	1
13/32-pixel filter[i]	3	17	47	73	67	37	11	1
14/32-pixel filter[i]	2	15	44	71	69	40	13	2
15/32-pixel filter[i]	2	15	44	71	69	40	13	2
16/32-pixel filter[i]	2	14	42	70	70	42	14	2

.

$$\begin{array}{c}\left(\begin{array}{c}\frac{16}{32}r[i_0\left]+\frac{112}{32}r\right[i_0+1\left]+\frac{336}{32}r\right[i_0+2]\\ +\frac{560}{32}r\left[i_0+3\right]+\frac{560}{32}r\left[i_0+4\right]+\frac{336}{32}r\left[i_0+5\right]\\ +\frac{112}{32}r\left[i_0+6\right]+\frac{16}{32}r\left[i_0+7\right]\end{array}\right)\ll 2\\ =\left(\begin{array}{c}2 r[i_0\left]+14 r\left[i_0+1\right]+42 r\right[i_0+2]\\ +70 r\left[i_0+3\right]+70 r\left[i_0+4\right]+42 r\left[i_0+5\right]\\ +14 r\left[i_0+6\right]+2 r\left[i_0+7\right]\end{array}\right)\end{array}$$

(10)

The integer reference samples used to derive the 8-tap SIF coefficients are shown in Figure 3, where eight integer samples $r\left[i_0\right]$ to $r\left[i_0+7\right]$ to derive the filter coefficients for black i₀ + 3 + 16/32-pixel position are colored gray and r[i₀] is the start sample of eight reference samples. Filter coefficients are scaled to an integer implementation. All p/32 interpolation filter coefficients in Table 5 are derived by substituting p = 0, 1, 2, …, 15 into Equation (9) in the same way as p = 16 in Equation (10). Interpolation filters at p = 17, 18, …, 31, which are not shown in Table 5, can be easily obtained with even symmetry on i₀ + 3.5, reflecting the filter coefficients of p = 15, 14, …, 1, respectively.

Table 4 and Table 5 show 8-tap DCT-IF and 8-tap SIF coefficients, where index = 0 and index = 7 correspond to r[i₀] and r[i₀ + 7] in Figure 3, respectively. In Table 4 and Table 5, index i is the position of the integer reference sample. Figure 4 shows the magnitude response at 16/32-pixel positions of 4-tap DCT-IF, 4-tap SIF, 8-tap DCT-IF, and 8-tap SIF, where the X-axis represents the normalized radian frequency and the Y-axis represents the magnitude response. The 8-tap DCT-IF has better HPF characteristics than the 4-tap DCT-IF and the 8-tap SIF has better LPF characteristics than the 4-tap SIF. Therefore, 8-tap SIF results in better interpolation than 4-tap SIF in low-frequency reference samples and 8-tap DCT-IF provides better interpolation than 4-tap DCT-IF in high-frequency reference samples.

3.2. Frequency-Based Adaptive Interpolation Filter Selection

To determine the reference sample characteristics based on the CU size, the correlation at Equation (11) is computed from the above or left-hand reference samples of the current CU according to the intra prediction mode, where N is the width or height of the current CU. If the prediction mode of the current CU is greater than the diagonal mode 34 in Figure 1, then the reference samples located above the current CU are used in Equation (11). Otherwise, the reference samples located to the left of the current CU are used in Equation (11), where x_i is the reference samples, y_i is one sample right-shifted reference samples with respect to x_i, and $\overline{x}$ and $\overline{y}$ are the mean values of x_i and y_i, respectively.

$$correlation=\frac{{{\displaystyle \sum }}_{i=0}^{N-2}\left(x_i-\overline{x}\right)\left(y_i-\overline{y}\right)}{\sqrt{{{\displaystyle \sum }}_{i=0}^{N-2}{\left(x_i-\overline{x}\right)}^2}\sqrt{{{\displaystyle \sum }}_{i=0}^{N-2}{\left(y_i-\overline{y}\right)}^2}}$$

(11)

Figure 5 shows the average correlation values of the reference samples for various video resolutions and each nTbS defined in Equation (3), which is determined according to the CU size at each picture resolution. The correlation increases as the CU size is larger and the video resolution is higher as shown in Figure 5, where video resolutions A1, A2, B, C, and D are shown in parentheses.

The intra CU size partition in video coding depends on the prediction performance to enhance the coding in terms of bit rate and distortion. The prediction performance depends on the prediction errors between the prediction samples and the samples in the current CU. When the current block has many detailed areas including high frequencies, the CU size is partitioned into small blocks in the consideration of bit rate and distortion using boundary reference samples of small width and height. However, when the current block consists of a homogeneous area, the CU size is partitioned into large blocks in the consideration of bit rate and distortion using boundary reference samples of large width and height [32,33,34].

Figure 5 shows the correlation values of the reference samples according to the nTbS size and the video resolution shown as A1, A2, B, C, and D. The reference samples have a high correlation in the large nTbS and a low correlation in the small nTbS, respectively, which means that small nTbS have high-frequency characteristics consistent with a low correlation and large nTbS have low-frequency characteristics consistent with high correlation.

VVC uses two interpolation filters as explained in Section 2.1: 4-tap DCT-IF is used for all blocks when nTbS = 2, alternatively 4-tap DCT-IF or 4-tap SIF is used when nTbS = 3 or 4 depending on minDistVerHor in Equation (4) and intraHorVerDistThres[nTbS] in Table 3, and 4-tap SIF applied to all blocks when nTbS ≥ 5. In this paper, in addition to the proposed interpolation filters, we also propose a selection method of the proposed interpolation filters for generating accurate fractional boundary prediction samples using the frequency information of the integer reference samples.

Even if the CU reference samples have a low-frequency characteristic, DCT-IF is used for the CU reference samples with nTbS = 2 in the VVC standard. However, from Figure 4, it is more effective to use SIF than DCT-IF when the CU reference samples have the low-frequency characteristics regardless of the nTbS size. Similarly, even if the CU reference samples have high-frequency characteristics, SIF is used for a CU with nTbS > 4 in the VVC standard. However, it is more effective to use DCT-IF than SIF in Figure 4 when the CU reference samples have high-frequency characteristics regardless of the nTbS size. To solve this problem, a method was developed that selects two different filters which consist of SIF and DCT-IF, according to the frequency characteristics of the reference samples. The reference samples are transformed using the scaled integer one-dimensional (1D) DCT-II kernel to detect the high-frequency energy of the reference samples. The scaled DCT-II coefficient X[k], k = 0, 1, 2, …, N − 1, is derived from Equation (12) as follows:

$$X\left[k\right]=\left(2^{6+M/2}\sqrt{\frac{2}{N}}{{\displaystyle \sum }}_{n=0}^{N-1}{c}_{k}x\left(n\right)\cos \frac{\left(n+1/2\right)\pi k}{N}\right)\gg shift$$

(12)

where N is the number of reference samples necessary for X[k] and M is log₂(N), and shift is M + 1. After 1-D transform, high-frequency energy is observed in the transform domain. As the energy is concentrated in the low-frequency components, the reference samples are composed of homogeneous samples. However, as energy exists in the high-frequency components, the reference samples contain high-frequency samples, which indicates that the samples in the CU have high-frequency components. The transform size of the reference samples is set according to the intra prediction mode of the current block. If the intra prediction mode is greater than mode 34 (diagonal mode), the upper CU reference samples are transformed with the N = CU width in Equation (12). Moreover, if the intra prediction mode is less than mode 34, the left reference samples are used with the N = CU height in Equation (12). X[k] is used to measure the energy ratio of the high-frequency coefficients. If there exists energy in the high-frequency data, DCT-IF is used because the reference samples are composed of high-frequency data. In contrast, SIF is used for high-energy reference samples in low-frequency data.

The energy percentage of the high-frequency coefficients, high_freq_ratio, is calculated in Equation (13).

$$high\_freq\_ratio=\frac{{{\displaystyle \sum }}_{k=N\ast \frac{3}{4}}^{N-1}X\left[k\right]\ast X\left[k\right]}{{{\displaystyle \sum }}_{k=0}^{N-1}X\left[k\right]\ast X\left[k\right]}\ast 100$$

(13)

Table 6. Proposed interpolation filter selection method and interpolation filters applied to the selected method.

nTbS	2	3	4	5	6
Filter Selection Method	high_freq_ratio	VVC Method	VVC Method	high_freq_ratio	high_freq_ratio
high_freq_ratio < THR	4-tap SIF	-	-	8-tap SIF	8-tap SIF
high_freq_ratio ≥ THR	8-tap DCT-IF	-	-	4-tap DCT-IF	4-tap DCT-IF

shows the proposed interpolation filter selection method by the threshold THR of high_freq_ratio and the interpolation filters applied to the selected method. The proposed method is only used when nTbS = 2 and nTbS > 4. Otherwise, the existing VVC method is used when nTbS = 3, 4. The proposed method uses an 8-tap DCT-IF/SIF and a 4-tap DCT-IF/SIF according to nTbS and high_freq_ratio.

The threshold (THR) of high_freq_ratio in Table 6 was determined experimentally. To select the threshold, CIF sequences with 352 × 288 resolution and FHD sequences with 1920 × 1080 resolution were used. The CIF sequences used are Akiyo, Bridge-far, Highway, News, and Paris, and the FHD sequences used are IceRock, Market3, Netflix_BarScene, Netflix_Crosswalk, and Netflix_FoodMarket. Figure 6 shows the Bjøntegaard Delta (BD) rate [35,36] reductions applying the proposed reference sample interpolations for each threshold, THR1, THR2, …, THR7, according to nTbS. Figure 6a,b are the result of nTbS = 2 and nTbS = 5, respectively.

In Figure 6a, since high_freq_ratio is less than the given threshold, a 4-tap SIF is used. Otherwise, the 8-tap DCT-IF is used. In Figure 6a, the most efficient BD rate reductions occurred with THR5 and THR6. Therefore, THR5 is selected as the THR of high_freq_ratio in this proposed method. In Figure 6b, when experimenting with high_freq_ratio at nTbS = 5, better coding efficiency was obtained with THR4 and a similar result was obtained when nTbS is 6. Therefore, when nTbS is 5 and 6, THR4 is selected as THR of high_freq_ratio in the proposed method. For CU with nTbS > 4, when high_freq_ratio < THR, the 8-tap SIF is used. Otherwise, the 4-tap DCT-IF is used. Correlation and filter have a close relationship. Small blocks have low correlation values with high-frequency characteristics. So, small blocks need to highlight high-frequency samples using strong HPF (8-tap DCT-IF). Since their average correlation value is relatively lower than large blocks, weak LPF (4-tap SIF) is better interpolation than strong LPF (8-tap SIF) when the block has low-frequency characteristics. Similarly, large blocks have high correlation values with low-frequency characteristics. So, large blocks need to highlight low-frequency samples using strong LPF (8-tap SIF). Since their average correlation value is relatively higher than small blocks, weak HPF (4-tap DCT-IF) has better interpolation than strong HPF (8-tap DCT-IF) when the block has high-frequency characteristics. For example, if the CU is 4 × 4, the nTbS value becomes 2. The 8-tap DCT-IF is used when high_freq_ratio ≥ THR5 in Figure 6a. Otherwise, 4-tap SIF is used for the CU. The proposed method depends on nTbS and high_freq_ratio. In the case where the CU has nTbS size of 2, if high_freq_ratio < THR, a 4-tap SIF with a weak LPF characteristic, as shown in Figure 4, is applied for the reference samples, because the correlation at nTbS = 2 is relatively less than that at nTbS > 4 as shown in Figure 5. Otherwise, if high_freq_ratio ≥ THR, the 8-tap DCT-IF with strong HPF characteristic as shown in Figure 4 is applied for the reference samples.

In a similar way, in the case where a CU has nTbS size greater than 4, if high_freq_ratio < THR, an 8-tap SIF with a strong LPF characteristic, as shown in Figure 4, is applied to the reference samples because the correlation at nTbS > 4 is relatively higher than with nTbS = 2 as shown in Figure 5. Otherwise, if high_freq_ratio ≥ THR, a 4-tap DCT-IF with weak HPF characteristic, as shown in Figure 4, is applied for the reference samples.

4. Experimental Results

The proposed method was implemented in VTM-14.2 [37], the VVC reference software, and conducted in All Intra (AI) configurations under the JVET common test conditions (CTC) [38]. The sequences of classes A1, A2, B, C, and D were tested with Quantization Parameter (QP) values of 22, 27, 32, and 37, respectively.

Table 7. Information on video sequences for each class.

Class	Sequence Name	Picture Size	Picture Count	Picture Rate	Bit Depth
A1	Tango2	3840 × 2160	294	60	10
	FoodMarket4	3840 × 2160	300	60	10
	Campfire	3840 × 2160	300	30	10
A2	CatRobot1	3840 × 2160	300	60	10
	DaylightRoad2	3840 × 2160	300	60	10
	ParkRunning3	3840 × 2160	300	50	10
B	MarketPlace	1920 × 1080	600	60	10
	RitualDance	1920 × 1080	600	60	10
	Cactus	1920 × 1080	500	50	8
	BasketballDrive	1920 × 1080	500	50	8
	BQTerrace	1920 × 1080	600	60	8
C	RaceHorses	832 × 480	300	30	8
	BQMall	832 × 480	600	60	8
	PartyScene	832 × 480	500	50	8
	BasketballDrill	832 × 480	500	50	8
D	RaceHorses	416 × 240	300	30	8
	BQSquare	416 × 240	600	60	8
	BlowingBubbles	416 × 240	500	50	8
	BasketballPass	416 × 240	500	50	8

shows the sequence name, picture size, picture rate, and bit depth of the CTC video sequences for each class.

Table 8. Various interpolation filter selection methods and interpolation filters applied to the selected method.

nTbS	2	3	4	5	6
Method A	8-tap DCT-IF	4-tap DCT-IF, 4-tap SIF	4-tap DCT-IF, 4-tap SIF	4-tap SIF	4-tap SIF
Method B	4-tap DCT-IF	4-tap DCT-IF, 4-tap SIF	4-tap DCT-IF, 4-tap SIF	8-tap SIF	8-tap SIF
Filter Selection Method	VVC Method	VVC Method	VVC Method	VVC Method	VVC Method
Method C	8-tap DCT-IF, 4-tap SIF	4-tap DCT-IF, 4-tap SIF	4-tap DCT-IF, 4-tap SIF	4-tap SIF	4-tap SIF
Filter Selection Method	high_freq_ratio	VVC Method	VVC Method	VVC Method	VVC Method
Method D	4-tap DCT-IF	4-tap DCT-IF, 4-tap SIF	4-tap DCT-IF, 4-tap SIF	8-tap SIF, 4-tap DCT-IF	8-tap SIF, 4-tap DCT-IF
Filter Selection Method	VVC Method	VVC Method	VVC Method	high_freq_ratio	high_freq_ratio

shows the interpolation filter selection method and the interpolation filters applied according to the selected method to test the efficiency of 8-tap/4-tap interpolation filter. Method A uses 8-tap DCT-IF for nTbS = 2 and 4-tap SIF for nTbS > 4 and Method B uses 8-tap SIF for nTbS > 4 and 4-tap DCT-IF for nTbS = 2, while selecting DCT-IF or SIF in the same way as a VVC anchor. The difference between Method A and the VVC methods is that Method A uses 8-tap DCT-IF instead of 4-tap DCT-IF for nTbS = 2 only. The difference between Method B and the VVC method is that Method B uses 8-tap SIF instead of 4-tap SIF only for nTbS > 4.

Method C uses 8-tap DCT-IF or 4-tap SIF depending on high_freq_ratio in Equation (13) for nTbS = 2, and 4-tap SIF for nTbS > 4. Method D uses 8-tap SIF or 4-tap DCT-IF depending on high_freq_ratio for nTbS > 4, and 4-tap DCT-IF for nTbS = 2.

Table 9. Experimental results of Method A and Method B.

Sequence	All Intra Main 10
	Method A			Method B
	Y	Cb	Cr	Y	Cb	Cr
Class A1	0.01%	−0.06%	0.06%	−0.08%	−0.20%	−0.15%
Class A2	0.02%	−0.03%	−0.02%	−0.01%	0.00%	−0.04%
Class B	−0.01%	0.04%	−0.01%	−0.01%	0.05%	−0.05%
Class C	−0.33%	−0.22%	−0.27%	0.00%	−0.02%	0.07%
Class D	−0.28%	−0.32%	−0.15%	−0.01%	−0.07%	0.03%
Overall	−0.13%	−0.12%	−0.08%	−0.02%	−0.03%	−0.02%

and

Table 10. Experimental results of method C and method D based on frequency-based adaptive filter selection method.

Sequence	All Intra Main 10
	Method C			Method D
	Y	Cb	Cr	Y	Cb	Cr
Class A1	0.01%	−0.18%	0.05%	−0.09%	−0.10%	−0.02%
Class A2	0.02%	0.08%	0.00%	0.00%	0.04%	−0.04%
Class B	0.01%	0.09%	0.01%	0.01%	0.02%	0.05%
Class C	−0.40%	−0.22%	−0.36%	0.01%	0.03%	0.02%
Class D	−0.30%	−0.25%	−0.23%	−0.01%	−0.06%	0.08%
Overall	−0.14%	−0.09%	−0.11%	−0.01%	−0.01%	0.03%

show simulation results of A, B, C, and D methods, in which the filter selection method and the interpolation filters used in the VVC anchor are employed for the CUs of nTbS = 3 and nTbS = 4.

In the case of Method A, the overall increase in the BD rate by −0.13%, −0.12% and –0.08% is observed for the Y, Cb, and Cr components, respectively, where the sign (−) means bit-savings. In the case of Method C, the overall increase in the BD rate by −0.14%, −0.09%, and −0.11% is observed for the Y, Cb, and Cr components, respectively. Particularly, increments of the Y component amounting to (−0.33%, −0.28%) in classes C with a resolution of 832 × 480 and D with a resolution of 416 × 240, respectively, at low picture resolutions are achieved in the Method A, the component gain (−0.40%, −0.30%) in classes C and D is achieved in Method C. Methods A and C have in common that an 8-tap DCT-IF for nTbS = 2 and a 4-tap SIF for nTbS > 4 are applied to each CU regardless of the filter selection method. For Method B, the overall BD rate gains are −0.02%, −0.03%, and −0.02% for the Y, Cb, and Cr components, respectively. For Method D, the overall BD rate gains are –0.01%, −0.01%, and 0.03% for the Y, Cb, and Cr components, respectively. Method B uses an 8-tap SIF for nTbS > 4, and a 4-tap DCT-IF for nTbS = 2 and Method D uses an 8-tap SIF or 4-tap DCT-IF in line with the proposed high_freq_ratio for nTbS > 4, and 4-tap DCT-IF for nTbS = 2. Even though there is almost no overall increase in BD rate with Methods B and D, the increase in BD rate by (−0.08%, −0.09%) in Y components in class A1 with resolution 3840 × 2160 is obtained in Methods B and D, respectively. The proposed frequency-based adaptive interpolation filtering using high_freq_ratio and nTbS and the existing VVC method in Table 6 were developed to take advantage of Methods C and D.

Table 11. CUs percentage using DCT-IF in which H and W are the height and width of each CU.

All Intra Main 10
	W	VVC Anchor					VVC Anchor with MRL and ISP					Adaptive Filter Method Based on high_freq_ratio (Proposed Method)
H		4	8	16	32	64	4	8	16	32	64	4	8	16	32	64
4		100.00	100.00	85.67	94.70	—	100.00	100.00	82.25	89.16	—	97.16	95.80	91.11	97.27	—
8		100.00	87.89	81.99	25.68	—	100.00	91.35	81.42	44.36	—	96.77	91.36	86.69	53.43	—
16		87.38	83.20	8.32	17.24	—	86.26	82.59	19.35	27.85	100.00	92.62	86.76	19.83	33.13	0.04
32		94.01	19.98	14.73	0.00	—	90.45	36.35	23.17	10.59	—	97.06	42.55	27.34	0.07	—
64		—	—	—	—	0.00	—	—	100.00	—	5.56	—	—	0.07	—	0.07

shows the percentages of the CUs applying the 4-tap DCT-IF in the VVC anchor and the 8-tap DCT-IF based on the high_freq_ratio in the proposed method for all test sequences. For nTbS = 2, the 4-tap DCT-IF is selected 100% on 4 × 4 CU, 4 × 8 CU and 8 × 4 CU in the VVC anchor, but the 8-tap DCT-IF is selected 97.16% on 4 × 4 CU, 95.80% on 4 × 8 CU, and 96.77% on 8 × 4 CU in the proposed Adaptive Filter Method based on high_freq_ratio. The percentage of 4-tap SIF selection with nTbS = 2 can be inferred from the DCT-IF selection percentages in Table 11.

The increases in percent selections of 4-tap SIF and 8-tap DCT-IF result in BD rate gains in

Table 12. Experimental results of the proposed filtering method.

		Adaptive Filter Method Based on high_freq_ratio (Proposed Method)
Class	Sequence Name	Y	Cb	Cr	EncT	DecT
A1	Tango2	−0.11%	−0.36%	−0.09%	102%	103%
	FoodMarket4	−0.11%	−0.06%	−0.22%	102%	106%
	Campfire	0.02%	0.01%	0.17%	102%	103%
A2	CatRobot1	−0.01%	0.03%	0.07%	101%	106%
	DaylightRoad2	0.03%	0.34%	0.13%	103%	105%
	ParkRunning3	−0.01%	−0.01%	0.01%	101%	103%
B	MarketPlace	−0.01%	−0.02%	−0.13%	102%	108%
	RitualDance	−0.01%	0.08%	0.02%	103%	104%
	Cactus	0.00%	−0.02%	0.27%	102%	105%
	BasketballDrive	0.03%	0.04%	−0.05%	102%	108%
	BQTerrace	0.06%	0.00%	0.10%	102%	108%
C	BasketballDrill	−1.20%	−0.78%	−0.68%	101%	110%
	BQMall	−0.18%	−0.26%	−0.12%	101%	106%
	PartyScene	−0.16%	−0.21%	−0.16%	102%	109%
	RaceHorses	−0.08%	−0.04%	−0.20%	103%	103%
D	BasketballPass	−0.29%	−0.25%	−0.42%	102%	104%
	BQSquare	−0.55%	−0.62%	−0.21%	101%	105%
	BlowingBubbles	−0.19%	−0.02%	−0.14%	101%	104%
	RaceHorses	−0.23%	−0.26%	0.03%	101%	103%
Class A1		−0.07%	−0.14%	−0.05%	102%	104%
Class A2		0.00%	0.12%	0.07%	102%	105%
Class B		0.02%	0.01%	0.04%	102%	107%
Class C		−0.41%	−0.32%	−0.29%	101%	107%
Class D		−0.31%	−0.29%	−0.18%	101%	104%
Overall		−0.16%	−0.13%	−0.09%	102%	105%

. The use of 4-tap SIF with low LPF characteristics and 8-tap DCT-IF with strong HPF characteristics in line with high_freq_ratio with small CU helps to increase the BD rate in the proposed method. Moreover, the use of 8-tap SIF with strong LPF characteristics and 4-tap DCT-IF with weak HPF characteristics according to high_freq_ratio at a large CU helps to slightly increase the BD rate in the proposed method.

For nTbS > 4, 4-tap DCT-IF is only applied to CUs using the MRL or ISP tool in the VVC anchor. However, 8-tap DCT-IF and 4-tap SIF based on high_freq_ratio are applied to the CUs using the MRL or ISP in the proposed method so that the 8-tap DCT-IF is selected 0.07% in 32 × 32 CU, 0.04% in 16 × 64 CU, 0.07% in 64 × 16 CU, and 0.07% in 64 × 64 CU, compared with 10.59% in 32 × 32 CU, 100% in 16 × 64 CU, 100% in 64 × 16 CU, and 5.56% in 64 × 64 CU in the VVC anchor.

Table 12 shows the results of the proposed Adaptive Filter Method based on high_freq_ratio, in which EncT and DecT represent the total encoding and decoding time ratios compared with the VVC anchor for various test sequences of classes A1 to D in the AI Main 10 configuration. The proposed method allows to achieve the overall BD rate increase of −0.16%, −0.13%, and −0.09% for the Y, Cb, and Cr components, respectively, with an average increase in computational complexity by 2% and 5% in the encoder and decoder, respectively, compared with the VVC anchor. Particularly, the highest BD rate increases amounting to −0.41%, −0.32%, and −0.29% for the Y, Cb, and Cr components are obtained, respectively, in class C compared with the VVC anchor.

With a slight increase in computational complexity, the proposed method allows for achieving a reduction in the BD rate compared with the VVC anchor. The sequence that shows the highest BD rate reduction is the BasketballDrill sequence in class C, in which the proposed method yields a gain of the Y component of −1.20%.

The proposed method did not obtain the BD rate gain in some sequences because we used CIF sequences and FHD sequences for determining only the threshold of high_freq_ratio. However, if the thresholds for correlation and high_freq_ratio are computed together for more various video sequences, the BD rate gain can be achieved in all test sequences with the computational complexity increases.

The proposed method shows slightly better subjective image quality than the VVC anchor when the BD rate gain is achieved, and the proposed method shows quite similar subjective quality to the VVC anchor even when the BD rate losses are 0.01% to 0.06%.

5. Conclusions

This paper proposes the Adaptive Filter Method to generate fractional reference samples for directional VVC intra prediction. With the high_freq_ratio derived from the 1-D scaled DCT, the 8-tap DCT-IFs and 8-tap SIFs in addition to the 4-tap DCT-IFs and the 4-tap SIFs are proposed to increase the precision of fractional reference samples. Depending on high_freq_ratio with respect to the block size, interpolation filters are applied to the reference samples. We conclude that in cases where the correlation between samples is high, 8-tap interpolation filters with strong HPF or strong LPF characteristics marginally affect the BD rate gain, but in cases where the correlation between samples is low, 8-tap interpolation filters with strong HPF or strong LPF characteristics affect the BD rate enhancement. Figure 5 shows the correlation graph for video resolutions and block size. Since high resolution videos show higher correlation value than low resolution videos, the sequences with low resolution achieve more coding gains than those with high resolution. For the proposed Adaptive Filter Method based on high_freq_ratio, overall BD rate gains of −0.16%, −0.13%, and −0.09% are observed for the Y, Cb, and Cr components, respectively, compared with the VVC anchor. We believe that the method of searching for high-frequency terms in the frequency domain helps video coding modules requiring strong/weak HPF and strong/weak LPF for next-generation video coding standards.