Next Article in Journal
Health Status Assessment of Diesel Engine Valve Clearance Based on BFA-BOA-VMD Adaptive Noise Reduction and Multi-Channel Information Fusion
Next Article in Special Issue
Feature Pyramid Networks and Long Short-Term Memory for EEG Feature Map-Based Emotion Recognition
Previous Article in Journal
EDLaaS:Fully Homomorphic Encryption over Neural Network Graphs for Vision and Private Strawberry Yield Forecasting
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Intelligent Motor Imagery Detection System Using Electroencephalography with Adaptive Wavelets

by
Smith K. Khare
1,
Nikhil Gaikwad
1 and
Neeraj Dhanraj Bokde
2,*
1
Department of Electrical & Computer Engineering, Aarhus University, 8000 Aarhus, Denmark
2
Center for Quantitative Genetics and Genomics, Aarhus University, 8000 Aarhus, Denmark
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(21), 8128; https://doi.org/10.3390/s22218128
Submission received: 30 September 2022 / Revised: 15 October 2022 / Accepted: 21 October 2022 / Published: 24 October 2022
(This article belongs to the Special Issue Biomedical Signal Processing and Health Monitoring Based on Sensors)

Abstract

:
Classification of motor imagery (MI) tasks provides a robust solution for specially-abled people to connect with the milieu for brain-computer interface. Precise selection of uniform tuning parameters of tunable Q wavelet transform (TQWT) for electroencephalography (EEG) signals is arduous. Therefore, this paper proposes robust TQWT for automatically selecting optimum tuning parameters to decompose non-stationary EEG signals accurately. Three evolutionary optimization algorithms are explored for automating the tuning parameters of robust TQWT. The fitness function of the mean square error of decomposition is used. This paper also exploits channel selection using a Laplacian score for dominant channel selection. Important features elicited from sub-bands of robust TQWT are classified using different kernels of the least square support vector machine classifier. The radial basis function kernel has provided the highest accuracy of 99.78%, proving that the proposed method is superior to other state-of-the-art using the same database.

1. Introduction

The recent increase in Brain-computer interface (BCI) has attracted researchers to develop solutions for computers and other devices with the aid of brain activities. BCI manipulates the brain’s electrical activities to help the specially-abled carry out their routine tasks. The cognitive activities accessed through electroencephalogram (EEG) signals provide an intelligent solution to assist specially-abled individuals to accomplish body movement just by mere imagination without any external support is motor imagery (MI) classification [1]. Non-invasive nature and wide exposure of EEG signals for various neurological activities makes it most viable for modelling BCI systems [2,3,4,5,6].
Several techniques using EEG signals exploring time, frequency and time-frequency (TF) domain computation have been developed to detect MI tasks. Separation of MI tasks by distinction sensitive learning vector quantization based adaptive autoregression model has been proposed in [7]. Welch spectral analysis method based on fast Fourier transform (FFT) with decision tree classifier has been used for discrimination of brain activities [8]. Regularized common spatial patterns (R-CSP) [9], filtered regularized CSP (FRCSP) [10], weighted and regularized CSP [11], CSP with particle swarm optimization (PSO) [12], optimization of filterbanks and time window within CSP [13] and adaptive removal of artifacts within CSP [14] have been explored for the MI classification. Cross-correlation (CC) and support vector machine with least square (LS-SVM) has been used in [15] for bifurcation of MI tasks. Cross-correlation [16] and modified cross-correlation (M-CC) [17] with logistic regression (LR) have been proposed for identification of MI. The utility of optimal allocation (OA) algorithm using Naive Bayes (NB) and LS-SVM have been used in MI recognition [18,19]. Power spectral density, phase lock value (PLV) with CC [20], and PLV with spectral coherence [21] have been proposed for MI detection.
Wavelet transform (WT) and Wilcoxon statistical method with tabu fuzzy standards have been used in [22]. Isolation of MI has been accomplished using machine learning techniques combined with discrete WT (DWT) [23,24], rational dilation WT (RDWT) [25], and tunable Q WT (TQWT) [26]. Empirical mode decomposition (EMD) with Hilbert transform [27] based on AM-FM intrinsic mode functions has also been used for recognizing MI tasks. Several TF analysis has also been proposed for MI classification. Classification of MI tasks using TF analysis filtered based FFT with long-short term memory [28], WT [29], and continuous WT (CWT) [30] with convolutional neural networks (CNN) have been proposed. Multivariate EMD with Gaussian SVM has been used for MI identification [31]. In addition to this, Z-score [32], multiscale principal component analysis (MSPCA) with wavelet packet decomposition (WPD) [33], clustering technique (CT) [34], adaptive space-time-frequency analysis [35] and comprehensive spectral methods [36] have been proposed for segregations of MI tasks. An automated form of variational mode decomposition combined with extreme learning machine classifier has been also used to detect MI tasks [37]. In [38], the authors explored hybridization of MSPCA combined with WPD to extract hidden information from EEG using subbands. The utility of flexible analytic wavelet transform (FAWT) has been used to extract and classify the evaluated time-frequency features from the subbands using linear discriminant analysis classifier [39]. The time-series analysis using a CNN module has been explored to detect MI tasks [40]. The authors in [41] explored multiscale Siamese CNN with cross-channel fusion to detect MI. The classification of MI has been accomplished using multi-branch hybrid neural network [42]. Efficient and accurate modelling of BCI systems is only possible with proper selection of channels, decomposition technique, machine learning or deep learning framework, and evaluation of performance indices [43]. Most of the signal decomposition methods used in the literature use an empirical selection of fixed basis functions. The choice of fixed basis function for non-stationary EEG signals may not properly decompose EEG signals. This inspires us to present adaptive tuning parameters selection for fruitful EEG analysis. This methodology proposes robust TQWT using evolutionary optimization algorithms (EOA) for quintessential tuning parameters and Laplacian score for channel selection. The novelty of the method is as follows:
  • Exploring evolutionary optimization for adaptive selection of proper basis function;
  • Use of optimum decomposition level to decompose the signal into sub-bands;
  • Exploring the utility of Laplacian score for selecting proper channels to reduce computational complexity.
The automated and adaptive TQWT has been used to various physiological conditions (sleep, emotions, and drowsiness) [44,45,46] and neurological disorders (schizophrenia and Parkison’s disease) [47,48,49]. The paper is structured as datasets, preprocessing, robust TQWT, feature extraction, channel selection, and classification are described in Section 2. Section 3 explains the results of computation of the explored method, discussion with state-of-the-art techniques (SOTA) in Section 4. The gist of the developed technique is presented in Section 5.

2. Methodology

2.1. Data-Set

The proposed method uses the IV-a dataset of BCI competition-III [50]. MI-tasks of five healthy subjects (aa, al, av, aw, ay) sat on comfortable chairs have been recorded. Subjects performed the MI tasks of right foot (RF) (task1) and right hand (RH) (task2). According to the international 10–20 system, one hundred eighteen electrodes are used to acquire the EEG recordings of MI-related tasks. For intimation of MI tasks, subjects are shown with visual cues of 3.5 s before acquiring EEG signals [51]. For each subject, a total of 280 trials are taken. Each task has 140 trials equally. Each subject consists of different sizes of training and testing sets. Out of 280 trials, for subjects aa, al, av, aw, ay training set composed of 168, 224, 84, 56 and 28 trials and remaining used for testing. The actual sampling rate in recording EEG signals is 1000 Hz, later downsampling at 100 Hz. The stepwise working of the proposed method is shown in Figure 1.

2.2. Pre-Processing

For BCI, two types of oscillations play a vital role, Rolandic mu and central beta lying in the frequency range of 7-30 Hz [52]. These oscillations originate in the sensorimotor cortex. Hence the EEG signals are bandpass through a sixth-order Butterworth IIR filter in the frequency range of 7-30 Hz. After the BPF, the filtered data of RF and RH has been segmented into 250 and 200 epochs of length 2000 samples each for every channel for further processing. The RF and RH EEG signals are shown in Figure 2, respectively. It is evident from the Figure that both filtered EEG signals of RF and RH have the same amplitude range, making it difficult to classify MI tasks.

2.3. Robust Tunable Q Wavelet Transform (r-TQWT)

A TQWT is a parametrized discrete-time WT with a tunable quality factor. To decompose the signal into subbands (SBs) using TQWT requires quality factor (Q), redundancy rate (r) and levels of decomposition (L) as a basis function. Decomposing a signal with L level results in the generation of one lowpass SB (LPS) and L highpass SBs (HPS). TQWT can tune the Q as per the oscillatory behavior of signals. The higher quality factor is recommended for better frequency resolution and a higher redundancy rate for the well-localized time domain. After the L level decomposition of signal, LPS V 0 L ( ω ) and HPS V 1 L ( ω ) are represented by [53]
V 0 L ( ω ) = l = 0 L 1 V 0 ω α m , | ω | α L π 0 , α L π < | ω | π
V 1 L ( ω ) = V 1 ω α L 1 m = 0 L 2 V 0 ω α m , ( 1 β ) α L 1 π | ω | α L 1 π 0 , ω [ π , π ]
With the tuning property of Q and r following the highly oscillatory nature of EEG signals, TQWT has gained wide acceptance in signal processing. The experiential selection of fixed tuning parameters may lead to the improper decomposition of EEG signals and the loss of some critical information. Setting a common for different EEG signals can lead to a higher decomposition error. The non-stationary nature of EEG signals requires the different values of tuning parameters for every set EEG signal for accurate reconstruction and better decomposition. This inspires us to propose the robust TQWT for selecting appropriate tuning parameters with the help of EOAs using the fitness function of mean square error (MSE) of decomposition. To resolve an issue of uniform tuning parameters, robust TQWT is proposed to automate the selection of Q and r using EOAs. The steps for robust TQWT are described in Algorithm 1. The quality factor of TQWT, which must be higher for signals with higher oscillations, is represented by
Q u a l i t y F a c t o r ( Q ) = 2 β β
Algorithm 1 Robust TQWT
1:
Select the Q and r initially to 1.
2:
Calculate L m a x from the values of Q and r.
3:
Decompose EEGs with Q, r and L m a x .
4:
Get the approximated original signal by inverse robust TQWT using Q, r and M (No. of time samples).
5:
Compute the MSE of decomposition error w e ( t ) .
6:
while( m i n ( w e ( t ) ) )do
7:
 if (we(t)== min) then
8:
  Optimum tuning parameters ( Q o p t i and r o p t i ).
9:
else
10:
  Iterate for next values of Q and r.
11:
end if
12:
end while
13:
Obtain the maximum decomposition levels L m a x i from Q o p t i and r o p t i .
14:
Evaluate the optimum decomposition levels from Lmax.
15:
Obtain the SBs of EEG signals using the optimum tuning parameters.
where Q o p t i , L m a x i and r o p t i are optimum tuning parameters for signal i.
The time-domain response of the signal is well-localized if r is ≥ 3. The redundancy rate is defined as
r = β 1 α
Maximum levels of decomposition in TQWT is denoted by
L m a x = | log M 4 * ( Q + 1 ) log Q + 1 Q + 1 2 r |
An EEG signal is represented as a combination of approximated and error signal that can be expressed as
f ( t ) = f ^ ( t ) + d e ( t )
where f ( t ) is the original signal in time domain, f ^ ( t ) denotes approximated signal evaluated by inverse TQWT, and decomposition error is d e ( t ) . To reconstruct the decomposed EEG signal with minimum decomposition error, mean square error is chosen as an fitness function of EOA represented by
w e ( t ) = + [ f ( t ) f ^ ( t ) ] 2 d t
Obtaining the minimum decomposition error of EEG signals by manually selecting the optimum tuning parameters is laborious. To overcome this, heuristic optimization techniques, namely PSO, ABC, and CS, are used to automate the tuning parameters. Details of these optimization algorithms are available in [54]. Optimization algorithms evaluate the fittest solution by repetitive iterations using several search agents. PSO mimics the behaviour of bird flocks and fish schooling to get the optimal global solution. The fittest solution formulas of PSO are expressed by
v i n + 1 = Y [ v i n + φ ( a 1 . ( p i n x i n ) + a 2 . ( g i n x i n ) ) ] x i n + 1 = x i n + v i
where Y is the constriction factor to increase the chances of convergence, p i and g i are the personal and global best. a 1 and a 2 are the personal and social cognitive factors, and φ is the random number in the range 0 to 1. The ABC algorithm copies the honey bees’ intelligent behaviour in search of nectar. The update equation to find the optimal solution is given by
v i = x i + κ i ( x i x r ) h i ( x i ) = 1 1 + f i ( x i ) f i ( x i ) 0 1 + a b s ( f i ( x i ) ) , f i ( x i ) < 0 p s i = h i ( x i ) i = 1 F N h i ( x i )
where v i and x i are the i t h particle velocity and position, x r is the randomly selected food source, fitness function is denoted by h i , κ is random number in the range {−1, 1} both are inclusive. f i is the value of fitness function for solution x i , probability is denoted by p s i and number of food sources are F N . The cuckoo search algorithm impersonates the cuckoo bird species’ broot parasite and Levy flight property. Following the Levy flight, the new solution of CS is generated by
x i ( n + 1 ) = x i ( n ) + δ L e v y ( β ) L e v y μ = n 1 β ( 0 < β < 2 )
where L e v y is the Levy distribution, δ is the step size mostly equal to 1, and ⊗ is the matrix multiplication. Once the optimum Q and r are obtained from EOA, the maximum decomposition level is calculated from Equation (5). To maintain the uniformity among all the decomposed EEG signals, the optimum level of the decomposition L o p t is evaluated. The equation of the L o p t is defined by
L o p t = 1 P c = 1 C 1 C p = 1 P L m a x
where P is the number of signals belonging to each class and C are the number of classes. The examples of subbands obtained after r-TQWT decomposition for RF and RH brain activities are shown in Figure 3 and Figure 4. It is seen from the Figures that subbands of RH and RF have different amplitude ranges, which depicts their better discrimination ability. Thus, the decomposition of r-TQWT extracts insight information of the EEG signals. Therefore, the idea of r-TQWT is justified for detecting brain activities.

2.4. Features Extraction and Channel Selection

Features represent the statistical measures of the decomposed EEG signals. To discriminate the motor imagery tasks, five statistical parameters are evaluated with details as follow.

2.4.1. Hurst Exponent (HE)

HE measures long-term memory of time series. HE quantifies the relative tendency of time series either regress sharply to cluster in a direction or to the mean.
H E = E r ( J ) σ ( J )
where E is the expected value, r is the range, J are the number of samples in each signal and σ is the standard deviation.

2.4.2. Modified Mean Absolute value1 (MAV1)

MAV1 [55] is the extension of mean absolute value with assignment of weighted window function w j for improving the robustness.
M A V 1 = 1 J j = 1 J w j | y j | w j = 1 , 0.25 J j 0.75 J 0.5 , o t h e r w i s e

2.4.3. Difference Absolute Standard Deviation Value (DASDV)

DASDV [55] is representing the standard deviation value of the wavelength.
D A S D V = 1 J 1 j = 1 J 1 ( y j + 1 y j ) 2

2.4.4. Log Energy Entropy (LEE)

LEE [56] is a measure of the complexity of the EEG signals.
L E E = j = 0 J 1 ( log 2 ( p j ( y ) ) 2
where p j is the probability of occurance of y.

2.4.5. Variance

Variance measure the variation in the data points of the data defined by
V a r i a n c e ( σ 2 ) = [ y μ ] 2 J
The features elicited from the filtered robust TQWT decomposed SBs are computed for 118 channels. To reduce the complexity of the BCI system, instead of exploring all the channels for classification, the adequacy of the single EEG channel is used in this framework. Laplacian score (LS), based on Laplacian Eigenmaps and locality preserving projection, is explored for selecting appropriate channels. The Laplacian score for the k t h feature is defined as [57].
L k = F k ˜ T L F k ˜ F k ˜ T D F k ˜ F k ˜ = F k F k T D 1 1 T D 1 1 S i j = e x p | | y i y j | | 2 t
where F k is the k t h feature matrix, T is the transform, 1 = [ 1 , 1 , . . . . . 1 ] T , D = d i a g (S1) and the Laplacian graph L = S D . i and j correspond to nodes y i and y j , while t is the constant, respectively.

2.5. Classifiers

Statistically, significant features are classified using classification techniques. This methodology uses the LS-SVM classifier to discriminate against the RH and RF activities. LS-SVM involves the formulation of inequality constraints that transform non-linear problems into linear equations with a rigid regression cost function. For a training set of data length of N points { z i , y i } i = 1 N the decision function of the LS-SVM classifier [58] is defined as
z ( y ) = s i g n i = 1 N a i z i Ψ ( y , y i ) + β
where y i I R n is the i t h input feature vector and z i I R is the i t h output pattern. a i is the positive real coefficient, β is the real constant biasing term, Ψ ( y , y i ) is the kernel function. Five kernels namely linear, polynomial, Mexican hat (MHW), Morlet (MW), and Radial basis function (RBF) have been used in this framework to test the compatibility of the proposed method. The details of these kernels are available in [59]. The linear kernel is expressed as
Ψ ( y , y i ) = ( y i T y )
The polynomial kernel can be defined as
Ψ ( y , y i ) = ( y i T y + 1 ) l
The equation of MHW kernel is denoted as
Ψ ( y , y i ) = i = 1 N 1 ( y y i ) 2 a i 2 . e x p | | y y i | | 2 2 a i 2
MW kernel is represented as
Ψ ( y , y i ) = i = 1 N c o s ω 0 ( y y i ) a i . e x p | | y y i | | 2 2 a i 2
The RBF kernel is defined by
Ψ ( y , y i ) = e x p | | y y i | | 2 2 σ 2
where l is the degree of polynomial kernel, σ is the RBF kernel width, ω 0 and a are the parameters of MHW and MW kernels.

3. Results

The selection of fixed basis functions for decomposing non-stationary EEG signals may result in information loss. Setting the tuning parameters of TQWT may not yield the desired results, leading to higher misclassification. The method proposed in this paper uses the automatic selection of tuning parameters to decompose EEG signals using EOA accurately. PSO, ABC, and CS optimizations are used for self-selection of Q, r and L o p t to excerpt the time-domain features from the SBs of decomposed signals. To maintain the effectiveness of the proposed method number of iterations (200) and search agents (50) is kept uniform. To choose the tuning parameters adaptively for every EEG signal, the fitness function of the MSE of the reconstructed and the original signal is considered.
The decomposition error obtained for robust TQWT using EOA is shown in Table 1. The average MSE using EOA is minimum in the case of CS algorithm with 2.548 × 10 05 for RF and 2.352 × 10 05 for RH while it is maximum for PSO producing the error as 7.822 × 10 05 and 5.997 × 10 05 for RF and RH, respectively. The least average MSE is obtained for the cuckoo search algorithm, which inspires us to use the optimum parameters of this algorithm over other EOA. L m a x evaluated from Q and r is used to compute L o p t from Equation (11) is obtained as 5. These optimum Q, r and L o p t are employed to obtain the SBs of EEG.
Features from 118 electrodes are elicited from decomposed SBs. Employing features of 118 electrodes for classifying MI tasks increases the system’s complexity. Therefore, the Laplacian feature score is evaluated to select the substantial channel for performance evaluation. The Laplacian score of the five time-domain features is shown in Table 2. Out of 118 channels, LS of the best performing seven channels is shown in the table. Features of a channel with the highest Laplacian score are considered significant for classification. LS for four features, MAV1, LEE, variance, and HE, produce the highest score for channel-1, while DASDV provides the best score for channel-9. Results of Table 2 prove the superiority of channel-1; hence features of this channel are taken into consideration for further evaluation. Kruskal Wallis (KW) analysis is applied to the extracted features of channel-1 to check the discrimination ability of the features. KW test is a non-parameterized analysis of variance that gives the c h i ( p ) probability. The probabilistic values of p < 0.05 are considered to be significant. Table 3 represents the probabilistic values of various features of the SBs on channel-1. As observed from the table, five features, MAV1, LEE, DASDV, variance, and HE, show the compelling discrimination ability for all the SBs and motivate us to use these feature sets for the segregation of the MI tasks.
Five kernels of LS-SVM classifiers are employed in this method to evaluate the classification accuracy of different SBs of channel-1. Table 4 indicates the accuracy (ACC) score of SBs using the LS-SVM classification technique. Table 4 shows that the worst-performing is the linear kernel, while the RBF kernel gives the best performance in all the SBs. SB5 is most superior, while SB6 is most inferior in the case of the linear kernel with a classification accuracy of 73.56% and 61.56%. The highest accuracy score provided by polynomial and Morlet is in SB4, providing an ACC of 89.78% and 92.44%, while the ACC of 97.56% is recorded highest in SB3 for the Mexican hat kernel. RBF kernel is the best performing kernel among all with ACC of 95.56%, 98.22%, 96%, 95.78%, 99.78% and 72.44% for SB1, SB2, SB3, SB4, SB5 and SB6, respectively.
As the RBF kernel overperforms other kernels, it is used to evaluate the performance parameters of channel-1. Table 5 shows the results of the performance parameters evaluated on all the SBs of channel 1. Five performance parameters are evaluated to test the dominance of the proposed methodology, viz. ACC, sensitivity (SEN), specificity (SPE), F-1 score and Matthews correlation coefficient (MCC), respectively. As observed from the table, SB5 gives the best results, while SB-6 is the worst performing SB. ACC of 99.78%, SEN and SPE are 99.60% and 100%, F-1 score is noted 0.998 while MCC 99.55%is marked as best scores for SB5. Worst values of ACC, SEN, SPE, F-1 score and MCC is obtained in SB6 as 72.44%, 75%, 69.19%, 0.752% and 44.14% respectively. The binary classification ability of the model is evaluated using the analysis of receiver operating characteristics and area under the curve, as shown in Figure 5. Our model has obtained the area under the curve of 99.81% with a minimal standard deviation depicting its binary classification ability. The confusion matrix of RF and RH is indicated in Table 6. The confusion matrix of RF is given 100% correct and 0% misclassification, while RH provides an incorrect classification of 0.5% and 99.5% of correct classification.

4. Discussion

The proposed framework is compared with the existing SOTA using the same database for its effectiveness. The performance of the proposed method is compared with 15 SOTA techniques considering the number of channels and features they have used, as shown in Table 7. Ince et al. [35] used the class separability (CT) method with SVM using three channels and eight features with 96% accuracy. Different versions of CSP have also been employed by Park et al. [10], and Lu et al. [9] to detect the MI tasks with an accuracy mark of 86.23% and 88.32%. Siuly et al. explored cross-correlation based signal processing [15,16,17] and optimal allocation [18,19] for recognition of MI tasks. The highest accuracy achieved is 96.62% while using OA and LS-SVM. Zhang et al. [32] used Z-score claimed 81.1% accuracy using linear discriminant analysis (LDA); the ACC of 96.1% was achieved by Verma et al. [33] using DWT. Kevric et al. [23] used MSPCA, WPD and higher-order statistics (HOS), claiming an ACC of 92.8%. Taran et al. [26,27] used EMD, and TQWT to discriminate brain activities and achieved an ACC of 96.89% and 97.56% using LS-SVM, respectively. Taran et al. [25] used RDWT and quadratic SVM classifier combining 10 channels and five features to obtain an ACC of 99.11%. Recently proposed MI tasks classification method using CWT and CNN by Chaudhary et al. [30] achieved an ACC of 99.35%. Subasi and Qaisar [38] developed a hybrid model combing hybridization of MSPCA and WPD to extract the SB. Six statistical measures extracted from the SB have been classified using ensemble classifier techniques. Their model yielded the highest accuracy of 98.69% using an RF classifier. The proposed method uses single-channel selection by Laplacian score and four time-domain features for classification of MI tasks using RBF kernel to achieve an ACC of 99.78% which is higher than all the SOTA using the same database.
The developed model has following advantages:
  • The model is robust (developed using a 10-fold cross-validation technique).
  • The developed model is simple (requiring only a single channel and five features to compute model performance).
  • The model is data-driven (does not require selection of basis).
However, the model suffers some limitations which are as follows:
  • The model is tested on a single EEG dataset with only five subjects.
  • The model does not provide explainability for the predictions.

5. Conclusions

This method explores the utility of automatic selection of optimum tuning parameters of robust TQWT using evolutionary optimization algorithms. The adaptive selection of optimum tuning parameters is accomplished using PSO, ABC and CS algorithms. CS provides the fittest solution for the objective function; hence, the tuning parameters of CS are used to evaluate optimum decomposition levels and decompose the signal with these parameters. This method exploits the LS for selecting a dominant channel for segregating MI tasks using the LS-SVM classifier. The proposed method obtained an ACC of 99.78% which is higher than all other methods using the same database. The method proposed in this paper can be employed in a real-time BCI system to recognise MI tasks with lowered complexity as it uses only a single channel with a lower number of features.

Author Contributions

Conceptualization, S.K.K.; methodology, S.K.K.; software, S.K.K.; validation, S.K.K., N.G. and N.D.B.; formal analysis, S.K.K.; investigation, S.K.K. and N.D.B.; data curation, S.K.K., N.G. and N.D.B.; writing—original draft preparation, S.K.K.; writing—review and editing, S.K.K., N.G. and N.D.B.; visualization, S.K.K. and N.D.B.; supervision, S.K.K. and N.D.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

The data is taken from BCI Competition III which is available at https://www.bbci.de/competition/iii/(accessed on 31 December 2020).

Acknowledgments

The authors would like to thanks BCI Competition III for providing open access to the EEG dataset. The authors would also like to thank Varun Bajaj, Indian Institute of Information Technology, Design, and Manufacturing (IIITDM) Jabalpur, India for his support and motivation.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
EEGElectroencephalogram
MIMotor imagery
TFTime-frequency
FFTFast Fourier transform
R-CSP   Regularized common spatial patterns
FRCSPFiltered regularized CSP
PSOParticle swarm optimization
LS-SVMsupport vector machine with least square
M-CCModified cross-correlation
OAOptimal allocation
PLVPhase lock value
NBNaive Bayes
WTWavelet transform
EMDEmpirical mode decomposition
DWTDiscrete WT
RDWTRational dilation WT
TQWTTunable Q WT
CNNconvolutional neural networks
WPDwavelet packet decomposition
MSPCAmultiscale principal component analysis
r-TQWTRobust Tunable Q Wavelet Transform
SBSubbands
LPSlowpass subbands
HPSHigh pass subbands
EOAevolutionary optimization algorithms
SOTAstate-of-the-art techniques
ABCArtificial Bee Colony
CSCuckoo search

References

  1. Neuper, C.; Müller, G.; Kübler, A.; Birbaumer, N.; Pfurtscheller, G. Clinical application of an EEG-based brain–computer interface: A case study in a patient with severe motor impairment. Clin. Neurophysiol. 2003, 114, 399–409. [Google Scholar] [CrossRef]
  2. Khare, S.K.; Bajaj, V. A CACDSS for automatic detection of Parkinson’s disease using EEG signals. In Proceedings of the 2021 International Conference on Control, Automation, Power and Signal Processing (CAPS), Jabalpur, India,, 10–12 December 2021; pp. 1–5. [Google Scholar]
  3. Kbah, S.N.S.; Al-Qazzaz, N.K.; Jaafer, S.H.; Sabir, M.K. Epileptic EEG Activity Detection for Children using Entropy-based Biomarkers. Neurosci. Inform. 2022, 2, 100101. [Google Scholar] [CrossRef]
  4. Sarkar, A.; Singh, A.; Chakraborty, R. A deep learning-based comparative study to track mental depression from EEG data. Neurosci. Inform. 2022, 2, 100039. [Google Scholar] [CrossRef]
  5. Khare, S.K.; Gaikwad, N.B.; Bajaj, V. VHERS: A novel Variational Mode Decomposition and Hilbert Transform based EEG rhythm separation for automatic ADHD detection. IEEE Trans. Instrum. Meas. 2022, 71, 4008310. [Google Scholar] [CrossRef]
  6. Khare, S.; Nishad, A.; Upadhyay, A.; Bajaj, V. Classification of emotions from EEG signals using time-order representation based on the S-transform and convolutional neural network. Electron. Lett. 2020, 56, 1359–1361. [Google Scholar] [CrossRef]
  7. Pfurtscheller, G.; Neuper, C.; Schlogl, A.; Lugger, K. Separability of EEG signals recorded during right and left motor imagery using adaptive autoregressive parameters. IEEE Trans. Rehabil. Eng. 1998, 6, 316–325. [Google Scholar] [CrossRef] [Green Version]
  8. Polat, K.; Güneş, S. Classification of epileptiform EEG using a hybrid system based on decision tree classifier and fast Fourier transform. Appl. Math. Comput. 2007, 187, 1017–1026. [Google Scholar] [CrossRef]
  9. Lu, H.; Eng, H.; Guan, C.; Plataniotis, K.N.; Venetsanopoulos, A.N. Regularized Common Spatial Pattern with Aggregation for EEG Classification in Small-Sample Setting. IEEE Trans. Biomed. Eng. 2010, 57, 2936–2946. [Google Scholar]
  10. Park, S.; Lee, D.; Lee, S. Filter Bank Regularized Common Spatial Pattern Ensemble for Small Sample Motor Imagery Classification. IEEE Trans. Neural Systems Rehabil. Eng. 2018, 26, 498–505. [Google Scholar] [CrossRef]
  11. Mishuhina, V.; Jiang, X. Feature Weighting and Regularization of Common Spatial Patterns in EEG-Based Motor Imagery BCI. IEEE Signal Process. Lett. 2018, 25, 783–787. [Google Scholar] [CrossRef]
  12. Duan, L.; Hongxin, Z.; Khan, M.S.; Fang, M. Recognition of motor imagery tasks for BCI using CSP and chaotic PSO twin SVM. J. China Univ. Posts Telecommun. 2017, 24, 83–90. [Google Scholar] [CrossRef]
  13. Zhang, Y.; Nam, C.S.; Zhou, G.; Jin, J.; Wang, X.; Cichocki, A. Temporally Constrained Sparse Group Spatial Patterns for Motor Imagery BCI. IEEE Trans. Cybern. 2019, 49, 3322–3332. [Google Scholar] [CrossRef] [PubMed]
  14. Mo, H.; Zhao, Y. Motor Imagery Electroencephalograph Classification Based on Optimized Support Vector Machine by Magnetic Bacteria Optimization Algorithm. Neural Process. Lett. 2016, 44, 185–197. [Google Scholar] [CrossRef]
  15. Siuly, S.; Li, Y. Improving the Separability of Motor Imagery EEG Signals Using a Cross Correlation-Based Least Square Support Vector Machine for Brain–Computer Interface. IEEE Trans. Neural Systems Rehabil. Eng. 2012, 20, 526–538. [Google Scholar] [CrossRef] [PubMed]
  16. Siuly, S.; Li, Y.; Wen, P. Identification of Motor Imagery Tasks Through CC-LR Algorithm in Brain Computer Interface. Int. J. Bioinform. Res. Appl. 2013, 9, 156–172. [Google Scholar] [CrossRef] [PubMed]
  17. Siuly; Li, Y.; Wen, P.P. Modified CC-LR algorithm with three diverse feature sets for motor imagery tasks classification in EEG based brain–computer interface. Comput. Methods Programs Biomed. 2014, 113, 767–780. [Google Scholar] [CrossRef] [PubMed]
  18. Siuly, S.; Li, Y. Discriminating the brain activities for brain–computer interface applications through the optimal allocation-based approach. Neural Comp. Appl. 2015, 26, 799–811. [Google Scholar] [CrossRef]
  19. Siuly; Wang, H.; Zhang, Y. Detection of motor imagery EEG signals employing Naïve Bayes based learning process. Measurement 2016, 86, 148–158. [Google Scholar] [CrossRef]
  20. Park, S.A.; Hwang, H.J.; Lim, J.H.; Choi, J.H.; Jung, H.K.; Im, C.H. Evaluation of feature extraction methods for EEG-based brain–computer interfaces in terms of robustness to slight changes in electrode locations. Med. Biol. Eng. Comput. 2013, 51, 571–579. [Google Scholar] [CrossRef]
  21. Gysels, E.; Celka, P. Phase synchronization for the recognition of mental tasks in a brain-computer interface. IEEE Trans. Neural Systems Rehabil. Eng. 2004, 12, 406–415. [Google Scholar] [CrossRef] [Green Version]
  22. Nguyen, T.; Khosravi, A.; Creighton, D.; Nahavandi, S. Fuzzy system with tabu search learning for classification of motor imagery data. Biomed. Signal Process. Control 2015, 20, 61–70. [Google Scholar] [CrossRef]
  23. Kevric, J.; Subasi, A. Comparison of signal decomposition methods in classification of EEG signals for motor-imagery BCI system. Biomed. Signal Process. Control 2017, 31, 398–406. [Google Scholar] [CrossRef]
  24. Mirvaziri, H.; Mobarakeh, Z.S. Improvement of EEG-based motor imagery classification using ring topology-based particle swarm optimization. Biomed. Signal Proc. Control 2017, 32, 69–75. [Google Scholar] [CrossRef]
  25. Taran, S.; Khare, S.K.; Bajaj, V.; Sinha, G.R. Classification of motor-imagery tasks from EEG signals using the rational dilation wavelet transform. Model. Anal. Act. Biopotential Signals Healthc. 2020, 2, 2053–2563. [Google Scholar]
  26. Taran, S.; Bajaj, V. Motor imagery tasks-based EEG signals classification using tunable-Q wavelet transform. Neural Comp. Appl. 2018, 31, 6925–6932. [Google Scholar] [CrossRef]
  27. Taran, S.; Bajaj, V.; Sharma, D.; Siuly, S.; Sengur, A. Features based on analytic IMF for classifying motor imagery EEG signals in BCI applications. Measurement 2018, 116, 68–76. [Google Scholar] [CrossRef]
  28. Wang, P.; Jiang, A.; Liu, X.; Shang, J.; Zhang, L. LSTM-Based EEG Classification in Motor Imagery Tasks. IEEE Trans. Neural Systems Rehabil. Eng. 2018, 26, 2086–2095. [Google Scholar] [CrossRef]
  29. Xu, B.; Zhang, L.; Song, A.; Wu, C.; Li, W.; Zhang, D.; Xu, G.; Li, H.; Zeng, H. Wavelet Transform Time-Frequency Image and Convolutional Network-Based Motor Imagery EEG Classification. IEEE Access 2019, 7, 6084–6093. [Google Scholar] [CrossRef]
  30. Chaudhary, S.; Taran, S.; Bajaj, V.; Sengur, A. Convolutional Neural Network Based Approach Towards Motor Imagery Tasks EEG Signals Classification. IEEE Sens. J. 2019, 19, 4494–4500. [Google Scholar] [CrossRef]
  31. Park, C.; Looney, D.; ur Rehman, N.; Ahrabian, A.; Mandic, D.P. Classification of Motor Imagery BCI Using Multivariate Empirical Mode Decomposition. IEEE Trans. Neural Systems Rehabil. Eng. 2013, 21, 10–22. [Google Scholar] [CrossRef] [Green Version]
  32. Zhang, R.; Xu, P.; Guo, L.; Zhang, Y.; Li, P.; Yao, D. Z-Score Linear Discriminant Analysis for EEG Based Brain-Computer Interfaces. PLoS ONE 2013, 8, e74433. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Verma, N.K.; Rao, L.S.V.S.; Sharma, S.K. Motor imagery EEG signal classification on DWT and crosscorrelated signal features. In Proceedings of the 2014 9th International Conference on Industrial and Information Systems (ICIIS), Gwalior, India, 15–17 December 2014; pp. 1–6. [Google Scholar]
  34. Siuly, S.; Li, Y.; Wen, P.P. Clustering technique-based least square support vector machine for EEG signal classification. Comput. Methods Programs Biomed. 2011, 104, 358–372. [Google Scholar] [CrossRef] [PubMed]
  35. Ince, N.F.; Goksu, F.; Tewfik, A.H.; Arica, S. Adapting subject specific motor imagery EEG patterns in space–time–frequency for a brain computer interface. Biomed. Signal Process. Control 2009, 4, 236–246. [Google Scholar] [CrossRef]
  36. Herman, P.; Prasad, G.; McGinnity, T.M.; Coyle, D. Comparative Analysis of Spectral Approaches to Feature Extraction for EEG-Based Motor Imagery Classification. IEEE Trans. Neural Systems Rehabil. Eng. 2008, 16, 317–326. [Google Scholar] [CrossRef] [PubMed]
  37. Khare, S.K.; Bajaj, V. A facile and flexible motor imagery classification using electroencephalogram signals. Comput. Methods Programs Biomed. 2020, 197, 105722. [Google Scholar] [CrossRef] [PubMed]
  38. Subasi, A.; Mian Qaisar, S. The ensemble machine learning-based classification of motor imagery tasks in brain-computer interface. J. Healthc. Eng. 2021, 2021, 1970769. [Google Scholar] [CrossRef]
  39. You, Y.; Chen, W.; Zhang, T. Motor imagery EEG classification based on flexible analytic wavelet transform. Biomed. Signal Process. Control 2020, 62, 102069. [Google Scholar] [CrossRef]
  40. Xiao, X.; Fang, Y. Motor imagery EEG signal recognition using deep convolution neural network. Front. Neurosci. 2021, 15, 655599. [Google Scholar] [CrossRef]
  41. Shen, L.; Xia, Y.; Li, Y.; Sun, M. A multiscale siamese convolutional neural network with cross-channel fusion for motor imagery decoding. J. Neurosci. Methods 2022, 367, 109426. [Google Scholar] [CrossRef]
  42. Ma, W.; Xue, H.; Sun, X.; Mao, S.; Wang, L.; Liu, Y.; Wang, Y.; Lin, X. A novel multi-branch hybrid neural network for motor imagery EEG signal classification. Biomed. Signal Process. Control 2022, 77, 103718. [Google Scholar] [CrossRef]
  43. Khademi, S.; Neghabi, M.; Farahi, M.; Shirzadi, M.; Marateb, H.R. A comprehensive review of the movement imaginary brain-computer interface methods: Challenges and future directions. In Artificial Intelligence-Based Brain-Computer Interface; Academic Press: Cambridge, MA, USA, 2022; pp. 23–74. [Google Scholar]
  44. Khare, S.K.; Bajaj, V. Constrained based tunable Q wavelet transform for efficient decomposition of EEG signals. Appl. Acoust. 2020, 163, 107234. [Google Scholar] [CrossRef]
  45. Khare, S.; Bajaj, V. Optimized Tunable Q Wavelet Transform Based Drowsiness Detection from Electroencephalogram Signals. IRBM 2020, 43, 13–21. [Google Scholar] [CrossRef]
  46. Khare, S.K.; Bajaj, V.; Sinha, G.R. Adaptive Tunable Q Wavelet Transform-Based Emotion Identification. IEEE Trans. Instrum. Meas. 2020, 69, 9609–9617. [Google Scholar] [CrossRef]
  47. Khare, S.K.; Bajaj, V. A self-learned decomposition and classification model for schizophrenia diagnosis. Comput. Methods Programs Biomed. 2021, 211, 106450. [Google Scholar] [CrossRef] [PubMed]
  48. Khare, S.K.; Bajaj, V.; Acharya, U.R. Detection of Parkinson’s disease using automated tunable Q wavelet transform technique with EEG signals. Biocybern. Biomed. Eng. 2021, 41, 679–689. [Google Scholar] [CrossRef]
  49. Murugappan, M.; Alshuaib, W.; Bourisly, A.K.; Khare, S.K.; Sruthi, S.; Bajaj, V. Tunable Q wavelet transform based emotion classification in Parkinson’s disease using Electroencephalography. PLoS ONE 2020, 15, e0242014. [Google Scholar] [CrossRef]
  50. Blankertz, B.; Muller, K.; Krusienski, D.J.; Schalk, G.; Wolpaw, J.R.; Schlogl, A.; Pfurtscheller, G.; Millan, J.R.; Schroder, M.; Birbaumer, N. The BCI competition III: Validating alternative approaches to actual BCI problems. IEEE Trans. Neural Systems Rehabil. Eng. 2006, 14, 153–159. [Google Scholar] [CrossRef]
  51. Dornhege, G.; Blankertz, B.; Curio, G.; Muller, K. Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigms. IEEE Trans. Biomed. Eng. 2004, 51, 993–1002. [Google Scholar] [CrossRef]
  52. Pfurtscheller, G.; Neuper, C. Motor imagery and direct brain-computer communication. Proc. IEEE 2001, 89, 1123–1134. [Google Scholar] [CrossRef]
  53. Selesnick, I.W. Wavelet Transform With Tunable Q-Factor. IEEE Trans. Signal Process. 2011, 59, 3560–3575. [Google Scholar] [CrossRef]
  54. Ab Wahab, M.N.; Nefti-Meziani, S.; Atyabi, A. A Comprehensive Review of Swarm Optimization Algorithms. PLoS ONE 2015, 10, e0122827. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  55. Phinyomark, A.; Phukpattaranont, P.; Limsakul, C. Feature reduction and selection for EMG signal classification. Expert Syst. Appl. 2012, 39, 7420–7431. [Google Scholar] [CrossRef]
  56. Aydın, S.; Saraoğlu, H.M.; Kara, S. Log Energy Entropy-Based EEG Classification with Multilayer Neural Networks in Seizure. Ann. Biomed. Eng. 2009, 37, 2626. [Google Scholar] [CrossRef] [PubMed]
  57. He, X.; Cai, D.; Niyogi, P. Laplacian Score for Feature Selection. In Proceedings of the 18th International Conference on Neural Information Processing Systems, Vancouver, BC, Canada, 5–8 December 2005; pp. 507–514. [Google Scholar]
  58. Suykens, J.; Vandewalle, J. Least Squares Support Vector Machine Classifiers. Neural Proc. Lett. 1999, 9, 293–300. [Google Scholar] [CrossRef]
  59. Li, Z.; Li, C. Selection of Kernel Function for Least Squares Support Vector Machines in Downburst Wind Speed Forecasting. In Proceedings of the 2018 11th International Symposium on Computational Intelligence and Design (ISCID), Hangzhou, China, 8–9 December 2018; Volume 2, pp. 337–341. [Google Scholar]
Figure 1. Workflow of proposed robust TQWT framework with channel selection.
Figure 1. Workflow of proposed robust TQWT framework with channel selection.
Sensors 22 08128 g001
Figure 2. Examples of EEG signals for RF and RH brain activity.
Figure 2. Examples of EEG signals for RF and RH brain activity.
Sensors 22 08128 g002
Figure 3. The subbands of RF brain activity obtained after r-TQWT decomposition.
Figure 3. The subbands of RF brain activity obtained after r-TQWT decomposition.
Sensors 22 08128 g003
Figure 4. The subbands of RH brain activity obtained after r-TQWT decomposition.
Figure 4. The subbands of RH brain activity obtained after r-TQWT decomposition.
Sensors 22 08128 g004
Figure 5. Receiver operating characteristics and the area under the curve obtained for binary classification of RH and RF activities.
Figure 5. Receiver operating characteristics and the area under the curve obtained for binary classification of RH and RF activities.
Sensors 22 08128 g005
Table 1. The average MSE obtained for the EEGs of RF and RH brain activities using three EOA.
Table 1. The average MSE obtained for the EEGs of RF and RH brain activities using three EOA.
EOAAverage MSE for the EEGs of RF and RH
RFRH
PSO7.822 × 10 05 5.997 × 10 05
ABC4.356 × 10 05 2.929 × 10 05
CS2.548 × 10 05 2.352 × 10 05
Table 2. Laplacian score of the features for the seven best channels.
Table 2. Laplacian score of the features for the seven best channels.
FeaturesCH1CH2CH3CH5CH6CH9CH11
MAV10.9900.5490.8470.8040.8920.2410.137
LEE0.9140.5250.7110.3560.8990.4680.401
DASDV0.6770.4660.4910.6600.6820.8900.810
Variance0.0760.0080.0130.0150.0540.0150.033
HE0.9110.7060.6210.7560.8250.7450.730
Table 3. Probability of chi (p)-Values of channel 1 SBs.
Table 3. Probability of chi (p)-Values of channel 1 SBs.
SBHEMAV1DASDVLEEVariance
SB16.7 × 10 03 1.9 × 10 03 2.3 × 10 05 7.3 × 10 55 2.0 × 10 04
SB21.9 × 10 04 2.3 × 10 03 8.7 × 10 06 5.6 × 10 50 3.2 × 10 04
SB31.2 × 10 05 8.3 × 10 03 6.1 × 10 06 9.2 × 10 45 7.5 × 10 04
SB44.1 × 10 05 2.5 × 10 02 7.6 × 10 06 2.8 × 10 40 1.3 × 10 03
SB51.0 × 10 04 6.3 × 10 02 9.3 × 10 06 2.2 × 10 34 2.4 × 10 03
SB61.1 × 10 02 7.1 × 10 04 4.6 × 10 02 3.2 × 10 03 7.5 × 10 03
Table 4. Accuracy of SBs using multiple kernels of LS-SVM classifier.
Table 4. Accuracy of SBs using multiple kernels of LS-SVM classifier.
KernelsSB1SB2SB3SB4SB5SB6
Linear69.7870.6771.1172.8973.5661.56
Polynomial89.118886.2289.7887.3374.44
Mexican hat86.8984.2291.7892.4489.7864.67
Morlet9493.5697.5694.4492.6769.78
RBF95.5698.229695.7899.7872.44
Table 5. Performance Parameter for channel 1 using RBF kernel.
Table 5. Performance Parameter for channel 1 using RBF kernel.
SubbandACCSENSPEF1-ScoreMCC
SB195.5697.1393.690.96091.05
SB298.2298.0298.480.98496.40
SB39697.1594.600.96391.93
SB495.5697.5393.710.96191.52
SB599.7899.601000.99899.55
SB672.447569.190.75244.14
Table 6. Confusion matrix of RF and RH.
Table 6. Confusion matrix of RF and RH.
ClassRFRH
RF1000
RH0.599.5
Table 7. Performance comparison with SOTA on the same dataset.
Table 7. Performance comparison with SOTA on the same dataset.
ArticlesMethodChannelClassifierFeatureACC
[30]CWTCNN99.35
[27]EMD10LS-SVM597.56
[26]TQWT5LS-SVM496.89
[10]FRCSP18EC286.23
[23]WPD3k-NN692.80
[19]OA118NB1196.32
[18]OA118LS-SVM1196.62
[17]M-CC118LR693.10
[33]DWT118LS-SVM996.10
[32]Z-scoreLDA681.10
[16]CC118LR91.79
[15]CC118LS-SVM695.72
[34]CT118LS-SVM988.32
[9]R-CSP1R-CSP683.90
[35]CS3SVM896.00
[38]MSPCA-WPD3RF698.69
[25]RDWT10QSVM599.11
Proposed methodr-TQWT1LS-SVM599.78
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Khare, S.K.; Gaikwad, N.; Bokde, N.D. An Intelligent Motor Imagery Detection System Using Electroencephalography with Adaptive Wavelets. Sensors 2022, 22, 8128. https://doi.org/10.3390/s22218128

AMA Style

Khare SK, Gaikwad N, Bokde ND. An Intelligent Motor Imagery Detection System Using Electroencephalography with Adaptive Wavelets. Sensors. 2022; 22(21):8128. https://doi.org/10.3390/s22218128

Chicago/Turabian Style

Khare, Smith K., Nikhil Gaikwad, and Neeraj Dhanraj Bokde. 2022. "An Intelligent Motor Imagery Detection System Using Electroencephalography with Adaptive Wavelets" Sensors 22, no. 21: 8128. https://doi.org/10.3390/s22218128

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop