Next Article in Journal
A Nomogram for Predicting Prostate Cancer with Lymph Node Involvement in Robot-Assisted Radical Prostatectomy Era: A Retrospective Multicenter Cohort Study in Japan (The MSUG94 Group)
Next Article in Special Issue
Mental Strategies in a P300-BCI: Visuomotor Transformation Is an Option
Previous Article in Journal
Multimodality Imaging of Benign Primary Cardiac Tumor
Previous Article in Special Issue
Automatic Malignant and Benign Skin Cancer Classification Using a Hybrid Deep Learning Approach
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

TMP19: A Novel Ternary Motif Pattern-Based ADHD Detection Model Using EEG Signals

by
Prabal Datta Barua
1,2,
Sengul Dogan
3,*,
Mehmet Baygin
4,
Turker Tuncer
3,
Elizabeth Emma Palmer
5,6,
Edward J. Ciaccio
7 and
U. Rajendra Acharya
8,9,10
1
School of Management & Enterprise, University of Southern Queensland, Toowoomba, QLD 4350, Australia
2
Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia
3
Department of Digital Forensics Engineering, Technology Faculty, Firat University, 23119 Elazig, Turkey
4
Department of Computer Engineering, Faculty of Engineering, Ardahan University, 75000 Ardahan, Turkey
5
Centre of Clinical Genetics, Sydney Children’s Hospitals Network, Sydney 2031, NSW, Australia
6
School of Women’s and Children’s Health, University of New South Wales, Sydney NSW 2031, Australia
7
Department of Medicine, Columbia University Irving Medical Center, New York, NY 10032, USA
8
Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore 599489, Singapore
9
Department of Biomedical Engineering, School of Science and Technology, SUSS University, Singapore 599494, Singapore
10
Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung 41354, Taiwan
*
Author to whom correspondence should be addressed.
Diagnostics 2022, 12(10), 2544; https://doi.org/10.3390/diagnostics12102544
Submission received: 23 September 2022 / Revised: 14 October 2022 / Accepted: 17 October 2022 / Published: 20 October 2022
(This article belongs to the Special Issue Artificial Intelligence in Medical Signal Processing and Analysis)

Abstract

:
Attention deficit hyperactivity disorder (ADHD) is a common neurodevelopmental condition worldwide. In this research, we used an ADHD electroencephalography (EEG) dataset containing more than 4000 EEG signals. Moreover, these EEGs are noisy signals. A new hand-modeled EEG classification model has been proposed to separate healthy versus ADHD individuals using the EEG signals. In this model, a new ternary motif pattern (TMP) has been incorporated. We have mimicked deep learning networks to create this hand-modeled classification method. The Tunable Q Wavelet Transform (TQWT) has been utilized to generate wavelet subbands. We applied the proposed TMP and statistics to construct informative features from both raw EEG signals and wavelet bands by generating TQWT. Herein, features have been generated by 18 subbands and the original EEG signal. Thus, this model is named TMP19. The most informative features have been chosen by deploying neighborhood component analysis (NCA), and the selected features have been classified using the k-nearest neighbor (kNN) classifier. The used ADHD EEG dataset has 14 channels. Thus, these three phases—(i) feature extraction with TQWT, TMP, and statistics; (ii) feature selection by deploying NCA; and (iii) classification with kNN—have been applied to each channel. Iterative hard majority voting (IHMV) has been applied to obtain a higher and more general classification response. Our model attained 95.57% and 77.93% classification accuracies by deploying 10-fold and leave one subject out (LOSO) cross-validations, respectively.

1. Introduction

Attention deficit hyperactivity disorder (ADHD) is a persistent neurodevelopmental disorder [1,2,3]. It can increase the risk of poor educational and occupational outcomes, social disability, and other psychiatric conditions [4]. ADHD is often diagnosed between the ages of 3 and 7 years, but may not be recognized until adulthood [5,6]. ADHD symptoms include inattentiveness and hyperactivity-impulsivity [7]. People with ADHD often have additional features such as impairments in their executive function and emotional regulation [8,9,10]. Systematic reviews show that ADHD affects 5% of children and adolescents and 2.5% of adults globally [11]. Boys are more likely to be diagnosed with ADHD than girls [12,13]. Early diagnosis is very important for this condition to optimize management and reduce the long-term negative sequalae in psychosocial wellbeing and integration into the community [14]. Management usually combines patient and family education and pharmacological and non-pharmacological interventions such as a range of behavioral and neurocognitive therapies [15]. The aim is to eliminate disease symptoms. Psychologists diagnose ADHD, and the professionals have responsibility for assessment and diagnosis. This assessment typically involves a combination of standardized evaluation scales plus a clinical interview, compared to the DSM-5 or ICD (International Statistical Classification of Diseases and Related Health Problems) diagnostic criteria [16]. Diagnosing ADHD can be challenging, particularly in regions with limited access to suitably trained health professionals.
There is, therefore, interest in the ability of other diagnostic tools to improve equitable access to an early diagnosis [17]. One suggested diagnostic data type is the EEG [18]. The FDA has stated that the EEG may be a helpful diagnostic tool in ADHD diagnoses [19]. An increasing number of studies on the potential diagnostic utility of EEG have now been reported in the literature. This paper proposes a new hand-modeled EEG classification for the automatic interpretation of EEG signals for diagnosing ADHD in children. The model developed in this study has high classification success and low computational complexity.
The diagnosis of ADHD using EEG signals remains a hot topic with as yet no universally agreed upon guideline for the diagnostic use and interpretation of the EEG. Moghaddari et al. [20] used the Convolutional Neural Network (CNN) for ADHD diagnosis in children. Their study utilized EEG signals from 31 ADHD and 30 healthy children, which were preprocessed and free of noise and artifacts. Thereafter, the EEG signals were converted to RGB images and provided as input to a 13-layer CNN. The developed model was evaluated with the 5-fold cross-validation technique, and an average accuracy of 99.06% was achieved. An ADHD classification method using power spectral density (PSD), spectral entropy (SE), and long short-term memory (LSTM) methods has been proposed by Tosun [21]. Their study applied an 80:20 hold-out validation strategy, and the proposed method yielded a 92.15% accuracy. Khoshnoud et al. [22] performed a nonlinear EEG analysis in children with ADHD. The largest Lyapunov exponent (LLE) and approximate entropy (ApEn) methods were used to obtain the nonlinear characteristics of the signal. These features were evaluated with a Probabilistic Neural Network (PNN), and an 87.5% classification accuracy was obtained. Chen et al. [23] proposed a deep learning framework to identify children with ADHD. In their proposed method, EEG signals are converted into image data and given as input to the CNN developed in the study. EEG signals from 50 children with ADHD and 51 healthy children were utilized. The developed model provided a 94.67% accuracy performance on the test data. Tenev et al. [24] proposed a learning approach for classifying adult ADHD individuals automatically. Their study analyzed EEG signals from 117 adults (67 ADHD and 50 controls) using a Support Vector Machine (SVM) and voting method. The proposed method achieved an 82.3% success rate in separating ADHD versus control groups. Saini et al. [25] developed an EEG signal-based machine learning model for ADHD diagnosis. The developed model uses principal component analysis (PCA) for feature selection and k-nearest neighbor (kNN) for classification. In this study, EEG signals from 77 ADHD and 80 healthy children were classified, and an accuracy of 86% was achieved. Dubreuil-Vall et al. [26] collected EEG signals from 40 subjects (20 ADHD and 20 controls) for ADHD classification. In their study, firstly, the signal was preprocessed and then the spectrogram of the signal was extracted. Thereafter, the spectrogram images of the EEG signal were fed as input to the custom designed CNN, and classification was made. The developed model reached an 88% classification accuracy. Tor et al. [27] used empirical mode decomposition (EMD) and discrete wavelet transform (DWT) decomposition methods and nonlinear features for ADHD, conduct disorder (CD), and ADHD+CD detection. They analyzed EEG data of 123 children (45 ADHD, 62 conduct disorder + ADHD, and 16 conduct disorder subjects) with a kNN classifier and obtained an accuracy of 97.88%. Loh et al. [28] reviewed the automated ADHD detection methods published in the last decade. They reviewed all the machine learning and deep learning techniques employed for the automated detection of ADHD using both physiological signals and images.
The essential motivations of the presented model are:
  • Presenting a new motif pattern to generate textural features;
  • Proposing a hand-modeled one-dimensional signal classification architecture;
  • Attaining robust and high classification performance with low time complexity.
Thus, this study has three main motivations. First, motifs of signals are very useful for extracting features. A new feature generation model has been proposed to use motifs as a feature vector, and this feature extraction function is named TMP. We aimed to present a highly accurate feature engineering model. Hence, we used both hand-crafted features and an architecture miming a deep learning architecture to attain high classification accuracy. Deep learning models have multiple levels/layers to generate distinctive features. Thus, we have used a multileveled feature extraction model. By using this model, an accurate EEG signal classification method has been proposed. To demonstrate its robustness, we used two validation techniques (10-fold CV and LOSO CV). These validations yielded 95.57% and 77.93% classification accuracies by deploying 10-fold CV and LOSO CV, respectively.
The novelties and contributions are:
  • A new ternary motif pattern has been proposed in this research. The main objective of the proposed TMP is to extract hidden and informative features from EEG signals.
  • A new generation multilevel feature engineering model has been proposed in this research to attain high classification accuracy on the EEG dataset. The presented feature engineering model uses 19 levels and TMP to extract features. Thus, this model is named TMP19.
  • In the feature selection phase, the main feature extraction function is NCA. At the same time, we employed threshold-based elimination to obtain more distinctive features. Thus, the model is named threshold–based NCA.
  • We integrated a noisy EEG dataset containing 4173 EEG signals, each of four seconds in length. We believe this is the first proposal of a classification model for this dataset in the literature.
  • Our proposal—TMP19—was tested using two validation techniques and showed robust results. The TMP19 attained 95.57% and 77.93% classification accuracies by deploying 10-fold CV and LOSO CV, respectively.

2. Material and Method

2.1. Material

We utilized a noisy EEG dataset in this work [29,30]. The dataset contains 2330 healthy EEG signals and 1843 ADHD EEG signals. The lengths of these EEG signals are equal and four seconds in length. In this EEG dataset, there are 14 channels. The frequency sampling of these EEG signals is 128 Hz.

2.2. Method

In this paper, a new local feature extraction function has been proposed, named the ternary motif pattern. Herein, we integrated five-sized overlapping blocks to obtain motifs, and we applied the ternary function to find upper, equal, and lower values. Two feature maps have been generated using these values, and histograms of these feature maps have been utilized as feature vectors. The model overview of the presented TMP is demonstrated in Figure 1.
To better explain this model, detailed descriptions have been given below.
Step 1: 
Create overlapping blocks with a length of five.
b l t = S t : t + 4 ,   t 1 , 2 , , l e n 4
Herein, b l t is the overlapping block with a length of five, and l e n defines the length of the signal.
Step 2: 
Generate ternary motifs.
v a l k = t f b l i t , b l j t ,   i 1 , 2 , 3 , 4 ,   j i + 1 , i + 2 , , 5 ,   k 1 , 2 , , 10
t f b l i t , b l j t = 0 , b l i t < b l j t 1 , b l i t = b l j t   2 ,   b l i t > b l j t  
where v a l represents ternary motif values, and t f ( ) defines ternary function.
Step 3: 
Calculate map values using ternary motif values.
m t 1 = j = 1 5 v a l j × 3 j 1
m t 2 = j = 1 5 v a l j + 5 × 3 j 1
The symbols m 1 and m 2 represent the first and second map signals, respectively.
Step 4: 
Extract histograms of map signals.
h 1 = ϑ m 1
h 2 = ϑ m 2
where h 1 and h 2 are histograms of first and second maps. The length of each map signal is 243 (=35).
Step 5: 
Merge the generated histograms and obtain a feature vector.
f v q = h c q + 243 × c 1 ,   c 1 , 2 ,   q 1 , 2 , , 243
The symbol f v defines the generated feature vector with a length of 486 (=243 × 2).
These five steps above define the proposed TMP.
We suggested a new hand-modeled signal classification method in this paper, and our proposal is named TMP19. TMP19 contains four main phases, and these phases are:
  • Feature extraction;
  • Feature selection;
  • Classification;
  • Majority voting.
In Figure 2, a graphical overview of the proposed TMP19 is demonstrated.
Figure 2 depicts our proposed TMP19 architecture. In Figure 3, C represents the number of channels. Phases of this model are defined below, briefly describing the TMP19 EEG signal classification model.

2.2.1. Feature Extraction

In the feature extraction phase, we utilized three methods: (i) TQWT [31], (ii) the proposed TMP feature extraction function, and (iii) statistical feature generator. First, we generated wavelet bands using TQWT transformation. TQWT is a parametric and third-generation wavelet transform. By using redundancy (r), oscillation (Q), and the number of level (J) parameters, a variable multileveled wavelet transform was created. The high oscillatory wavelet transform was assigned 4 and 3 for the Q and r parameters.
The system’s main aim was to propose a new feature engineering model as in DarkNet19. Thus, we generated 18 wavelet coefficient bands to use 19 inputs. These 19 signals (raw EEG signal + 18 wavelet bands) have been utilized as inputs to the feature extraction functions. The system contains two feature extraction functions: the TMP and the statistical feature generator. Both statistical parameters and motifs have been extracted using these feature extractors in the space and frequency domains. The steps of the proposed feature extraction method are given below.
Step 1: 
Apply TQWT to the EEG signal for generating wavelet bands.
R = τ S , 4 , 3 , 17
where R defines TQWT bands, S is the EEG signal, 4, 3, and 18 are the Q, r, and J parameters of the TQWT function ( τ ( ) ).
Step 2: 
Generate features using TMP and statistical feature generation function.
f 1 = c o n c a t T M P S , S G S
f l + 1 = c o n c a t T M P R l , S G R l ,   l 1 , 2 , , 18  
In this step (Step 2), 19 feature vectors have been generated by deploying the TMP feature generator ( T M P ( ) ), and statistical generator ( S G ( ) ). T M P ( ) function generates 486 features from a one-dimensional signal, and S G ( ) extracts 14 features from a signal since 14 statistical moments [32] have been used in this function. These moments are (i) maximum, (ii) minimum, (iii) average, (iv) variance, (v) standard deviation, (vi) median, (vii) range, (viii) root mean square, (ix) energy, (x) Shannon entropy, (xi) sure entropy, (xii) log energy entropy, (xiii) threshold entropy, and (xiv) mean absolute deviation. c o n c a t ( ) is concatenation function and it is feature merging function. By using Step 2, 19 feature vectors have been created and the length of each feature vector is 500 (=486 + 14).
Step 3: 
Concatenate the 19 generated feature vectors to create the final feature vectors.
f g p = X p + 500 × g 1 ,   p 1 , 2 , , 500 ,   g 1 , 2 , , 19
Herein, X defines the merged feature vector with a length of 9500 (=500 × 19).

2.2.2. Feature Selection

In this research, we proposed an improved NCA-based protocol [33], with the feature selection method being named the threshold-based NCA. The selector has two layers: (i) threshold-based redundant feature elimination and (ii) NCA-based feature selection. In this phase, we selected the most informative and valuable 250 features from the generated 9500 features. The steps of this phase are:
Step 4: 
Normalize the final feature vector by deploying a min-max normalization.
X N = X min X max X min X
where X N defines the normalized final features, and min ( ) and max ( ) are the minima and maximum value finding functions, respectively.
Step 5: 
Eliminate the redundant features using a threshold value.
a g d = i = 1 n X N d , i , d 1 , 2 , , d i m  
n X : , c t = X : , i ,   i f   a g d > t h
Herein, the summarization value of each vector ( a g d ) has been calculated in Equation (14), where d i m is the number of EEG signals. In Equation (15), features are eliminated, and a new final feature vector ( n X ) has been generated using a threshold value ( t h ). In this research, t h is selected as zero.
Step 6: 
Calculate qualified/sorted indexes by deploying the NCA feature selection function.
i d = ξ n X , y  
where i d is a sorted index vector with a length of 9500, y defines real outputs/labels, and ξ ( ) is the NCA feature selection function.
Step 7: 
Select the most meaningful 250 features from the n X .
s X d , i = n X d , i d i ,   i 1 , 2 , , 250
Herein,   s X is a selected feature vector with a length of 250.

2.2.3. Classification

To obtain classification accuracy and the predicted vector of each channel, we used a simple/shallow classifier. The kNN [34] classifier has been used, which is named the Weighted kNN. The hyperparameters of the Weighted kNN are:
k:10;
Distance weight: squared inverse;
Distance: L1-norm (Manhattan);
Validation: 10-fold CV/LOSO CV.
As is evident from the above description, we used two validation techniques (10-fold CV and LOSO CV) to calculate the robust results obtained with this classifier. The classification step is given below.
Step 8: 
Calculate the predicted vector of each channel by applying the kNN classifier.
p c = κ s X , y ,   c 1 , 2 , , 14  
where p c represented predicted vectors of the cth channel, and κ ( ) is the defined kNN classifier.
Step 9: 
Repeat Steps 1–8 by the number of channels. We used an ADHD dataset containing 14 channels. Thus, we repeated these steps 14 times.

2.2.4. Majority Voting

In the majority voting phase, the iterative hard majority voting (IHMV) algorithm was used to obtain the best classification result. IHMV was proposed by Dogan et al. [35] in 2021. We calculated 14 predicted vectors from the EEG channels individually. By incorporating the 14 predicted vectors, 12 (=14 − 2) new voted predicted vectors were created for each validation technique. The steps of this phase are listed below.
Step 10: 
Calculate the classification accuracy of each channel.
Step 11: 
Qualify/sort the predicted vectors using the predicted vectors and obtain qualified/sorted indexes.
i x = s o r t p  
where i x defines indexes of the sorted predicted vectors.
Step 12: 
Calculate voted predicted vectors by deploying the mode function.
v r 2 = ω p i x 1 , p i x 2 , , p i x r , r 3 , 4 , , C    
Herein, v represents the voted vector, C represents the number of channels, and ω ( ) defines the mode function. In these steps, 12 voted vectors have been generated.
Step 13: 
Calculate classification accuracies of the voted vectors.
Step 14: 
Choose the most accurate voted vector as the final predicted vector.
The given 14 steps above define the proposed TMP19 feature engineering model.

3. Results

We have proposed a new feature engineering model that uses four phases in this research. These phases use lightweight methods. Thus, the proposed TMP19 is a lightweight signal classification model, and there is no need to use expensive hardware. We implemented this model on a simply configured computer (main memory: 16 GB, processor: Intel i7-7700, operating system: Windows 11, programming environment: MATLAB 2021a). We used two validation techniques. Moreover, channel-wise voted results have been given in this section.

3.1. Performance Metrics

The used ADHD EEG dataset contains two classes, ADHD and normal. Thus, this is a binary classification problem. We built in two common classification performance measures: classification accuracy and geometric mean. To assess these metrics, the number of true positives (tp), false positives (fp), true negatives (tn), and false negatives (fn) are deployed. The mathematical notations of the accuracy (acc) and geometric mean (gm) are given below.
a c c = t p + t n t p + f p + t n + f n
g m = t p t p + f n × t n t n + f p

3.2. Channel-Wise Results

The used EEG dataset contains 14 channels. To comprehensively depict the proposed model’s classification performance, we applied our proposal to each channel, and the classification performances of each channel were calculated. Furthermore, two validations were used in the classification phase. The channel-wise results are tabulated in Table 1.
Table 1 highlights the best results using a bold font face. By applying a 10-fold CV, the most accurate channel is the 13th since our TMP19 model yielded 92.16% classification accuracy and 91.91% geometric mean. According to LOSO CV results, the best classification accuracy is 74.84% on the 7th channel, and the best geometric mean attained on the 13th channel by employing LOSO CV.

3.3. Voted Results

In the last phase of the TMP19, the majority voting component is availed of. We applied the IHMV algorithm in this phase to create C-2-voted vectors. Twelve voted vectors were generated by deploying the IHMV algorithm. The results of the voted vectors are listed in Table 2.
Table 2 shows that the best classification accuracies were obtained by using 11th and 1st voted vectors when deploying 10-fold CV and LOSO CV, respectively. Per Table 2, IHMV increased the classification accuracies from 92.16% and 74.84% to 95.57% and 77.93% by deploying 10-fold CV and LOSO CV, respectively. These results are the final results of the proposed TMP19.

3.4. Final Results

Our proposed TMP19-based model generates 26 (=14 results from 14 channels + 12 voted results) results, and this model selects the best results among the 26 generated results. Thus, the suggested TMP19 is a self-organized feature engineering model. Moreover, two validations were applied in the classification phase. The calculated confusion matrices of the presented TMP19 by deploying LOSO CV and 10-fold CV are given in Figure 3.
As can be seen from Figure 3, our proposed TMP19 attained 95.57% and 77.93% classification accuracies on the ADHD dataset with a 10-fold CV and LOSO CV, respectively.

4. Discussion

A new feature engineering model has been proposed in this research by mimicking a deep learning structure. The main motivation of the proposed TMP19 is to extract hidden motifs to obtain high classification performances. The TMP19 generates features at both high levels and low levels. High-level features have been generated using wavelet bands. Moreover, features at the frequency domain have been extracted. The threshold-based NCA method has been used to obtain distinctive features. kNN has been employed to show the classification capability of the generated features. The best classification results were generated and selected from the model by applying a majority voting technique. Then the channel-wise and voted results were given. Per the results, the most appropriate channels are the 7th and 13th for ADHD detection. Our model attained a 95.57% classification accuracy by deploying a 10-fold CV and a 77.93% classification accuracy using LOSO CV. These results showed that the presented TMP19 is a successful EEG classification model. Furthermore, we believe that we are the first team to use this dataset to develop a machine-learning model.
The results of other state-of-art classification models and our TMP19 were compared to highlight the classification ability of our model. These results are listed in Table 3.
As can be seen from Table 3, our model produced better accuracy than the results of other state-of-the-art methods. Tor et al. [27] achieved better accuracy than our study. They used 3 classes with 123 subjects in the study. Classes include 45 ADHD, 62 conduct disorder + ADHD, and 16 conduct disorder subjects, and the amount of data for each class is small. In addition, two different validation techniques were used in this study. These are the 10-fold CV and the LOSO CV, respectively. Another advantage is that noisy EEG signals were used in our study. A superior side of our study to other previously presented works is to use LOSO CV. Since reliable results have been calculated using LOSO CV, we depicted our model’s performances in real-world applications by helping LOSO CV. Although our proposed method exhibits a low computational complexity, it outperforms. The results obtained show the superiority of the proposed method.
The benefits of the presented TMP:
  • A novel feature generation function was introduced. This function generates motifs. Thus, this feature generator is named TMP.
  • An accurate one-dimensional signal classification architecture has been proposed by using TMP. This model contains 19 levels. Thus, it is named TMP19.
  • Simple methods have been used to create the TMP19 model. Thus, the implementation of this model is straightforward and of low complexity.
  • TMP19 is a parametric model. Therefore, next-generation TMP-based classification models can be proposed by using different classification methods.
  • TMP19 is a highly accurate model.
  • The robustness of the presented TMP19 is demonstrated by deploying a 10-fold CV and LOSO CV.
Drawbacks:
  • Parameters should be optimized to gain higher classification performances.
  • Recently, authors in [37] have developed an automated system to detect ADHD and conduct disorder in children using empirical wavelet transform and entropy features extracted from electrocardiogram (ECG) signals. They obtained an accuracy of 88% in classifying ADHD, ADHD + CD, and CD patients for appropriate intervention using accessible ECG signals. In the future, ECG and heart rate variability (HRV) signals can be used for automated ADHD detection as they can be easily acquired using wearable devices.
  • More disorders can be used to evaluate the performance of the TMP19 model.

5. Conclusions

ADHD detection using EEG signals has great potential in improving the equitable early diagnosis of ADHD, maximizing appropriate treatments, and minimizing the potential long-term negative impacts of this globally common neurodevelopmental condition. However, there is a lack of consensus on the best way to utilize EEG and how machine learning may be beneficial in optimizing this as a diagnostic tool. To overcome this problem, we proposed a new feature generator called TMP. The main goal of the TMP is to extract distinctive features from EEG signals. A feature engineering model was proposed by applying the proposed feature generator—TMP. This model has 19 levels in the feature extraction phase. Hence, it is named TMP19. TMP19 was applied to a noisy EEG signal dataset for the detection of ADHD. Moreover, we used two validation techniques to show the robustness of the proposed TMP19. As can be seen from Section 5, our TMP19 reached 95.57% and 77.93% classification accuracies using 10-fold CV and LOSO CV techniques, respectively.
We plan to develop an intelligent EEG signal classification application in future work. This application will extract information from EEG signals to detect ADHD and potentially other neurodevelopmental and mental health conditions. Moreover, we plan to devise and develop an intelligent brain cap that will detect changes automatically.

Author Contributions

Conceptualization: P.D.B., S.D., M.B., T.T., E.E.P., E.J.C., U.R.A.; methodology, P.D.B., S.D., M.B., T.T., E.E.P., E.J.C., U.R.A.; software, S.D., T.T.; validation, P.D.B., S.D., M.B., T.T.; formal analysis, P.D.B., S.D., M.B., T.T., E.E.P., E.J.C., U.R.A.; investigation P.D.B., S.D., M.B., T.T.; resources, P.D.B., S.D., M.B., T.T.; data curation, P.D.B., S.D., M.B., T.T.; writing—original draft preparation, P.D.B., S.D., M.B., T.T., E.E.P., E.J.C., U.R.A.; writing—review and editing, P.D.B., S.D., M.B., T.T., E.E.P., E.J.C., U.R.A.; visualization, P.D.B., S.D., M.B., T.T., E.E.P., E.J.C., U.R.A.; supervision, U.R.A.; project administration, U.R.A. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The EEG dataset database has been downloaded from [29,30].

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Leijten, P.; Scott, S.; Landau, S.; Harris, V.; Mann, J.; Hutchings, J.; Beecham, J.; Gardner, F. Individual participant data meta-analysis: Impact of conduct problem severity, comorbid attention-deficit/hyperactivity disorder and emotional problems, and maternal depression on parenting program effects. J. Am. Acad. Child Adolesc. Psychiatry 2020, 59, 933–943. [Google Scholar] [CrossRef] [PubMed]
  2. Yadav, S.K.; Bhat, A.A.; Hashem, S.; Nisar, S.; Kamal, M.; Syed, N.; Temanni, M.-R.; Gupta, R.K.; Kamran, S.; Azeem, M.W. Genetic variations influence brain changes in patients with attention-deficit hyperactivity disorder. Transl. Psychiatry 2021, 11, 349. [Google Scholar] [CrossRef] [PubMed]
  3. Faraone, S.; Asherson, P.; Banaschewski, T.; Biederman, J.; Buitelaar, J.; Ramos-Quiroga, J.; Rohde, L.; Sonuga-Barke, E.; Tannock, R.; Franke, B. Attention-deficit/hyperactivity disorder. Nature reviews. Dis. Prim. 2015, 1, 15020. [Google Scholar]
  4. Tzang, R.-F.; Chang, Y.-C.; Kao, K.-L.; Huang, Y.-H.; Huang, H.-C.; Wang, Y.-C.; Muo, C.-H.; Wu, S.-I.; Sung, F.-C.; Stewart, R. Increased risk of developing psychiatric disorders in children with attention deficit and hyperactivity disorder (ADHD) receiving sensory integration therapy: A population-based cohort study. Eur. Child Adolesc. Psychiatry 2019, 28, 247–255. [Google Scholar] [CrossRef]
  5. Bonati, M.; Cartabia, M.; Zanetti, M.; Reale, L.; Didoni, A.; Costantino, M.A. Age level vs. grade level for the diagnosis of ADHD and neurodevelopmental disorders. Eur. Child Adolesc. Psychiatry 2018, 27, 1171–1180. [Google Scholar] [CrossRef]
  6. Pawaskar, M.; Fridman, M.; Grebla, R.; Madhoo, M. Comparison of quality of life, productivity, functioning and self-esteem in adults diagnosed with ADHD and with symptomatic ADHD. J. Atten. Disord. 2020, 24, 136–144. [Google Scholar] [CrossRef] [Green Version]
  7. Sörös, P.; Hoxhaj, E.; Borel, P.; Sadohara, C.; Feige, B.; Matthies, S.; Müller, H.H.O.; Bachmann, K.; Schulze, M.; Philipsen, A. Hyperactivity/restlessness is associated with increased functional connectivity in adults with ADHD: A dimensional analysis of resting state fMRI. BMC Psychiatry 2019, 19, 43. [Google Scholar] [CrossRef] [Green Version]
  8. Serrano-Barroso, A.; Siugzdaite, R.; Guerrero-Cubero, J.; Molina-Cantero, A.J.; Gomez-Gonzalez, I.M.; Lopez, J.C.; Vargas, J.P. Detecting attention levels in ADHD children with a video game and the measurement of brain activity with a single-channel BCI headset. Sensors 2021, 21, 3221. [Google Scholar] [CrossRef]
  9. Biederman, J.; Spencer, T.; Lomedico, A.; Day, H.; Petty, C.; Faraone, S.V. Deficient emotional self-regulation and pediatric attention deficit hyperactivity disorder: A family risk analysis. Psychol. Med. 2012, 42, 639–646. [Google Scholar] [CrossRef]
  10. Willcutt, E.G.; Doyle, A.E.; Nigg, J.T.; Faraone, S.V.; Pennington, B.F. Validity of the executive function theory of attention-deficit/hyperactivity disorder: A meta-analytic review. Biol. Psychiatry 2005, 57, 1336–1346. [Google Scholar] [CrossRef]
  11. Simon, V.; Czobor, P.; Bálint, S.; Mészáros, A.; Bitter, I. Prevalence and correlates of adult attention-deficit hyperactivity disorder: Meta-analysis. Br. J. Psychiatry 2009, 194, 204–211. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Quinn, P.; Wigal, S. Perceptions of girls and ADHD: Results from a national survey. Medscape Gen. Med. 2004, 6, 2. [Google Scholar]
  13. Bauermeister, J.J.; Shrout, P.E.; Chávez, L.; Rubio-Stipec, M.; Ramírez, R.; Padilla, L.; Anderson, A.; García, P.; Canino, G. ADHD and gender: Are risks and sequela of ADHD the same for boys and girls? J. Child Psychol. Psychiatry 2007, 48, 831–839. [Google Scholar] [CrossRef] [PubMed]
  14. Zahmacioglu, O.; Kilic, E.Z. Early diagnosis and treatment of ADHD are important for a secure transition to adolescence. Anatol. J. Psychiatry/Anadolu Psikiyatr. Derg. 2017, 18, 79–84. [Google Scholar] [CrossRef]
  15. Safren, S.A.; Sprich, S.; Mimiaga, M.J.; Surman, C.; Knouse, L.; Groves, M.; Otto, M.W. Cognitive behavioral therapy vs. relaxation with educational support for medication-treated adults with ADHD and persistent symptoms: A randomized controlled trial. Jama 2010, 304, 875–880. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Bell, A.S. A critical review of ADHD diagnostic criteria: What to address in the DSM-V. J. Atten. Disord. 2011, 15, 3–10. [Google Scholar] [CrossRef]
  17. Loh, H.W.; Ooi, C.P.; Seoni, S.; Barua, P.D.; Molinari, F.; Acharya, U.R. Application of Explainable Artificial Intelligence for Healthcare: A Systematic Review of the Last Decade (2011–2022). Comput. Methods Programs Biomed. 2022, 226, 107161. [Google Scholar] [CrossRef]
  18. Lenartowicz, A.; Loo, S.K. Use of EEG to diagnose ADHD. Curr. Psychiatry Rep. 2014, 16, 498. [Google Scholar] [CrossRef] [Green Version]
  19. Stein, M.A.; Snyder, S.M.; Rugino, T.A.; Hornig, M. Commentary: Objective aids for the assessment of ADHD–further clarification of what FDA approval for marketing means and why NEBA might help clinicians. A response to Arns et al. (2016). J. Child Psychol. Psychiatry 2016, 57, 770–771. [Google Scholar] [CrossRef]
  20. Moghaddari, M.; Lighvan, M.Z.; Danishvar, S. Diagnose ADHD disorder in children using convolutional neural network based on continuous mental task EEG. Comput. Methods Programs Biomed. 2020, 197, 105738. [Google Scholar] [CrossRef]
  21. Tosun, M. Effects of spectral features of EEG signals recorded with different channels and recording statuses on ADHD classification with deep learning. Phys. Eng. Sci. Med. 2021, 44, 693–702. [Google Scholar] [CrossRef] [PubMed]
  22. Khoshnoud, S.; Shamsi, M.; Nazari, M.A. Non-linear EEG analysis in children with attention-deficit/hyperactivity disorder during the rest condition. In Proceedings of the 2015 22nd Iranian Conference on Biomedical Engineering (ICBME), Tehran, Iran, 25–27 November 2015; pp. 87–92. [Google Scholar]
  23. Chen, H.; Song, Y.; Li, X. A deep learning framework for identifying children with ADHD using an EEG-based brain network. Neurocomputing 2019, 356, 83–96. [Google Scholar] [CrossRef]
  24. Tenev, A.; Markovska-Simoska, S.; Kocarev, L.; Pop-Jordanov, J.; Müller, A.; Candrian, G. Machine learning approach for classification of ADHD adults. Int. J. Psychophysiol. 2014, 93, 162–166. [Google Scholar] [CrossRef] [PubMed]
  25. Saini, S.; Rani, R.; Kalra, N. Prediction of Attention Deficit Hyperactivity Disorder (ADHD) using machine learning Techniques based on classification of EEG signal. In Proceedings of the 2022 8th International Conference on Advanced Computing and Communication Systems (ICACCS), Coimbatore, India, 25–26 March 2022; pp. 782–786. [Google Scholar]
  26. Dubreuil-Vall, L.; Ruffini, G.; Camprodon, J.A. Deep learning convolutional neural networks discriminate adult ADHD from healthy individuals on the basis of event-related spectral EEG. Front. Neurosci. 2020, 14, 251. [Google Scholar] [CrossRef]
  27. Tor, H.T.; Ooi, C.P.; Lim-Ashworth, N.S.; Wei, J.K.E.; Jahmunah, V.; Oh, S.L.; Acharya, U.R.; Fung, D.S.S. Automated detection of conduct disorder and attention deficit hyperactivity disorder using decomposition and nonlinear techniques with EEG signals. Comput. Methods Programs Biomed. 2021, 200, 105941. [Google Scholar] [CrossRef]
  28. Loh, H.W.; Ooi, C.P.; Barua, P.D.; Palmer, E.E.; Molinari, F.; Acharya, U. Automated detection of ADHD: Current trends and future perspective. Comput. Biol. Med. 2022, 146, 105525. [Google Scholar] [CrossRef]
  29. Samavati, M.; Nasrabadi, A.M.; Mohammadi, M.R. EEG data for ADHD/Control children. IEEE DataPort 2020. [Google Scholar] [CrossRef]
  30. Samavati, M.; Nasrabadi, A.M.; Mohammadi, M.R. Automatic minimization of eye blink artifacts using fractal dimension of independent components of multichannel EEG. In Proceedings of the 20th Iranian Conference on Electrical Engineering (ICEE2012), Tehran, Iran, 15–17 May 2012; pp. 1576–1578. [Google Scholar]
  31. Selesnick, I.W. Wavelet transform with tunable Q-factor. IEEE Trans. Signal Process. 2011, 59, 3560–3575. [Google Scholar] [CrossRef]
  32. Akbal, E.; Tuncer, T. FusedTSNet: An automated nocturnal sleep sound classification method based on a fused textural and statistical feature generation network. Appl. Acoust. 2021, 171, 107559. [Google Scholar] [CrossRef]
  33. Goldberger, J.; Hinton, G.E.; Roweis, S.; Salakhutdinov, R.R. Neighbourhood components analysis. Adv. Neural Inf. Process. Syst. 2004, 17, 513–520. [Google Scholar]
  34. Peterson, L.E. K-nearest neighbor. Scholarpedia 2009, 4, 1883. [Google Scholar] [CrossRef]
  35. Dogan, A.; Akay, M.; Barua, P.D.; Baygin, M.; Dogan, S.; Tuncer, T.; Dogru, A.H.; Acharya, U.R. PrimePatNet87: Prime pattern and tunable q-factor wavelet transform techniques for automated accurate EEG emotion recognition. Comput. Biol. Med. 2021, 138, 104867. [Google Scholar] [CrossRef] [PubMed]
  36. Mohammadi, M.R.; Khaleghi, A.; Nasrabadi, A.M.; Rafieivand, S.; Begol, M.; Zarafshan, H. EEG classification of ADHD and normal children using non-linear features and neural network. Biomed. Eng. Lett. 2016, 6, 66–73. [Google Scholar] [CrossRef]
  37. Koh, J.E.; Ooi, C.P.; Lim-Ashworth, N.S.; Vicnesh, J.; Tor, H.T.; Lih, O.S.; Tan, R.-S.; Acharya, U.R.; Fung, D.S.S. Automated classification of attention deficit hyperactivity disorder and conduct disorder using entropy features with ECG signals. Comput. Biol. Med. 2022, 140, 105120. [Google Scholar] [CrossRef]
Figure 1. Model overview of the proposed TMP feature extraction function.
Figure 1. Model overview of the proposed TMP feature extraction function.
Diagnostics 12 02544 g001
Figure 2. (a) Overview of the TMP19 signal classification architecture, (b) the proposed statistical and TMP-based feature extraction method, and (c) feature selection with the thresholded NCA method.
Figure 2. (a) Overview of the TMP19 signal classification architecture, (b) the proposed statistical and TMP-based feature extraction method, and (c) feature selection with the thresholded NCA method.
Diagnostics 12 02544 g002
Figure 3. Generated confusion matrices by TMP19 on the ADHD EEG dataset by deploying (a) 10-fold CV, (b) LOSO CV. Herein, the used classes are enumerated as 1 and 2. These numbers are defined as healthy and ADHD classes. 1: Healthy, 2: ADHD.
Figure 3. Generated confusion matrices by TMP19 on the ADHD EEG dataset by deploying (a) 10-fold CV, (b) LOSO CV. Herein, the used classes are enumerated as 1 and 2. These numbers are defined as healthy and ADHD classes. 1: Healthy, 2: ADHD.
Diagnostics 12 02544 g003
Table 1. Channel-wise results (%) by deploying 10-fold CV and LOSO CV.
Table 1. Channel-wise results (%) by deploying 10-fold CV and LOSO CV.
Channel 10-fold CVLOSO CV
AccuracyGeometric MeanAccuracyGeometric Mean
187.7587.2172.2571.16
286.6585.6971.4170.19
389.7089.1768.5667.88
487.0886.3867.7767.29
591.4791.1374.3173.73
688.4387.7465.4964.83
788.3587.2274.8473.55
886.1785.2961.8059.37
987.9087.5266.5966.12
1086.1085.6558.5958.10
1186.5685.787170.09
1284.1483.2772.6871.79
1392.1691.9174.5774.35
1483.3081.8566.8165.10
General
(mean ± SD)
87.55 ± 2.4586.36 ± 2.7069.05 ± 4.8968.11 ± 5.05
Table 2. Voted results (%) by deploying 10-fold CV and LOSO CV.
Table 2. Voted results (%) by deploying 10-fold CV and LOSO CV.
Voted Vector10-fold CVLOSO CV
AccuracyGeometric MeanAccuracyGeometric Mean
194.4994.2577.9377.23
293.2492.4575.3973.46
394.4994.1177.4576.89
493.9693.3075.1773.28
595.2194.8977.3876.74
694.2093.5775.4173.81
795.1694.7776.9576.35
894.4993.8875.5874.13
995.4095.0376.5675.86
1094.9494.4074.8973.62
1195.5795.1875.9975.23
1294.9094.3274.8473.41
General
(mean ± SD)
94.67 ± 0.6694.17 ± 0.7976.12 ± 1.0875 ± 1.54
Table 3. Summary of comparison of our results with other methods developed using EEG signals.
Table 3. Summary of comparison of our results with other methods developed using EEG signals.
AuthorYearMethodKey Point(s)Result(s) (%)
Mohammadi et al. [36]2016Preprocessing, nonlinear feature extraction (fractal dimension, LLE, ApEn), mRMR, and neural networks- 60 subjects (30 ADHD, 30 control)
- 70:10:20 hold-out validation
Acc. = 93.65
Tenev et al. [24]2014SVM and voting-117 subjects (67 ADHD, 50 control)
-10-fold CV
Acc. = 82.3
Tosun [21]2021Data augmentation, PSD, SE, and LSTM- 16 subject
- 80:20 hold-out validation
Acc. = 92.15
Khoshnoud et al. [22]2015Preprocessing, LLE, ApEn, PNN- 22 subject (12 ADHD, 10 control)
- 75:25 hold-out validation
Acc. = 87.5
Chen et al. [23]2019EEG signal to image conversion, CNN- 101 subject (50 ADHD, 51 control)
- 10-fold CV
Acc. = 94.67
Saini et al. [25]2022PCA and kNN- 157 subject (77 ADHD, 80 control)Acc. = 86.0
Tor et al. [27]2021Empirical mode decomposition, Discrete wavelet transform, kNN- 123 subjects (45 ADHD, 62 conduct disorder + ADHD, 16 conduct disorder)
- 10-fold CV
Acc.= 97.88
Dubreuil-Vall et al. [26]2020Preprocessing, spectrogram conversion and CNN- 40 subject (20 ADHD, 20 control)
- Leave pair out CV
Acc. = 88.0
Our methodTQWT, TMP19, NCA, kNN, and majority voting- 121 subjects (61 ADHD, 60 control)
- 10-fold CV and LOSO CV
10-fold CV
Acc. = 95.57
Gm. = 95.18
LOSO CV
Acc. = 77.93
Gm. = 77.23
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Barua, P.D.; Dogan, S.; Baygin, M.; Tuncer, T.; Palmer, E.E.; Ciaccio, E.J.; Acharya, U.R. TMP19: A Novel Ternary Motif Pattern-Based ADHD Detection Model Using EEG Signals. Diagnostics 2022, 12, 2544. https://doi.org/10.3390/diagnostics12102544

AMA Style

Barua PD, Dogan S, Baygin M, Tuncer T, Palmer EE, Ciaccio EJ, Acharya UR. TMP19: A Novel Ternary Motif Pattern-Based ADHD Detection Model Using EEG Signals. Diagnostics. 2022; 12(10):2544. https://doi.org/10.3390/diagnostics12102544

Chicago/Turabian Style

Barua, Prabal Datta, Sengul Dogan, Mehmet Baygin, Turker Tuncer, Elizabeth Emma Palmer, Edward J. Ciaccio, and U. Rajendra Acharya. 2022. "TMP19: A Novel Ternary Motif Pattern-Based ADHD Detection Model Using EEG Signals" Diagnostics 12, no. 10: 2544. https://doi.org/10.3390/diagnostics12102544

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop