Next Article in Journal
Ka Band Holographic Imaging System Based on Linear Frequency Modulation Radar
Previous Article in Journal
Probabilistic Load Forecasting for Building Energy Models
Previous Article in Special Issue
A Computerized Bioinspired Methodology for Lightweight and Reliable Neural Telemetry
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Letter

Deep-Asymmetry: Asymmetry Matrix Image for Deep Learning Method in Pre-Screening Depression

1
Department of Computer Engineering, Gachon University, Sungnam-si 13306, Korea
2
Department of IT Convergence Engineering, Gachon University, Sungnam-si 13306, Korea
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(22), 6526; https://doi.org/10.3390/s20226526
Submission received: 23 September 2020 / Revised: 7 November 2020 / Accepted: 13 November 2020 / Published: 15 November 2020
(This article belongs to the Special Issue Novel Approaches to EEG Signal Processing)

Abstract

:
To have an objective depression diagnosis, numerous studies based on machine learning and deep learning using electroencephalogram (EEG) have been conducted. Most studies depend on one-dimensional raw data and required fine feature extraction. To solve this problem, in the EEG visualization research field, short-time Fourier transform (STFT), wavelet, and coherence commonly used as method s for transferring EEG data to 2D images. However, we devised a new way from the concept that EEG’s asymmetry was considered one of the major biomarkers of depression. This study proposes a deep-asymmetry methodology that converts the EEG’s asymmetry feature into a matrix image and uses it as input to a convolutional neural network. The asymmetry matrix image in the alpha band achieved 98.85% accuracy and outperformed most of the methods presented in previous studies. This study indicates that the proposed method can be an effective tool for pre-screening major depressive disorder patients.

1. Introduction

Major depressive disorder (MDD), commonly called depression, is a neurological disorder that affects more than 3 million people worldwide every year [1]. Depression negatively affects the way a person feels, thinks, and behaves. It seriously disrupts the person’s social life, and in severe cases, leads to serious problems, such as suicide [2]. There are many ways to diagnose depression; however, the most common approach is through consultation with a psychologist or psychiatrist [3]. The diagnostic and statistical manual of mental disorders (DSM-V) [4], Beck depression inventory [5], Hamilton depression rating scale tests [6], and other supplementary indicators can be used.
However, diagnosis of depression through subjective judgment of a person is limited. For example, if the symptoms of depression are masked as symptoms of disorders other than depression, they may not be judged as depression, and thus, may be misdiagnosed. In particular, referred to as masked depression [7,8] appear as symptoms other than depression. Such atypical depression is difficult to diagnose and easy to misdiagnose, but it carries a great risk [9]. In these cases, there is a problem that the disease may be getting worse because they did not receive treatment at the right time. In addition, many depressed patients are concerned about the public perception of their mental illness; hence, they do not easily reveal their condition to experts [10].
Therefore, there is a need for a consistent and accurate method for classifying depressed patients and healthy individuals. Several studies have attempted to identify biomarkers of depression based on objective physiological data such as computed tomography (CT), functional magnetic resonance imaging (FMRI), and electroencephalogram (EEG) [11]. In particular, the noninvasive method of acquiring EEG by attaching electrodes to a patient’s head has gained attention as it is more cost-effective and easier to implement than conventional tracking methods, such as CT and FMRI.
Research on EEG-based depression diagnosis using machine learning technology is of great interest. Various features extracted from EEG are entered into a machine learning model, and the model is trained to classify MDD patients and healthy controls effectively. Mumtaz et al. proposed a machine learning model that classifies MDD patients based on features such as frequency band power and alpha hemisphere asymmetry [12]. Mahato et al. presented a machine learning model that uses band power, theta asymmetry, and alpha1 and alpha2 features [13]. In addition, Mahato et al. also presented a classification model that uses linear features, such as band power and hemispheric asymmetry, and nonlinear features, such as relative wavelet energy (RWE) and wavelet entropy (WE) [14].
One of the features commonly shown in research results is brain asymmetry. Both Allen et al. [15] and Dharmadhikari et al. [16] reported that frontal lobe asymmetry is a promising biomarker of depression.
In previous studies, deep learning techniques were also used to classify brain waves of depressed patients. Deep learning is widely used in medical diagnosis owing to its wide range of functions—from pre-processing to extraction of key features based on self-learned data. Acharya et al. presented a 13-layer model for EEG-based depression screening using a convolutional neural network (CNN) [17]. Mumtaz et al. proposed one-dimensional CNN (1D CNN) and 1DCNN + LSTM (long short-term memory) models to confirm the possibility of using deep learning architectures for diagnosis of depression [18]. In addition, Betul Ay et al. confirmed the effective classification performance of raw EEG signals obtained from the left and right hemispheres of the brain using CNN + LSTM [19].
This study proposes a deep-asymmetry method that converts brain asymmetry, which has been identified as a promising biomarker, into a matrix-type image and provides it to a convolution neural network. Figure 1 illustrates the proposed method. The asymmetry image matrix can express the difference in the degree of asymmetry between different channels. The model automatically extracts image features through a CNN and classifies MDD patients and healthy controls using a fully-connected network. The proposed approach was tested on an open-accessible dataset and its performance was compared with previous related studies.

2. Materials and Methods

2.1. Dataset

This study used the EEG data set [20], an open access data set, collected by Mumtaz et al. at the Hospital Universiti Sains Malaysia (HUSM). The data set comprises information of 34 depressed patients (mean age = 40.33, SD = ±12.861) and 30 healthy controls (mean age = 38.227, SD = ±15.64). The MDD patients were diagnosed with DSM-IV and underwent a two-week drug washing period before EEG collection. The experimental setup and data collection of the study were approved by the ethics committee of HUSM and written consents were obtained from the subjects. The EEG data collection was based on the international 10–20 system [21]. A total of 19 channels were collected, including frontal (Fp1, F3, F7, Fz, Fp2, F4, and F8), central (C3, C4, and Cz), parietal lobes (P3, Pz, and P4), occipital (O1 and O2), and temporal regions (T3, T4, T5, and T6). The data were filtered between 0.5–70.0 Hz and a 50 Hz notch filter was used to suppress power line noise. The EEG data were collected in three states: eyes closed (5 min), eyes open (5 min), and with a given specific visual stimulus (10 min). The EEG data were collected with a sample rate of 256 samples per second. This study used the eye-closed (EC) data and eye-opened (EO) data in the HUSM data set.

2.2. Data Preprocessing

The EEG data were normalized before use so that each channel would have similar amplitude scaling. Each channel was normalized using the min-max normalization method. Electroencephalogram data are easily affected by noise, such as eye blinking and muscle movement. Therefore, independent component analysis (ICA) was used to further remove EEG noise. ICA is an effective method for removing artifacts [22] and has been adopted in previous studies [10].
The number of samples in a dataset is an important consideration in machine learning problems. This is a commonly considered problem in other EEG studies [23]. Data segmentation, the process of dividing samples in EEG data into meaningful segments, is a potential approach to address this problem, and it has been used in existing EEG studies [24]. Therefore, in this study, the 5 min data set was divided into epochs of 4 s (1024 samples) each and assigned with the same label.

2.3. Visualizing EEG Image of Brain Asymmetry

The asymmetry score can be obtained through the difference between observations, such as the EEG signal power of each channel [25]. The relative powers of delta (0.5–4 Hz), theta (4–8 Hz), alpha (8–13 Hz), and beta (13–30 Hz) were calculated to obtain asymmetry images for each EEG band. The power spectrum (PSD) of the EEG signal was calculated using Welch’s periodogram [26] The window length was set to two times the inverse of the lower frequency of interest and overlap was set to 50% This was used to obtain power spectral density S. The calculated frequency band power spectral density was a parabolic approximation using the Simpson’s method [27]. Equations (1) and (2) were used to calculate the relative power of each channel at the desired frequency.
Rp ch 1 =   f = f 1 f 2 S c h 1 f = 0.5 Hz 30 Hz S c h 1
Rp ch 2 =   f = f 1 f 2 S c h 2 f = 0.5 Hz 30 Hz S c h 2
where, f1 and f2 denote the lowest and highest frequencies in the band, respectively. For example, if the relative EEG signal power of the alpha wave (8–13 Hz) is calculated, f1 = 8 and f2 = 13. The power spectral densities at each channel are denoted as Sch1 and Sch2 Equation (3) is used to obtain the power asymmetry between channels ch1 and ch2. The parameter A(ch1, ch2) is calculated as the difference between the relative power values of ch1 and ch2. For example, if fp1 is ch1, then ch2 is set to one of the 16 channels (Fp1, F3, C3, P3, O1, F7, T3, T5, Fp2, F4, C4, P4, O2, F8, T4, and T6).
A ( ch 1 , ch 2 ) = Rp ch 1     Rp ch 2 Rp ch 1   +   Rp ch 2
Using Equation (3), it is possible to calculate the difference between the relative power of two channels for each channel pair, and hence, the difference in activity corresponding to each part of the brain can be identified. Figure 2 shows an example of EEG asymmetry calculation.
A (ch1, ch2) can have a value between −1 and 1. A positive value means that ch1 has a relatively higher EEG relative power. A negative value means that ch2 has a relatively lower EEG relative power. Based on this, the asymmetry matrix image shown in Figure 3 is proposed to express the value of A (ch1, ch2) as one image.
The image is composed of 16 rows and columns, and each row and column correspond to 16 channels. Each cell has a color corresponding to A (ch1, ch2) value, as indicated on the color bar on the right. Red indicates an A (ch1, ch2) value close to +1, while blue indicates a value close to −1. Clear reds and blues indicate a greater difference between the channels and a more active brain. Yellow and green indicate that the relative power between the channels is similar.

2.4. Classification Model

This study proposes a deep learning model using a CNN to classify depressed patients and normal controls using asymmetry matrix images. Table 1 lists the parameters of the model. A 3-layer model comprising a 2-dimensional convolution layer and a pooling layer followed by a fully connected layer was used. The convolution layer used the ReLU activation function. A sigmoid function was used in the output layer. In addition, batch normalization [28] was performed to prevent gradient vanishing problem during model training and a dropout layer [29] was used to prevent overfitting of the model. The dimensions of the input image were set to 64 × 64 × 3. Image input was carried out using a mini batch, which was used to improve the model training performance and speed [30]. When training the model, the learning rate was set to 0.0001 and 10 epochs were used. The binary cross-entropy loss function was used and training was performed using Adam optimizer [31].

2.5. Evaluation

For model evaluation, a k-fold cross-validation [32] (k = 5) was used. When dividing the data set into training and testing sets, the data set was randomly mixed and then divided into 5 subsets to avoid data bias. One subset was used for testing and the other four subsets were used for training. The model was evaluated using the average of the evaluation indicators obtained after 5 repetitions without overlapping.
In this study, accuracy (Equation (4)), sensitivity (Equation (5)), and specificity (Equation (6)) based on the confusion matrix were used as indicators of performance evaluation. Sensitivity was defined as the percentage of actual MDD patients in all cases with MDD patients (TP + FN), and specificity was defined as the percentage of actual healthy controls in all cases with healthy controls (TN + FP). Accuracy was defined as the percentage of correctly classified MDD patients and healthy controls.
A c c u r a c y   =   T P   +   T N T P   +   T N   +   F P   +   T N
sensitivity =   T P T P   +   F N
specificity =   T N T N   +   F P
Additionally, evaluation was conducted using the receiver operating characteristic (ROC) curve, which is widely used in the evaluation of binary classification. The ROC curve evaluates sensitivity and specificity based on several thresholds.

3. Results

3.1. Visualized EEG Image of Brain Asymmetry

In this study, a matrix image of the degree of asymmetry for each channel was created based on the relative signal power in the delta (0.5–4 Hz), theta (4–8 Hz), alpha (8–13 Hz), and beta (13–30 Hz) bands. Each model with this input image was constructed and its performance was compared. Figure 4, Figure 5, Figure 6 and Figure 7 shows example images of healthy controls and MDD patients based on the frequency of each band.

3.2. Classification Model

Table 2 shows the performance of the asymmetry matrix image-based classification model in EC dataset. The table presents the average of each evaluation index from the five repetitions. The table shows that the best performance was obtained using the alpha band-based asymmetry image, which had an accuracy of 98.85, sensitivity of 98.84, and specificity of 98.66.
Table 3 shows the performance of the asymmetry matrix image-based classification model in EO dataset. From the table, the accuracy of the model using alpha band-based asymmetry image was 97.56, sensitivity was 98.75, and specificity was 96.31.
Figure 8 and Figure 9 shows the performance of the proposed model under each band using the ROC curve. The figure shows the graph of each five cross-validations as well as the graph of the average value. The alpha band had the best ROC curve compared with the other bands. The area under its curve (AUC) also showed effective classification performance with an average of 0.9879 in EC dataset’s alpha band.

4. Discussion

It is important to diagnose and treat depression early. However, many people are reluctant to seek medical help for their illness as they are concerned about the public perception of mental illness. As EEG devices become popular and the public can easily use them, the EEG-based machine learning and deep learning methods can be used as powerful tools for identifying depression and providing follow-up treatment.
One of the major novelties of this study is converting the brain asymmetry matrix into a 2D image and providing it to a 2D CNN model. Several methods for the conversion of 1D signal data into a 2D image have been considered. For example, the STFT, wavelet-based spectrogram method [33], and brain coherence network-based method [34,35] have been proposed. However, to implement an effective 2D CNN image, this study used brain asymmetry, which has been identified as an important biomarker of depression. The matrix was expressed as a visualized image. A high classification accuracy of 98.85% was achieved using the alpha asymmetry image. This is consistent with the findings of other studies published in the literature that the alpha asymmetry feature can be used as a biomarker for reading depression [11].
Table 4 summarizes the methodology and results of the studies using the same dataset. Accuracy, a commonly used index in other studies, was used. Table 4 shows that the proposed method surpasses all the other methods presented in the table, except for the study conducted by Saeedi et al. Thus, compared with the other methods using raw EEG signals, the asymmetry matrix image method proved to be effective for detecting and controlling depression.
Similar to other studies, the size of the data set is the limitation of the study. Because small datasets are at risk of overfitting. It is also because a smaller sample size limits generalization to a larger population. As our small pilot study, generalization of the proposed classification model requires further evaluation with more study samples.
So we willingly released the code. Our code can be accessed from Supplementary Materials. Our efforts will show that the model can be validated on more test data and the methodology can be further advanced.
Furthermore, beyond the classification of depressed patients and healthy controls, it would be meaningful to find the correlation of the proposed classification function with scores such as beck’s depression inventory (BDI) score.
However, to overcome model overfitting problem, data segmentation, batch normalization, and dropout layer were used in this study. Future research will be focused on generalizing results and presenting a more reliable model using more samples and other types of EEG data.

5. Conclusions

Prescreening and treatment of depression are very important. Traditional methods of diagnosing depression include consulting with an expert. However, diagnosis of psychological depression involves human subjectivity. In addition, people are reluctant to reveal their condition to experts due to social stigma. Therefore, there is a need for a model to diagnose depression in an objective and consistent way. Models use brain waves and machine learning methods; hence, they have gained attention as they are objective and do not depend on experts. This study proposes a deep-asymmetry method, which uses an EEG-based image asymmetry matrix along with a CNN. The proposed methodology and classification model classified MDD patients and healthy individuals with an accuracy of 98.85%, which exceeds accuracy of most existing methods. The proposed method extracts features by preserving the spatial characteristics of the EEG channel. In addition, the proposed process is performed automatically without a manual feature extraction method. Such an automatic method can be used by nonprofessionals and could be used as an effective tool for pre-screening depression.

Supplementary Materials

The following are available online at https://doi.org/10.6084/m9.figshare.13083995.v2: Software codes of proposed study.

Author Contributions

Conceptualization, M.K. and H.K.; Methodology, M.K. and H.K.; Project administration, Y.L.; Software, M.K. and H.K.; Supervision, Y.L.; Validation, J.-H.P. and S.K.; Visualization, M.K.; Writing—original draft, M.K.; Writing—review and editing, J.-H.P., S.K. and Y.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the Ministry of Science and ICT (MSIT), Korea, under the Information Technology Research Center (ITRC) support program (IITP-2020-2017-0-01630) supervised by the IITP(Institute for Information & Communications Technology Promotion)

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Depression. Available online: https://www.who.int/news-room/fact-sheets/detail/depression (accessed on 7 September 2020).
  2. Parekh, R. What Is Depression? Available online: https://www.psychiatry.org/patients-families/depression/what-is-depression (accessed on 7 September 2020).
  3. Smith, K.M.; Renshaw, P.F.; Bilello, J. The diagnosis of depression: Current and emerging methods. Compr. Psychiatry 2013, 54, 1–6. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Psychiatric, A. Association. In Diagnostic and Statistical Manual of Mental Disorders, 5th ed.; American Psychiatric Association: Washington, DC, USA, 2013. [Google Scholar] [CrossRef]
  5. Brenner, L.A. Beck Anxiety Inventory. In Encyclopedia of Clinical Neuropsychology; Springer New York: New York, NY, USA, 2011; pp. 359–361. [Google Scholar]
  6. Williams, J.B.W. A Structured Interview Guide for the Hamilton Depression Rating Scale. Arch. Gen. Psychiatry 1988, 45, 742–747. [Google Scholar] [CrossRef] [PubMed]
  7. Shetty, P.; Mane, A.; Fulmali, S.; Uchit, G. Understanding masked depression: A Clinical scenario. Indian J. Psychiatry 2018, 60, 97. [Google Scholar] [CrossRef] [PubMed]
  8. Eberhard, G. Masked depression—History, diagnosis and delimitation. Nord. Psykiatr. Tidsskr. 1989, 43, 7–13. [Google Scholar] [CrossRef]
  9. Łojko, D.; Rybakowski, J.K. Atypical depression: Current perspectives. Neuropsychiatr. Dis. Treat. 2017, 13, 2447–2456. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Park, J.-I.; Jeon, M. The Stigma of Mental Illness in Korea. J. Korean Neuropsychiatr. Assoc. 2016, 55, 299–309. [Google Scholar] [CrossRef] [Green Version]
  11. de Aguiar Neto, F.S.; Rosa, J.L.G. Depression biomarkers using non-invasive EEG: A review. Neurosci. Biobehav. Rev. 2019, 105, 83–93. [Google Scholar] [CrossRef]
  12. Mumtaz, W.; Xia, L.; Ali, S.S.A.; Yasin, M.A.M.; Hussain, M.; Malik, A.S. Electroencephalogram (EEG)-based computer-aided technique to diagnose major depressive disorder (MDD). Biomed. Signal Process. Control 2017, 31, 108–115. [Google Scholar] [CrossRef]
  13. Mahato, S.; Paul, S. Classification of Depression Patients and Normal Subjects Based on Electroencephalogram (EEG) Signal Using Alpha Power and Theta Asymmetry. J. Med Syst. 2019, 44, 28. [Google Scholar] [CrossRef]
  14. Mahato, S.; Paul, S. Detection of major depressive disorder using linear and non-linear features from EEG signals. Microsyst. Technol. 2019, 25, 1065–1076. [Google Scholar] [CrossRef]
  15. Allen, J.J.B.; Reznik, S.J. Frontal EEG asymmetry as a promising marker of depression vulnerability. Summ. Methodol. Consid. 2015, 4, 93–97. [Google Scholar] [CrossRef] [Green Version]
  16. Dharmadhikari, A.S.; Tandle, A.L.; Jaiswal, S.V.; Sawant, V.A.; Vahia, V.N.; Jog, N. Frontal Theta Asymmetry as a Biomarker of Depression. East Asian Arch. Psychiatry 2018, 28, 17–22. [Google Scholar] [PubMed]
  17. Acharya, U.R.; Oh, S.L.; Hagiwara, Y.; Tan, J.H.; Adeli, H.; Subha, D.P. Automated EEG-based screening of depression using deep convolutional neural network. Comput. Methods Programs Biomed. 2018, 161, 103–113. [Google Scholar] [CrossRef] [PubMed]
  18. Mumtaz, W.; Qayyum, A. A deep learning framework for automatic diagnosis of unipolar depression. Int. J. Med Inform. 2019, 132, 103983. [Google Scholar] [CrossRef] [PubMed]
  19. Ay, B.; Yildirim, O.; Talo, M.; Baloglu, U.B.; Aydin, G.; Puthankattil, S.D.; Acharya, U.R. Automated Depression Detection Using Deep Representation and Sequence Learning with EEG Signals. J. Med. Syst. 2019, 43, 205. [Google Scholar] [CrossRef]
  20. Wajid, M. MDD Patients and Healthy Controls EEG Data (New). 2016. Available online: https://figshare.com/articles/EEG_Data_New/4244171 (accessed on 15 November 2020). [CrossRef]
  21. Klem, G.H.; Lüders, H.O.; Jasper, H.H.; Elger, C. The ten-twenty electrode system of the International Federation. The International Federation of Clinical Neurophysiology. Electroencephalogr. Clin. Neurophysiol. Suppl. 1999, 52, 3–6. [Google Scholar]
  22. Jung, T.-P.; Makeig, S.; Humphries, C.; Lee, T.-W.; McKeown, M.J.; Iragui, V.; Sejnowski, T.J. Removing electroencephalographic artifacts by blind source separation. Psychophysiology 2000, 37, 163–178. [Google Scholar] [CrossRef]
  23. Durongbhan, P.; Zhao, Y.; Chen, L.; Zis, P.; Marco, M.D.; Unwin, Z.C.; Venneri, A.; He, X.; Li, S.; Zhao, Y.; et al. A Dementia Classification Framework Using Frequency and Time-Frequency Features Based on EEG Signals. IEEE Trans. Neural Syst. Rehabil. Eng. 2019, 27, 826–835. [Google Scholar] [CrossRef] [Green Version]
  24. Chao, H.; Dong, L.; Liu, Y.L.; Lu, B.Y. Emotion Recognition from Multiband EEG Signals Using CapsNet. Sensors 2019, 19, 2212. [Google Scholar] [CrossRef] [Green Version]
  25. Hinrikus, H.; Suhhova, A.; Bachmann, M.; Aadamsoo, K.; Võhma, Ü.; Lass, J.; Tuulik, V. Electroencephalographic spectral asymmetry index for detection of depression. Med. Biol. Eng. Comput. 2009, 47, 1291. [Google Scholar] [CrossRef]
  26. Welch, P. The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms. IEEE Trans. Audio Electroacoust. 1967, 15, 70–73. [Google Scholar] [CrossRef] [Green Version]
  27. Weisstein, E.W. Simpson’s Rule. Available online: https://mathworld.wolfram.com/SimpsonsRule.html (accessed on 7 September 2020).
  28. Ioffe, S.; Szegedy, C. Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. arXiv 2015, arXiv:1502.03167. [Google Scholar]
  29. Srivastava, N.; Hinton, G.; Krizhevsky, A.; Sutskever, I.; Salakhutdinov, R. Dropout: A simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 2014, 15, 1929–1958. [Google Scholar]
  30. Masters, D.; Luschi, C. Revisiting Small Batch Training for Deep Neural Networks. arXiv 2018, arXiv:1804.07612. [Google Scholar]
  31. Kingma, D.P.; Ba, J. Adam: A Method for Stochastic Optimization. arXiv 2015, arXiv:1412.6980. [Google Scholar]
  32. Stone, M. An Asymptotic Equivalence of Choice of Model by Cross-Validation and Akaike’s Criterion. J. R. Stat. Soc. Ser. B 1977, 39, 44–47. [Google Scholar] [CrossRef]
  33. Aslan, Z.; Akin, M. Automatic Detection of Schizophrenia by Applying Deep Learning over Spectrogram Images of EEG Signals. Traitement Signal 2020, 37, 235–244. [Google Scholar] [CrossRef]
  34. Li, X.; La, R.; Wang, Y.; Hu, B.; Zhang, X. A Deep Learning Approach for Mild Depression Recognition Based on Functional Connectivity Using Electroencephalography. Front. Neurosci. 2020, 14. [Google Scholar] [CrossRef] [Green Version]
  35. Saeedi, A.; Saeedi, M.; Maghsoudi, A.; Shalbaf, A. Major depressive disorder diagnosis based on effective connectivity in EEG signals: A convolutional neural network and long short-term memory approach. Cogn. Neurodyn. 2020. [Google Scholar] [CrossRef]
Figure 1. Illustration of the deep-asymmetry method.
Figure 1. Illustration of the deep-asymmetry method.
Sensors 20 06526 g001
Figure 2. Example for the calculation of an EEG Asymmetry. (a) asymmetry between Fp1 and the other channels. (b) asymmetry between Fp2 and the other channels.
Figure 2. Example for the calculation of an EEG Asymmetry. (a) asymmetry between Fp1 and the other channels. (b) asymmetry between Fp2 and the other channels.
Sensors 20 06526 g002
Figure 3. Frame of the brain asymmetry image. The rows and columns correspond to the 16 channels (Fp1, F3, C3, P3, O1, F7, T3, T5, Fp2, F4, C4, P4, O2, F8, T4, and T6) and every cell has a color based on the value of A (ch1, ch2), as indicated on the color bar on the right side.
Figure 3. Frame of the brain asymmetry image. The rows and columns correspond to the 16 channels (Fp1, F3, C3, P3, O1, F7, T3, T5, Fp2, F4, C4, P4, O2, F8, T4, and T6) and every cell has a color based on the value of A (ch1, ch2), as indicated on the color bar on the right side.
Sensors 20 06526 g003
Figure 4. Visualized EEG images for healthy controls at various frequency bands in EC dataset: (a) delta (b) theta (c) alpha, and (d) beta.
Figure 4. Visualized EEG images for healthy controls at various frequency bands in EC dataset: (a) delta (b) theta (c) alpha, and (d) beta.
Sensors 20 06526 g004
Figure 5. Visualized EEG images for MDD patients at various frequency bands in EC dataset: (a) delta, (b) theta, (c) alpha, and (d) beta.
Figure 5. Visualized EEG images for MDD patients at various frequency bands in EC dataset: (a) delta, (b) theta, (c) alpha, and (d) beta.
Sensors 20 06526 g005
Figure 6. Visualized EEG images for healthy controls at various frequency bands in eyes-opened(EO) dataset: (a) delta (b) theta (c) alpha, and (d) beta.
Figure 6. Visualized EEG images for healthy controls at various frequency bands in eyes-opened(EO) dataset: (a) delta (b) theta (c) alpha, and (d) beta.
Sensors 20 06526 g006
Figure 7. Visualized EEG images for Major Depressive Disorder (MDD) patients at various frequency bands in EO dataset: (a) delta, (b) theta, (c) alpha, and (d) beta.
Figure 7. Visualized EEG images for Major Depressive Disorder (MDD) patients at various frequency bands in EO dataset: (a) delta, (b) theta, (c) alpha, and (d) beta.
Sensors 20 06526 g007
Figure 8. Receiver operating characteristic (ROC) curves of the deep learning model in EC dataset: (a) delta, (b) theta, (c) alpha, and (d) beta.
Figure 8. Receiver operating characteristic (ROC) curves of the deep learning model in EC dataset: (a) delta, (b) theta, (c) alpha, and (d) beta.
Sensors 20 06526 g008
Figure 9. ROC curves of the deep learning model in EO dataset: (a) delta, (b) theta, (c) alpha, and (d) beta.
Figure 9. ROC curves of the deep learning model in EO dataset: (a) delta, (b) theta, (c) alpha, and (d) beta.
Sensors 20 06526 g009
Table 1. Parameters of the CNN model.
Table 1. Parameters of the CNN model.
LayerOutput ShapeParam #
Input64, 64, 3-
2D Convolution (C1)62, 62, 32896
2D Maxpooling (P1)31, 31, 320
Batch normalization (BN)31, 31, 32128
2D Convolution (C2)29, 29, 6418,496
2D Maxpooling (P3)14, 14, 640
2D Convolution (C3)12, 12, 12873,856
2D Maxpooling (P3)6, 6, 1280
Flatten46080
Dense 12561,179,904
Dropout (DP)2560
Dense (sigmoid)1257
Table 2. Results of proposed model in eye-closed (EC) dataset.
Table 2. Results of proposed model in eye-closed (EC) dataset.
BandAccuracySensitivitySpecificity
Delta95.5095.1195.95
Theta95.9097.1194.56
Alpha98.8599.1598.51
Beta96.0796.1396.00
Table 3. Results of proposed model in EO dataset.
Table 3. Results of proposed model in EO dataset.
BandAccuracySensitivitySpecificity
Delta93.0392.8393.24
Theta94.6695.4193.86
Alpha97.5698.7596.31
Beta94.0694.7593.33
Table 4. Overview of related studies.
Table 4. Overview of related studies.
StudiesMethodsClassification MethodsAccuracy
Wajid Mumtaz (2016) [12]Frequency power + asymmetry featureSVM98.4
Shalini Mahato (2018) [14]Alpha power + RWEMLPNN93.33
Wajid Mumtaz (2019) [18]raw EEG1D CNN98.32
Shalini Mahato (2019) [13]Alpha power + theta asymmetrySVM88.33
Abdolkarim Saeedi (2020) [35]Effective Connectivity (GPDC, dDTF)1D CNN + LSTM99.25
Current studyAsymmetry image2D CNN98.85
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Kang, M.; Kwon, H.; Park, J.-H.; Kang, S.; Lee, Y. Deep-Asymmetry: Asymmetry Matrix Image for Deep Learning Method in Pre-Screening Depression. Sensors 2020, 20, 6526. https://doi.org/10.3390/s20226526

AMA Style

Kang M, Kwon H, Park J-H, Kang S, Lee Y. Deep-Asymmetry: Asymmetry Matrix Image for Deep Learning Method in Pre-Screening Depression. Sensors. 2020; 20(22):6526. https://doi.org/10.3390/s20226526

Chicago/Turabian Style

Kang, Min, Hyunjin Kwon, Jin-Hyeok Park, Seokhwan Kang, and Youngho Lee. 2020. "Deep-Asymmetry: Asymmetry Matrix Image for Deep Learning Method in Pre-Screening Depression" Sensors 20, no. 22: 6526. https://doi.org/10.3390/s20226526

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop