Emerging Wearable Biosensor Technologies for Stress Monitoring and Their Real-World Applications
Abstract
:1. Introduction
1.1. The History of Wearable Biosensors
1.2. The Development Potential of Wearable Devices
1.3. Detection of Physical and Psychological Stress with Wearable Devices
2. Electroencephalogram
2.1. What Is an EEG?
2.2. How Is EEG Data Collected?
2.3. The Application of EEG in Measuring Physical Situations, Relieving Stress and Managing Emotions
2.4. Emotion Detection with EEG
2.5. Limitations of EEG Detection
3. Eye Movement
3.1. In What Ways Do Eyes Move?
3.2. How Can Eye Movement Data Be Collected?
3.2.1. Eye Tracking
3.2.2. EOG
3.3. Different Glasses-Type Wearables for Fatigue Detection and Human-Computer Interfaces
3.4. Emotion Detection by EEGs
3.5. Limitations of Eye Movement Detection
4. Sweat Detection
4.1. Sweat Components
4.2. How Can the Components of Sweat Be Detected?
4.3. The Application of Sweat Detection to Determine Body Movement and Emotion
4.4. Limitations of Sweat Detection
5. Summary and Outlook
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Zheng, M.; Liu, P.X.; Gravina, R.; Fortino, G. An emerging wearable world: New gadgetry produces a rising tide of changes and challenges. IEEE Syst. Man Cybern. Mag. 2018, 4, 6–14. [Google Scholar] [CrossRef]
- Gernsback, H. The isolator. Sci. Invent. 1925, 13, 214–281. [Google Scholar]
- Brockwell, H. Forgotten genius: The man who made a working VR machine in 1957. TechRadar 2016, 7. [Google Scholar]
- Thorp, E.O. The invention of the first wearable computer. In Proceedings of the Digest of Papers. Second International Symposium on Wearable Computers (Cat. No. 98EX215), Pittsburgh, PA, USA, 19–20 October 1998; pp. 4–8. [Google Scholar]
- Oppermann, L.; Prinz, W. Introduction to this Special Issue on Smart Glasses. I-COM 2016, 15, 123–132. [Google Scholar] [CrossRef]
- Mann, S. Smart clothing: The shift to wearable computing. Commun. ACM 1996, 39, 23–24. [Google Scholar] [CrossRef]
- Meeker, M.; Wu, L. Internet Trends 2018; Kleiner Perkins: Menlo Park, CA, USA, 2018. [Google Scholar]
- Hickey, A. The rise of wearables: From innovation to implementation. In Digital Health; Elsevier: Amsterdam, The Netherlands, 2021; pp. 357–365. [Google Scholar]
- Yousif, M.; Hewage, C.; Nawaf, L. IOT technologies during and beyond COVID-19: A comprehensive review. Future Internet 2021, 13, 105. [Google Scholar] [CrossRef]
- Sengupta, J.; Baviskar, N.; Shukla, S. Biosignal acquisition system for stress monitoring. In Proceedings of the International Conference on Advances in Information Technology and Mobile Communication, Bangalore, India, 27–28 April 2012; pp. 451–458. [Google Scholar]
- Ren, P.; Barreto, A.; Huang, J.; Gao, Y.; Ortega, F.R.; Adjouadi, M. Off-line and on-line stress detection through processing of the pupil diameter signal. Ann. Biomed. Eng. 2014, 42, 162–176. [Google Scholar] [CrossRef]
- Raymond, J.; Varney, C.; Parkinson, L.A.; Gruzelier, J.H. The effects of alpha/theta neurofeedback on personality and mood. Cogn. Brain Res. 2005, 23, 2–3. [Google Scholar] [CrossRef]
- Polliack, A.; Taylor, R.; Bader, D. Sweat analysis following pressure ischaemia in a group of debilitated subjects. J. Rehabil. Res. Dev. 1997, 34, 303–308. [Google Scholar]
- Cheol Jeong, I.; Bychkov, D.; Searson, P.C. Wearable devices for precision medicine and health state monitoring. IEEE Trans. Biomed. Eng. 2018, 66, 1242–1258. [Google Scholar] [CrossRef]
- Taj-Eldin, M.; Ryan, C.; O’Flynn, B.; Galvin, P. A review of wearable solutions for physiological and emotional monitoring for use by people with autism spectrum disorder and their caregivers. Sensors 2018, 18, 4271. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Diaz-Romero, D.J.; Rincón, A.M.R.; Miguel-Cruz, A.; Yee, N.; Stroulia, E. Recognizing emotional states with wearables while playing a serious game. IEEE Trans. Instrum. Meas. 2021, 70, 1–12. [Google Scholar] [CrossRef]
- Zheng, W.-L.; Liu, W.; Lu, Y.; Lu, B.-L.; Cichocki, A. Emotionmeter: A multimodal framework for recognizing human emotions. IEEE Trans. Cybern. 2018, 49, 1110–1122. [Google Scholar] [CrossRef] [PubMed]
- Suiçmez, A.; Cengiz, T.; Odabas, M.S. An Overview of Classification of Electrooculography (EOG) Signals by Machine Learning Methods. Gazi Univ. J. Sci. Part C Des. Technol. 2022, 10, 330–338. [Google Scholar] [CrossRef]
- Buzsáki, G.; Anastassiou, C.A.; Koch, C. The origin of extracellular fields and currents—EEG, ECoG, LFP and spikes. Nat. Rev. Neurosci. 2012, 13, 407–420. [Google Scholar] [CrossRef]
- Silva, F.L.d. EEG: Origin and measurement. In EEg-fMRI; Springer: Berlin/Heidelberg, Germany, 2009; pp. 19–38. [Google Scholar]
- Nunez, P.L.; Srinivasan, R. Electric Fields of the Brain: The Neurophysics of EEG; Oxford University Press: New York, NY, USA, 2006; p. 178. [Google Scholar]
- Usakli, A.B. Improvement of EEG signal acquisition: An electrical aspect for state of the art of front end. Comput. Intell. Neurosci. 2010, 2010, 1–7. [Google Scholar] [CrossRef] [Green Version]
- Jackson, A.F.; Bolger, D.J. The neurophysiological bases of EEG and EEG measurement: A review for the rest of us. Psychophysiology 2014, 51, 1061–1071. [Google Scholar] [CrossRef]
- Lin, C.-T.; Liao, L.-D.; Liu, Y.-H.; Wang, I.-J.; Lin, B.-S.; Chang, J.-Y. Novel dry polymer foam electrodes for long-term EEG measurement. IEEE Trans. Biomed. Eng. 2010, 58, 1200–1207. [Google Scholar]
- Liu, N.-H.; Chiang, C.-Y.; Chu, H.-C. Recognizing the degree of human attention using EEG signals from mobile sensors. Sensors 2013, 13, 10273–10286. [Google Scholar] [CrossRef]
- Gil, H.; Gonçalves, V. The use of «Peak & Neuronation» digital applications for the inclusion of older adults: A case study at USALBI. In Proceedings of the 2017 International Symposium on Computers in Education (SIIE), Lisbon, Portugal, 9 November 2017; pp. 1–5. [Google Scholar]
- İnce, R.; Adanır, S.S.; Sevmez, F. The inventor of electroencephalography (EEG): Hans Berger (1873–1941). Child’s Nerv. Syst. 2021, 37, 2723–2724. [Google Scholar] [CrossRef] [Green Version]
- Brazier, M.A. The analysis of brain waves. Sci. Am. 1962, 206, 142–155. [Google Scholar] [CrossRef]
- Ferree, T.C.; Luu, P.; Russell, G.S.; Tucker, D.M. Scalp electrode impedance, infection risk, and EEG data quality. Clin. Neurophysiol. 2001, 112, 536–544. [Google Scholar] [CrossRef] [PubMed]
- Li, G.-L.; Wu, J.-T.; Xia, Y.-H.; He, Q.-G.; Jin, H.-G. Review of semi-dry electrodes for EEG recording. J. Neural Eng. 2020, 17, 051004. [Google Scholar] [CrossRef] [PubMed]
- Shad, E.H.T.; Molinas, M.; Ytterdal, T. Impedance and noise of passive and active dry EEG electrodes: A review. IEEE Sens. J. 2020, 20, 14565–14577. [Google Scholar]
- De Aguiar Neto, F.S.; Rosa, J.L.G. Depression biomarkers using non-invasive EEG: A review. Neurosci. Biobehav. Rev. 2019, 105, 83–93. [Google Scholar] [CrossRef]
- Keren, H.; O’Callaghan, G.; Vidal-Ribas, P.; Buzzell, G.A.; Brotman, M.A.; Leibenluft, E.; Pan, P.M.; Meffert, L.; Kaiser, A.; Wolke, S. Reward processing in depression: A conceptual and meta-analytic review across fMRI and EEG studies. Am. J. Psychiatry 2018, 175, 1111–1120. [Google Scholar] [CrossRef] [Green Version]
- Cassani, R.; Estarellas, M.; San-Martin, R.; Fraga, F.J.; Falk, T.H. Systematic review on resting-state EEG for Alzheimer’s disease diagnosis and progression assessment. Dis. Mrk. 2018, 2018, 1–26. [Google Scholar] [CrossRef] [Green Version]
- Rossini, P.M.; Di Iorio, R.; Vecchio, F.; Anfossi, M.; Babiloni, C.; Bozzali, M.; Bruni, A.C.; Cappa, S.F.; Escudero, J.; Fraga, F.J. Early diagnosis of Alzheimer’s disease: The role of biomarkers including advanced EEG signal analysis. Report from the IFCN-sponsored panel of experts. Clin. Neurophysiol. 2020, 131, 1287–1310. [Google Scholar] [CrossRef]
- Sharmila, A. Epilepsy detection from EEG signals: A review. J. Med. Eng. Technol. 2018, 42, 368–380. [Google Scholar] [CrossRef]
- Amin, U.; Benbadis, S.R. The role of EEG in the erroneous diagnosis of epilepsy. J. Clin. Neurophysiol. 2019, 36, 294–297. [Google Scholar] [CrossRef]
- Barros, C.; Silva, C.A.; Pinheiro, A.P. Advanced EEG-based learning approaches to predict schizophrenia: Promises and pitfalls. Artif. Intell. Med. 2021, 114, 102039. [Google Scholar] [CrossRef] [PubMed]
- Perrottelli, A.; Giordano, G.M.; Brando, F.; Giuliani, L.; Mucci, A. EEG-based measures in at-risk mental state and early stages of schizophrenia: A systematic review. Front. Psychiatry 2021, 12, 653642. [Google Scholar] [CrossRef] [PubMed]
- Alday, P.M. M/EEG analysis of naturalistic stories: A review from speech to language processing. Lang. Cogn. Neurosci. 2019, 34, 457–473. [Google Scholar] [CrossRef]
- Tromp, J.; Peeters, D.; Meyer, A.S.; Hagoort, P. The combined use of virtual reality and EEG to study language processing in naturalistic environments. Behav. Res. Methods 2018, 50, 862–869. [Google Scholar] [CrossRef] [Green Version]
- Hanslmayr, S.; Sauseng, P.; Doppelmayr, M.; Schabus, M.; Klimesch, W. Increasing individual upper alpha power by neurofeedback improves cognitive performance in human subjects. Appl. Psychophysiol. Biofeedback 2005, 30, 1–10. [Google Scholar] [CrossRef]
- Vernon, D.; Egner, T.; Cooper, N.; Compton, T.; Neilands, C.; Sheri, A.; Gruzelier, J. The effect of training distinct neurofeedback protocols on aspects of cognitive performance. Int. J. Psychophysiol. 2003, 47, 75–85. [Google Scholar] [CrossRef]
- Egner, T.; Gruzelier, J.H. Ecological validity of neurofeedback: Modulation of slow wave EEG enhances musical performance. Neuroreport 2003, 14, 1221–1224. [Google Scholar] [CrossRef]
- Egner, T.; Gruzelier, J.H. Learned self-regulation of EEG frequency components affects attention and event-related brain potentials in humans. Neuroreport 2001, 12, 4155–4159. [Google Scholar] [CrossRef] [Green Version]
- Egner, T.; Gruzelier, J.H. EEG biofeedback of low beta band components: Frequency-specific effects on variables of attention and event-related brain potentials. Clin. Neurophysiol. 2004, 115, 131–139. [Google Scholar] [CrossRef]
- Cheng, M.-Y.; Wang, K.-P.; Hung, C.-L.; Tu, Y.-L.; Huang, C.-J.; Koester, D.; Schack, T.; Hung, T.-M. Higher power of sensorimotor rhythm is associated with better performance in skilled air-pistol shooters. Psychol. Sport Exerc. 2017, 32, 47–53. [Google Scholar] [CrossRef] [Green Version]
- Doerrfuss, J.I.; Kilic, T.; Ahmadi, M.; Holtkamp, M.; Weber, J.E. Quantitative and qualitative EEG as a prediction tool for outcome and complications in acute stroke patients. Clin. EEG Neurosci. 2020, 51, 121–129. [Google Scholar] [CrossRef] [PubMed]
- Sebastián-Romagosa, M.; Udina, E.; Ortner, R.; Dinarès-Ferran, J.; Cho, W.; Murovec, N.; Matencio-Peralba, C.; Sieghartsleitner, S.; Allison, B.Z.; Guger, C. EEG biomarkers related with the functional state of stroke patients. Front. Neurosci. 2020, 14, 582. [Google Scholar] [CrossRef] [PubMed]
- Zangani, C.; Casetta, C.; Saunders, A.S.; Donati, F.; Maggioni, E.; D’Agostino, A. Sleep abnormalities across different clinical stages of Bipolar Disorder: A review of EEG studies. Neurosci. Biobehav. Rev. 2020, 118, 247–257. [Google Scholar] [CrossRef] [PubMed]
- Raymond, J.; Sajid, I.; Parkinson, L.A.; Gruzelier, J.H. Biofeedback and dance performance: A preliminary investigation. Appl. Psychophysiol. Biofeedback 2005, 30, 65–73. [Google Scholar] [CrossRef]
- Ros, T.; Moseley, M.J.; Bloom, P.A.; Benjamin, L.; Parkinson, L.A.; Gruzelier, J.H. Optimizing microsurgical skills with EEG neurofeedback. BMC Neurosci. 2009, 10, 1–10. [Google Scholar] [CrossRef]
- Komarudin, K.; Mulyana, M.; Berliana, B.; Purnamasari, I. NeuroTracker Three-Dimensional Multiple Object Tracking (3D-MOT): A Tool to Improve Concentration and Game Performance among Basketball Athletes. Ann. Appl. Sport Sci. 2021, 9. [Google Scholar] [CrossRef]
- Park, S.-Y.; Klotzbier, T.J.; Schott, N. The effects of the combination of high-intensity interval training with 3D-multiple object tracking task on perceptual-cognitive performance: A randomized controlled intervention trial. Int. J. Environ. Res. Public Health 2021, 18, 4862. [Google Scholar] [CrossRef]
- Sorrell, J.M. The Aging Brain: Can Cognitive Decline Be Reversed? J. Psychosoc. Nurs. Ment. Health Serv. 2021, 59, 13–16. [Google Scholar] [CrossRef]
- Carelli, L.; Solca, F.; Tagini, S.; Torre, S.; Verde, F.; Ticozzi, N.; Ferrucci, R.; Pravettoni, G.; Aiello, E.N.; Silani, V. Gaze-Contingent Eye-Tracking Training in Brain Disorders: A Systematic Review. Brain Sci. 2022, 12, 931. [Google Scholar] [CrossRef]
- Lee, T.L.; Yeung, M.K.; Sze, S.L.; Chan, A.S. Eye-tracking training improves inhibitory control in children with attention-deficit/hyperactivity disorder. Brain Sci. 2021, 11, 314. [Google Scholar] [CrossRef]
- Liao, C.-Y.; Chen, R.-C.; Tai, S.-K. Emotion stress detection using EEG signal and deep learning technologies. In Proceedings of the 2018 IEEE International Conference on Applied System Invention (ICASI), Tokyo, Japan, 13–17 April 2018; pp. 90–93. [Google Scholar]
- Pylyshyn, Z.W.; Storm, R.W. Tracking multiple independent targets: Evidence for a parallel tracking mechanism. Spat. Vis. 1988, 3, 179–197. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Stockman, C. Can a technology teach meditation? Experiencing the EEG headband interaxon muse as a meditation guide. Int. J. Emerg. Technol. Learn. (Ijet) 2020, 15, 83–99. [Google Scholar] [CrossRef]
- Parsons, B.; Magill, T.; Boucher, A.; Zhang, M.; Zogbo, K.; Bérubé, S.; Scheffer, O.; Beauregard, M.; Faubert, J. Enhancing cognitive function using perceptual-cognitive training. Clin. EEG Neurosci. 2016, 47, 37–47. [Google Scholar] [CrossRef] [PubMed]
- Tran, J.; Gallagher Poehls, C. NeuroTracker Cognitive Function and its Relationship to GPA in College Students. Honors Thesis, Loyola Marymount University, Los Angeles, CA, USA, 2018; p. 219. [Google Scholar]
- Moen, F.; Hrozanova, M.; Stiles, T. The effects of perceptual-cognitive training with Neurotracker on executive brain functions among elite athletes. Cogent Psychol. 2018, 5, 1544105. [Google Scholar] [CrossRef]
- Vartanian, O.; Coady, L.; Blackler, K. 3D multiple object tracking boosts working memory span: Implications for cognitive training in military populations. Mil. Psychol. 2016, 28, 353–360. [Google Scholar] [CrossRef]
- Corbin-Berrigan, L.-A.; Kowalski, K.; Faubert, J.; Christie, B.; Gagnon, I. Could Neurotracker be used as a clinical marker of recovery following pediatric mild traumatic brain injury? An exploratory study. Brain Inj. 2020, 34, 385–389. [Google Scholar] [CrossRef]
- Corbin-Berrigan, L.-A.; Kowalski, K.; Faubert, J.; Christie, B.; Gagnon, I. Three-dimensional multiple object tracking in the pediatric population: The NeuroTracker and its promising role in the management of mild traumatic brain injury. Neuroreport 2018, 29, 559–563. [Google Scholar] [CrossRef]
- Legault, I.; Allard, R.; Faubert, J. Healthy older observers show equivalent perceptual-cognitive training benefits to young adults for multiple object tracking. Front. Psychol. 2013, 4, 323. [Google Scholar] [CrossRef] [Green Version]
- Byrom, B.; McCarthy, M.; Schueler, P.; Muehlhausen, W. Brain monitoring devices in neuroscience clinical research: The potential of remote monitoring using sensors, wearables, and mobile devices. Clin. Pharmacol. Ther. 2018, 104, 59–71. [Google Scholar] [CrossRef] [Green Version]
- Liao, L.-D.; Lin, C.-T.; McDowell, K.; Wickenden, A.E.; Gramann, K.; Jung, T.-P.; Ko, L.-W.; Chang, J.-Y. Biosensor technologies for augmented brain–computer interfaces in the next decades. Proc. IEEE 2012, 100, 1553–1566. [Google Scholar] [CrossRef]
- Luneski, A.; Konstantinidis, E.; Bamidis, P. Affective medicine. Methods Inf. Med. 2010, 49, 207–218. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Lystad, R.P.; Pollard, H. Functional neuroimaging: A brief overview and feasibility for use in chiropractic research. J. Can. Chiropr. Assoc. 2009, 53, 59. [Google Scholar] [PubMed]
- Schmidt, L.A.; Trainor, L.J. Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions. Cogn. Emot. 2001, 15, 487–500. [Google Scholar] [CrossRef]
- Tandle, A.L.; Joshi, M.S.; Dharmadhikari, A.S.; Jaiswal, S.V. Mental state and emotion detection from musically stimulated EEG. Brain Inform. 2018, 5, 1–13. [Google Scholar] [CrossRef]
- Trainor, L.J.; Schmidt, L.A. Processing Emotions Induced by Music; Oxford University Press: New York, NY, USA, 2003; pp. 310–324. [Google Scholar]
- Gonzalez, H.A.; Muzaffar, S.; Yoo, J.; Elfadel, I.M. BioCNN: A hardware inference engine for EEG-based emotion detection. IEEE Access 2020, 8, 140896–140914. [Google Scholar] [CrossRef]
- Leon, E.; Clarke, G.; Sepulveda, F.; Callaghan, V. Real-time physiological emotion detection mechanisms: Effects of exercise and affect intensity. In Proceedings of the 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference, Shanghai, China, 17–18 January 2006; pp. 4719–4722. [Google Scholar]
- Joshi, V.M.; Ghongade, R.B. EEG based emotion detection using fourth order spectral moment and deep learning. Biomed. Signal Process. Control 2021, 68, 102755. [Google Scholar] [CrossRef]
- Boto, E.; Seedat, Z.A.; Holmes, N.; Leggett, J.; Hill, R.M.; Roberts, G.; Shah, V.; Fromhold, T.M.; Mullinger, K.J.; Tierney, T.M. Wearable neuroimaging: Combining and contrasting magnetoencephalography and electroencephalography. NeuroImage 2019, 201, 116099. [Google Scholar] [CrossRef]
- Chen, Y.-H.; Sawan, M. Trends and challenges of wearable multimodal technologies for stroke risk prediction. Sensors 2021, 21, 460. [Google Scholar] [CrossRef]
- Rosch, J.L.; Vogel-Walcutt, J.J. A review of eye-tracking applications as tools for training. Cogn. Technol. Work 2013, 15, 313–327. [Google Scholar] [CrossRef]
- Preuschoff, K.; ’t Hart, B.M.; Einhäuser, W. Pupil dilation signals surprise: Evidence for noradrenaline’s role in decision making. Front. Neurosci. 2011, 5, 115. [Google Scholar] [CrossRef] [Green Version]
- Brunyé, T.T.; Gardony, A.L. Eye tracking measures of uncertainty during perceptual decision making. Int. J. Psychophysiol. 2017, 120, 60–68. [Google Scholar] [CrossRef] [PubMed]
- Johansson, R.; Johansson, M. Look here, eye movements play a functional role in memory retrieval. Psychol. Sci. 2014, 25, 236–242. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Christman, S.D.; Garvey, K.J.; Propper, R.E.; Phaneuf, K.A. Bilateral eye movements enhance the retrieval of episodic memories. Neuropsychology 2003, 17, 221. [Google Scholar] [CrossRef] [PubMed]
- Hannula, D.E.; Althoff, R.R.; Warren, D.E.; Riggs, L.; Cohen, N.J.; Ryan, J.D. Worth a glance: Using eye movements to investigate the cognitive neuroscience of memory. Front. Hum. Neurosci. 2010, 4, 166. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Viswanathan, A.R. Head-Mounted Eye Tracker; Cornell University: New York, NY, USA, 2011. [Google Scholar]
- Huang, M.X.; Kwok, T.C.; Ngai, G.; Chan, S.C.; Leong, H.V. Building a personalized, auto-calibrating eye tracker from user interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA, 7–12 May 2016; pp. 5169–5179. [Google Scholar]
- Mourant, R.R.; Rockwell, T.H. Mapping eye-movement patterns to the visual scene in driving: An exploratory study. Hum. Factors 1970, 12, 81–87. [Google Scholar] [CrossRef]
- Holmqvist, K.; Blignaut, P. Small eye movements cannot be reliably measured by video-based P-CR eye-trackers. Behav. Res. Methods 2020, 52, 2098–2121. [Google Scholar] [CrossRef]
- Ware, C.; Mikaelian, H.H. An evaluation of an eye tracker as a device for computer input2. In Proceedings of the SIGCHI/GI conference on Human factors in computing systems and graphics interface, Toronto, ON, Canada, 5–9 April 1987; pp. 183–188. [Google Scholar]
- Economou, S.; Stefanis, C. Electrooculographic (EOG) findings in manic-depressive illness. Acta Psychiatr. Scand. 1979, 60, 155–162. [Google Scholar] [CrossRef]
- Blue, C. Utlizing eye-tracking technology and data to augment UX-UI web development curriculum. In Proceedings of the INTED2021 Proceedings, Online, 8–9 March 2021; pp. 424–430. [Google Scholar]
- Malmivuo, J.; Plonsey, R. Bioelectromagnetism—Principles and Applications of Bioelectric and Biomagnetis Fields; Oxford University Press: New York, NY, USA, 1995; p. 2. [Google Scholar]
- Kosmyna, N.; Morris, C.; Sarawgi, U.; Nguyen, T.; Maes, P. AttentivU: A wearable pair of EEG and EOG glasses for real-time physiological processing. In Proceedings of the 2019 IEEE 16th International Conference on Wearable and Implantable Body Sensor Networks (BSN), Chicago, IL, USA, 19–22 May 2019; pp. 1–4. [Google Scholar]
- Lin, C.-T.; Jiang, W.-L.; Chen, S.-F.; Huang, K.-C.; Liao, L.-D. Design of a wearable eye-movement detection system based on electrooculography signals and its experimental validation. Biosensors 2021, 11, 343. [Google Scholar] [CrossRef]
- Bulling, A.; Roggen, D.; Tröster, G. Eyemote–towards context-aware gaming using eye movements recorded from wearable electrooculography. In Proceedings of the International Conference on Fun and Games, Eindhoven, The Netherlands, 20–21 October 2018; pp. 33–45. [Google Scholar]
- Bulling, A.; Roggen, D.; Tröster, G. Wearable EOG goggles: Seamless sensing and context-awareness in everyday environments. J. Ambient Intell. Smart Environ. 2009, 1, 157–171. [Google Scholar] [CrossRef] [Green Version]
- Milanizadeh, S.; Safaie, J. EOG-based HCI system for quadcopter navigation. IEEE Trans. Instrum. Meas. 2020, 69, 8992–8999. [Google Scholar] [CrossRef]
- Bulling, A.; Ward, J.A.; Gellersen, H.; Tröster, G. Eye movement analysis for activity recognition using electrooculography. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 33, 741–753. [Google Scholar] [CrossRef] [PubMed]
- Shustak, S.; Inzelberg, L.; Steinberg, S.; Rand, D.; Pur, M.D.; Hillel, I.; Katzav, S.; Fahoum, F.; De Vos, M.; Mirelman, A. Home monitoring of sleep with a temporary-tattoo EEG, EOG and EMG electrode array: A feasibility study. J. Neural Eng. 2019, 16, 026024. [Google Scholar] [CrossRef] [PubMed]
- Duchowski, A.T. A breadth-first survey of eye-tracking applications. Behav. Res. Methods Instrum. Comput. 2002, 34, 455–470. [Google Scholar] [CrossRef] [PubMed]
- Rayner, K. Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 1998, 124, 372. [Google Scholar] [CrossRef] [PubMed]
- Degno, F.; Loberg, O.; Zang, C.; Zhang, M.; Donnelly, N.; Liversedge, S.P. Parafoveal previews and lexical frequency in natural reading: Evidence from eye movements and fixation-related potentials. J. Exp. Psychol. Gen. 2019, 148, 453. [Google Scholar] [CrossRef]
- Rayner, K.; Castelhano, M.S. Eye Movements during Reading, Scene Perception, Visual Search, and While Looking at Print Advertisements; Psychology Press: East Sussex, UK, 2008. [Google Scholar]
- David, E.J.; Gutiérrez, J.; Coutrot, A.; Da Silva, M.P.; Callet, P.L. A dataset of head and eye movements for 360 videos. In Proceedings of the 9th ACM Multimedia Systems Conference, Amsterdam, The Netherlands, 12–15 June 2018; pp. 432–437. [Google Scholar]
- Knoblich, G.; Ohlsson, S.; Raney, G.E. An eye movement study of insight problem solving. Mem. Cogn. 2001, 29, 1000–1009. [Google Scholar] [CrossRef]
- Van Marlen, T.; Van Wermeskerken, M.; Jarodzka, H.; Van Gog, T. Effectiveness of eye movement modeling examples in problem solving: The role of verbal ambiguity and prior knowledge. Learn. Instr. 2018, 58, 274–283. [Google Scholar] [CrossRef]
- Sussman, R.; Campana, E.; Tanenhaus, M.; Carlson, G. Verb-based access to instrument roles: Evidence from eye movements. In Proceedings of the Poster Presented at the 8th Annual Architectures and Mechanisms of Language Processing Conference, Tenerife, Canary Islands, Spain, 2–4 September 2002. [Google Scholar]
- Gagl, B.; Golch, J.; Hawelka, S.; Sassenhagen, J.; Poeppel, D.; Fiebach, C.J. Reading at the speed of speech: The rate of eye movements aligns with auditory language processing. BioRxiv 2018, 6, 429–442. [Google Scholar]
- Kowler, E.; Anderson, E.; Dosher, B.; Blaser, E. The role of attention in the programming of saccades. Vis. Res. 1995, 35, 1897–1916. [Google Scholar] [CrossRef] [Green Version]
- Guo, J.-J.; Zhou, R.; Zhao, L.-M.; Lu, B.-L. Multimodal emotion recognition from eye image, eye movement and EEG using deep neural networks. In Proceedings of the 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Berlin, Germany, 23–27 July 2019; pp. 3071–3074. [Google Scholar]
- Lenferink, L.; Meyerbröker, K.; Boelen, P. PTSD treatment in times of COVID-19: A systematic review of the effects of online EMDR. Psychiatry Res. 2020, 293, 113438. [Google Scholar] [CrossRef]
- Møllenbach, E.; Lillholm, M.; Gail, A.; Hansen, J.P. Single gaze gestures. In Proceedings of the 2010 symposium on eye-tracking research & applications, Austin, TX, USA, 22–24 March 2010; pp. 177–180. [Google Scholar]
- Baldauf, M.; Fröhlich, P.; Hutter, S. KIBITZER: A wearable system for eye-gaze-based mobile urban exploration. In Proceedings of the 1st Augmented Human International Conference, Megève, France, 2–4 April 2010; pp. 1–5. [Google Scholar]
- Bowers, A.R.; Lovie-Kitchin, J.E.; Woods, R.L. Eye movements and reading with large print and optical magnifiers in macular disease. Optom. Vis. Sci. 2001, 78, 325–334. [Google Scholar] [CrossRef] [PubMed]
- López, A.; Arévalo, P.; Ferrero, F.; Valledor, M.; Campo, J. EOG-based system for mouse control. In SENSORS, 2014 IEEE; IEEE: New York, NY, USA, 2014; pp. 1264–1267. [Google Scholar]
- Tangsuksant, W.; Aekmunkhongpaisal, C.; Cambua, P.; Charoenpong, T.; Chanwimalueang, T. Directional eye movement detection system for virtual keyboard controller. In Proceedings of the 5th 2012 Biomedical Engineering International Conference, Muang Ubon Ratchathani, Thailand, 5–7 December 2012; pp. 1–5. [Google Scholar]
- Champaty, B.; Jose, J.; Pal, K.; Thirugnanam, A. Development of EOG based human machine interface control system for motorized wheelchair. In Proceedings of the 2014 Annual International Conference on Emerging Research Areas: Magnetics, Machines and Drives (AICERA/iCMMD), Kottayam, India, 24–26 July 2014; pp. 1–7. [Google Scholar]
- Deng, L.Y.; Hsu, C.-L.; Lin, T.-C.; Tuan, J.-S.; Chang, S.-M. EOG-based Human–Computer Interface system development. Expert Syst. Appl. 2010, 37, 3337–3343. [Google Scholar] [CrossRef]
- Ubeda, A.; Ianez, E.; Azorin, J.M. An integrated electrooculography and desktop input bimodal interface to support robotic arm control. IEEE Trans. Hum. -Mach. Syst. 2013, 43, 338–342. [Google Scholar] [CrossRef]
- Ding, X.; Lv, Z. Design and development of an EOG-based simplified Chinese eye-writing system. Biomed. Signal Process. Control 2020, 57, 101767. [Google Scholar] [CrossRef]
- Ma, J.; Zhang, Y.; Cichocki, A.; Matsuno, F. A novel EOG/EEG hybrid human–machine interface adopting eye movements and ERPs: Application to robot control. IEEE Trans. Biomed. Eng. 2014, 62, 876–889. [Google Scholar] [CrossRef]
- Belkhiria, C.; Boudir, A.; Hurter, C.; Peysakhovich, V. EOG-Based Human–Computer Interface: 2000–2020 Review. Sensors 2022, 22, 4914. [Google Scholar]
- Dhuliawala, M.; Lee, J.; Shimizu, J.; Bulling, A.; Kunze, K.; Starner, T.; Woo, W. Smooth eye movement interaction using EOG glasses. In Proceedings of the 18th ACM International Conference on Multimodal Interaction, Tokyo, Japan, 12–16 November 2016; pp. 307–311. [Google Scholar]
- Uema, Y.; Inoue, K. JINS MEME algorithm for estimation and tracking of concentration of users. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers, Maui, HI, USA, 11–15 September 2017; pp. 297–300. [Google Scholar]
- Foy, H.J.; Chapman, P. Mental workload is reflected in driver behaviour, physiology, eye movements and prefrontal cortex activation. Appl. Ergon. 2018, 73, 90–99. [Google Scholar] [CrossRef]
- Roy, R.; Venkatasubramanian, K. EKG/ECG based driver alert system for long haul drive. Indian J. Sci. Technol 2015, 8, 8–13. [Google Scholar] [CrossRef] [Green Version]
- Lin, C.-T.; King, J.-T.; Chuang, C.-H.; Ding, W.; Chuang, W.-Y.; Liao, L.-D.; Wang, Y.-K. Exploring the brain responses to driving fatigue through simultaneous EEG and fNIRS measurements. Int. J. Neural Syst. 2020, 30, 1950018. [Google Scholar] [CrossRef]
- Schlögl, A.; Keinrath, C.; Zimmermann, D.; Scherer, R.; Leeb, R.; Pfurtscheller, G. A fully automated correction method of EOG artifacts in EEG recordings. Clin. Neurophysiol. 2007, 118, 98–104. [Google Scholar] [CrossRef]
- Moretti, D.V.; Babiloni, F.; Carducci, F.; Cincotti, F.; Remondini, E.; Rossini, P.; Salinari, S.; Babiloni, C. Computerized processing of EEG–EOG–EMG artifacts for multi-centric studies in EEG oscillations and event-related potentials. Int. J. Psychophysiol. 2003, 47, 199–216. [Google Scholar] [CrossRef] [PubMed]
- Woestenburg, J.; Verbaten, M.; Slangen, J. The removal of the eye-movement artifact from the EEG by regression analysis in the frequency domain. Biol. Psychol. 1983, 16, 127–147. [Google Scholar] [CrossRef] [PubMed]
- Hosni, S.M.; Shedeed, H.A.; Mabrouk, M.S.; Tolba, M.F. EEG-EOG based virtual keyboard: Toward hybrid brain computer interface. Neuroinformatics 2019, 17, 323–341. [Google Scholar] [CrossRef] [PubMed]
- Lee, M.-H.; Williamson, J.; Won, D.-O.; Fazli, S.; Lee, S.-W. A high performance spelling system based on EEG-EOG signals with visual feedback. IEEE Trans. Neural Syst. Rehabil. Eng. 2018, 26, 1443–1459. [Google Scholar] [CrossRef]
- He, Y.; Eguren, D.; Azorín, J.M.; Grossman, R.G.; Luu, T.P.; Contreras-Vidal, J.L. Brain–machine interfaces for controlling lower-limb powered robotic systems. J. Neural Eng. 2018, 15, 021004. [Google Scholar] [CrossRef] [PubMed]
- Mishra, A.; Bhateja, V.; Gupta, A.; Mishra, A.; Satapathy, S.C. Feature fusion and classification of EEG/EOG signals. In Soft Computing and Signal Processing; Springer: Berlin/Heidelberg, Germany, 2019; pp. 793–799. [Google Scholar]
- Gratton, G. Dealing with artifacts: The EOG contamination of the event-related brain potential. Behav. Res. Methods Instrum. Comput. 1998, 30, 44–53. [Google Scholar] [CrossRef]
- Lim, J.Z.; Mountstephens, J.; Teo, J. Emotion recognition using eye-tracking: Taxonomy, review and current challenges. Sensors 2020, 20, 2384. [Google Scholar] [CrossRef]
- Hess, E.H.; Polt, J.M. Pupil size as related to interest value of visual stimuli. Science 1960, 132, 349–350. [Google Scholar] [CrossRef]
- Anwar, S.A. Real Time Facial Expression Recognition and Eye Gaze Estimation System; University of Arkansas: Little Rock, AR, USA, 2019. [Google Scholar]
- Raudonis, V.; Dervinis, G.; Vilkauskas, A.; Paulauskaitė-Tarasevičienė, A.; Keršulytė-Raudonė, G. Evaluation of human emotion from eye motions. Int. J. Adv. Comput. Sci. Appl. 2013, 4, 79–84. [Google Scholar] [CrossRef] [Green Version]
- Wang, Y.; Lv, Z.; Zheng, Y. Automatic emotion perception using eye movement information for E-healthcare systems. Sensors 2018, 18, 2826. [Google Scholar] [CrossRef] [Green Version]
- Paul, S.; Banerjee, A.; Tibarewala, D. Emotional eye movement analysis using electrooculography signal. Int. J. Biomed. Eng. Technol. 2017, 23, 59–70. [Google Scholar] [CrossRef]
- Schreiber, K.; Haslwanter, T. Improving calibration of 3-D video oculography systems. IEEE Trans. Biomed. Eng. 2004, 51, 676–679. [Google Scholar] [CrossRef] [PubMed]
- Oliva, M.; Anikin, A. Pupil dilation reflects the time course of emotion recognition in human vocalizations. Sci. Rep. 2018, 8, 1–10. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Barua, S.; Ahmed, M.U.; Ahlström, C.; Begum, S. Automatic driver sleepiness detection using EEG, EOG and contextual information. Expert Syst. Appl. 2019, 115, 121–135. [Google Scholar] [CrossRef]
- Arnin, J.; Anopas, D.; Horapong, M.; Triponyuwasi, P.; Yamsa-ard, T.; Iampetch, S.; Wongsawat, Y. Wireless-based portable EEG-EOG monitoring for real time drowsiness detection. In Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan, 3–7 July 2013; pp. 4977–4980. [Google Scholar]
- Sonner, Z.; Wilder, E.; Heikenfeld, J.; Kasting, G.; Beyette, F.; Swaile, D.; Sherman, F.; Joyce, J.; Hagen, J.; Kelley-Loughnane, N. The microfluidics of the eccrine sweat gland, including biomarker partitioning, transport, and biosensing implications. Biomicrofluidics 2015, 9, 031301. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Morris, D.; Coyle, S.; Wu, Y.; Lau, K.T.; Wallace, G.; Diamond, D. Bio-sensing textile based patch with integrated optical detection system for sweat monitoring. Sens. Actuators B: Chem. 2009, 139, 231–236. [Google Scholar] [CrossRef] [Green Version]
- Bandodkar, A.J.; You, J.-M.; Kim, N.-H.; Gu, Y.; Kumar, R.; Mohan, A.V.; Kurniawan, J.; Imani, S.; Nakagawa, T.; Parish, B. Soft, stretchable, high power density electronic skin-based biofuel cells for scavenging energy from human sweat. Energy Environ. Sci. 2017, 10, 1581–1589. [Google Scholar] [CrossRef]
- Xu, J.; Fang, Y.; Chen, J. Wearable biosensors for non-invasive sweat diagnostics. Biosensors 2021, 11, 245. [Google Scholar] [CrossRef]
- Taylor, N.A.; Machado-Moreira, C.A. Regional variations in transepidermal water loss, eccrine sweat gland density, sweat secretion rates and electrolyte composition in resting and exercising humans. Extrem. Physiol. Med. 2013, 2, 1–30. [Google Scholar] [CrossRef] [Green Version]
- Hu, Y.; Converse, C.; Lyons, M.; Hsu, W. Neural control of sweat secretion: A review. Br. J. Dermatol. 2018, 178, 1246–1256. [Google Scholar] [CrossRef]
- Nemiroski, A.; Christodouleas, D.C.; Hennek, J.W.; Kumar, A.A.; Maxwell, E.J.; Fernández-Abedul, M.T.; Whitesides, G.M. Universal mobile electrochemical detector designed for use in resource-limited applications. Proc. Natl. Acad. Sci. USA 2014, 111, 11984–11989. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Anastasova, S.; Crewther, B.; Bembnowicz, P.; Curto, V.; Ip, H.M.; Rosa, B.; Yang, G.-Z. A wearable multisensing patch for continuous sweat monitoring. Biosens. Bioelectron. 2017, 93, 139–145. [Google Scholar] [CrossRef] [PubMed]
- Abellán-Llobregat, A.; Jeerapan, I.; Bandodkar, A.; Vidal, L.; Canals, A.; Wang, J.; Morallon, E. A stretchable and screen-printed electrochemical sensor for glucose determination in human perspiration. Biosens. Bioelectron. 2017, 91, 885–891. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Kerassidis, S. Is palmar and plantar sweating thermoregulatory? Acta Physiol. Scand. 1994, 152, 259–263. [Google Scholar] [CrossRef]
- Wilke, K.; Martin, A.; Terstegen, L.; Biel, S. A short history of sweat gland biology. Int. J. Cosmet. Sci. 2007, 29, 169–179. [Google Scholar] [CrossRef]
- De Groot, J.H.; Smeets, M.A.; Kaldewaij, A.; Duijndam, M.J.; Semin, G.R. Chemosignals communicate human emotions. Psychol. Sci. 2012, 23, 1417–1424. [Google Scholar] [CrossRef]
- Chen, D.; Katdare, A.; Lucas, N. Chemosignals of fear enhance cognitive performance in humans. Chem. Senses 2006, 31, 415–423. [Google Scholar] [CrossRef]
- Haegler, K.; Zernecke, R.; Kleemann, A.M.; Albrecht, J.; Pollatos, O.; Brückmann, H.; Wiesmann, M. No fear no risk! Human risk behavior is affected by chemosensory anxiety signals. Neuropsychologia 2010, 48, 3901–3908. [Google Scholar] [CrossRef]
- Van de Kar, L.D.; Blair, M.L. Forebrain pathways mediating stress-induced hormone secretion. Front. Neuroendocrinol. 1999, 20, 1–48. [Google Scholar] [CrossRef]
- Weaver, L.M.; Gan, S.; Quirino, B.; Amasino, R.M. A comparison of the expression patterns of several senescence-associated genes in response to stress and hormone treatment. Plant Mol. Biol. 1998, 37, 455–469. [Google Scholar] [CrossRef]
- Dalirirad, S.; Steckl, A.J. Aptamer-based lateral flow assay for point of care cortisol detection in sweat. Sens. Actuators B: Chem. 2019, 283, 79–86. [Google Scholar] [CrossRef]
- Pali, M.; Jagannath, B.; Lin, K.-C.; Upasham, S.; Sankhalab, D.; Upashama, S.; Muthukumar, S.; Prasad, S. CATCH (Cortisol Apta WATCH):‘Bio-mimic alarm’to track Anxiety, Stress, Immunity in human sweat. Electrochim. Acta 2021, 390, 138834. [Google Scholar] [CrossRef]
- Brady, B.; Wang, R.; Cheong, R.; Wang, X. Digital printing of selective and reversible ion optodes on fabrics: Toward smart clothes for epidermal chemical sensing. Analyst 2021, 146, 6119–6123. [Google Scholar] [CrossRef] [PubMed]
- Liu, C.; Xu, T.; Wang, D.; Zhang, X. The role of sampling in wearable sweat sensors. Talanta 2020, 212, 120801. [Google Scholar] [CrossRef] [PubMed]
- Liao, L.-D.; Chen, C.-Y.; Wang, I.-J.; Chen, S.-F.; Li, S.-Y.; Chen, B.-W.; Chang, J.-Y.; Lin, C.-T. Gaming control using a wearable and wireless EEG-based brain-computer interface device with novel dry foam-based sensors. J. Neuroeng. Rehabil. 2012, 9, 1–12. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Hramov, A.E.; Maksimenko, V.A.; Pisarchik, A.N. Physical principles of brain–computer interfaces and their applications for rehabilitation, robotics and control of human brain states. Phys. Rep. 2021, 918, 1–133. [Google Scholar] [CrossRef]
- Vater, C.; Gray, R.; Holcombe, A.O. A critical systematic review of the Neurotracker perceptual-cognitive training tool. Psychon. Bull. Rev. 2021, 28, 1458–1483. [Google Scholar] [CrossRef] [PubMed]
- Surangsrirat, D.; Intarapanich, A. Analysis of the meditation brainwave from consumer EEG device. In Proceedings of the SoutheastCon 2015, Fort Lauderdale, FL, USA, 9–12 April 2015; pp. 1–6. [Google Scholar]
- Peake, J.M.; Kerr, G.; Sullivan, J.P. A critical review of consumer wearables, mobile applications, and equipment for providing biofeedback, monitoring stress, and sleep in physically active populations. Front. Physiol. 2018, 9, 743. [Google Scholar] [CrossRef] [PubMed]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Wu, J.-Y.; Ching, C.T.-S.; Wang, H.-M.D.; Liao, L.-D. Emerging Wearable Biosensor Technologies for Stress Monitoring and Their Real-World Applications. Biosensors 2022, 12, 1097. https://doi.org/10.3390/bios12121097
Wu J-Y, Ching CT-S, Wang H-MD, Liao L-D. Emerging Wearable Biosensor Technologies for Stress Monitoring and Their Real-World Applications. Biosensors. 2022; 12(12):1097. https://doi.org/10.3390/bios12121097
Chicago/Turabian StyleWu, Ju-Yu, Congo Tak-Shing Ching, Hui-Min David Wang, and Lun-De Liao. 2022. "Emerging Wearable Biosensor Technologies for Stress Monitoring and Their Real-World Applications" Biosensors 12, no. 12: 1097. https://doi.org/10.3390/bios12121097