sensors-logo

Journal Browser

Journal Browser

Sensing Human Cognitive Factors

A special issue of Sensors (ISSN 1424-8220). This special issue belongs to the section "Sensing and Imaging".

Deadline for manuscript submissions: 15 July 2024 | Viewed by 3657

Special Issue Editors


E-Mail Website
Guest Editor
Department of Software Development and Application, Informatics Institute, University of Dunaujvaros, Dunaújváros, Hungary
Interests: human–computer interaction (HCI); bioinformatics; software development and cognitive psychology
Special Issues, Collections and Topics in MDPI journals

E-Mail Website
Guest Editor
Faculty of Engineering and Science, Western Norway University of Applied Sciences, Bergen, Norway
Interests: information systems (IS); human–computer interaction (HCI); serious games

E-Mail Website
Guest Editor
Department of Special Psychopedagogy, Babes Bolyai University, Cluj-Napoca, Romania
Interests: technology-based psychological assessment; digital interventions; neurodevolopmental disorders
Special Issues, Collections and Topics in MDPI journals

E-Mail Website
Guest Editor
Institute of Digital Technology, Faculty of Computer Science, Eszterházy Károly Catholic University, Eger, Hungary
Interests: human–computer interaction (HCI); application of eye-tracking in education; cognitive infocommunication; ICT in Education
Special Issues, Collections and Topics in MDPI journals

Special Issue Information

Dear Colleagues,

Nowadays, cost-effective and high-resolution eye-tracking devices have appeared. These can be used to record eye movement parameters, such as fixations, saccades, and pupil size. As a result, eye tracking technology is increasingly appearing in scientific fields such as: human–computer interactions, the examination of cognitive processes, healthcare or education.

This Special Issue aims to present papers examining sensory aspects of human cognition associated with eye-tracking research, e.g., approximating attention, emotion, approaches to memory function or the process underlying decision making. Papers can consider theoretical approaches to suggest new methodologies, theories for utilizing sensory information for better examining, or for a more thorough understanding of human cognitive factors. We also welcoming researchers to submit practical case studies or papers, illustrating examples and evidence of the effect of utilizing sensing information or data.  Information and data can come from different sources, e.g., handling texts, images, video or audio-based information from different domains and fields, such as human–computer interactions, healthcare, education or marketing.   

Potential topics include but are not limited to:

  • Sensors used in HCI systems
  • Sensing methods used in HCI systems
  • Human–computer interaction and bio-interfaces
  • Eye-tracking systems and applications
  • Eye-tracking in cognitive psychology
  • Eye-tracking in virtual and augmented reality
  • Eye-tracking in education
  • Sensing used in neurodevelopmental disorders
  • Sensing used in safety applications
  • Sensing used in automotive applications
  • Sensing used in engineering applications
  • Sensing used in serious game applications
  • Sensing used in assistive technology
  • Sensing used in aviation applications
  • Sensing used in education

Dr. Jozsef Katona
Prof. Dr. Ilona Heldal
Dr. Cristina Costescu
Prof. Dr. Attila Kovari
Guest Editors

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Sensors is an international peer-reviewed open access semimonthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Published Papers (4 papers)

Order results
Result details
Select all
Export citation of selected articles as:

Research

Jump to: Review

16 pages, 838 KiB  
Article
EF-Net: Mental State Recognition by Analyzing Multimodal EEG-fNIRS via CNN
by Aniqa Arif, Yihe Wang, Rui Yin, Xiang Zhang and Ahmed Helmy
Sensors 2024, 24(6), 1889; https://doi.org/10.3390/s24061889 - 15 Mar 2024
Viewed by 662
Abstract
Analysis of brain signals is essential to the study of mental states and various neurological conditions. The two most prevalent noninvasive signals for measuring brain activities are electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). EEG, characterized by its higher sampling frequency, captures more [...] Read more.
Analysis of brain signals is essential to the study of mental states and various neurological conditions. The two most prevalent noninvasive signals for measuring brain activities are electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). EEG, characterized by its higher sampling frequency, captures more temporal features, while fNIRS, with a greater number of channels, provides richer spatial information. Although a few previous studies have explored the use of multimodal deep-learning models to analyze brain activity for both EEG and fNIRS, subject-independent training–testing split analysis remains underexplored. The results of the subject-independent setting directly show the model’s ability on unseen subjects, which is crucial for real-world applications. In this paper, we introduce EF-Net, a new CNN-based multimodal deep-learning model. We evaluate EF-Net on an EEG-fNIRS word generation (WG) dataset on the mental state recognition task, primarily focusing on the subject-independent setting. For completeness, we report results in the subject-dependent and subject-semidependent settings as well. We compare our model with five baseline approaches, including three traditional machine learning methods and two deep learning methods. EF-Net demonstrates superior performance in both accuracy and F1 score, surpassing these baselines. Our model achieves F1 scores of 99.36%, 98.31%, and 65.05% in the subject-dependent, subject-semidependent, and subject-independent settings, respectively, surpassing the best baseline F1 scores by 1.83%, 4.34%, and 2.13% These results highlight EF-Net’s capability to effectively learn and interpret mental states and brain activity across different and unseen subjects. Full article
(This article belongs to the Special Issue Sensing Human Cognitive Factors)
Show Figures

Figure 1

16 pages, 1509 KiB  
Article
Cognitive Task Domain Influences Cognitive-Motor Interference during Large-Magnitude Treadmill Stance Perturbations
by Jessica Pitts, Lakshmi Kannan and Tanvi Bhatt
Sensors 2023, 23(18), 7746; https://doi.org/10.3390/s23187746 - 08 Sep 2023
Cited by 1 | Viewed by 821
Abstract
Reactive balance is postulated to be attentionally demanding, although it has been underexamined in dual-tasking (DT) conditions. Further, DT studies have mainly included only one cognitive task, leaving it unknown how different cognitive domains contribute to reactive balance. This study examined how DT [...] Read more.
Reactive balance is postulated to be attentionally demanding, although it has been underexamined in dual-tasking (DT) conditions. Further, DT studies have mainly included only one cognitive task, leaving it unknown how different cognitive domains contribute to reactive balance. This study examined how DT affected reactive responses to large-magnitude perturbations and compared cognitive-motor interference (CMI) between cognitive tasks. A total of 20 young adults aged 18–35 (40% female; 25.6 ± 3.8 y) were exposed to treadmill support surface perturbations alone (single-task (ST)) and while completing four cognitive tasks: Target, Track, Auditory Clock Test (ACT), Letter Number Sequencing (LNS). Three perturbations were delivered over 30 s in each trial. Cognitive tasks were also performed while seated and standing (ST). Compared to ST, post-perturbation MOS was lower when performing Track, and cognitive performance was reduced on the Target task during DT (p < 0.05). There was a larger decline in overall (cognitive + motor) performance from ST for both of the visuomotor tasks compared to the ACT and LNS (p < 0.05). The highest CMI was observed for visuomotor tasks; real-life visuomotor tasks could increase fall risk during daily living, especially for individuals with difficulty attending to more than one task. Full article
(This article belongs to the Special Issue Sensing Human Cognitive Factors)
Show Figures

Figure 1

17 pages, 1394 KiB  
Article
Implicit IAT Measures and Neurophysiological fNIRS Markers in Response to High-Engagement Advertising
by Michela Balconi, Martina Sansone and Carlotta Acconito
Sensors 2023, 23(9), 4332; https://doi.org/10.3390/s23094332 - 27 Apr 2023
Viewed by 1255
Abstract
Self-report measures partially explain consumers’ purchasing choices, which are inextricably linked to cognitive, affective processes and implicit drives. These aspects, which occur outside of awareness and tacitly affect the way consumers make decisions, could be explored by exploiting neuroscientific technology. The study investigates [...] Read more.
Self-report measures partially explain consumers’ purchasing choices, which are inextricably linked to cognitive, affective processes and implicit drives. These aspects, which occur outside of awareness and tacitly affect the way consumers make decisions, could be explored by exploiting neuroscientific technology. The study investigates implicit behavioural and neurovascular responses to emotionally arousing and high-engagement advertisements (COVID-19 content). High-engagement advertisements and control stimuli were shown in two experimental sessions that were counterbalanced across participants. During each session, hemodynamic variations were recorded with functional Near-Infrared Spectroscopy (fNIRS) of the prefrontal cortex (PFC), a neurophysiological marker for emotional processing. The implicit association task (IAT) was administered to investigate the implicit attitude. An increase in the concentration of oxygenated haemoglobin (O2Hb) was found for the high-engagement advertising when this category of stimuli was seen first. Specular results were found for deoxygenated haemoglobin (HHb) data. The IAT reported higher values for highly engaging stimuli. Increased activity within the PFC suggests that highly engaging content may be effective in generating emotional arousal and increasing attention when presented before other stimuli, which is consistent with the higher IAT scores, indicating more favourable implicit attitudes. This evidence suggests that the effectiveness of highly engaging advertising-related messages may be constrained by the order of advertisement administration. Full article
(This article belongs to the Special Issue Sensing Human Cognitive Factors)
Show Figures

Figure 1

Review

Jump to: Research

16 pages, 296 KiB  
Review
A Review of the Use of Gaze and Pupil Metrics to Assess Mental Workload in Gamified and Simulated Sensorimotor Tasks
by Holly Gorin, Jigna Patel, Qinyin Qiu, Alma Merians, Sergei Adamovich and Gerard Fluet
Sensors 2024, 24(6), 1759; https://doi.org/10.3390/s24061759 - 08 Mar 2024
Viewed by 451
Abstract
Gaze and pupil metrics are used to represent higher cognitive processes in a variety of contexts. One growing area of research is the real-time assessment of workload and corresponding effort in gamified or simulated cognitive and motor tasks, which will be reviewed in [...] Read more.
Gaze and pupil metrics are used to represent higher cognitive processes in a variety of contexts. One growing area of research is the real-time assessment of workload and corresponding effort in gamified or simulated cognitive and motor tasks, which will be reviewed in this paper. While some measurements are consistent across studies, others vary and are likely dependent on the nature of the effort required by the task and the resulting changes in arousal. Pupil diameter is shown to consistently increase with task effort and arousal; however, the valence of arousal must be considered. In many cases, measures of pupil diameter were sensitive to both excessive and insufficient challenge. Overall, it is evident that gaze and pupil metrics are valuable to assess the cognitive state during gamified and simulated tasks, and further research is indicated regarding their use in clinical populations in rehabilitation to inform optimally engaging interventions. Full article
(This article belongs to the Special Issue Sensing Human Cognitive Factors)
Back to TopTop