Next Article in Journal
Smartphone Application for Structural Health Monitoring of Bridges
Next Article in Special Issue
The Number and Structure of Muscle Synergies Depend on the Number of Recorded Muscles: A Pilot Simulation Study with OpenSim
Previous Article in Journal
Transformer-Based Maneuvering Target Tracking
Previous Article in Special Issue
A Parallel Cross Convolutional Recurrent Neural Network for Automatic Imbalanced ECG Arrhythmia Detection with Continuous Wavelet Transform
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An “Instantaneous” Response of a Human Visual System to Hue: An EEG-Based Study

by
Gleb V. Tcheslavski
1,* and
Maryam Vasefi
2
1
Drayer Department of Electrical Engineering, Lamar University, Beaumont, TX 77710, USA
2
Department of Biology, Lamar University, Beaumont, TX 77710, USA
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(21), 8484; https://doi.org/10.3390/s22218484
Submission received: 15 September 2022 / Revised: 28 October 2022 / Accepted: 31 October 2022 / Published: 4 November 2022
(This article belongs to the Special Issue Advances in Biomedical Sensing, Instrumentation and Systems)

Abstract

:
(1) The article presents a new technique to interpret biomedical data (EEG) to assess cortical responses to continuous color/hue variations. We propose an alternative approach to analyze EEG activity evoked by visual stimulation. This approach may augment the traditional VEP analysis. (2) Considering ensembles of EEG epochs as multidimensional spatial vectors evolving over time (rather than collections of time-domain signals) and evaluating the similarity between such vectors across different EEG epochs may result in a more accurate detection of colors that evoke greater responses of the visual system. To demonstrate its suitability, the developed analysis technique was applied to the EEG data that we previously collected from 19 participants with normal color vision, while exposing them to stimuli of continuously varying hue. (3) Orange/yellow and dark blue/violet colors generally aroused better-pronounced cortical responses. The selection of EEG channels allowed for assessing the activity that predominantly originates from specific cortical regions. With such channel selection, the strongest response to the hue was observed from Parieto-Temporal region of the right hemisphere. The statistical test—Kruskal–Wallis one-way analysis of variance—indicates that the distance evaluated for spatial EEG vectors at different post-stimulus latencies generally originate from different statistical distributions with a probability exceeding 99.9% (α = 0.001).

1. Introduction

Color is a powerful descriptor that is critically important for most animal species, as well as for humans. The ability to distinguish between approximately a million different colors (hues) allows us to attain a more accurate and detailed perception of the environment. Yet, the mechanisms of such perceptions are not completely understood, although recent evidence indicates that the visual cortex may be more sensitive to the hue of an object rather than to the color category [1]. Various neuroimaging modalities are used to assess neuronal activity and link it to visual perception. Among such modalities, electroencephalography (EEG) offers an excellent temporal resolution that allows studying neuronal activity that is time-locked to particular stimuli.
Numerous EEG analysis techniques have been applied to relate the cortical activity to the perceived color, including spectral estimates [2], Visual Evoked Potentials (VEPs) [3,4], fractal dimensions [5], EEG skewness [5,6], asymmetry [7], etc. Specifically, chromatic Visual Evoked Potentials (cVEPs) have been extensively studied during the last decades [8,9,10,11], while the particular features of cVEPs may be linked to specific participants’ conditions or even dysfunctions of their visual system [12,13].
We have reported previously that distinct local extrema may be observed in multivariate Temporal Response Functions (mTRFs) evaluated from the EEG of participants viewing the screen of changing color and these extrema should be attributed to the colors perceived by the participant rather than to the post-stimulus latencies. Therefore, we hypothesize that the specific color(s) may elicit a more pronounced cortical response. We have also suggested that specific EEG channels are responsible for better-defined results [14]. However, mTRFs appear to produce results prone to significant variation and, thus, lead to conclusions based on approximations. Therefore, the question of what specific color(s) may be linked to the more observable EEG features still remains. Additionally, mTRFs have been evaluated while using parametric modeling. As such, selecting an inappropriate model might lead to erroneous results.
The purpose of this study is to explore an alternative non-parametric EEG analysis technique capable of more accurate detection of stimulation-locked cortical activity and then to determine the specific colors evoking the most pronounced cortical response.

2. Materials and Methods

This study presents the verification of an alternative analysis technique applied to the color-evoked EEG data that we have reported previously [14]. We consider an ensemble of EEG epochs produced by “stacking” multichannel EEG fragments/epochs recorded as a response to the same stimulation. Since EEG is deemed related to neuronal activity and assuming that repeating the same stimulation should evoke similar responses, it is reasonable to expect that the EEG epochs forming such an ensemble should exhibit some common features, i.e., be “similar” in some sense. Traditionally, such ensembles of multidimensional vectors are processed, while considering their time dependence. Perhaps an alternative approach—viewing EEG as a spatial vector evolving over time—is also instrumental and thus may augment the traditional techniques.

2.1. Participants

This study was approved by the Lamar University IRB committee, and each participant has given informed consent. Nine male subjects aged between 19 and 30 (mean 22.9 years, standard deviation 2.6 years) and ten female subjects aged between 20 and 25 (mean 21.7 years, standard deviation 1.9 years) with normal color vision (verified by an Ishihara test [15]) have participated. Participants not passing the Ishihara test were referred to a specialist. The subjects reported no neurological problems or tiredness at the time of the EEG collection. Participants were seated in a comfortable chair in a dim environment with no direct lighting. Subjects were instructed to avoid body movements and eye blinking during the color stimuli presentation; blinking was allowed between the stimuli during the presentation of a black screen.

2.2. Visual Stimulation

Visual stimulation consisted of a video of a solid color that was changing over time. The intensity and saturation were kept approximately constant, while the hue (pure color) of the solid-color screen changed linearly from 0 to 1 (or from 0° to 360°). The rate of color variation was adjusted to allow the complete hue change cycle within approximately one, three, five, or fifteen seconds, resulting in video clips of the corresponding duration. These durations were selected empirically. Such short videos are referred to as “1-s”, “3-s”, etc. stimuli. The stimulation consisted of a randomized sequence of the abovementioned videos with a black screen presented between each stimulus for three seconds. The overall stimulation contained 15 “1-s” stimuli, 20 “3-s” stimuli, 10 “5-s” stimuli, and 5 “15-s” stimuli videos. The number of stimuli repetitions will be referred to as Ks, where the index s is either 1, 3, 5, or 15. Therefore, K1 = 15, K3 = 20, K5 = 10, and K15 = 5. This combination of stimuli durations and the number of their repetitions was selected to maintain the overall experiment time under 10 min to reduce the participants’ fatigue.
Figure 1 illustrates the time course of the color presentation as the function of time for the four stimulation video clips. Assuming that the stimuli start at time “0” and for a specific post-stimulation time elapsed, the color observed on the screen would depend on the type of stimulus displayed. For instance, at 2 s (vertical blue line in Figure 1), the “15-s” stimulus would produce an orange screen, and the “5-s”—green, the ”3-s”—blue, and the “1-s” stimulus would be over, so the screen would be black.
Visual stimulation was presented using an overhead projector (Epson Home Cinema 8350) on a white screen located approximately two meters in front of the participants’ eyes. The image on the screen was approximately 2.2 m wide and 1.25 m high, effectively covering most of the subjects’ visual field with horizontal and vertical viewing angles of approximately 57 and 34 degrees, respectively.

2.3. EEG Acquisition

Electroencephalogram (EEG) was recorded using the ASA-Lab 40 system by ANT Neuro, Netherlands. Continuous EEG was pre-filtered in the 0.3–50 Hz range, notch-filtered at 60 Hz, sampled at 256 Hz, and recorded from 32 electrodes positioned according to the international 10/20 placement map. Stimuli presentation was synchronized with EEG acquisition by “eevoke”. Two identical trials (i.e., EEG recording attempts) were performed for most participants.

2.4. EEG Analysis: Pre-Processing and Segmentation

The EEG analysis was conducted using MATLAB. At the pre-processing step, DC components were removed from the EEG and the Common Average Reference spatial filter was applied to reduce surface currents. Next, each EEG data set was partitioned into K1 + K3 + K5 + K15 = 50 epochs, synchronized with the visual stimulation on- and off-sets. A total of 50 epochs were extracted for each participant and each trial. The epochs were N1 = 282, N3 = 794, N5 = 1289, and N15 = 3775 sample-long, respectively.
Visual Evoked Potentials (VEPs) can be viewed as time-locked responses that may be stimulation-specific. Therefore, VEPs can be evaluated next by time-averaging over the Ks EEG epochs corresponding to the same visual stimulation.
We have previously illustrated that an EEG epoch can be alternatively viewed as a sequence of “instantaneous” spatial vectors that evolve over time. This approach was shown to be instrumental for the VEP analysis [16] and appears suitable for studying the timing of stimulation-locked cortical activities with higher accuracy. Therefore, we will adopt the underlying concepts for the present study.

2.5. The “Instantaneous” Analysis

The proposed approach assumes that EEG can be viewed as an M-dimensional spatial vector (where M is the number of EEG channels determined by the hardware used) observed at the specific time instance, i.e., at the time when the EEG sample was collected for all EEG channels. Such spatial vectors can be compared with each other using a predefined similarity measure. Figure 2 illustrates the structure of the set of EEG epochs that correspond to the specific stimulus and the temporal vs. spatial vector representations.
Brown/orange frames in Figure 2 illustrate the process of the epochs’ extraction/segmentation. For instance, “epoch 1” starts at the time index n0 and is Ns-sample long (Ns is either 282, 794, 1289, or 3775). A “traditional”, i.e., the temporal vector, is shown by the blue dash/dot contour for EEG channel #2. This vector starts at the time instance n0 and ends at n0+Ns.
Alternatively, the ith spatial (i.e., “instantaneous”) EEG vector is delimited by the green dash contour for all M EEG channels and corresponds to the time instance ni. The temporal vector concept can be used to estimate the VEPs. We suggest that the spatial vector representation “may be more adequate for the analysis of the perception-related alterations in the temporal distribution of the cortical activity” [16]. We also maintain that a spatial EEG vector can be viewed as an “instantaneous” snapshot of cortical activity taken from all available (or pre-selected) EEG channels.
From the conceptual viewpoint, each EEG epoch can be considered as a 2D array (a matrix) that contains Ns by M elements. A juxtaposition of Ks, such as the EEG epochs, can be viewed as a 3D array, X, of size Ns by M by Ks. The elements of X are Xn,y,z, where n is the time variable that is in the range between n0 and n0 + Ns (Figure 2); y represents the EEG channel/electrode and varies from 1 to M; z is the epoch number that constitutes the set X. Here, z ranges between 1 and Ks. Using the italic font to represent vectors and extending the abovementioned notation, for instance, the temporal vector representing EEG channel #2 from the first epoch (the blue dash/dot contour in Figure 2) can be denoted as Xn,2,1; the ith spatial/instantaneous vector in the first EEG epoch (the green dash contour in Figure 2) will be Xi,y,1, etc.
The similarity between multi-dimensional vectors may be assessed with a number of techniques, including k-means clustering [17], multidimensional scaling [18], Pearson’s correlation coefficient [19], etc. For this study, we have adopted a generalized distance as the measure of similarity between two vectors as, perhaps, the most robust. Such a distance can be estimated as the Lp norm of the difference between the coordinates of two arbitrary vectors, Y and Z [20]:
D p = Y Z p = j = 1 M | Y j Z j | p p
After removing the DC components and applying a spatial filter, EEG can be assumed as a zero-mean process. Therefore, we suggest that the absolute value should be included in (1) to potentially account for negative differences in the coordinates, i.e., the instantaneous voltages. Traditionally, the L2 norm is utilized, which reduces (1) to the Euclidean distance. However, as the vectors’ dimensionality (the number of EEG channels, M, in our case) increases, lower orders or even fractional distance metrics may provide more meaningful results, especially for clustering applications [21]. Therefore, we will also assess fractional values of p.
Rather than conducting an exhaustive similarity assessment (i.e., each test vector with all other vectors in the epoch set), we will only compare the instantaneous vectors recorded at the same post-stimulus lag, as indicated by the red arrows in Figure 2. The latter reduces the number of necessary comparisons from the order of Ns2Ks to NsKs. Incorporating the notation for the spatial vectors introduced earlier, (1) can be rewritten for the post-stimulus latency i and between the epochs a and b as follows:
D p ( a , b ) i = X i , y , a X i , y , b p = j = 1 M | X i , j , a X i , j , b | p p
The total number of unordered pairs of instantaneous vectors in the set of Ks epochs while eliminating singletons (i.e., assuming that ab) is [22]:
L s = ( K s 2 ) = K s ! ( K s 2 ) ! 2 ! = K s ( K s 1 ) 2
Combining (2) and (3), the average distance between these Ls spatial vectors for the time latency i and all EEG epochs constituting the current epoch set is:
D ¯ p , i = 1 L s a b L s j = 1 M | X i , j , a X i , j , b | p p
We will be using the average distance (4) as a measure of similarity between the spatial vectors that correspond to the latency i.
Additionally, we can view the distance evaluated according to (2) as some metrics represented by a random variable with an unknown distribution. Thus, in addition to averaging, we may perform a statistical analysis (such as ANOVA or similar) to assess whether the distances evaluated at different post-stimulus latencies, say, i and k, originate from the same distribution or not. We selected a non-parametric test, the Kruskal–Wallis test, on ranks, which does not assume specific distributions of data. The distance evaluated at zero post-stimulation latency will contribute to one data sample, while the distance evaluated at another, non-zero latency, will constitute another sample used in the comparison. We can reasonably assume that the two data samples chosen in this manner are independent, since the metrics (i.e., the distances) are evaluated for different spatial vectors. The selection of the zero latency for the reference is arbitrary and can be revised without affecting the results. Details on the Kruskal–Wallis test can be found in [23].

3. Results

Figure 3 illustrates the Visual Evoked Potentials (VEPs) evaluated for one randomly selected participant and a single trial. These VEPs correspond to “1-s”, “3-s”, and “5-s” stimuli and were evaluated for the Oz, POz, and Cz electrodes, respectively. Similar to the previous study [14], we have observed that the “15-s” stimuli have not resulted in pronounced VEPs and thus were excluded from this report. Perhaps additional (other than the vision) physiological processes may contribute to the EEG while exposing subjects to prolonged visual stimulation.
The VEPs in Figure 3 were evaluated by averaging over 15, 20, and 10 EEG epochs, respectively. The VEPs are plotted as functions of the stimulation color, rather than time. As a result, for instance, the local maxima observed in Figure 3a,b, when the blue screen was projected correspond to different post-stimulation latencies for the “1-s”, “3-s”, and “5-s” stimuli, respectively. Therefore, we may argue that this particular VEP component may be a response to the specific stimulation color. On the other hand, the peaks observed for orange, yellow, and light-green colors for the “1-s” stimuli should, most likely, be attributed to the “pattern” VEP components, such as P100 and N145 [24] and, therefore, are not color-specific. The perhaps most studied component of VEPs, P300, may produce a peak at latencies between 250 and 700 ms [25]. Thus, we suggest that the portions of the VEPs observed during approximately the first ½ second following the stimuli onset may represent the combined result of two different perception mechanisms: the perception of color and the perception of light (i.e., the changing brightness). We further suggest that the classical, VEP-based processing does not appear as capable of detecting the colors producing stronger cortical responses by the continuous stimulation we have implemented. Additionally, the VEP-based approach appears to provide low temporal resolution, although it allows for the studying of the specific EEG channels, i.e., the electrical activity that predominantly originates from the specific cortical regions.
We maintain that the “instantaneous” spatial vector-based approach may be implemented as an alternative means of extracting the color-related information from EEG. Prior to applying this technique to the multi-channel EEG, its validity was evaluated by processing the synthetic data generated as a multi-channel pseudo-random normal process with a zero mean and the variance approximately matching that of the real EEG. The corresponding averaged distances (4) evaluated for both the synthetic data and real EEG of an arbitrarily selected subject are contrasted in Figure 4. Both results were averaged over 10 sets of either the real EEG or the synthetic data of the same dimensionality.
Consistent with our expectations, the distance plot evaluated for the synthetic data appears to randomly fluctuate around a seemingly arbitrary value, while the result evaluated from the EEG exhibits local minima and maxima for the specific latencies and generally produces lower values than those for the synthetic data. We suggest that this difference in appearance, to some extent, validates the proposed approach. Furthermore, the distance can be viewed as a measure of similarity: the lower distance may indicate that the underlying data vectors are similar to each other in some sense. Therefore, one may conclude that the “instantaneous” EEG vectors, constituting the same epoch at the latency of approximately 0.6s, may be similar to each other. Likewise, the vectors observed at the latency of approximately 4.3s may also be deemed similar, while the vectors at approximately 0.2s appear as the most dissimilar since the average distance between them reaches its maximum value.
The second norm was used when producing the results in Figure 4: i.e., p = 2 in (4). We have also evaluated the norms of the lower orders (i.e., 1 and 0.1). However, varying p resulted in changing the scale of the corresponding distance plots, while neither the plots’ general appearance nor the position of extrema seemed affected; therefore, the results for the norms of the lower orders are not included in this report.
Next, Figure 5 illustrates the average distance estimates, evaluated for all four stimuli and averaged over 19 participants, two trials per participant, and all corresponding epochs. A brief summary of the analyzed EEG epochs is provided in Table 1.
Zero on the time scale in Figure 5 corresponds to the stimulation onset, while the end of each graph is aligned with the stimulation offset for the corresponding stimuli; i.e., “1-s”, “3-s”, “5-s”, and “15-s”, correspondingly. All of the EEG channels, except for the mastoids, were used to produce the results. One may observe that every average distance graph exhibits distinct maxima and minima that do not appear as time-synchronized between the responses to different stimuli (except for the first minima for the “1-s”, “3-s”, and “5-s” stimuli). We may, perhaps, argue that the response during approximately the first second following the stimulation onset may predominantly represent the VEP, while the response after 1 s may be attributed mostly to color perception mechanisms. To assess this hypothesis, the average distance was next plotted as a function of observed color. In this case, as Figure 6 illustrates, the specific local extrema observed in the distance plots may be related to the perceived color.
The response to the “1-s” stimuli shows a single minimum for the green/teal color and appears dissimilar to the responses to the stimuli of the other durations. The responses to the “3-s” and “5-s” stimuli exhibit two distinct minima in the distance plots: around the orange/yellow and dark blue/violet colors. The teal/light-blue and red colors result in local maxima in the average distance. The response to the “15-s” stimuli appears more complex and with additional local extrema as compared to the stimulations with shorter stimuli. Perhaps, the latter may indicate that more complex perception mechanisms are involved. Yet, the pronounced minimum at the orange and a maximum at the teal colors are observed similarly to the shorter stimulations.
We maintain that, since distance (1) can be viewed as a measure of similarity, the local minima of the average distance plot indicate that the underlying spatial EEG vectors are “more similar” in some sense. Perhaps, this observation may suggest stronger responses of the visual system to the specific hues. Considering the “15-s” stimuli, the stronger responses are observed to orange, green, blue, and magenta colors. On the other hand, local maxima may suggest weaker responses of the visual system to other colors, such as red, yellow, and teal.
We have further observed that most female participants have produced distance maps that were somewhat inconsistent with similar maps evaluated for the male participants (Figure 7).
We observe in Figure 7 that the distance plots averaged for the nine male participants exhibit more consistent local minima/maxima and fewer variations than those evaluated for the ten female participants. The origin of these differences in the map appearance—whether they are due to some potential gender-specific differences in color perception or may be artifactual, for instance, related to a larger on average hair volume among the female participants (and thus poorer electrical contact)—would require an additional study. Not hypothesizing regarding the nature of such differences, we will only consider the results evaluated for male participants. We also conclude that the shortest, “1-s” stimuli seem to generate results that are generally inconsistent with those evoked by longer stimulations. Perhaps, this may be attributed to the experiment design that might lead to contaminating the response to colors by the response to the light intensity changes (i.e., light flashes). Therefore, we have excluded the results produced by the “1-s” stimuli in the rest of the report.
Applying this technique to the selected EEG channels may allow for the assessment of color processing by the specific cortical regions. Figure 8 illustrates the average distance evaluated for Occipital (O1, Oz, and O2), Parieto-Temporal (T7, T8, P7, P3, Pz, P4, and P8), and Frontal (Fp1, Fpz, Fp2, F7, F3, Fz, F4, and F8) regions averaged over the male participants and all the available trials. Occipital channels approximately cover the primary visual cortex, V1. Parieto-Temporal channels are located on top of area V4, which is traditionally associated with the processing of colors. Frontal channels primarily assess the activity of the Frontal lobe.
For the longest, i.e., “15-s”, stimuli, we observe in Figure 8 that the most pronounced response is registered from Parieto-Temporal region. Frontal region produces a well-defined, although weaker, response, and Occipital region generates the response that is the least defined.
Figure 9 illustrates, next, the average distance evaluated for Parieto-Temporal region, the left (a) and right (b) cerebral hemispheres.
We see in Figure 9 that the average distance evaluated for the right hemisphere shows less variation and better pronounced local extrema; therefore, the right hemisphere appears to produce a stronger response to color stimulation.
Before proceeding with the statistical analysis, it may be worth assessing the type of statistical distribution of the analyzed data. Figure 10 illustrates histograms evaluated for the distance estimated for the EEG spatial vectors corresponding to the “3-s”, “5-s”, and “15-s” stimuli for all the male participants, all the EEG electrodes, and all post-stimuli latencies.
As seen in Figure 10, the sample distributions appear to have long tails and certainly cannot be approximated by normal curves. Therefore, the non-parametric Kruskal–Wallis test should be preferred to the more traditional ANOVA. Figure 11 shows the H-values (red curve) evaluated between the distances estimated at the zero post-stimulation latency and all other latencies, the “3-s” stimuli. The blue curve illustrates the average distance and is identical to the corresponding curve shown in Figure 7a. The EEG data recorded from all the male participants and all the electrode locations were used.
We can draw two important conclusions based on Figure 11. Firstly, the average distance and H-values evaluated between the samples of the distance computed at different latencies appear to have opposite dynamics, i.e., when one curve has local minima, the other shows local maxima and vice versa. Most importantly, the majority of the H-values greatly exceed Hc, the critical value, which, in our case, can be approximated by the χ2 distribution with one degree of freedom. Assuming the significance level α = 0.05, Hc ≈ 3.84 for α = 0.001, the critical value increases to Hc ≈ 10.83. Therefore, from Figure 11 (red curve) the null hypothesis—that the medians of the groups being compared are equal—should be rejected, even at the significance level of 0.001 (0.1%). In other words, we conclude that the distance between spatial EEG vectors is, in general, statistically different if evaluated at different post-stimulation latencies at the significance level of 0.001.
We further maintain that the maxima of the H-statistics should be attributed to the stimulation colors rather than the post-stimulation latencies. Figure 12 illustrates the H-values evaluated for the “3-s”, “5-s”, and “15-s” stimuli and presented as functions of the color perceived by participants.
We observe in Figure 12 that the H-statistics exhibit similar behavior when evaluated for the EEG data corresponding to different visual stimuli. More specifically, three curves show two local maxima corresponding to yellow and blue-violet stimulation colors. Perhaps, the difference in the scale between these curves may be attributed to the differences in the sample sizes. So, the sample size corresponding to the “3-s” stimuli was 3,420, while the sample sizes corresponding to the “5-s” and “15-s” stimuli were 810 and 180, respectively. Reducing the sample sizes to values of 50-100, for instance, by limiting the analysis to a single participant and one trial, scales the corresponding H-values down (not shown), while still exceeding the critical value for α = 0.001 at similar stimulation colors.
We should, however, note that the results of the statistical analysis (those depicted in Figure 10, Figure 11 and Figure 12) are only presented to further validate the utility of the spatial vector-based approach, rather than as a vital part of the technique.

4. Discussion

We conclude that using visual stimulation with dynamically varying color/hue allows for assessing the visual system responses to all available colors in the gamut. The latter constitutes the main advantage of the proposed stimulation approach compared to the stimulation with a finite set of fixed colors. Adjusting the speed of the hue variation allows varying for the temporal resolutions of the observed response.
We further conclude that the proposed “instantaneous” approach to the color-evoked visual response may be instrumental by providing an alternative view of the visual system response to color stimulation. The application of this technique to synthetic data can serve as a validation step. We maintain that considering ensembles of EEG epochs as multidimensional spatial vectors—rather than collections of time-domain signals—and evaluating the similarity between such vectors across different EEG epochs may result in a more accurate (compared to the traditional VEP approach) determination of colors that evoke stronger responses of the visual system. From Figure 6, we conclude that orange/yellow and dark blue/violet colors generally evoke more pronounced cortical responses.
The appropriate selection of the measure of similarity is an important aspect and should be the subject of additional investigations. In this study, we propose using the generalized distance between the spatial vectors as the measure of their similarity. Deeming the distance evaluated at specific latencies as random samples that originate from unknown statistical distribution(s), a Kruskal–Wallis analysis of the ranks indicates that such distances belong to distributions with different medians, with the probability exceeding 99.9% (the significance level of 0.001) when the distances are compared between the spatial EEG vectors recorded at different post-stimulation latencies. Our results also indicate that the statistical distribution of the distance cannot be approximated as normal.
Considering the longest (i.e., “15-s”) stimuli, the observation that Parieto-Temporal region produces the most pronounced color response (Figure 8b) is consistent with the current theory associating V4 with color processing [26,27,28]. This cortical area is a part of the ventral stream conveying the color information to the interior temporal lobe. Perhaps, the less defined color response from the occipital region (Figure 8a) may be explained by the “double-opponent” model [29,30], suggesting that regions of V1 respond best to the color contrast, rather than the colors themselves. Perhaps, shorter stimulation may be perceived as “more contrast”, thus eliciting a stronger response (Figure 8a). Additionally, a reasonably strong color response observed from Frontal region (Figure 8c) may indicate that color perception is also integrated into high-level cognitive processes, as suggested by other reports [31,32].
Considering Occipital region (Figure 8a), the longest “15-s” stimuli produce four well-pronounced minima, three of which correspond to orange, green, and blue colors. We may argue that these colors are somewhat similar to the colors/wavelengths of the peak sensitivity of the three types of cones, L, M, and S, in the human retina [33,34]. On the other hand, the L-cones (peaking at yellow/orange) are normally more numerous, while the S-cones (peaking at blue) are the least numerous in the human retina [35,36]. As seen in Figure 8a, the orange color evokes the strongest response, while the blue color elicits the weakest response. Perhaps, this response ranking may be correlated with the abundance of the corresponding cone cells constituting the retina. We may also notice that, although similar colors produce stronger responses in other cortical regions (i.e., the parieto-temporal and frontal, Figure 8b,c, respectively), the ranking of such responses is different than for those observed in the occipital region.
The lateral asymmetry in the response to the colors observed in Figure 9 appears consistent with the report by Bramao and colleagues [37] who suggested that the right V4 may carry more color processing than the left V4. Taylor and Xu [38] and Siuda-Krzywicka with co-workers [39] have recently reported somewhat similar observations, while the results of Singh and colleagues [40] may also be relevant.
A follow-up study assessing a larger and more diversified pool of participants is needed to verify the presented results and further justify the conclusions.
The spatial distribution of the response can be assessed while selecting the EEG channels included in the analysis. The proposed “instantaneous” approach may be further combined with time-domain techniques, such as VEP or mTRF analyses, to provide additional details of the spatial distribution of cortical activity.
On the other hand, alternating color stimuli (with an approximately constant “brightness”) and the black screen (with the “brightness” close to zero) may evoke the response to light during the first second following the color stimuli onset in addition to the response to the color itself. Therefore, the response to the color may be fused with the flash VEP, thus affecting the results. This possible contamination of the response to hue by the response to light is a potential limitation of the present stimulation that stems from the experiment design. To mitigate this, a grey image with an intensity matching the intensity of the color stimuli may be used instead of the black one.
Other stimuli modifications, such as stimuli reversal and/or non-linear hue variation, can be implemented to gain additional insight into the functionality of the visual system.
It may also be of interest to assess whether the specific features of the selected metrics (such as the extrema of the average distance or the H-values) may be subject-specific and, for instance, linked to individual color preferences, emotions experienced during the data acquisition, gender, age, cultural background, etc.

5. Conclusions

We conclude that the developed “instantaneous” approach to the analysis of vision-evoked cortical responses appears instrumental and may augment traditional techniques, such as VEPs. Although investigated (in the current study) for the specific case of color stimulation, we suggest that this approach may be easily extended to studying responses to other types of stimuli, such as visual, audible, tactile, etc.
From the experimental results of applying the proposed technique presented in this report, we made several observations that were generally aligned with the reports of other recent studies. The spatial vector-based EEG analysis appears capable of detecting cortical events synchronized with specific external stimuli. We have also discussed the potential limitations of the implemented stimulation protocol and underlined the follow-up study.

Author Contributions

Conceptualization, G.V.T. and M.V.; methodology, G.V.T. and M.V.; software, G.V.T.; validation, G.V.T.; formal analysis, G.V.T.; investigation, G.V.T. and M.V.; resources, G.V.T. and M.V.; data curation, G.V.T.; writing—original draft preparation, G.V.T.; writing—review and editing, G.V.T. and M.V.; visualization, G.V.T.; supervision, G.V.T.; project administration, G.V.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board of Lamar University (IRB-FY17-114, approved on 2 June 2017).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Not applicable.

Acknowledgments

The authors would like to acknowledge all of the volunteers who contributed to the data collection for this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Liu, Z.; Lu, W.; Seger, C.A. Perceptual and categorical processing and representation in color categorization. Brain Cogn. 2019, 136, 103617. [Google Scholar] [CrossRef] [PubMed]
  2. Yoto, A.; Katsuura, T.; Iwanaga, K.; Shimomura, Y. Effects of object color stimuli on human brain activities in perception and attention referred to EEG alpha band response. J. Physiol. Anthropol. 2007, 26, 373–379. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Yeh, Y.-Y.; Lee, D.-S.; Ko, Y.-H. Color combination and exposure time on legibility and EEG response of icon presented on visual display terminal. Displays 2013, 34, 33–38. [Google Scholar] [CrossRef]
  4. Wang, H.; Zhang, N. The analysis on vehicle color evoked EEG based on ERP method. In Proceedings of the 4th International Conference on Bioinformatics and Biomedical Engineering (iCBBE) 2010, Chengdu, China, 18–20 June 2010. [Google Scholar]
  5. Tripathy, J.; Fuss, F.K.; Kulish, V.V.; Yang, S. Influence of colour hue on fractal EEG dimensions. In Proceedings of the International Conference on Biomedical and Pharmaceutical Engineering, ICBPE2006, Singapore, 11–14 December 2006; pp. 186–187. [Google Scholar]
  6. Fosu, K.P.O.; Jouny, I. Separation and classification of EEG responses to color stimuli. In Proceedings of the 2015 41st Annual Northeast Biomedical Engineering Conference (NEBEC), Troy, NY, USA, 17–19 April 2015. [Google Scholar]
  7. Khoroshikh, V.V.; Ivanova, V.Y.; Kulikov, G.A. The effect of unconscious color hue saturation on the emotional state of humans. Hum. Physiol. 2012, 38, 129–136. [Google Scholar] [CrossRef]
  8. Rabin, J.; Switkes, E.; Crognale, M.; Schneck, M.E.; Adams, A.J. Visual evoked potentials in three-dimensional color space: Correlates of spatio-chromatic processing. Vis. Res. 1994, 34, 2657–2671. [Google Scholar] [CrossRef]
  9. Kulikowski, J.J.; Robson, A.G.; McKeefry, D.J. Specificity and Selectivity of Chromatic Visual Evoked Potentials. Vis. Res. 1996, 36, 3397–3401. [Google Scholar] [CrossRef]
  10. Skiba, R.M.; Duncan, C.S.; Crognale, M.A. The effects of luminance contribution from large fields to chromatic visual evoked potentials. Vis. Res. 2014, 95, 68–74. [Google Scholar] [CrossRef] [Green Version]
  11. Bernstein, C.A.; Nir, R.R.; Noseda, R.; Fulton, A.B.; Huntington, S.; Lee, A.J.; Bertisch, S.; Hovaguimain, A.; Buettner, C.; Borsook, D.; et al. The migraine eye: Distinct rod-driven retinal pathways’ response to dim light challenges the visual cortex hyperexcitability theory. Pain 2019, 160, 569–578. [Google Scholar] [CrossRef]
  12. Tekavcic Pompe, M.; Perovsek, D.; Sustar, M. Chromatic visual evoked potentials indicate early dysfunction of color processing in young patients with demyelinating disease. Doc. Ophthalmol. 2020, 141, 157–168. [Google Scholar] [CrossRef]
  13. Yu, Y.; Shi, B.; Cheng, S.; Liu, Y.; Zhu, R.; You, Y.; Chen, J.; Pi, X.; Wang, X.; Jiang, F. Chromatic visual evoked potentials identify optic nerve dysfunction in patients with Graves’ orbitopathy. Int. Ophthalmol. 2022, 42, 3713–3724. [Google Scholar] [CrossRef]
  14. Tcheslavski, G.V.; Vasefi, M.; Gonen, F.F. Response of a human visual system to continuous color variation: An EEG-based approach. Biomed. Signal Process. Control. 2018, 43, 130–137. [Google Scholar] [CrossRef]
  15. Ishihara, S. Tests for Color-blindness; Handaya Hongo Harukich: Tokyo, Japan, 1917. [Google Scholar]
  16. Sultana, S.; Tcheslavski, G.V. Spatial Vector-based Approach to the ERP Analysis as Applied to an EEG-based Discrimination of Traffic Light Signals. Neuroregulation 2019, 6, 170–180. [Google Scholar] [CrossRef]
  17. Kanungo, T.; Mount, D.M.; Netanyahu, N.S.; Piatko, C.D.; Silverman, R.; Wu., A.Y. An efficient k-means clustering algorithm: Analysis and implementation. IEEE Trans. Pattern Anal. Mach. Intell. 2002, 24, 881–892. [Google Scholar] [CrossRef]
  18. Zeng, W.; Zeng, A.; Liu, H.; Shang, M.S.; Zhang, Y.C. Similarity from multi-dimensional scaling: Solving the accuracy and diversity dilemma in information filtering. PLoS ONE 2014, 9, e111005. [Google Scholar] [CrossRef] [Green Version]
  19. Mukaka, M.M. Statistics corner: A guide to appropriate use of correlation coefficient in medical research. Malawi Med. J. 2012, 24, 69–71. [Google Scholar]
  20. McCune, B.; Grace, J.B. Analysis of Ecological Communities; MjM Software Design: Gleneden Beach, OR, USA, 2002. [Google Scholar]
  21. Aggarwal, C.C.; Hinneburg, A.; Keim, D.A. On the Surprising Behavior of Distance Metrics in High Dimensional Space. In Database Theory—ICDT 2001; Lecture Notes in Computer Science; Van den Bussche, J., Vianu, V., Eds.; Springer: Berlin/Heidelberg, Germany, 2001; Volume 1973. [Google Scholar] [CrossRef] [Green Version]
  22. Papoulis, A.; Pillai, S.U. Probability, Random Variables and Stochastic Processes, 4th ed.; McGraw-Hill: New York, NY, USA, 2002; ISBN 13 978-0071226615. [Google Scholar]
  23. Kruskal, W.H.; Wallis, W.A. Use of Ranks in One-Criterion Variance Analysis. J. Am. Stat. Assoc. 1952, 47, 583–621. [Google Scholar] [CrossRef]
  24. Oner, A.; Coskun, M.; Evereklioglu, C.; Dogan, H. Pattern VEP is a useful technique in monitoring the effectiveness of occlusion therapy in amblyopic eyes under occlusion therapy. Doc. Ophthalmol. 2004, 109, 223–227. [Google Scholar] [CrossRef]
  25. Luck, S.J.; Kappenman, E.S. (Eds.) The Oxford Handbook of Event-Related Potential Components; Oxford University Press: Oxford, UK, 2012; p. 664. ISBN 9780195374148. [Google Scholar]
  26. Zeki, S.M. Colour coding in rhesus monkey prestriate cortex. Brain Res. 1973, 53, 422–427. [Google Scholar] [CrossRef]
  27. Conway, B.R.; Moeller, S.; Tsao, D.Y. Specialized Color Modules in Macaque Extrastriate Cortex. Neuron 2007, 56, 560–573. [Google Scholar] [CrossRef] [Green Version]
  28. Tanigawa, H.; Lu, H.; Roe, A. Functional organization for color and orientation in macaque V4. Nat. Neurosci. 2010, 13, 1542–1548. [Google Scholar] [CrossRef]
  29. Hubel, D.H. Eye, Brain, and Vision; Scientific American Library/Scientific American Books; W. H. Freeman: New York, NY, USA, 1995. [Google Scholar]
  30. Conway, B.R. Spatial Structure of Cone Inputs to Color Cells in Alert Macaque Primary Visual Cortex (V-1). J. Neurosci. 2001, 21, 2768–2783. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  31. Cela-Conde, C.J.; Marty, G.; Maestú, F.; Ortiz, T.; Munar, E.; Fernández, A.; Roca, M.; Rosselló, J.; Quesney, F. Activation of the prefrontal cortex in the human visual aesthetic perception. Proc. Natl. Acad. Sci. USA 2004, 101, 6321–6325. [Google Scholar] [CrossRef] [Green Version]
  32. Bird, C.M.; Berens, S.C.; Horner, A.J.; Franklin, A. Categorical encoding of color in the brain. Proc. Natl. Acad. Sci. USA 2014, 111, 4590–4595. [Google Scholar] [CrossRef] [Green Version]
  33. Stockman, A.; MacLeod, D.I.A.; Johnson, N.E. Spectral sensitivities of the human cones. J. Opt. Soc. Am. A 1993, 10, 2491–2521. [Google Scholar] [CrossRef]
  34. Stockman, A.; Sharpe, L.T. The spectral sensitivities of the middle- and long-wavelength-sensitive cones derived from measurements in observers of known genotype. Vis. Res. 2000, 40, 1711–1737. [Google Scholar] [CrossRef] [Green Version]
  35. Roorda, A.; Metha, A.B.; Lennie, P.; Williams, D.R. Packing arrangement of the three cone classes in primate retina. Vis. Res. 2001, 41, 1291–1306. [Google Scholar] [CrossRef] [Green Version]
  36. Hofer, H.; Carroll, J.; Neitz, J.; Neitz, M.; Williams, D.R. Organization of the human trichromatic cone mosaic. J. Neurosci. 2005, 25, 9669–9679. [Google Scholar] [CrossRef] [Green Version]
  37. Bramão, I.; Faísca, L.; Forkstam, C.; Reis, A.; Petersson, K.M. Cortical brain regions associated with color processing: An FMRI study. Open Neuroimaging J. 2010, 4, 164–173. [Google Scholar] [CrossRef] [Green Version]
  38. Taylor, J.; Xu, Y. Representation of color, form, and their conjunction across the human ventral visual pathway. NeuroImage 2022, 251, 118941. [Google Scholar] [CrossRef] [PubMed]
  39. Siuda-Krzywicka, K.; Witzel, C.; Taga, M.; Delanoe, M.; Cohen, L.; Bartolomeo, P. When colours split from objects: The disconnection of colour perception from colour language and colour knowledge. Cogn. Neuropsychol. 2019, 37, 325–339. [Google Scholar] [CrossRef]
  40. Singh, A.; Pammi, V.C.; Guleria, A.; Srinivasan, N. Concentrative (Sahaj Samadhi) meditation training and visual awareness: An fMRI study on color afterimages. Prog. Brain Res. 2019, 244, 185–206. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Time course of the color presentation for “1-s”, “3-s”, “5-s”, and “15-s” stimuli.
Figure 1. Time course of the color presentation for “1-s”, “3-s”, “5-s”, and “15-s” stimuli.
Sensors 22 08484 g001
Figure 2. The structure of the set of EEG epochs corresponding to the specific stimulus.
Figure 2. The structure of the set of EEG epochs corresponding to the specific stimulus.
Sensors 22 08484 g002
Figure 3. Visual evoked potentials for the “1-s”, “3-s”, and “5-s” stimuli and Oz (a), POz (b), and Cz (c) EEG channels.
Figure 3. Visual evoked potentials for the “1-s”, “3-s”, and “5-s” stimuli and Oz (a), POz (b), and Cz (c) EEG channels.
Sensors 22 08484 g003
Figure 4. Distance averaged over 10 EEG epochs (one arbitrarily selected participant, single-trial, and “5-s” stimuli) and over 10 sets of synthetic data.
Figure 4. Distance averaged over 10 EEG epochs (one arbitrarily selected participant, single-trial, and “5-s” stimuli) and over 10 sets of synthetic data.
Sensors 22 08484 g004
Figure 5. Distance averaged over 19 participants, 2 trials per participant, and all EEG channels and epochs as a function of post-stimulation latency.
Figure 5. Distance averaged over 19 participants, 2 trials per participant, and all EEG channels and epochs as a function of post-stimulation latency.
Sensors 22 08484 g005
Figure 6. Distance averaged over 19 participants, 2 trials per participant, and all EEG channels as a function of stimulation color.
Figure 6. Distance averaged over 19 participants, 2 trials per participant, and all EEG channels as a function of stimulation color.
Sensors 22 08484 g006
Figure 7. Average distance evaluated for male (a) and female (b) participants and for all EEG channels as a function of stimulation color.
Figure 7. Average distance evaluated for male (a) and female (b) participants and for all EEG channels as a function of stimulation color.
Sensors 22 08484 g007
Figure 8. Average distance evaluated for the male participants and for Occipital (a), Parieto-Temporal (b), and Frontal (c) EEG channels as a function of stimulation color.
Figure 8. Average distance evaluated for the male participants and for Occipital (a), Parieto-Temporal (b), and Frontal (c) EEG channels as a function of stimulation color.
Sensors 22 08484 g008
Figure 9. Average distance evaluated for the male participants and for the left (a) and right (b) Parieto-Temporal EEG channels as a function of stimulation color.
Figure 9. Average distance evaluated for the male participants and for the left (a) and right (b) Parieto-Temporal EEG channels as a function of stimulation color.
Sensors 22 08484 g009
Figure 10. Histograms approximating the shape of sample distributions of the distance evaluated for spatial EEG vectors corresponding to the three color stimuli.
Figure 10. Histograms approximating the shape of sample distributions of the distance evaluated for spatial EEG vectors corresponding to the three color stimuli.
Sensors 22 08484 g010
Figure 11. Average distance (blue) and H-values (red) evaluated for male participants and for all EEG channels as a function of post-stimulation latency.
Figure 11. Average distance (blue) and H-values (red) evaluated for male participants and for all EEG channels as a function of post-stimulation latency.
Sensors 22 08484 g011
Figure 12. H-values evaluated for the male participants and for all EEG channels as functions of stimulation color.
Figure 12. H-values evaluated for the male participants and for all EEG channels as functions of stimulation color.
Sensors 22 08484 g012
Table 1. A summary of processed EEG epochs.
Table 1. A summary of processed EEG epochs.
StimuliEEG Epoch Duration, Ns, SamplesTotal Number of Available EEG Epochs
“1-s”282570
“3-s”794760
“5-s”1289380
“15-s”3775190
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Tcheslavski, G.V.; Vasefi, M. An “Instantaneous” Response of a Human Visual System to Hue: An EEG-Based Study. Sensors 2022, 22, 8484. https://doi.org/10.3390/s22218484

AMA Style

Tcheslavski GV, Vasefi M. An “Instantaneous” Response of a Human Visual System to Hue: An EEG-Based Study. Sensors. 2022; 22(21):8484. https://doi.org/10.3390/s22218484

Chicago/Turabian Style

Tcheslavski, Gleb V., and Maryam Vasefi. 2022. "An “Instantaneous” Response of a Human Visual System to Hue: An EEG-Based Study" Sensors 22, no. 21: 8484. https://doi.org/10.3390/s22218484

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop