Next Article in Journal
The Relation between Physiological Parameters and Colour Modifications in Text Background and Overlay during Reading in Children with and without Dyslexia
Next Article in Special Issue
Cognitive Effects of Montelukast: A Pharmaco-EEG Study
Previous Article in Journal / Special Issue
Elevated and Slowed EEG Oscillations in Patients with Post-Concussive Syndrome and Chronic Pain Following a Motor Vehicle Collision
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Distinction of Physiologic and Epileptic Ripples: An Electrical Stimulation Study

by
Jan Schönberger
1,2,3,4,*,
Anja Knopf
1,2,3,
Kerstin Alexandra Klotz
1,2,3,4,
Matthias Dümpelmann
1,3,
Andreas Schulze-Bonhage
1,3 and
Julia Jacobs
2,3,5,6
1
Epilepsy Center, Medical Center, University of Freiburg, 79106 Freiburg, Germany
2
Department of Neuropediatrics and Muscle Disorders, Medical Center, University of Freiburg, 79106 Freiburg, Germany
3
Faculty of Medicine, University of Freiburg, 79085 Freiburg, Germany
4
Berta-Ottenstein-Programme, Faculty of Medicine, University of Freiburg, 79085 Freiburg, Germany
5
Department of Paediatrics and Department of Neuroscience, Cumming School of Medicine, University of Calgary, Calgary, AB T3B 6A8, Canada
6
Hotchkiss Brain Institute and Alberta Children’s Hospital Research Institute, University of Calgary, Calgary, AB T2N 4N1, Canada
*
Author to whom correspondence should be addressed.
Brain Sci. 2021, 11(5), 538; https://doi.org/10.3390/brainsci11050538
Submission received: 15 March 2021 / Revised: 15 April 2021 / Accepted: 19 April 2021 / Published: 24 April 2021
(This article belongs to the Special Issue Quantitative EEG and Cognitive Neuroscience)

Abstract

:
Ripple oscillations (80–250 Hz) are a promising biomarker of epileptic activity, but are also involved in memory consolidation, which impairs their value as a diagnostic tool. Distinguishing physiologic from epileptic ripples has been particularly challenging because usually, invasive recordings are only performed in patients with refractory epilepsy. Here, we identified ‘healthy’ brain areas based on electrical stimulation and hypothesized that these regions specifically generate ‘pure’ ripples not coupled to spikes. Intracranial electroencephalography (EEG) recorded with subdural grid electrodes was retrospectively analyzed in 19 patients with drug-resistant focal epilepsy. Interictal spikes and ripples were automatically detected in slow-wave sleep using the publicly available Delphos software. We found that rates of spikes, ripples and ripples coupled to spikes (‘spike–ripples’) were higher inside the seizure-onset zone (p < 0.001). A comparison of receiver operating characteristic curves revealed that spike–ripples slightly delineated the seizure-onset zone channels, but did this significantly better than spikes (p < 0.001). Ripples were more frequent in the eloquent neocortex than in the remaining non-seizure onset zone areas (p < 0.001). This was due to the higher rates of ‘pure’ ripples (p < 0.001; median rates 3.3/min vs. 1.4/min), whereas spike–ripple rates were not significantly different (p = 0.87). ‘Pure’ ripples identified ‘healthy’ channels significantly better than chance (p < 0.001). Our findings suggest that, in contrast to epileptic spike–ripples, ‘pure’ ripples are mainly physiological. They may be considered, in addition to electrical stimulation, to delineate eloquent cortex in pre-surgical patients. Since we applied open source software for detection, our approach may be generally suited to tackle a variety of research questions in epilepsy and cognitive science.

1. Introduction

High-frequency oscillations (HFOs), traditionally divided into ripples (80–250 Hz) and fast ripples (250–500 Hz), are a promising marker of epileptic activity. They have not only been directly linked to seizures [1,2,3,4]; moreover, there is a by now an extensive body of evidence on the value of interictal HFOs: resecting HFO-generating tissue has been associated with seizure-free outcome [5,6,7,8], HFO rates correlated with response to electrical stimulation [9], HFOs were suppressed by antiepileptic medication [10,11], and ripples may identify patients at risk of developing epilepsy [12]. Nonetheless, HFOs are rarely analyzed in clinical routine settings. One reason may be that the visual identification is time-consuming, an obstacle that may be overcome by the increasing efficiency of automatic detectors [13,14,15,16]. Another key aspect is that ripples are likely involved in memory consolidation [17,18,19], which may open new avenues for cognitive science, but impairs specificity if ripples are analyzed in epilepsy. To develop strategies that reliably distinguish pathologic from physiologic HFOs is thus of imminent importance for researchers from both fields [20].
To design studies on potential approaches is, however, challenging, considering that most intracranial recordings are from patients with epilepsy and that in these subjects, there is both epileptic and physiologic activity. A fruitful approach has been to hypothesize that sleep influences epileptic and physiologic ripples differently. Following this concept, it was revealed that HFOs from epileptic and ‘normal’ channels are synchronized to distinct phases of sleep slow waves [21,22,23], and that they are associated with different sleep stages [24]. Moreover, systematic differences in HFO amplitude and frequency have been reported, though not always consistent and often with significant overlap [25,26,27]. A third approach has been to define epileptic ripples based on coupling to epileptic spikes. Several recent studies suggest that such ‘spike–ripples’ may indeed be superior to ripples or spikes, regarding the delineation of seizure-generating areas [28,29,30] and the prediction of seizure risk [31]. On the other hand, however, one study also found that spike-HFOs performed no better than spikes [32]. The additional value of HFOs is thus still subject to debate [33,34]. Finally, it has remained unclear whether the remaining ‘pure’ ripples, i.e., those occurring independently from spikes, are truly physiological.
We thus set out, in a retrospective analysis of subdural grid electrode recordings from patients with drug-resistant focal epilepsy, to explore whether such ‘pure’ ripples are specifically generated in ‘healthy’ brain areas, identified based on our patients’ response to electrical stimulation. Moreover, we aimed to provide additional evidence for the concept that spike–ripples are truly epileptic, which would underline that analyzing coupling to interictal spikes is indeed a promising strategy to distinguish physiologic from epileptic ripples.

2. Methods

2.1. Patient Selection

We considered all patients with drug-resistant focal epilepsy who, as part of their evaluation for epilepsy surgery, had undergone the implantation of subdural grid electrodes at the Freiburg Epilepsy Center in 2008 or 2009. From this cohort, subjects with contacts recording from the eloquent cortex, identified based on cortical stimulation, were selected. Recruitment was restricted to the specified period because afterwards a new video-EEG recording system was in use, and we aimed not to examine a mixed dataset obtained with different hardware setups. This study was approved by the Ethics Commission at the University Medical Center Freiburg (No. 69/18) and written informed consent was obtained from all patients.

2.2. Electrical Stimulation and Assignment of Grid Contacts

Electrode grids produced by Ad-Tech (Ad-Tech Medical Instrument Corporation, Racine, WI, USA), which were implanted after open craniotomy. Grids had 32, 48 or 64 contacts, each with a center-to-center distance of 10 mm and an exposed surface diameter of 2.3 mm. The decisions on the size of the grid, its position and the stimulation protocols were made solely by the attending physician and thus not influenced by this study.
Cortical stimulation was performed during continuous video-EEG monitoring on all contacts, except for those that were obviously damaged, i.e., with frequent artifacts or high impedance. Pairs of electrodes were stimulated at 50 Hz with a biphasic rectangular pulse (width 0.25 ms) for 10 s. Stimulation was repeated every 30 to 60 s, with gradually increased electrical currents (max. 15 mA) until the patient had a seizure or symptoms indicating that the stimulated tissue was involved in a particular function. Typical motor symptoms like clonus, tonic movements or weakness, and various sensory phenomena like paresthesia, hallucinations, nausea or pain were documented in a stimulation protocol, which was retrospectively analyzed by our study team. To examine verbal impairment, a series of tasks was performed, which typically included an assessment of reading, serial and repetitive language, body commands and a token test. We relied on the assessment of the attending physician, i.e., on data generated independently from this study, to determine whether or not an electrode contact was located on the functional cortex.
The seizure onset zone (SOZ) was defined by contacts with a clearly ictal EEG pattern within two seconds of seizure onset. Seizure onset was defined based on EEG and semiology, as part of the clinical routine evaluation and under the supervision of the attending physician. We identified SOZ contacts based on this assessment, i.e., based on data generated independently from this study. All remaining channels were classified as ‘non-SOZ’ channels.

2.3. Detection of Interictal Epileptic Spikes and Ripples

Intracranial EEG was recorded with a Neurofile NT system (IT-Med, Usingen, Germany). The sampling rate was 1024 kHz and a low-pass filter with 450 Hz cut-off frequency was applied. Forehead electrodes were used as an amplifier ground. For each patient, we selected a 1 h segment of non-rapid eye movement sleep, at least two hours before and after a seizure. We took great care to ensure that this segment contained no clear or only very sparse muscle artifacts.
Interictal epileptic spikes and ripples (80–250 Hz) were identified in bipolar montages using the Delphos detector (Version 1.0.1; [16,35]) within the open source software Anywave [36]. A detailed description of the algorithm was provided in the original publications. This detector was benchmarked against previously published methods. The default settings were kept (number of voices 12, vanishing moment 20, threshold 40, oscillation width threshold 1.4, oscillation frequency spread threshold 10, spike width threshold 1.3, spike frequency spread threshold 11). Further analyses were performed with Matlab R2019b (Version 9.7; Mathworks, Natick, MA, USA). Spike–ripples were defined as spikes and ripples that co-occurred within 100 ms [32].

2.4. Quantifying Performance of Different Biomarkers

To quantify how reliably a biomarker could distinguish SOZ from non-SOZ channels, receiver operating characteristic (ROC) curves and their area under the curve (AUC) were computed using the Matlab built-in function ‘perfcurve’. We also determined the partial AUC (pAUC) between 100% and 85% specificity, as has been suggested in a previous study comparing the diagnostic values of spikes and high-frequency oscillations in patients with epilepsy [32]. This parameter is particularly useful if ROC curves tend to reach a plateau, reflecting that a classifier performs poorly in a distinct range of thresholds. Reproducing our colleagues’ approach, the ‘raw’ pAUC values were divided by the maximum possible area, i.e., 0.15, to obtain an index ranging from 0 to 1. It may be noteworthy that the expected AUC for random classification is 0.5, whereas the chance-level pAUC, if normalized as in our study, should only be 0.075.

2.5. Statistical Analysis

We did not assume that the data were normally distributed. Therefore, the median was specified as a measure of central tendency and the range as a measure of dispersion. Hypothesis tests were performed as two-tailed tests. A significance level of 5% was chosen. Paired data were compared with a Wilcoxon signed-rank test, unpaired data with a Wilcoxon rank sum test, and Spearman’s rank order correlation was performed to investigate whether the patient-specific performance of a biomarker was systematically linked to the patient’s median spike rate.
Furthermore, we conducted a permutation test to investigate whether spike–ripples performed significantly better than spikes regarding the distinction of SOZ from non-SOZ channels. First, for each channel, the spike–ripple and spike rates were transformed to biomarker-specific ranks, i.e., a spike–ripple and a spike rank, relative to the remaining channels, was assigned to each channel. It may be noteworthy that this step does not alter the two ROC curves because those are invariant to monotone increasing transformations of the measurement scale [37]. We then calculated the AUC difference based on our empirical data:
Diff(AUC)empirical = AUCspike-ripples − AUCspikes
Then, for each channel independently, we randomly swapped group labels, and again computed Diff(AUC) (‘Diff(AUC)surrogate’). This step was repeated 100,000 times to compute a distribution of Diff(AUC)surrogate. The performance of spike–ripples and spikes was considered significantly different if Diff(AUC)empirical ranked above 97.5% or below 2.5% of all Diff(AUC)surrogate. A detailed investigation of the properties of such an approach can be found, e.g., in [38]. This procedure was also performed for the pAUC difference, and finally, in a slightly adapted fashion, for the functional vs. remaining non-SOZ classification.

3. Results

3.1. Patients and Channels

Nineteen subjects (9 females, 10 males; age: median 38 years, range 11–54 years, see Table 1 for more clinical data) met the inclusion criteria. The majority of our patients had a neocortical lesion, most often focal cortical dysplasia (n = 12 patients), whereas a mesiotemporal pathology was rare. Two patients had no clear epileptogenic lesion on their MRI. We analyzed recordings from all major lobes and a variety of functional regions, including primary motor (n = 15 patients) and sensory cortex (n = 13), Broca’s (n = 4) and Wernicke’s (n = 7) area. In patient 2, the grid did not cover the seizure onset zone (SOZ); this patient therefore had to be excluded from the patient-specific comparisons of SOZ and non-SOZ channels described below. Epilepsy surgery was performed in all but this patient, most often extended lesionectomy, and more than half of them (n = 11 patients) became completely seizure-free (median follow-up 6 months).

3.2. Biomarkers of the Seizure-Onset Zone

Interictal spikes, ripples and spike–ripples have each been suggested as biomarkers of epileptogenic tissue. First, we therefore investigated whether this applies also to our particular dataset, which only contained recordings from the neocortex and with subdural grid electrodes. Comparing all identified channels, pooled across patients, it was revealed that the seizure onset zone generated significantly higher rates of interictal spikes (p < 0.001, Wilcoxon rank sum test; SOZ: n = 258 channels, non-SOZ: n = 635 channels), ripples (p < 0.001) and spike–ripples (p < 0.001) than the remaining non-SOZ regions (Figure 1). To perform a similar analysis at the level of patients, we also compared each subject’s median SOZ channel, i.e., the channel with a median rate from this subject’s SOZ channels, to the median non-SOZ channel. Again, the rates of interictal spikes (p = 0.001, Wilcoxon signed-rank test; n = 18 patients), ripples (p = 0.004) and spike–ripples (p < 0.001) were higher inside the SOZ. In summary, these findings suggest that the analysis of all three biomarkers in subdural grid electrode recordings reveals localizing information on seizure-generating neocortical regions.

3.3. Systematic Comparison of Diagnostic Value

To compare how reliably these biomarkers could generally distinguish SOZ from non-SOZ channels, we analyzed their receiver operating characteristic (ROC) curves (Figure 2A). The area under the curve (AUC), as the standard parameter quantifying performance, was the highest for spike–ripples (0.664), intermediate for ripples (0.640) and lowest for spikes (0.628). Noticing that the shape of these curves was especially different for high specificities, we also computed the partial AUC (pAUC) between 100% and 85%, which was also highest for spike–ripples (0.252), intermediate for ripples (0.244) and lowest for spikes (0.181). Permutation-based testing revealed that the difference between spike–ripples and spikes was significant, both for AUC (p < 0.001; Figure 2B) and pAUC (p < 0.001; Figure 2C). It can thus be concluded that in our dataset, focusing on interictal spikes with a co-occurring ripple oscillation improved our identification of SOZ channels significantly.

3.4. Diagnostic Value at the Level of Individual Patients

Considering that the impact of a biomarker on clinical decision-making depends on its performance in individual patients, we also computed patient-specific ROC curves, and the corresponding AUC and pAUC (Figure 2D). For both spike–ripples and spikes, a broad range of values was obtained, reflecting that the SOZ could be nicely delineated in several patients, whereas performance was poor in others. In summary, there was no significant difference between spike–ripples and spikes in our group of patients (AUC: p = 0.71, pAUC: p = 0.29; Wilcoxon signed-rank test; n = 18 patients). There was a significant correlation between our patients’ median spike rate and their pAUC (Figure 2E), both for spike–ripples (rho = 0.68, p = 0.002; Spearman’s rank order correlation) and spikes (rho = 0.54, p = 0.02). Moreover, the patient-specific pAUC difference between spike–ripple- and spike-based classification correlated with the subject’s median spike rate (rho = 0.48, p = 0.042). These results suggest that both biomarkers perform better in patients with many spikes and that in these individuals, spike–ripples may be superior.

3.5. ‘Pure’ Ripples in Eloquent Cortex

Our main aim was to investigate whether ‘pure’ ripples, i.e., those occurring independently from spikes, are more frequent in the eloquent neocortex. First, we therefore identified channels with a functional response to stimulation and compared them to all remaining non-SOZ channels. The ripple rate in general was higher in the eloquent cortex than in the remaining non-SOZ channels (p < 0.001; Wilcoxon rank sum test; eloquent cortex: n = 311 channels, non-SOZ remaining: n = 282 channels; Figure 3), and this difference was due to a significant difference in ‘pure’ ripples (p < 0.001; median rates 3.3/min vs. 1.4/min). Spike–ripple rates, in contrast, were not significantly different (p = 0.87). To perform a similar analysis at the level of patients, we then compared each subject’s median channels between the two groups, in analogy to the SOZ vs. non-SOZ comparison described above. Again, ripples (p = 0.03, Wilcoxon signed-rank test; n = 19 patients) and specifically ‘pure’ ripples (p = 0.02) were more frequent in eloquent cortex, whereas spike–ripples did not differ significantly (p = 0.98). It can thus be concluded that neocortical ‘pure’ ripples likely reflect physiologic fast oscillatory activity.

3.6. Delineation of Eloquent Cortex—Across and in Individual Patients

Finally, we explored whether ‘pure’ ripples might be of value regarding the delineation of the functional neocortex in pre-surgical patients with epilepsy. To this end, we also computed a receiver operating characteristic (ROC) curve for the functional vs. remaining non-SOZ classification (Figure 4A). Across patients, ‘pure’ ripples identified functional tissue significantly better than chance (AUC = 0.64; p < 0.001, permutation test; Figure 4B). In line with these findings, we found that ‘pure’ ripples nicely delineated an eloquent neocortex in some patients (Figure 5). Our data thus suggest that ‘pure’ ripples could be of value, in addition to electrical stimulation, if functional regions have to be mapped—but to what extent they are a reliable tool clearly has to be examined in a larger systematic study.

4. Discussion

The main novel finding of this study is that in interictal recordings from subdural grid electrodes, ’pure’ ripples are more frequent in the unequivocally functional cortex, identified based on electrical stimulation. Moreover, we report that spike–ripples identify seizure onset better than spikes, which underlines that they are highly pathologic. Various aspects of these findings shall be discussed in detail below.

4.1. ‘Pure’ Ripples: A Reproducible Marker of Eloquent Neocortex

Our main finding is that ‘pure’ ripples, i.e., ripples not associated with spikes, occur significantly more often in the eloquent neocortex than in remaining non-SOZ areas. The rates we report are very similar to a recent study on physiologic HFOs, which also found the highest rates in typically eloquent regions [39]. This may be noteworthy because the dataset we analyzed was different in several important aspects, and because we applied a different algorithm for automated detection. Furthermore, we provide solid evidence for the concept that our ‘pure’ ripples are truly physiological because (1) they were recorded from unequivocally functional neocortex, as demonstrated by stimulation, and because (2) the difference between eloquent and remaining non-SOZ channels was only significant for ‘pure’ ripples, and not for spike–ripples. Together with a previous study on specific coupling to slow waves [23], these data suggest that HFOs in ‘healthy’ tissue are generated based on distinct mechanisms. Our recordings covered a variety of regions, including primary motor and sensory cortex, Broca’s and Wernicke’s area. It thus seems unlikely that ‘pure’ ripples are directly linked to only one specific function, but future studies will have to investigate such questions in detail. Another aspect is that the stimulation as such suppresses HFOs [40], and it may be interesting to explore if this effect applies particularly to physiological HFOs. Anyway, it can be concluded that ‘pure’ ripples are indeed a marker of eloquent regions, and that they probably reflect physiologic brain activity.

4.2. Delineation of Epileptogenic Tissue AAre Spike–Ripples a Better Biomarker?

We report that interictal spikes with a co-occurring ripple oscillation identify the seizure onset zone (SOZ) channels significantly better than spikes. This finding is in line with previous work [28,29,30] and the stereotyped coupling of HFOs to spike-slow waves may also be characteristic of epileptogenic areas [8]. At the level of individual patients, however, there was no significant difference between the two biomarkers, which is consistent with a previous study analyzing stereotactic electroencephalography in 30 patients [32]. Therefore, in summary, do spike–ripples provide additional value, or not? It should be acknowledged that both ours and the previous study had limited power to detect differences at the patient level-and our channel-based analysis does suggest that spike–ripples are slightly—but significantly—superior. Furthermore, our study underlines that patient-specific features must be taken into account: while performance differed substantially between individuals, spike–ripples were particularly better if high specificity was required, and in patients with many spikes. In conclusion, spike–ripples may not be suited to delineate non-epileptogenic areas but are superior if clearly pathologic tissue has to be identified.

4.3. Interactions between Spikes and Ripples

High-frequency oscillations (HFOs) sometimes co-occur with spikes, and interactions between these two kinds of activity have been examined since the first reports on HFOs in humans [41,42,43]. A potential confounder in any such study is that high-pass filtering of sharp transients may artificially generate ‘false’ ripples [44]. Such effects can be minimized by using filters with a finite impulse response [45], implementing a criterion of, e.g., at least four oscillatory cycles [5,45], or by performing a time–frequency decomposition as in the detection algorithm we applied [16,35]. Despite these methodological challenges, several lines of evidence suggest that spike–ripples are a distinct pathophysiological phenomenon: ripples riding on spikes are frequently visible even in unfiltered traces, as recent studies have revealed their value in different clinical scenarios [28,31], and we have reported that spikes with HFOs have a distinct single-neuron correlate [46]. The current study demonstrates that spike–ripples and ‘pure’ ripples are two distinct kinds of activity, the former being epileptic and the latter being physiological, and which clearly underlines the relevance of understanding interactions between spikes and HFOs.

4.4. Limitations and Outlook

This study is limited in several ways. Focusing on subdural grid recordings from neocortical tissue, we obtained a relatively homogeneous dataset, but this also implies that our conclusions do not necessarily apply to other regions, such as the mesial temporal lobe. Another issue is that spikes and ripples were detected by an algorithm that had not been developed at our center, based on data from depth electrodes recorded with a setup from a different company. We decided not to modify the default settings of this detector-and one might speculate that if we had done so, its accuracy and thus the performance of our biomarkers, would have been improved. On the other hand, we thus demonstrated that HFO analysis is feasible without time-consuming visual identification, ‘optimization’ or even the new development of an automated algorithm. In addition, the distinction of epileptic and physiologic HFOs may be improved by integrating our coupling-based strategy in a multivariate classifier, which also takes other HFO features or interactions with sleep into account. Such approaches promise to open up new avenues for a variety of research questions, in both epilepsy and cognitive science.

5. Conclusions

This study suggests that ‘pure’ ripples are physiological and a marker of eloquent neocortex. Spike–ripples, in contrast, provide additional value regarding the delineation of epileptogenic tissue. Considering that both types of events were detected with open source software that was not developed at our center, our approach should permit to efficiently tackle a variety of research questions, in both epilepsy and cognitive science.

Author Contributions

Conceptualization, J.S. and J.J.; methodology, J.S., K.A.K., M.D. and J.J.; software, J.S. and M.D.; formal analysis, J.S. and A.K.; investigation, J.S. and A.K.; resources, K.A.K., A.S.-B. and J.J.; data curation, J.S. and A.K.; writing—original draft preparation, J.S.; writing—review and editing, A.K., K.A.K., M.D., A.S.-B. and J.J.; visualization, J.S.; supervision, J.S., A.S.-B. and J.J.; funding acquisition, J.S., K.A.K., A.S.-B. and J.J. All authors have read and agreed to the published version of the manuscript.

Funding

J.S. and K.A.K. were supported by the Berta-Ottenstein-Program for Clinician Scientists from the Faculty of Medicine, University of Freiburg. J.J. was supported by the German Research Foundation (DFG; JA 1725/4-1).

Institutional Review Board Statement

This study was approved by the Ethics Commission at the University Medical Center Freiburg (No. 69/18) and written informed consent was obtained from all patients.

Informed Consent Statement

Written informed consent was obtained from all patients.

Data Availability Statement

Not Applicable.

Conflicts of Interest

None of the authors have any conflicts of interest to disclose.

References

  1. Perucca, P.; Dubeau, F.; Gotman, J. Intracranial Electroencephalographic Seizure-Onset Patterns: Effect of Underlying Pathology. Brain 2014, 137, 183–196. [Google Scholar] [CrossRef] [PubMed]
  2. Weiss, S.A.; Alvarado-Rojas, C.; Bragin, A.; Behnke, E.; Fields, T.; Fried, I.; Engel, J.J.; Staba, R. Ictal Onset Patterns of Local Field Potentials, High Frequency Oscillations, and Unit Activity in Human Mesial Temporal Lobe Epilepsy. Epilepsia 2016, 57, 111–121. [Google Scholar] [CrossRef] [PubMed]
  3. Schönberger, J.; Frauscher, B.; von Ellenrieder, N.; Avoli, M.; Dubeau, F.; Gotman, J. Fast Ripple Analysis in Human Mesial Temporal Lobe Epilepsy Suggests Two Different Seizure-Generating Mechanisms. Neurobiol. Dis. 2019, 127, 374–381. [Google Scholar] [CrossRef] [PubMed]
  4. Schönberger, J.; Birk, N.; Lachner-Piza, D.; Dümpelmann, M.; Schulze-Bonhage, A.; Jacobs, J. High-frequency Oscillations Mirror Severity of Human Temporal Lobe Seizures. Ann. Clin. Transl. Neurol. 2019, 6, 2479–2488. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Jacobs, J.; Zijlmans, M.; Zelmann, R.; Chatillon, C.-E.; Hall, J.; Olivier, A.; Dubeau, F.; Gotman, J. High-Frequency Electroencephalographic Oscillations Correlate with Outcome of Epilepsy Surgery. Ann. Neurol. 2010, 67, 209–220. [Google Scholar] [CrossRef]
  6. Wu, J.Y.; Sankar, R.; Lerner, J.T.; Matsumoto, J.H.; Vinters, H.V.; Mathern, G.W. Removing Interictal Fast Ripples on Electrocorticography Linked with Seizure Freedom in Children. Neurology 2010, 75, 1686–1694. [Google Scholar] [CrossRef] [Green Version]
  7. Jacobs, J.; Wu, J.Y.; Perucca, P.; Zelmann, R.; Mader, M.; Dubeau, F.; Mathern, G.W.; Schulze-Bonhage, A.; Gotman, J. Removing High-Frequency Oscillations. Neurology 2018, 91, e1040–e1052. [Google Scholar] [CrossRef]
  8. Kuroda, N.; Sonoda, M.; Miyakoshi, M.; Nariai, H.; Jeong, J.-W.; Motoi, H.; Luat, A.F.; Sood, S.; Asano, E. Objective Interictal Electrophysiology Biomarkers Optimize Prediction of Epilepsy Surgery Outcome. Brain Commun. 2021. [Google Scholar] [CrossRef]
  9. Jacobs, J.; Zijlmans, M.; Zelmann, R.; Olivier, A.; Hall, J.; Gotman, J.; Dubeau, F. Value of Electrical Stimulation and High Frequency Oscillations (80–500 Hz) in Identifying Epileptogenic Areas during Intracranial EEG Recordings. Epilepsia 2010, 51, 573–582. [Google Scholar] [CrossRef] [Green Version]
  10. Zijlmans, M.; Jacobs, J.; Zelmann, R.; Dubeau, F.; Gotman, J. High-Frequency Oscillations Mirror Disease Activity in Patients with Epilepsy. Neurology 2009, 72, 979–986. [Google Scholar] [CrossRef] [Green Version]
  11. Kobayashi, K.; Akiyama, T.; Oka, M.; Endoh, F.; Yoshinaga, H. A Storm of Fast (40–150 Hz) Oscillations Hypsarrhythmia in West Syndrome. Ann. Neurol. 2015, 77, 58–67. [Google Scholar] [CrossRef]
  12. Klotz, K.A.; Sag, Y.; Schönberger, J.; Jacobs, J. Scalp Ripples Can Predict Development of Epilepsy after First Unprovoked Seizure in Childhood. Ann. Neurol. 2020, 89, 134–142. [Google Scholar] [CrossRef]
  13. Staba, R.J.; Wilson, C.L.; Bragin, A.; Fried, I.; Engel, J.J. Quantitative Analysis of High-Frequency Oscillations (80–500 Hz) Recorded in Human Epileptic Hippocampus and Entorhinal Cortex. J. Neurophysiol. 2002, 88, 1743–1752. [Google Scholar] [CrossRef] [PubMed]
  14. Zelmann, R.; Mari, F.; Jacobs, J.; Zijlmans, M.; Dubeau, F.; Gotman, J. A Comparison between Detectors of High Frequency Oscillations. Clin. Neurophysiol. 2012, 123, 106–116. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Dümpelmann, M.; Jacobs, J.; Kerber, K.; Schulze-Bonhage, A. Automatic 80–250 Hz “Ripple” High Frequency Oscillation Detection in Invasive Subdural Grid and Strip Recordings in Epilepsy by a Radial Basis Function Neural Network. Clin. Neurophysiol. 2012, 123, 1721–1731. [Google Scholar] [CrossRef] [PubMed]
  16. Roehri, N.; Pizzo, F.; Bartolomei, F.; Wendling, F.; Benar, C.-G. What Are the Assets and Weaknesses of HFO Detectors? A Benchmark Framework Based on Realistic Simulations. PLoS ONE 2017, 12, e0174702. [Google Scholar] [CrossRef] [PubMed]
  17. Buzsaki, G.; Horvath, Z.; Urioste, R.; Hetke, J.; Wise, K. High-Frequency Network Oscillation in the Hippocampus. Science 1992, 256, 1025–1027. [Google Scholar] [CrossRef]
  18. Foster, D.J.; Wilson, M.A. Reverse Replay of Behavioural Sequences in Hippocampal Place Cells during the Awake State. Nature 2006, 440, 680–683. [Google Scholar] [CrossRef] [PubMed]
  19. Vaz, A.P.; Wittig, J.H.J.; Inati, S.K.; Zaghloul, K.A. Replay of Cortical Spiking Sequences during Human Memory Retrieval. Science 2020, 367, 1131–1134. [Google Scholar] [CrossRef]
  20. Engel, J.J.; Bragin, A.; Staba, R.; Mody, I. High-Frequency Oscillations: What Is Normal and What Is Not? Epilepsia 2009, 50, 598–604. [Google Scholar] [CrossRef]
  21. Frauscher, B.; von Ellenrieder, N.; Ferrari-Marinho, T.; Avoli, M.; Dubeau, F.; Gotman, J. Facilitation of Epileptic Activity during Sleep Is Mediated by High Amplitude Slow Waves. Brain 2015, 138, 1629–1641. [Google Scholar] [CrossRef] [Green Version]
  22. Von Ellenrieder, N.; Frauscher, B.; Dubeau, F.; Gotman, J. Interaction with Slow Waves during Sleep Improves Discrimination of Physiologic and Pathologic High-Frequency Oscillations (80–500 Hz). Epilepsia 2016, 57, 869–878. [Google Scholar] [CrossRef] [Green Version]
  23. Nonoda, Y.; Miyakoshi, M.; Ojeda, A.; Makeig, S.; Juhász, C.; Sood, S.; Asano, E. Interictal High-Frequency Oscillations Generated by Seizure Onset and Eloquent Areas May Be Differentially Coupled with Different Slow Waves. Clin. Neurophysiol. 2016, 127, 2489–2499. [Google Scholar] [CrossRef] [Green Version]
  24. Von Ellenrieder, N.; Dubeau, F.; Gotman, J.; Frauscher, B. Physiological and Pathological High-Frequency Oscillations Have Distinct Sleep-Homeostatic Properties. NeuroImage Clin. 2017, 14, 566–573. [Google Scholar] [CrossRef] [PubMed]
  25. Alkawadri, R.; Gaspard, N.; Goncharova, I.I.; Spencer, D.D.; Gerrard, J.L.; Zaveri, H.; Duckrow, R.B.; Blumenfeld, H.; Hirsch, L.J. The Spatial and Signal Characteristics of Physiologic High Frequency Oscillations. Epilepsia 2014, 55, 1986–1995. [Google Scholar] [CrossRef] [PubMed]
  26. Bruder, J.C.; Dümpelmann, M.; Piza, D.L.; Mader, M.; Schulze-Bonhage, A.; Jacobs-Le Van, J. Physiological Ripples Associated with Sleep Spindles Differ in Waveform Morphology from Epileptic Ripples. Int. J. Neural Syst. 2017, 27, 1750011. [Google Scholar] [CrossRef] [PubMed]
  27. Cimbalnik, J.; Brinkmann, B.; Kremen, V.; Jurak, P.; Berry, B.; Van Gompel, J.; Stead, M.; Worrell, G. Physiological and Pathological High Frequency Oscillations in Focal Epilepsy. Ann. Clin. Transl. Neurol. 2018, 5, 1062–1076. [Google Scholar] [CrossRef] [PubMed]
  28. Ren, L.; Kucewicz, M.T.; Cimbalnik, J.; Matsumoto, J.Y.; Brinkmann, B.H.; Hu, W.; Marsh, W.R.; Meyer, F.B.; Stead, S.M.; Worrell, G.A. Gamma Oscillations Precede Interictal Epileptiform Spikes in the Seizure Onset Zone. Neurology 2015, 84, 602–608. [Google Scholar] [CrossRef] [Green Version]
  29. Jacobs, J.; Vogt, C.; LeVan, P.; Zelmann, R.; Gotman, J.; Kobayashi, K. The Identification of Distinct High-Frequency Oscillations during Spikes Delineates the Seizure Onset Zone Better than High-Frequency Spectral Power Changes. Clin. Neurophysiol. 2016, 127, 129–142. [Google Scholar] [CrossRef]
  30. Lachner-Piza, D.; Jacobs, J.; Bruder, J.C.; Schulze-Bonhage, A.; Stieglitz, T.; Dumpelmann, M. Automatic Detection of High-Frequency-Oscillations and Their Sub-Groups Co-Occurring with Interictal-Epileptic-Spikes. J. Neural Eng. 2020, 17, 16030. [Google Scholar] [CrossRef]
  31. Kramer, M.A.; Ostrowski, L.M.; Song, D.Y.; Thorn, E.L.; Stoyell, S.M.; Parnes, M.; Chinappen, D.; Xiao, G.; Eden, U.T.; Staley, K.J.; et al. Scalp Recorded Spike Ripples Predict Seizure Risk in Childhood Epilepsy Better than Spikes. Brain 2019, 142, 1296–1309. [Google Scholar] [CrossRef]
  32. Roehri, N.; Pizzo, F.; Lagarde, S.; Lambert, I.; Nica, A.; McGonigal, A.; Giusiano, B.; Bartolomei, F.; Bénar, C.-G. High-Frequency Oscillations Are Not Better Biomarkers of Epileptogenic Tissues than Spikes. Ann. Neurol. 2018, 83, 84–97. [Google Scholar] [CrossRef] [PubMed]
  33. Weiss, S.A. Are Spikes Noninferior to High-Frequency Oscillations? Ann. Neurol. 2018, 83, 870. [Google Scholar] [CrossRef] [PubMed]
  34. Roehri, N.; Pizzo, F.; McGonigal, A.; Bartolomei, F.; Bénar, C.G. Reply to “Are Spikes Noninferior to High-Frequency Oscillations?”. Ann. Neurol. 2018, 83, 870–871. [Google Scholar] [CrossRef]
  35. Roehri, N.; Lina, J.-M.; Mosher, J.C.; Bartolomei, F.; Benar, C.-G. Time-Frequency Strategies for Increasing High-Frequency Oscillation Detectability in Intracerebral EEG. IEEE Trans. Biomed. Eng. 2016, 63, 2595–2606. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Colombet, B.; Woodman, M.; Badier, J.M.; Bénar, C.G. AnyWave: A Cross-Platform and Modular Software for Visualizing and Processing Electrophysiological Signals. J. Neurosci. Methods 2015, 242, 118–126. [Google Scholar] [CrossRef] [Green Version]
  37. Hsieh, F.; Turnbull, B.W. Nonparametric and Semiparametric Estimation of the Receiver Operating Characteristic Curve. Ann. Stat. 1996, 24, 25–40. [Google Scholar] [CrossRef]
  38. Bandos, A.I.; Rockette, H.E.; Gur, D. A Permutation Test Sensitive to Differences in Areas for Comparing ROC Curves from a Paired Design. Stat. Med. 2005, 24, 2873–2893. [Google Scholar] [CrossRef]
  39. Frauscher, B.; von Ellenrieder, N.; Zelmann, R.; Rogers, C.; Nguyen, D.K.; Kahane, P.; Dubeau, F.; Gotman, J. High-Frequency Oscillations in the Normal Human Brain. Ann. Neurol. 2018, 84, 374–385. [Google Scholar] [CrossRef]
  40. Jacobs, J.; Golla, T.; Mader, M.; Schelter, B.; Dümpelmann, M.; Korinthenberg, R.; Schulze-Bonhage, A. Electrical Stimulation for Cortical Mapping Reduces the Density of High Frequency Oscillations. Epilepsy Res. 2014, 108, 1758–1769. [Google Scholar] [CrossRef]
  41. Urrestarazu, E.; Jirsch, J.D.; LeVan, P.; Hall, J.; Avoli, M.; Dubeau, F.; Gotman, J. High-Frequency Intracerebral EEG Activity (100–500 Hz) Following Interictal Spikes. Epilepsia 2006, 47, 1465–1476. [Google Scholar] [CrossRef]
  42. Urrestarazu, E.; Chander, R.; Dubeau, F.; Gotman, J. Interictal High-Frequency Oscillations (100–500 Hz) in the Intracerebral EEG of Epileptic Patients. Brain 2007, 130, 2354–2366. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Jacobs, J.; Kobayashi, K.; Gotman, J. High-Frequency Changes during Interictal Spikes Detected by Time-Frequency Analysis. Clin. Neurophysiol. 2011, 122, 32–42. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Bénar, C.G.; Chauvière, L.; Bartolomei, F.; Wendling, F. Pitfalls of High-Pass Filtering for Detecting Epileptic Oscillations: A Technical Note on “False” Ripples. Clin. Neurophysiol. 2010, 121, 301–310. [Google Scholar] [CrossRef] [Green Version]
  45. Jirsch, J.D.; Urrestarazu, E.; LeVan, P.; Olivier, A.; Dubeau, F.; Gotman, J. High-Frequency Oscillations during Human Focal Seizures. Brain 2006, 129, 1593–1608. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  46. Single-Unit Analysis Reveals That Distinct Networks Underlie High-Frequency Oscillation-Associated Interictal Epileptiform Discharges. Available online: https://cms.aesnet.org/abstractslisting/single-unit-analysis-reveals-that-distinct-networks-underlie-high-frequency-oscillation-associated-interictal-epileptiform-discharges (accessed on 23 April 2021).
Figure 1. Interictal spikes, ripples and spike-ripples are biomarkers of the seizure onset zone (SOZ) in subdural grid recordings. (A–C) Channels pooled across patients. SOZ channels have higher rates of interictal spikes (A, p < 0.001), ripples (B, p < 0.001) and spike-ripples (C, p < 0.001) than non-SOZ channels. (DF) Comparison at the level of individual patients. For each patient, and from both groups of channels, we considered the channel with the median rate as representative. Again, rates of interictal spikes (D, p = 0.001), ripples (E, p = 0.004) and spike-ripples (F, p < 0.001) were higher inside the SOZ.
Figure 1. Interictal spikes, ripples and spike-ripples are biomarkers of the seizure onset zone (SOZ) in subdural grid recordings. (A–C) Channels pooled across patients. SOZ channels have higher rates of interictal spikes (A, p < 0.001), ripples (B, p < 0.001) and spike-ripples (C, p < 0.001) than non-SOZ channels. (DF) Comparison at the level of individual patients. For each patient, and from both groups of channels, we considered the channel with the median rate as representative. Again, rates of interictal spikes (D, p = 0.001), ripples (E, p = 0.004) and spike-ripples (F, p < 0.001) were higher inside the SOZ.
Brainsci 11 00538 g001
Figure 2. Interictal spike-ripples identify SOZ channels slightly but significantly better than spikes. (A) ROC curves, SOZ vs. non-SOZ classification, channels pooled across patients. The AUC for spike-ripples (red line, 0.664) was slightly higher than for all spikes (blue line, 0.628). (B) To investigate whether this difference was significant, we applied permutation-based hypothesis testing. The probability of obtaining an AUC difference that is as high as or higher than our empirically measured value (bold vertical line) by chance (grey bars represent surrogate data) was less than 5 % (two-tailed p < 0.001). (C) Same analysis for pAUC (between 85 and 100 % specificity), as applied in [32]. Again, spike ripples classified significantly better (p < 0.001). (D) At the level of individual patients, there was no significant difference between the pAUC for spike-ripples and spikes (p = 0.29). Note the broad range of values, reflecting that the SOZ could be nicely delineated in several patients, whereas performance was poor in others. (E) Both biomarkers classify better in patients with many interictal spikes. There was a significant correlation between our patients’ median spike rate and their pAUC, both for spike-ripples (red, p = 0.002) and spikes (blue, p = 0.02). Each dot corresponds to one patient. (F) Spike-ripples are a better classifier in patients with many spikes. There was a significant correlation between our patients’ median spike rate and their pAUC difference between spike-ripples and spikes (p = 0.042).
Figure 2. Interictal spike-ripples identify SOZ channels slightly but significantly better than spikes. (A) ROC curves, SOZ vs. non-SOZ classification, channels pooled across patients. The AUC for spike-ripples (red line, 0.664) was slightly higher than for all spikes (blue line, 0.628). (B) To investigate whether this difference was significant, we applied permutation-based hypothesis testing. The probability of obtaining an AUC difference that is as high as or higher than our empirically measured value (bold vertical line) by chance (grey bars represent surrogate data) was less than 5 % (two-tailed p < 0.001). (C) Same analysis for pAUC (between 85 and 100 % specificity), as applied in [32]. Again, spike ripples classified significantly better (p < 0.001). (D) At the level of individual patients, there was no significant difference between the pAUC for spike-ripples and spikes (p = 0.29). Note the broad range of values, reflecting that the SOZ could be nicely delineated in several patients, whereas performance was poor in others. (E) Both biomarkers classify better in patients with many interictal spikes. There was a significant correlation between our patients’ median spike rate and their pAUC, both for spike-ripples (red, p = 0.002) and spikes (blue, p = 0.02). Each dot corresponds to one patient. (F) Spike-ripples are a better classifier in patients with many spikes. There was a significant correlation between our patients’ median spike rate and their pAUC difference between spike-ripples and spikes (p = 0.042).
Brainsci 11 00538 g002
Figure 3. Eloquent cortex generates ‘pure’ ripples. (A) Ripple rate was higher (p < 0.001) in eloquent cortex than in remaining non-SOZ channels. (B) This difference was due to the fact that eloquent cortex generates significantly more ‘pure’ ripples (p < 0.001). (C) Spike-ripple rates, in contrast, were not significantly different (p = 0.87).
Figure 3. Eloquent cortex generates ‘pure’ ripples. (A) Ripple rate was higher (p < 0.001) in eloquent cortex than in remaining non-SOZ channels. (B) This difference was due to the fact that eloquent cortex generates significantly more ‘pure’ ripples (p < 0.001). (C) Spike-ripple rates, in contrast, were not significantly different (p = 0.87).
Brainsci 11 00538 g003
Figure 4. Delineation of eloquent neocortex based on ‘pure’ ripples—across patients. (A) ROC curve, functional vs. remaining non-SOZ classification, channels pooled across patients. (B) To investigate whether ‘pure’ ripples identify eloquent regions significantly better than chance, we again applied permutation-based testing. The probability of obtaining an AUC that is as high as or higher than our empirically measured value (bold vertical line) by chance (grey bars represent surrogate data) was less than 5% (two-tailed p < 0.001).
Figure 4. Delineation of eloquent neocortex based on ‘pure’ ripples—across patients. (A) ROC curve, functional vs. remaining non-SOZ classification, channels pooled across patients. (B) To investigate whether ‘pure’ ripples identify eloquent regions significantly better than chance, we again applied permutation-based testing. The probability of obtaining an AUC that is as high as or higher than our empirically measured value (bold vertical line) by chance (grey bars represent surrogate data) was less than 5% (two-tailed p < 0.001).
Brainsci 11 00538 g004
Figure 5. Delineation of eloquent neocortex based on ‘pure’ ripples in patient 9. Schematic illustrates approximate location of grid electrodes, MRI sections below are displayed for reference. Each filled circle represents one bipolar channel, with its radius proportional to its ‘pure’ ripple rate. Note that ‘pure’ ripples were particularly frequent in clearly functional neocortex, identified based on electrical stimulation. In this patient, these regions correspond nicely to the typical location of Broca’s area, primary motor and sensory cortex.
Figure 5. Delineation of eloquent neocortex based on ‘pure’ ripples in patient 9. Schematic illustrates approximate location of grid electrodes, MRI sections below are displayed for reference. Each filled circle represents one bipolar channel, with its radius proportional to its ‘pure’ ripple rate. Note that ‘pure’ ripples were particularly frequent in clearly functional neocortex, identified based on electrical stimulation. In this patient, these regions correspond nicely to the typical location of Broca’s area, primary motor and sensory cortex.
Brainsci 11 00538 g005
Table 1. Clinical data. Abbreviations: AHE, amygdalohippocampectomy; ATL, anterior temporal lobectomy; EL, extended lesionectomy; F, frontal lobe; f, female; FCD, focal cortical dysplasia; L, left; m, male (second column)/months (last column); MST, multiple subpial trans-sections; P, parietal lobe; O, occipital lobe; R, right; s/p, status post; T, temporal lobe; y, years.
Table 1. Clinical data. Abbreviations: AHE, amygdalohippocampectomy; ATL, anterior temporal lobectomy; EL, extended lesionectomy; F, frontal lobe; f, female; FCD, focal cortical dysplasia; L, left; m, male (second column)/months (last column); MST, multiple subpial trans-sections; P, parietal lobe; O, occipital lobe; R, right; s/p, status post; T, temporal lobe; y, years.
IDSexAge (y)MRIGrid CoverageEloquent CortexAEDsSurgeryOutcome, Engel Class (Follow-Up)
1m21S/p resection pilocytic astrocytoma, gliosis temporobasal LT WernickeOXCELIa (1 y)
2f51Hippocampal sclerosis LT, FWernicke, motorLEV, PGBAHEIa (1 y)
3f28no clear epileptogenic lesionF, T, P, OMotor, sensory, WernickeOXC, PGBnoneN/A
4m11FCD frontoparietal RF, PMotor, sensoryLEV, OXC, ZNSELIa (3 m)
5m41S/p resection ganglioglioma parietal LP, T, FWernicke, motor, sensoryZNS, PHTELIb (3 m)
6f21FCD frontal RF, T, PMotor, sensoryOXC, TPM, CLBELIa (3 m)
7m41FCD frontocentral RF, PMotor, sensoryLTG, CLBEL + MSTIa (3 m)
8m39Hippocampal sclerosis L, FCD temporal LT, FMotorLEVEL + AHEIa (3 m)
9f48FCD frontal LF, PMotor, sensory, BrocaOXC, PHT, DZPELIIb (1 y)
10m54Gliosis frontal LFMotor, BrocaOXC, LEVELIa (6 m)
11f33FCD frontal RF, PMotor, sensoryOXC, CLBELIa (1 y)
12f27S/p AHE, FCD temporal LTWernickeOXC, LCMATL + MST superior temporal gyrusIVb (1 y)
13m17FCD temporal RT, PSensoryLEV, OXCEL + AHEIa (2 y)
14f14FCD occipitotemporal LTWernickeOXC, LTG, PHTMSTIVb (1 y)
15f15FCD frontal RF, PMotor, sensorySTM, LTG, CLBELIa (3 m)
16f38FCD frontal LF, PMotor, sensory, BrocaLTG, LCM, TPM, CLBpartial resection frontal lobeIIIa (6 m)
17m33no clear epileptogenic lesionF, PMotor, sensoryLTG, RUF, CLBMSTIIIa (6 m)
18m22FCD frontal LF, T, P, OMotor, sensory, Broca, WernickeOXC, LTG, CLBELIIIa (1 y)
19m14Gliosis frontal RF, PMotor, sensoryLEVELIa (3 m)
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Schönberger, J.; Knopf, A.; Klotz, K.A.; Dümpelmann, M.; Schulze-Bonhage, A.; Jacobs, J. Distinction of Physiologic and Epileptic Ripples: An Electrical Stimulation Study. Brain Sci. 2021, 11, 538. https://doi.org/10.3390/brainsci11050538

AMA Style

Schönberger J, Knopf A, Klotz KA, Dümpelmann M, Schulze-Bonhage A, Jacobs J. Distinction of Physiologic and Epileptic Ripples: An Electrical Stimulation Study. Brain Sciences. 2021; 11(5):538. https://doi.org/10.3390/brainsci11050538

Chicago/Turabian Style

Schönberger, Jan, Anja Knopf, Kerstin Alexandra Klotz, Matthias Dümpelmann, Andreas Schulze-Bonhage, and Julia Jacobs. 2021. "Distinction of Physiologic and Epileptic Ripples: An Electrical Stimulation Study" Brain Sciences 11, no. 5: 538. https://doi.org/10.3390/brainsci11050538

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop