Sage Journals: Discover world-class research

Abstract

Objective: Electroencephalography (EEG) interpretations through visual (by human raters) and automated (by computer technology) analysis were still not reliable for the diagnosis of nonconvulsive status epilepticus (NCSE). This study aimed to identify typical pitfalls in the EEG analysis and make suggestions as to how those pitfalls might be avoided. Methods: We analyzed the EEG recordings of individuals who had clinically confirmed or suspected NCSE. Epileptiform EEG activity during seizures (ictal discharges) was visually analyzed by 2 independent raters. We investigated whether unreliable EEG visual interpretations quantified by low interrater agreement can be predicted by the characteristics of ictal discharges and individuals’ clinical data. In addition, the EEG recordings were automatically analyzed by in-house algorithms. To further explore the causes of unreliable EEG interpretations, 2 epileptologists analyzed EEG patterns most likely misinterpreted as ictal discharges based on the differences between the EEG interpretations through the visual and automated analysis. Results: Short ictal discharges with a gradual onset (developing over 3 s in length) were liable to be misinterpreted. An extra 2 min of ictal discharges contributed to an increase in the kappa statistics of >0.1. Other problems were the misinterpretation of abnormal background activity (slow-wave activities, other abnormal brain activity, and the ictal-like movement artifacts), continuous interictal discharges, and continuous short ictal discharges. Conclusion: A longer duration criterion for NCSE-EEGs than 10 s that is commonly used in NCSE working criteria is recommended. Using knowledge of historical EEGs, individualized algorithms, and context-dependent alarm thresholds may also avoid the pitfalls.

Keywords

NCSE interrater agreement misinterpretation reliability seizure

Introduction

NCSE is characterized by its inconspicuous motor signs with prolonged electrographic seizure activities.¹ Given the subtle and variable clinical presentations, EEG that confirms ictal discharges (epileptiform EEG activity during a seizure) is an essential diagnostic tool of NCSE. The reliability of the diagnostic tool can be assessed by the interrater agreement of visual EEG interpretation.² A low agreement could indicate the presence of certain EEG misinterpretations and therefore less reliable diagnosis of NCSE.³

Currently, NCSE-EEG interpretations through visual analysis by human raters and automated analysis by computer technology are still not very reliable.^4–10 The Salzburg consensus criteria (SCC)^11,12 achieved reasonably high accuracy and interrater agreement among human raters for the diagnosis of NCSE.^13,14 However, the accuracy and agreement are relatively low when human raters cannot assess the effect of intravenous antiepileptic drugs on the EEG of individuals during NCSE and when raters interpret short EEG recordings.^5,15,16 The visual EEG interpretation relies heavily on subjective judgments based on human raters’ experience and knowledge about the characteristics of ictal discharges such as location, morphology, frequency, and persistence. EEG-readers who are inexperienced for NCSE-EEG patterns are more liable to misinterpret EEG, which results in an unreliable NCSE diagnosis. A previous study¹⁰ summarized several pitfalls in the EEG interpretations of intensive care unit (ICU) patients with NCSE, including misinterpreting artifacts as ictal discharges, assuming that the stereotypical patterns of ictal discharges are observed on the same subject, and assuming that a dichotomy exists between ictal and interictal discharges (epileptiform EEG activity between seizures) in patients with encephalopathy. On the other hand, automated EEG analysis can assist clinicians and caregivers in the detection of ictal discharges because of its greater time efficiency and more objective judgments than visual analysis.^6–9 However, pitfalls of EEG misinterpretations (misclassifications) also exist in automated analysis:^8,9 the misclassification of preictal discharges (epileptiform EEG activity before a seizure), postictal discharges (epileptiform EEG activity after a seizure), high-frequency artifacts, or similar background EEG activity. These misinterpretations of EEG by both human raters and computer technology could lead to wrong diagnoses of NCSE and cause serious consequences.^17,18

EEG readers need to be alert to potential pitfalls in EEG analysis for reliable NCSE diagnosis. Nevertheless, studies on the pitfalls in the visual and automated EEG analysis for NCSE are relatively scarce.^4,10 This preliminary study, therefore, addresses the pitfalls of unreliable EEG interpretations in the visual and automated EEG analysis for NCSE patients with chronic epilepsy and brain development disorders when a pharmacological test is not available. We explored whether the reliability of EEG interpretation can be predicted by the characteristics of ictal discharges and the clinical data of patients. Moreover, we further identified potential pitfalls which could cause EEG misinterpretations and therefore low reliability in the NCSE diagnosis. Strategies to avoid the pitfalls were also proposed in this study.

Materials and Methods

Study Design

This is a retrospective explorative study approved by the Medical Research Ethics Committee of Kempenhaeghe in the Netherlands. We retrieved and analyzed the EEG and the clinical records of 30 subjects with preceding seizures between 2008 and 2016 in this study. Twenty of the 30 subjects’ data were recorded when they had clinically confirmed NCSE, which was diagnosed based on the clinical information, such as clinical signs, response to treatment, and EEG recordings. The other 10 subjects’ data were recorded during clinically suspected NCSE, that is, the subjects were first suspected to have NCSE based on clinical signs, but the suspicion was disconfirmed based on the response to treatment and EEG recordings. We included subjects <65 years and excluded EEG recordings with excessive artifacts and those of subjects from whom we did not receive permission (from themselves and/or their legal guardians) to use their recordings for scientific research.

The study had 3 phases. (1) Subjects’ data were screened according to the inclusion and exclusion criteria, and the clinical background was evaluated by an experienced epileptologist. (2) Ictal discharges in the EEG recordings were annotated by 2 independent raters. (3) Pitfalls in the visual and automated EEG analysis were investigated.

Data Sources

The EEG recordings were acquired by 3 different systems (BrainRT equipment from Onafhankelijke Software Groep, EEG Stellate from Natus Europe GmbH, and Micromed from SIGMA Medizin-Technik GmbH). The sampling rate of the EEG recordings was 100, 200, or 256 Hz. EEG electrodes were positioned in the 10 to 20 system. For the algorithm development of the automated EEG analysis, 21 electrodes were used (19 electrodes in the 10 to 20 system, plus electrodes F9 and F10). All recordings were continuous except in 9 subjects, where 5 min per hour were stored when no clinical abnormalities were recorded. From each subject's clinical data and the corresponding clinical report of EEG recordings, we collected information about age, sex, intellectual disability level, sleep status, preexisting epileptic encephalopathy (defined as severe brain dysfunction at an early age), clinical signs during NCSE, and seizure history.

EEG Visual Analysis and Interrater Agreement

The raters were asked to focus on the EEG visual analysis without checking corresponding videos, as NCSE is known for its difficult discrimination from normal behavior and the fact that different patients show variable clinical presentations. Annotations of ictal discharges were made with the assist of the open-source software “EDFbrowser.”¹⁹ Four types of EEG montages were available during the visual analysis, including longitudinal bipolar montage, transverse bipolar montage, average montage, and original archived data montage.

The raters annotated ictal discharges and labeled their characteristics duration, certainty, onset location, onset visibility, and morphology patterns according to the predefined criteria shown in Table 1. As NCSE takes a relatively long time to develop and disappear, we set a minimum of 20 s as the duration criterion for the EEG pattern. The presence of ictal discharges was primarily assessed according to the combination of both SCC and the American Clinical Neurophysiology Society's (ACNS) Standardized Critical Care EEG Terminology criteria.^11,12,20 The raters categorized the certainty of their annotations as either definite or possible ictal discharges, and the rest of the recordings was categorized as episodes without ictal discharges. In addition, the ictal discharges were labeled either generalized or focal according to their onset location, and their onset visibility was labeled either sudden or gradual according to the ACNS criteria. Five categories were used to describe the dominant morphology patterns: 3 of 5 categories—“Spike Wave,” “Wave,” and “Fast Spike” pattern—were summarized from several terms in ACNS criteria, and the other 2 empirical categories were added—“Seizure-related EMG Artifacts,”²¹ and “Unknown Type.”

Table 1.

Annotation Criteria of Ictal Discharges.

		Definite ictal discharges	Possible ictal discharges	Not ictal discharges
Duration		≥20 s		<20 s
Certainty		- SW discharges > 2.5 Hz	- SW discharges ≤ 2.5 Hz	Rest EEG activity
		- Other-pattern evolving discharges > 4 Hz	- Other-pattern evolving discharges ≤ 4 Hz
		- Other-pattern evolving discharges > 4 Hz	- RDA > .5Hz
Onset location	Generalized	Occupying > half of the longitudinal bipolar channels
Onset location	Focal	Occupying ≤ half of the longitudinal bipolar channels
Onset visibility	Sudden	Developing from absent ≤ 3 s
Onset visibility	Gradual	Developing from absent > 3 s
Morphology patterns	Spike wave	SW discharges or RDA with superimposed repetitive sharp waves or spikes (RDA + S)
	Wave	RDA
	Fast spike	Spiky or sharp periodic discharges
	Seizure-related EMG artifacts	Electromyography artifacts caused by seizures
	Unknown type	Other patterns than the above 4

Abbreviations: EEG, electroencephalography; EMG, electromyography; RDA, rhythmic delta activity; SW, spike-and-wave or sharp-and-wave.

We summarized the annotated ictal discharges by the 2 raters via an annotation code (Appendix A) and estimated the interrater agreement. Cohen's kappa was calculated to assess the agreement on episodes with and without ictal discharges. Fleiss’ kappa was estimated to assess the agreement on episodes with definite ictal discharges, with possible ictal discharges, and without ictal discharges. The 95% confidence interval (CI) of the kappa statistics were also calculated. The level of the agreement was interpreted according to the suggestions of Landis and Koch.²²

Investigation of Unreliable EEG Interpretations Through Visual Analysis

We applied linear regression models to determine whether the reliability of EEG interpretations, quantified by the interrater agreement, was influenced by the characteristics of ictal discharges and the clinical data of subjects. Two models with Cohen's kappa and Fleiss’ kappa as the dependent variables were fitted. The independent variables were the characteristics of ictal discharges (duration, certainty, onset location, onset visibility, and morphology patterns) and the clinical data (age, sex, intellectual disability level, sleep status, preexisting epileptic encephalopathy, clinical signs during NCSE, and seizure history). The analysis was implemented in SPSS Statistics version 25. A 2-tailed P-value < .05 indicated a significant linear relationship.

Analysis of EEG Misinterpretations Through Visual and Automated Analysis

Comparing the EEG interpretations from the visual and automated analysis can help us point out the hidden pitfalls. Therefore, we developed a customized multimodal viewer (a Matlab graphical user interface shown in Figure 1) that presents the EEG recordings, the annotated ictal discharges by raters, and the EEG signal classification results generated by our in-house automated analysis system. The automated analysis system included preprocessing, feature extraction, and synthetic 3-class classification (more details can be found in Appendix B). The system mainly analyzed features in time–frequency domain and built a synthetic 3-class classifier to classify EEG epochs into 3 categories ictal discharges, suspicious activity, and normal activity. The suspicious activity indicated the misinterpreted EEG signals (signals misclassified as ictal discharges) in the automated analysis. In the lower panel of the multimodal viewer (Figure 1), the distribution of the 3 categories was presented in units of 10 s.

Figure 1.

Viewer for EEG recording and classification results. The upper panel in the viewer presents an EEG recording in the longitudinal bipolar montage. Pink backgrounds indicate ictal discharges. The lower panel shows the stacked percentages of the classification results. Each bin in the bar plot indicates 10 s. The upper and lower panels are linked, and both of them are able to be zoomed in or out. EEG: electroencephalography.

Two epileptologists investigated and discussed the pitfalls of EEG misinterpretations for each subject. They used the multimodal viewer to compare the EEG interpretations through the visual and automated analysis. Meanwhile, they checked the corresponding clinical data and interrater agreement. The pitfalls of EEG misinterpretations in the automated analysis were investigated among the EEG episodes without annotated ictal discharges but automatically classified as definite or suspected ictal discharges. The pitfalls of EEG misinterpretations in the visual analysis were investigated among the EEG episodes with annotated ictal discharges but automatically classified as normal activity.

Results

Subjects

The subject flow through the 3 study phases is shown in a recruitment tree (Figure 2). In the first phase, 2 subjects were excluded, and 2 were moved from the diagnosed NCSE group to the suspected NCSE group. In the second phase, the EEG recordings of 2 subjects in the NCSE group and 9 subjects in the suspected NCSE group did not include any agreed annotated ictal discharges. All 16 subjects in the NCSE group were included in the third phase for the statistical analysis. Fourteen of the 16 subjects were used in the automated EEG analysis system development. In addition, 2, 9, and 5 of the 16 subjects’ EEG recordings in the NCSE group were sampled at 100, 200, and 256 Hz, respectively. In the suspected NCSE group, 1 subject’s recording was sampled at 200 Hz, and the others were at 256 Hz.

Figure 2.

Recruitment tree.

In the first phase, the median age of the 16 NCSE subjects was 21 years, ranging from 6 to 43 years, and the median age of the 12 suspected NCSE subjects was 19 years, ranging from 4 to 61 years. Figure 3 presents an overview of the demographics and the clinical characteristics of the subjects. Of note, 2 of 16 NCSE subjects had preexisting epileptic encephalopathy, whereas in the suspected NCSE group, the subjects with and without preexisting epileptic encephalopathy were equally distributed. Moreover, the EEG recording duration in the suspected NCSE group is generally shorter than that in the NCSE group. A more comprehensive list of the clinical signs, seizure histories, and other characteristics of individual NCSE and suspected NCSE subjects are provided in Appendix C.

Figure 3.

The overview of the demographics and the clinical characteristics of the subjects in the NCSE and suspected NCSE groups.

Interrater Agreement of Visual EEG Interpretations

In the NCSE group, the interrater agreement for both 2 categories (episodes with ictal discharges and without ictal discharges) and 3 categories (episodes with possible ictal discharges, with definite ictal discharges, and without ictal discharges) was moderate, with Cohen's kappa = .53% and 95% CI [0.37, 0.69], and Fleiss’ kappa = .41% and 95% CI [0.25, 0.57], respectively. The interrater agreement of the individual subjects are shown in Appendix D. In the suspected NCSE group, the interrater agreement was poor (Cohen's kappa = 0; Fleiss’ kappa = −.08); hence, we did not further analyze the EEG recordings in this group.

Annotated Ictal Discharges in the NCSE Group

In the NCSE group, 338 ictal discharges were annotated among ∼183 h of EEG recordings. The annotated ictal discharges lasted for ∼14.7 h in total. The ictal discharges were summarized (Figure 4) according to their characteristics the certainty, onset location, onset visibility, and morphology patterns. The definite and possible ictal discharges each accounted for similar proportions. With respect to the onset location, generalized ictal discharges reached major proportions. In addition, the ictal discharges with a sudden onset, developing from absent in less than or equal to 3 s, accounted for a slightly higher proportion than the ictal discharges with a gradual onset, developing from absent in <3 s. Morphologically, the vast majority (66%) of the ictal discharges had a “Spike Wave” pattern.

Figure 4.

The number of the ictal discharges categorized by their characteristics.

Pitfalls of Unreliable EEG Interpretations Through Visual EEG Analysis

Linear models showed a significant relationship between the average duration of the ictal discharges with a gradual onset and interrater agreement measured by the kappa statistics. For Cohen's kappa, β = .001, F(1,14) = 10.861, P = .005, and the independent variable (the average duration) explained 43.7% of the variability. For Fleiss's kappa, β = .001, F(1,14) = 12.89, P = .003, and the independent variable explained 44.2% of the variability. In other words, an extra 2 min of the ictal discharges with a gradual onset contributed to an increase in the kappa statistics of > 0.1. This implies that human raters interpreted ictal discharges with a gradual onset less reliably when the duration was shorter. Using a short duration criterion in annotating these ictal discharges could be a pitfall in visual EEG analysis (Table 2).

Expert Opinion of the Reasons of Misinterpretations by Visual and Automated EEG Analysis

The epileptologists summarized the pitfalls of EEG misinterpretations using the multimodal viewer. The pitfalls were the misinterpretation of the following:

- abnormal background activity (Figure 5A to C),

- continuous interictal discharges (Figure 5D),

- continuous short ictal discharges (Figure 5E) whose durations were shorter than 20 s.

Figure 5.

Abnormal background activity. (A) Slow wave activities marked by an arrow. (B) Other abnormal brain activity. (C) Ictal-like movement artifacts. (D) Several interictal discharges. The onsets of the interictal discharges are marked by arrows. (E) Short ictal discharges. The onsets of 2 short ictal discharges are labeled by arrows.

Table 2.

Pitfalls in Electroencephalography (EEG) Interpretations.

Pitfalls of unreliable EEG interpretations through visual analysis

Using a short duration criterion in annotating ictal with a gradual onset

Pitfalls of EEG over-interpretations

Misinterpretation of abnormal background activity:

- Misinterpretation of slow wave activities observed in a dysfunctional brain or in a drowsy stage.

- Assuming that the EEG background of individual subjects was consistently normal, and over-interpreting the abnormalities as ictal.

- Misinterpretation of the envelope of ictal-like movement artifacts leads to false alarms in computer-assisted EEG analysis.

Misinterpretation of continuous interictal discharges

Misinterpretation of continuous short ictal discharges

The abnormal background activity was categorized into 3 types slow wave activities (Figure 5A) regularly observed in a dysfunctional brain or in a drowsy stage, other abnormal brain activity (Figure 5B) whose appearance was subject-dependent, and ictal-discharge-like movement artifacts caused by rhythmic movements, such as repetitive chewing movements (Figure 5C). The pitfalls of misinterpretations are summarized in Table 2, and the remarks by the epileptologists are provided in Appendix E.

Discussion

A reliable and correct EEG interpretation to diagnose NCSE is currently still difficult from visual as well as automated analysis.^5,18,23 In this retrospective study, we visually and automatically analyzed NCSE-EEG recordings, and the interrater agreement in the NCSE group was moderate (Cohen's kappa = 0.53 and Fleiss’ kappa = 0.41), consistent with the findings by Goselink et al.⁵ We found that using a short duration criterion for ictal discharges with a gradual onset contributed to an unreliable EEG interpretation. Moreover, we pointed out other factors for EEG misinterpretation: abnormal background activity, continuous interictal discharges, and continuous short ictal discharges, which extended the findings of a previous study.¹⁰

One pitfall was to use a short ictal duration criterion for ictal discharges with a gradual onset. In this study, we set 20 s as the duration criterion for ictal discharges, but even then the interrater agreement was still low. The 10-s criterion in SCC,¹² defined according to commonly used EEG reading duration via software, could be too short to support the reliability of visual EEG interpretations in clinical practice. To increase the reliability of NCSE diagnosis and conform to the natural course of the disease, a longer duration criterion can be recommended in future, especially when EEG-readers rate ictal discharges with a gradual onset. However, using a too long duration criterion might increase the risk of ignoring intervals carrying essential information. Further research should be undertaken into optimal length. Until now, automated EEG analysis algorithms for NCSE have regularly used short (eg, 3 s) EEG signals as a classification epoch, but the epoch duration is too short to be used in reliably detecting the ictal discharges for NCSE diagnosis according to the earlier discussion. To be consistent with the way clinicians diagnose NCSE, future studies about automated EEG analysis algorithms should focus on ictal discharge detection using longer-duration EEG epochs. Moreover, other signals, such as electrocardiography (ECG) and respiratory signals, also contribute to the detection performance of ictal discharges.²⁴ A multimodal analysis of polygraphy signals: EEG, ECG, and respiratory patterns to increase the reliability of NCSE diagnosis in short ictal discharges should be further investigated.

The pitfalls of EEG misinterpretations in both visual and automated analysis were misinterpreting the following as ictal discharges: (1) abnormal background activity ([a] slow wave activities, [b] other abnormal brain activity, and [c] the ictal-like movement artifacts), (2) continuous interictal discharges, and (3) continuous short ictal discharges.

(1) For the 3 types of activities of the abnormal background activity.

Slow-wave activities are frequently observed in a damaged brain (eg, in epileptic encephalopathies) or during drowsiness. In visual analysis, EEG readers with insufficient training in reading EEGs from a dysfunctional brain or sleep-EEG may misinterpret the EEG.¹⁸ In automated analysis, slow-wave activities and ictal discharges could be confused because their frequency bands are similar. An advanced signal processing technique, such as extracting features in the morphological besides the time–frequency domain features,²⁵ may be helpful in their distinction in future studies.

The other abnormal brain activity is individually variable and can be avoided by the use of historical EEG data. Its misinterpretation (false alarms) in automated analysis was also mentioned in the previous studies.^8,9

The ictal-like movement artifacts could be misinterpreted in automated analysis when their repetitive movements have a similar frequency band as ictal discharges. The low-pass filter of the analysis algorithms helps filter out high-frequency components caused by muscle activities but keeps the envelope of signals caused by the repetitive movements.

In summary, to avoid misinterpretation of abnormal background activity, we suggest reading more EEG recordings from the same subject to help human raters better recognize subject-specific ictal discharges and individualizing automated analysis algorithms.

(2) Interictal discharges are not always clearly distinct from ictal discharges, and misinterpretation of continuous interictal discharges occurs especially in patients with encephalopathy.¹⁰ The duration and presence of repetitive spiking or bursting activity cannot be the only criteria to identify interictal discharges by EEG readers.²⁶ Further investigation of criteria for interictal discharges is needed.

(3) High concentrations of short ictal discharges can be observed in the EEG recording of a subject presenting many short and unstable epileptic activities. Raters with hyper-sensitivity may misinterpret them as ictal discharges. We would suggest that EEG readers carefully interpret such EEG recordings and consult other readers if in doubt. In addition, we recommend tuning alarm thresholds according to subject-dependent clinical practice in the automated EEG analysis for these particular recordings.

One unanticipated finding is that the interrater agreement in the suspected NCSE group was poor. Based on our previous discussions and the clinical data of the suspected NCSE subjects, we could assume that 2 factors may explain the unreliable EEG interpretations in this group. (1) Almost all the recordings were <1 h, and the raters may not have had enough EEG recordings from the same subject to correctly distinguish ictal discharges from the abnormal background activity. (2) Half of the subjects had preexisting epileptic encephalopathy. The slow wave activities and the interictal discharges in the subjects with encephalopathy were probably misinterpreted as ictal discharges. Additional studies are needed to confirm the causes of the poor interrater agreement in the EEG interpretations of patients with suspected NCSE.

This study has several limitations. Given that the number of recordings from patients with NCSE at Kempenhaeghe is relatively small, we also included several discontinuous archived EEG recordings. These discontinuous recordings may hinder human readers and automatic algorithms from correctly interpreting EEG. Continuous recordings from more data sources should be used in future. The EEG recordings were acquired by 3 systems, and their sampling rates were different (the lowest sampling rate was 100 Hz [n = 2]). The heterogeneity of the sampling rate was not expected to affect our results, such as the problem of the aliasing, because the frequency band of interest, such as the frequency range occupied by Spike Wave and Wave patterns, is much lower than 50 Hz. Nevertheless, future works should be undertaken to further confirm the influence of the different system hardware and setting-up on our results. Given that this is an explorative study, the number of recruited subjects (n = 30), EEG readers (n = 2), and research centers (n = 1) was small; hence, the generalization of the conclusions is limited. In addition, given that our study is explorative and a large population of the patient requires a large sample size, the subjects included in this study were outpatients with chronic seizures and brain development disorders, and their age ranged between 4 and 61 years; thus, the conclusions do not extend beyond this population. Future work should include more subjects, especially those of neonatal age, elderly patients, patients without preexisting epilepsy, and ICU patients, and more EEG readers from different research centers for generalizability. In the development of the automated EEG analysis algorithm, we primarily used time–frequency domain features, which limited our conclusion of the pitfalls in the automated analysis. In future, morphological features should be added to the automated analysis.

Conclusion

We visually and automatically analyzed NCSE-EEG recordings to explore the causes of EEG misinterpretations. To avoid the pitfalls in NCSE-EEG analysis, a longer duration criterion than the one suggested by the Salzburg criteria is recommended. Using knowledge of historical EEGs, individualized algorithms, and context-dependent alarm thresholds may also avoid mistakes.

Supplemental Material

sj-docx-1-eeg-10.1177_15500594211050492 - Supplemental material for Pitfalls in EEG Analysis in Patients With Nonconvulsive Status Epilepticus: A Preliminary Study

Supplemental material, sj-docx-1-eeg-10.1177_15500594211050492 for Pitfalls in EEG Analysis in Patients With Nonconvulsive Status Epilepticus: A Preliminary Study by Ying Wang, Ivan C. Zibrandtsen, Richard H. C. Lazeron, Johannes P. van Dijk, Xi Long, Ronald M. Aarts, Lei Wang and Johan B. A. M. Arends in Clinical EEG and Neuroscience

Footnotes

Author Contributions

1. Research project: A. Conception, B. Organization, C. Execution; 2. Statistical Analysis: A. Design, B. Execution, C. Review and Critique; 3. Manuscript Preparation: A. Writing of the first draft, B. Review and Critique;

Ying Wang contributed to 1A, 1B, 1C, 2A, 2B, 2C, 3A, and 3B.

Ivan C Zibrandtsen contributed to 1C, 2C, and 3B.

Richard HC Lazeron contributed to 1A, 2C, and 3B.

Johannes P van Dijk contributed to 1A, 2C, and 3B.

Xi Long contributed to 3B.

Ronald M Aarts contributed to 3B.

Lei Wang contributed to 3B.

Johan BAM Arends contributed to 1A, 1B, 2A, 2C, and 3B.

Declaration of Conflicting Interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work is part of the research program BrainWave with project number 14714, which is (partly) financed by the Netherlands Organization for Scientific Research (NWO). This work was supported by the Stichting voor de Technische Wetenschappen (grant number 14714).

Ethical Approval

This is a retrospective explorative study approved by the Medical Research Ethics Committee of Kempenhaeghe in the Netherlands.

Informed Consent

We included subjects <65 years and excluded EEG recordings with excessive artifacts and those of subjects from whom we did not receive permission (from themselves and/or their legal guardians) to use their recordings for scientific research.

ORCID iDs

Ying Wang

Ivan C. Zibrandtsen

Richard H. C. Lazeron

Supplemental Material

Supplemental material for this article is available online.

References

Trinka

Cock

Hesdorffer

, et al. A definition and classification of status epilepticus - report of the ILAE task force on classification of Status epilepticus. Epilepsia. 2015;56(10):1515-1523. https://doi.org/10.1111/epi.13121

Stroink

Schimsheimer

R-J

de Weerd

, et al. Interobserver reliability of visual interpretation of electroencephalograms in children with newly diagnosed seizures. Dev Med Child Neurol. 2006;48(05):374. https://doi.org/10.1017/S0012162206000806

Grant

Abdel-Baki

Weedon

, et al. EEG Interpretation reliability and interpreter confidence: a large single-center study. Epilepsy Behav. 2014;32:102-107. https://doi.org/10.1016/j.yebeh.2014.01.011

Ronner

Ponten

Stam

Uitdehaag

BMJ

. Inter-observer variability of the EEG diagnosis of seizures in comatose patients. Seizure. 2009;18(4):257-263. https://doi.org/10.1016/j.seizure.2008.10.010

Goselink

RJM

van Dillen

Aerts

, et al. The difficulty of diagnosing NCSE in clinical practice; external validation of the salzburg criteria. Epilepsia. 2019;60(8):e88-e92. https://doi.org/10.1111/epi.16289

Sackellares

Shiau

D-S

Halford

LaRoche

Kelly

. Quantitative EEG analysis for automated detection of nonconvulsive seizures in intensive care units. Epilepsy Behav. 2011;22:S69-S73. https://doi.org/10.1016/J.YEBEH.2011.08.028

Sharma

Khan

Farooq

Tripathi

Adeli

. A wavelet-statistical features approach for nonconvulsive seizure detection. Clin EEG Neurosci. 2014;45(4):274-284. https://doi.org/10.1177/1550059414535465

Aldana

Hunyadi

Reyes

EJM

Rodriguez

Van Huffel

. Nonconvulsive epileptic seizure detection in scalp EEG using multiway data analysis. IEEE J Biomed Heal Informatics. 2019;23(2):660-671. https://doi.org/10.1109/JBHI.2018.2829877

Khan

Farooq

Tripathi

Sharma

Alam

. Automatic detection of non-convulsive seizures using AR modeling. 2012 2nd International Conference on Power, Control and Embedded Systems; IEEE. 2012:1-4. Available at: http://ieeexplore.ieee.org/document/6508099/ (accessed April 3, 2019).

10.

Gaspard

Hirsch

. Pitfalls in ictal EEG interpretation. Neurology. 2013;80(Supplement 1):S26-S42. https://doi.org/10.1212/WNL.0b013e31827974f8

11.

Beniczky

Hirsch

Kaplan

, et al. Unified EEG terminology and criteria for nonconvulsive status epilepticus. Epilepsia. 2013;54(Suppl. 6):28-29. https://doi.org/10.1111/epi.12270

12.

Leitinger

Beniczky

Rohracher

, et al. Salzburg consensus criteria for Non-convulsive Status epilepticus – approach to clinical application. Epilepsy Behav. 2015;49:158-163. https://doi.org/10.1016/j.yebeh.2015.05.007

13.

Leitinger

Trinka

Gardella

, et al. Diagnostic accuracy of the salzburg EEG criteria for non-convulsive status epilepticus: a retrospective study. Lancet Neurol. 2016;15(10):1054-1062. https://doi.org/10.1016/S1474-4422(16)30137-5

14.

Krogstad

Høgenhaven

Beier

Krøigård

. Nonconvulsive Status epilepticus: validating the salzburg criteria against an expert EEG examiner. J Clin Neurophysiol. 2019;36(2):141-145. https://doi.org/10.1097/WNP.0000000000000556

15.

Goselink

RJM

Dillen

Zwarts

Alfen

. Response: the difficulty of diagnosing nonconvulsive status epilepticus in clinical practice. Epilepsia. 2019;60(11):2337-2338. https://doi.org/10.1111/epi.16365

16.

Leitinger

Trinka

Zimmermann

Beniczky

. Salzburg criteria for nonconvulsive status epilepticus: details matter. Epilepsia. 2019;60(11):2334-2336. https://doi.org/10.1111/epi.16361

17.

Benbadis

. The tragedy of over-read EEGs and wrong diagnoses of epilepsy. Expert Rev Neurother. 2010;10(3):343-346. https://doi.org/10.1586/ern.09.157

18.

Arends

van der Linden

Ebus

Debeij

Gunning

Zwarts

. Value of re-interpretation of controversial EEGs in a tertiary epilepsy clinic. Clin Neurophysiol. 2017;128(4):661-666. https://doi.org/10.1016/J.CLINPH.2016.12.010

19.

van Beelen

. EDFbrowser. Available at: https://www.teuniz.net/edfbrowser/index.html. Published 2018 (accessed August 1, 2018).

20.

Hirsch

LaRoche

Gaspard

, et al. American Clinical neurophysiology Society's Standardized critical care EEG terminology. J Clin Neurophysiol. 2013;30(1):1-27. https://doi.org/10.1097/WNP.0b013e3182784729

21.

Wang

Arends

JBAM

Long

Cluitmans

PJM

van Dijk

. Seizure pattern-specific epileptic epoch detection in patients with intellectual disability. Biomed Signal Process Control. 2017;35:38-49. https://doi.org/10.1016/j.bspc.2017.02.008

22.

Landis

Koch

. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159-174. https://doi.org/10.2307/2529310

23.

Williams

Lüders

Brickner

Goormastic

Klass

. Interobserver variability in EEG interpretation. Neurology. 1985;35(12):1714-1719. Available at: http://www.ncbi.nlm.nih.gov/pubmed/4069362 (accessed March 8, 2019).

24.

Jeppesen

Fuglsang-Frederiksen

Johansen

, et al. Seizure detection based on heart rate variability using a wearable electrocardiography device. Epilepsia. 2019;60(10):2105-2113. https://doi.org/10.1111/epi.16343

25.

Wang

Long

van Dijk

Aarts

Wang

Arends

JBAM

. False alarms reduction in non-convulsive status epilepticus detection via continuous EEG analysis. Physiol Meas. 2020;41(5):055009. https://doi.org/10.1088/1361-6579/ab8cb3

26.

Fisher

Scharfman

DeCurtis

. How Can We identify ictal and interictal abnormal activity? In: Scharfman

Buckmaster

, eds. Issues in Clinical Epileptology: A View from the Bench. Advances in Experimental Medicine and Biology. Springer; 2014:3-23. Available at: http://link.springer.com/10.1007/978-94-017-8914-1_1 (accessed April 15, 2019).

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

1.00 MB