Abstract
Background
Clinicians appear to obtain emergent neuroimaging for children with headaches based on the presence of red flag findings. However, little data exists regarding the prevalence of these findings in emergency department populations, and whether the identification of red flag findings is associated with potentially unnecessary emergency department neuroimaging.
Objectives
We aimed to determine the prevalence of red flag findings and their association with neuroimaging in otherwise healthy children presenting with headaches to the emergency department. Our secondary aim was to determine the prevalence of emergent intracranial abnormalities in this population.
Methods
A prospective cohort study of otherwise healthy children 2–17 years of age presenting to an urban pediatric emergency department with non-traumatic headaches was undertaken. Emergency department physicians completed a standardized form to document headache descriptors and characteristics, associated symptoms, and physical and neurological exam findings. Children who did not receive emergency department neuroimaging received 4-month telephone follow-up. Outcomes included emergency department neuroimaging and the presence of emergent intracranial abnormalities.
Results
We enrolled 224 patients; 197 (87.9%) had at least one red flag finding on history. Several red flag findings were reported by more than a third of children, including: Headache waking from sleep (34.8%); headache present with or soon after waking (39.7%); or headaches increasing in frequency, duration and severity (40%, 33.1%, and 46.3%). Thirty-three percent of children received emergency department neuroimaging. The prevalence of emergent intracranial abnormalities was 1% (95% CI 0.1, 3.6). Abnormal neurological exam, extreme pain intensity of presenting headache, vomiting, and positional symptoms were independently associated with emergency department neuroimaging.
Conclusions
Red flag findings are common in children presenting with headaches to the emergency department. The presence of red flag findings is associated with emergency department neuroimaging, although the risk of emergent intracranial abnormalities is low. Many children with headaches may be receiving unnecessary neuroimaging due to the high prevalence of non-specific red flag findings.
Keywords
Introduction
Background
More than 400,000 children present annually to emergency departments (EDs) in the US with a chief complaint of headache, comprising approximately 1% of ED visits (1–3). Most of these children have headaches that are primary (e.g. migraines), or secondary to conditions such as respiratory infections (2–4). A small but meaningful proportion (0.5–1.0%) are associated with intracranial abnormalities requiring emergent identification, such as brain tumors, intracranial hemorrhages, or strokes (2,5–7).
Although emergent intracranial abnormalities are uncommon, clinicians in the ED obtain computed tomography (CT) or magnetic resonance imaging (MRI) scans for as many as 36% of these children (1). The overuse of CT exposes children to unnecessary radiation, with an estimated rate of inducing lethal malignancies between 1 in 1000 and 1 in 5000 CT scans (8,9). MRI, which has become increasingly utilized in US EDs, may require procedural sedation with its associated risks, including growing concerns that anesthetics and sedatives may be harmful to the developing brain (10–17). Finally, unnecessary neuroimaging may also identify inconsequential findings that lead to unnecessary testing and interventions, and unwarranted patient and parental concerns (18).
Importance
ED clinicians likely obtain emergent neuroimaging for children with headaches based on the presence of red flag findings, such as early-morning headaches or vomiting, that have been associated with the presence of emergent intracranial abnormalities (19–23). However, these red flag findings were identified primarily from retrospective studies of children already diagnosed with intracranial abnormalities (4,6,24–36). Little prospective data exists on the prevalence of red flag findings in well-defined ED populations of otherwise healthy children with headaches. If the prevalence of red flag findings being used to prompt ED neuroimaging is significantly greater than that of emergent intracranial abnormalities, and these red flag findings are associated with ED neuroimaging, there may be the need to reconsider how or which red flag findings are used for decision-making in order to reduce unnecessary neuroimaging in children.
Goals of this investigation
We aimed to determine the prevalence of red flag findings and the association between clinical variables and ED neuroimaging in otherwise healthy children presenting with headaches to the ED. Our secondary aim was to determine the prevalence of emergent intracranial abnormalities in a well-described population of children. Finally, we explored the reasons endorsed by physicians for obtaining ED neuroimaging for children with headaches.
Methods
Study design and setting
We conducted a prospective cohort study in an urban pediatric ED with an annual census of approximately 55,000 visits. The institutional review board approved this study with waiver of informed consent for collection of ED data. We obtained verbal consent for completion of telephone follow-up.
Selection of participants
From October 2015 to April 2017, we enrolled children 2 to 17 years of age. Children were eligible if they presented with a headache as their chief complaint, or if headache was identified on review of systems and was of concern to the clinician, such that a consultation by a neurologist was obtained or recommended, neuroimaging (cranial CT or MRI) was completed in the ED or recommended as an outpatient, or outpatient follow-up with a neurologist or primary care physician for headache evaluation was recommended.
We excluded children if they had a documented temperature of ≥38℃ in the ED or at home; neuroimaging (cranial CT or MRI) prior to their index ED visit; an abnormal baseline neurological exam; or any history of intracranial surgery, structural abnormalities, or other chronic condition that was a clear risk factor for an intracranial abnormality including, but not limited to: sickle cell disease; immunocompromised state; history of, or current, neoplasm or any intracranial lesion or shunt; collagen vascular disease; coagulopathy or currently taking an anticoagulant; history of pseudotumor cerebri; known pregnancy. We also excluded patients with a head injury in the past 7 days or if previously enrolled in the study.
Procedures
A pediatric emergency medicine attending or fellow or a general pediatrician attending completed a standard case report form for each eligible patient (Supplemental Figure). Forms were completed prior to ED neuroimaging, if obtained. The decision to obtain ED neuroimaging was at the discretion of the attending physician caring for the patient. Patients for whom ED neuroimaging was not completed received a follow-up telephone call 4 months after their index ED visit to assess for emergent intracranial abnormalities. Parents were asked for details regarding any interim outpatient neuroimaging, neurosurgical intervention, interventional radiologic procedure, or medical intervention (e.g. chemotherapy, fibrinolytic therapy).
For patients who had neither ED neuroimaging nor telephone follow-up completed, we reviewed medical and radiological records 6 months after their index ED visit to evaluate for completion of any neuroimaging, neurosurgical interventions, interventional radiologic procedures, or medical interventions. Patients with emergent intracranial abnormalities identified during the 6-month review were included in determination of emergent intracranial abnormality prevalence. Patients were considered lost to follow-up if they did not undergo ED neuroimaging, the 4-month follow-up telephone call was incomplete, and no emergent intracranial abnormality was identified by the 6-month medical and radiological review. Enrolled patients lost to follow-up (i.e. no outcome determined) were not included in the determination of emergent intracranial abnormality prevalence.
We identified eligible but not enrolled (i.e. missed eligible) patients by reviewing the electronic health record, using ICD-9 and ICD-10 codes with a headache or headache-related diagnosis, and for diagnoses that were considered relevant intracranial findings (Supplemental Table 1). If eligible, data was collected to compare the missed eligible patients to those enrolled, including whether ED neuroimaging was obtained, neuroimaging results, and ED disposition.
ED data collected
Clinical findings from the history and physical were documented for each patient. These findings were chosen to include common headache-related variables and red flag findings described in prior literature and guidelines, and in consultation with two pediatric neurologists with specific expertise in childhood headaches (19–23). For patients who received neuroimaging, physicians were asked to document in free-text their reason(s) for ordering the test.
Outcomes
The primary outcome was completion of ED neuroimaging (cranial CT or MRI). The secondary outcome was the presence or absence of an emergent intracranial abnormality. A priori, we defined intracranial abnormalities based on an iterative consensus process involving a group of seven pediatric emergency medicine physicians, five pediatric neurosurgeons, and four pediatric neurologists from five geographically distinct tertiary pediatric hospitals across the US. Supplemental Table 1 describes the four clinically-oriented categories resulting from this consensus process: Emergent intracranial abnormalities; serious intracranial abnormalities; incidental intracranial abnormalities; and pseudotumor cerebri. Patients with documented sinus changes or disease were not categorized as having an intracranial finding.
An emergent intracranial abnormality was defined as an intracranial finding for which, if identified in the ED, one of the following interventions would be indicated at that time: a) A surgical intervention; b) a medical intervention; or c) hospital admission to monitor for potential clinical deterioration, to obtain additional diagnostic evaluation (e.g. imaging, biopsy), or to perform a planned intervention specifically related to the intracranial abnormality. In order for a diagnosis to be considered an emergent intracranial abnormality, >70% of the consensus working group had to classify the finding as emergent. For those patients who had no CT or MRI performed in the ED or within the 4-month follow-up period, we defined the absence of an emergent intracranial abnormality as not having a neurosurgical intervention, interventional radiologic procedure, or medical intervention (e.g. chemotherapy, fibrinolytic therapy) performed for an intracranial abnormality when assessed at 4 months after the index ED visit.
A serious intracranial abnormality was defined as an intracranial finding that is typically asymptomatic but has the potential to be the cause of a headache (depending on characteristics such as size or location of the finding) and, therefore, may potentially require emergent intervention. An incidental intracranial abnormality was defined as an intracranial finding that did not require immediate intervention, may or may not require outpatient follow up, and would be unlikely to be the cause of a headache. Although termed “incidental” in accordance with prior literature, these findings may still be concerning to patients and families (18). Supplemental Table 1 lists the specific findings on CT or MRI assigned to each clinically-oriented category.
Patients diagnosed with pseudotumor cerebri were classified as their own category because, even though its identification in the ED would prompt an intervention at that time, the diagnosis cannot typically be made by neuroimaging alone. Rather, opening pressures obtained by lumbar puncture are required, and since our patients would not be routinely receiving lumbar punctures and follow-up would not rule out the presence of pseudotumor cerebri, this diagnosis could not be reliably classified as an emergent intracranial abnormality.
Analyses
We used proportions to describe the prevalence of headache red flag findings. We calculated relative risks with 95% CIs and conducted standard bivariable analyses, appropriate for variable type and distribution, to identify clinical findings associated with patients receiving ED neuroimaging. In addition to assessing all findings individually, a priori we grouped specific findings from patient history and physical examination into clinically-relevant composite categories that reflected a specific disease (e.g. subarachnoid hemorrhage), a common underlying pathophysiology (e.g. positional symptoms), or that were conceptually similar (e.g. extreme pain intensity of presenting headache, change in headache characteristic). Individual red flag findings that were not related to other findings in these ways were analyzed on their own (e.g. occipital location of headache). Supplemental Table 2 shows the specific findings grouped into each category. No single finding was included in more than one category. We also created a category of “possible migraine headache” by using the higher-sensitivity version of the Irma Criteria (i.e. requiring three out of six migraine criteria) (37).
We conducted logistic regression analyses using the clinically-relevant categories of patient history and physical examination to identify factors independently associated with ordering ED neuroimaging. The categories were used instead of individual variables in order to accommodate a reasonable number of factors in the regression analyses. All variables analyzed were categorical. We conducted backward stepwise regression with confirmation using forward stepwise regression. We included variables that had plausible association with the outcome and had potential association (p < 0.1) on bivariable analysis. We removed from the final model those variables with p > 0.05. We assessed for multicollinearity of variables using variance inflation factors and model goodness-of-fit based on the Hosmer-Lemeshow test. We aimed to include in the models a maximum of one variable for every 10 patients who had ED neuroimaging. Finally, we summarized clinicians’ free-text reasons for obtaining CTs and used descriptive statistics to describe the results. We conducted all statistical analyses using SPSS (version 24; IBM Corporation, Armonk, NY).
Results
Characteristics of study subjects
Patient characteristics and clinical management (n = 224).
These age groupings were chosen to show the number of children that would be considered at higher risk of emergent intracranial abnormality due to young age, based on different age cutoffs that have been described in the literature.
Patients may have taken more than one type of analgesic.
Only includes patients who did not receive neuroimaging in the ED and completed follow up (n = 125).
IQR: interquartile range; CT: computed tomography; MRI: magnetic resonance imaging; PICU: pediatric intensive care unit.

Patient enrollment.
Headache characteristics: Bivariable association with receiving ED neuroimaging.
Presenting and/or prior headaches.
Only includes patients who have had more than one headache in their life (n = 160).
Chronic progressive temporal pattern is defined as headaches that gradually increase in frequency and severity over time (21).
Main results
Headache-related symptoms and characteristics: Bivariable association with receiving ED neuroimaging.
Associated with presenting and/or prior headaches.
Within the past 6 months of index ED visit.
This variable was not collected until starting with patient 74.
General physical and neurological examination findings: Bivariable association with receiving ED neuroimaging.
This variable was not collected until starting with patient 74.
Clinically-relevant composite categories of variables from patient history and examination: Bivariable association with receiving ED neuroimaging.
A symptom such as headache or vomiting that changes or is associated with a change in position, or prolonged supine position.
Unsure and missing variables from individual findings were combined when categories created, and all analyzed as missing.
p < 0.05.
There were 74 (33%) children with headaches who received ED neuroimaging, with 68.9% of studies obtained being MRIs. Of the 197 patients with at least one red flag finding on history, 73 (37.6%) received ED neuroimaging. Of the 27 patients with no red flag findings on history, only one received ED neuroimaging. Twenty patients had an abnormal neurological exam and 16 (80%) of them received ED neuroimaging. There were 58 (25.9%) patients with no abnormal neurological findings who received ED neuroimaging; all of these patients had at least one red flag finding on history.
Clinically-relevant composite categories of variables from patient history and examination independently associated with ED neuroimaging (p < 0.05) 1 .
Categories analyzed in the model were: Abnormal neurological exam finding (other than altered mental status); neurological or neurocognitive dysfunction; change in headache characteristics; extreme pain intensity of presenting headache; positional symptoms; symptoms concerning for subarachnoid hemorrhage; Valsalva- or exertion-related symptoms; vomiting (any); headache duration ≤1 day; and headache duration >1 week (see Supplemental Table 2 for specific red flag findings in each category).
A symptom such as headache or vomiting that changes or is associated with a change in position, or prolonged supine position.
Two (1%, 95% CI 0.1, 3.6) patients were diagnosed with emergent intracranial abnormalities; their findings are detailed in Supplemental Table 5. One of the patients (Patient #2) was diagnosed with a complex migraine headache at her index ED visit and did not receive emergent neuroimaging. She was discharged with a plan to attend outpatient neurology follow-up and neuroimaging. She returned to the ED prior to her appointments with a focal seizure, with neuroimaging at that time identifying the lesion. There were three patients (1.5%) with serious intracranial abnormalities, 14 (7%) with incidental intracranial abnormalities, and two (1%) with pseudotumor cerebri (Supplemental Table 6).
Of the 74 children who underwent ED neuroimaging, physicians documented their reasons for ordering emergent neuroimaging for 55 (Supplemental Table 7). Fifty-two of the 55 (94.5%) underwent ED neuroimaging because of a concerning history, with the most common reasons being headaches that awoke the patient from sleep (46.1%), headaches present in the morning or with waking (26.9%) or headaches of increasing frequency (19.2%).
Discussion
In this prospective study, previously identified red flag findings were present in the majority of children assessed in the ED for headaches and were associated with obtaining ED neuroimaging. The frequency of red flag findings was in contrast to the rarity of emergent intracranial abnormalities in this well-described population. Our findings highlight the need to more clearly understand how or which red flag findings should be used to decide whether emergent neuroimaging is indicated.
Red flag findings are the foundation of existing guidelines and recommendations regarding the use of neuroimaging. However, there is no clear consensus on which findings should be used for decision-making, resulting in a large number of findings proposed to be concerning enough to warrant emergent neuroimaging. For instance, authoritative groups such as the American Academy of Neurology, the Child Neurology Society, and the American College of Radiology have recommended neuroimaging for a host of findings, including: The presence of an abnormal neurological exam; concurrent seizures; recent or sudden onset of severe headache; change in type of headache, including increasing frequency, duration and intensity; headaches with associated neurological dysfunction; headaches that awaken a child from sleep or occur on arising; intense, prolonged, and incapacitating headaches with an absent family history for migraine; and vomiting (19,20). Other recommendations include obtaining neuroimaging for children younger than 6 years old, progression of symptoms for less than 2 months, an inability to describe the quality of pain, headaches of occipital location, recent or sudden onset (i.e. thunderclap) or that are of a concerning pattern (i.e. precipitated by Valsalva maneuver, positional, progressive), or if there is no family history of a primary headache disorder (21–23). Given the high prevalence in our study of children having at least one of these findings, the substantial proportion that had ED neuroimaging might be expected. Specific red flag findings (such as headache that wakes from sleep) were also commonly cited as reasons for ordering ED neuroimaging.
The presence of an abnormal neurological examination is also considered a red flag finding in a child with headache, and an indication for emergent neuroimaging (19–23). Although a normal neurological exam was common in our population, it did not appear reassuring enough for clinicians to forego ED neuroimaging when other red flag findings were present on history. One potential explanation could be clinician concern that abnormal neurological findings in a child with an emergent intracranial abnormality might be a later development, following the initial endorsement of headache and red flag findings on history (33,38). Additionally, clinicians were frequently “unsure” of the presence or absence of important exam findings, such as papilledema. The high rates of unsure status may also reflect the challenge faced in an ED setting, when children with headaches may be too symptomatic or too young to comply with a complete neurological exam.
Interestingly, the prevalence of emergent intracranial abnormalities we observed (1%) appears on initial review to be lower than the 3% to 8.1% reported in prior studies of children presenting to EDs with non-traumatic headaches (3,4,6,7,39,40). However, prior studies often failed to exclude patients with fever, known intracranial abnormalities (e.g. VP shunts), or risk factors for intracranial abnormalities. These studies also did not differentiate their findings into categories such as emergent intracranial abnormality, serious intracranial abnormalities, incidental intracranial abnormalities, and pseudotumor cerebri, which are important distinctions to front-line clinicians. Using our definition of emergent intracranial abnormalities, the prevalence of emergent intracranial abnormalities in all but one of these studies decreased to 0.3% to 1% (3,6,7,39,40). The one differing study did not state whether patients with underlying risk factors or prior intracranial abnormalities were excluded (4).
Our results strongly suggest the need to conduct large prospective studies with sufficient numbers of patients to enable accurate stratification of the risk of emergent intracranial abnormalities based on specific key findings from patient history and physical examination. The association between clinical findings and emergent intracranial abnormalities in children with headaches has mainly been derived from retrospective studies of children with known intracranial abnormalities (26,27,32,33,41–43). The relative lack of prospective studies of sufficient rigor and sample size was recognized more than a decade ago by the American Academy of Neurology and the Child Neurology Society, and more recently by the Society for Academic Emergency Medicine (19,44).
Finally, the use of neuroimaging in our study was at the higher end of the 6.3% to 41% range noted in prior studies of children evaluated in both general and pediatric EDs with headaches (1–3,5–7,39,45,46). One possible reason for the broad range of estimates is the different inclusion and exclusion criteria among the studies. This variability in ED neuroimaging could also reflect specific institutional protocols, local variations in practice, or differences in availability of resources for outpatient follow-up or neuroimaging.
Limitations
Our study was a convenience sample and had a substantial proportion of missed eligible patients. However, the missed population had similar characteristics to those enrolled. Although the use of 4-month telephone follow-up likely captured the patients with emergent intracranial abnormalities, it would not necessarily identify the presence of serious intracranial abnormalities and pseudotumor cerebri if the patient did not receive any neuroimaging or further investigations (e.g. lumbar puncture). Additionally, we did not collect certain variables that may be considered red flag findings, such as witnessed loss of consciousness or dizziness. We also did not have enough patients who received ED neuroimaging to be able to analyze each red flag finding individually, although we were able to identify categories of findings associated with imaging practices. We did not ask clinicians whether or not they felt that completing the case report forms influenced their decision to obtain neuroimaging, although the prevalence of ED neuroimaging observed in our study was similar to that reported in prior ED settings (1,3,5). We also did not evaluate the interrater reliability of the variables collected. However, many similar variables obtained from history and some from physical exam in children with seizures and closed head injury have been shown to have at least moderate reliability (47,48). Finally, we did not collect any information about the clinicians evaluating the children. Clinician characteristics, such as years in practice, could potentially be related to decisions to obtain neuroimaging. Of note, the majority of clinicians who evaluate children in our emergency department are board-certified in pediatric emergency medicine.
Conclusions
Red flag findings are common in otherwise healthy children presenting with headaches to the ED. The presence of red flag findings is associated with ED neuroimaging, although the risk of emergent intracranial abnormalities is low. Our data suggest that many children with headaches receive unnecessary neuroimaging due to the high prevalence of non-specific red flag findings. In order to optimize the use of ED neuroimaging, further study is necessary to determine which clinical findings most accurately identify children with headaches who are at high and low risk of emergent intracranial abnormalities.
Supplemental Material
Supplemental tables -Supplemental material for Red flag findings in children with headaches: Prevalence and association with emergency department neuroimaging
Supplemental material, Supplemental tables for Red flag findings in children with headaches: Prevalence and association with emergency department neuroimaging by Daniel S Tsze, Julie B Ochs, Ariana E Gonzalez and Peter S Dayan in Cephalalgia
Supplemental Material
Supplemental figure -Supplemental material for Red flag findings in children with headaches: Prevalence and association with emergency department neuroimaging
Supplemental material, Supplemental figure for Red flag findings in children with headaches: Prevalence and association with emergency department neuroimaging by Daniel S Tsze, Julie B Ochs, Ariana E Gonzalez and Peter S Dayan in Cephalalgia
Footnotes
Clinical implications
Red flag findings are common in children presenting with headaches to the ED.
The presence of red flag findings is associated with ED neuroimaging, although the risk of emergent intracranial abnormalities is low.
Many children with headaches may be receiving unnecessary neuroimaging due to the high prevalence of non-specific red flag findings.
Acknowledgements
The authors would like to thank all of their colleagues who completed the case report forms; Dr. Nathan Kuppermann for his mentorship and oversight in the development of this project; Drs. Robert Fryer and Shannon Babineau for their assistance in developing the case report form; Drs. Nathan Kuppermann, Robert Hickey, Elizabeth Powell, Lynn Babcock and Steven Chan for their assistance in defining and classifying intracranial abnormalities; and Leonor Suarez and Christine Sison for their assistance with the study.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
