Skip to main content
Sports Medicine - Open
Download PDF

The Clinical Utility of the Child SCAT5 for Acute Concussion Assessment

Sports Medicine - Open volume 8, Article number: 104 (2022) Cite this article

Abstract

Background

The Child Sport Concussion Assessment Tool 5th Edition (Child SCAT5) was developed to evaluate children between 5 and 12 years of age for a suspected concussion. However, limited empirical evidence exists demonstrating the value of the Child SCAT5 for acute concussion assessment. Therefore, the purpose of our study was to examine differences and assess the diagnostic properties of Child SCAT5 scores among concussed and non-concussed middle school children on the same day as a suspected concussion.

Methods

Our participants included 34 concussed (21 boys, 13 girls; age = 12.8 ± 0.86 years) and 44 non-concussed (31 boys, 13 girls; age = 12.4 ± 0.76 years) middle school children who were administered the Child SCAT5 upon suspicion of a concussion. Child SCAT5 scores were calculated from the symptom evaluation (total symptoms, total severity), child version of the Standardized Assessment of Concussion (SAC-C), and modified Balance Error Scoring System (mBESS). The Child SCAT5 scores were compared between the concussed and non-concussed groups. Non-parametric effect sizes (\(r=\frac{Z}{\sqrt{n}}\)) were calculated to assess the magnitude of difference for each comparison. The diagnostic properties (sensitivity, specificity, diagnostic accuracy, predictive values, likelihood ratios, and diagnostic odds ratio) of each Child SCAT5 score were also calculated.

Results

Concussed children endorsed more symptoms (p < 0.001, \(r\)=0.45), higher symptom severity (p < 0.001, \(r\)=0.44), and had higher double leg (p = 0.046, \(r\)=0.23), single leg (p = 0.035, \(r\)=0.24), and total scores (p = 0.022, \(r\)=0.26) for the mBESS than the non-concussed children. No significant differences were observed for the SAC-C scores (p’s ≥ 0.542). The quantity and severity of endorsed symptoms had the best diagnostic accuracy (AUC = 0.76–0.77), negative predictive values (NPV = 0.84–0.88), and negative likelihood ratios (-LR = 0.22–0.31) of the Child SCAT5 scores.

Conclusions

Clinicians should prioritize interpretation of the symptom evaluation form of the Child SCAT5 as it was the most effective component for differentiating between concussed and non-concussed middle school children on the same day as a suspected concussion.

Key Points

  • Concussed middle school children endorsed more symptoms, reported greater symptom severity, and had worse balance performance as compared to middle school children who were not diagnosed with a concussion on the same day as the suspected injury.

  • Healthcare professionals should prioritize the interpretation of the symptom evaluation form of the Child SCAT5 as it was the most effective component of the Child SCAT5 for differentiating between concussed and non-concussed middle school children when administered on the same day as a suspected concussion.

  • Highly variable diagnostic properties were observed for the individual assessment of the symptom, neurocognitive, and balance components of the Child SCAT5 when administered to middle school children on the same day as a suspected concussion.

Background

There are approximately 12.3 million middle school (grade level 6–8) age children in the United States and an estimated 36% (≈4.4 million) participate in organized intramural or interscholastic sport annually [1, 2]. Participation in organized sport for children under 14 years of age is the leading cause of concussion (43%)[3] and has been associated with a six times greater risk of concussion as compared to other leisure physical activities [4]. Limited on-site medical coverage of school-sponsored sports [5] contributes to a majority (86%) of children seeking medical care from healthcare professionals in direct access settings (e.g., emergency department, outpatient clinics) [6, 7] where follow up visits are uncommon (1–3%) [8,9,10].

Several governing bodies [11,12,13,14] recommend the implementation of a multi-modal assessment for the evaluation of children following a suspected concussion. The Sport Concussion Assessment Tool 5th edition (SCAT5) [15] and the Child Sport Concussion Assessment Tool 5th Edition (Child SCAT5)[16] are two of the most commonly used multi-modal assessments by licensed healthcare professionals for the acute evaluation and clinical management of concussion [17,18,19,20]. The Child SCAT5 is a modified version of the SCAT5 that was developed for administration to children between 5 and 12 years of age and consists of a symptom evaluation form, the child version of the Standardized Assessment of Concussion (SAC-C), and the modified balance error scoring system (mBESS) [15]. Previous literature has demonstrated poor psychometric (e.g., test–retest reliability) and diagnostic properties (e.g., sensitivity, specificity, predictive value, likelihood ratios) for the individual components of prior iterations of the SCAT [16, 21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40] and the Child SCAT 3rd Edition (Child SCAT3) [41,42,43,44]. Despite consensus recommendation and wide adoption, scant evidence exists regarding the psychometric and diagnostic properties of the Child SCAT5 [45,46,47].

The lack of empirical evidence regarding the Child SCAT5 necessitates that healthcare professionals rely upon their subjective interpretation of Child SCAT5 scores to inform acute clinical management. An approach which may contribute to misdiagnosis and inconsistent treatment for those children acutely evaluated for concussion using the Child SCAT5 [48]. Therefore, the purpose of our study was to evaluate for differences and assess the diagnostic properties of Child SCAT5 scores on the same day as a suspected concussion among middle school children who were (“concussed”) or were not (“non-concussed”) clinically diagnosed with a concussion. We hypothesized that (i) the concussed children would endorse significantly more symptoms and report a significantly higher symptom severity as compared to the non-concussed children; (ii) the concussed children would score lower on the SAC-C and commit significantly more errors on the mBESS as compared to the non-concussed children; and (iii) the symptom evaluation (total symptoms endorsed, symptom severity) would demonstrate better diagnostic properties than the SAC-C or mBESS on the same day as the suspected concussion.

Methods

Design and Settings

The Advancing Healthcare Initiatives for Underserved Students (ACHIEVES) Project provided on-site medical care to sixteen middle schools within a large socio-demographically diverse school district in Virginia, USA [49]. The George Mason University Institutional Review Board approved the construction of the deidentified database for research purposes and waived assent and consent. All participants in our study competed in school-sponsored sports between the 2017–2018 and 2019–2020 academic years.

Participants

Our sample originally consisted of 186 (103 concussed, 83 non-concussed) middle school children that were evaluated for a suspected concussion (Fig. 1). Exclusion criteria were set to ensure that injury and assessment data were available from the concussion assessment that was administered at the time of the suspected concussion. Participants were excluded if their suspected concussion occurred outside of sport, the initial assessment was not completed on the same day as the suspected concussion, or there were any missing data elements from the Child SCAT5 (Fig. 1). After applying all of our exclusion criteria, our final sample consisted of 78 (34 concussed, 44 non-concussed) middle school children that were evaluated for a suspected concussion while participating in school-sponsored sports. Certified athletic trainers administered the Child SCAT5 to all middle school children, up to age 13, participating in sport. The reason for this was two-fold: (i) to be consistent with prior studies on the Child SCAT3[42, 50] and Child SCAT5[46, 47] that include children up to age 13, and (ii) children could have been baseline measured with the Child SCAT5 at age 12 and then could potentially be injured at age 13; rather than change the assessment to the SCAT5 for that child, the athletic trainers used the Child SCAT5 to avoid the complexities of interpreting two distinct assessment tools.

Fig. 1
figure 1

Flow chart for participant evaluation and analyses

Full size image

Testing Procedures

Consistent with Virginia Code (§ 22.1–271.5)[51] and the school system’s concussion management protocol, any middle school child exhibiting signs or symptoms consistent with a concussion was immediately removed from participation in school-sponsored sport and evaluated by the school’s certified athletic trainer. The Child SCAT5 was administered by certified athletic trainers, via pen and paper, using the standardized instructions provided for each component of the Child SCAT5 as published elsewhere [16, 46, 47]. The certified athletic trainers utilized their clinical judgement in respect to time, resources, and location to determine the most appropriate environment to administer the Child SCAT5 following a suspected concussion while limiting potential distractions and ensuring the safety of the student-athlete. All assessments were conducted on the day of the suspected concussion, operationally defined as having matching “date-of-injury” and “date-of-assessment” documentation in the electronic medical records. The definition of a concussion was consistent with the most recent international consensus statement on concussion in sport [11]. Regardless of their Child SCAT5 scores, the children were not permitted to return to sport participation on the same day as the suspected concussion which is in alignment with international consensus statements, several governing bodies, and Virginia Code.[11,12,13,14, 51, 52]. The cases included in our study were ascertained from deidentified electronic medical records. Cases were allocated into groups by the research team dependent on whether the child was clinically diagnosed (i.e., “concussed”) or was not clinically diagnosed (i.e., “non-concussed”) as having a concussion by the respective certified athletic trainer.

Outcomes

The administration and scoring of each component of the Child SCAT5 (symptom evaluation, child version of the Standardized Assessment of Concussion [SAC-C], and the modified version of the balance error scoring system [mBESS]) are described in detail elsewhere [16, 46, 47]. For the symptom evaluation, the total number of symptoms endorsed (range = 0–21) and the total symptom severity (range = 0–63) endorsed by the children were calculated. For the SAC-C, points earned for the 5-word immediate memory (range = 0–15 points), concentration (range = 0–6 points), and delayed recall (range = 0–5 points) domains were recorded and summed to calculate a composite score (range = 0–26 points). For the mBESS, errors committed (range = 0–10) during each stance (double leg, single leg, tandem) were recorded and summed to calculate the total score (range = 0–30). Lower scores on the SAC-C and higher scores on the mBESS were indicative of worse performance on the respective components of the Child SCAT5.

Statistical Analyses

Nonparametric analyses were performed due to the non-normal distribution (Shapiro–Wilk = 0.78–0.94, p’s < 0.05) of the Child SCAT5 scores. Mann–Whitney U-tests were used to assess for differences between the concussed and non-concussed children for each Child SCAT5 score. Nonparametric effect sizes[53] (\(r=\frac{Z}{\sqrt{N}}\)) were calculated and interpreted as small (r = 0.10–0.30), moderate (r = 0.30–0.50), or large (r ≥ 0.50) [54].

Receiver operator curve analyses were performed to calculate the diagnostic accuracy (area under the curve [AUC]) of each Child SCAT5 score [21, 24, 25, 55,56,57,58]. Youden’s Index (J) [59] was calculated to determine the cutoff score that optimized the combination of sensitivity (Sn) and specificity (Sp) for each Child SCAT5 score [60,61,62,63]. Values closer to 1.0 for the Youden Index are indicative of a greater combination of sensitivity and specificity [59].

The sensitivity and specificity values of each Child SCAT5 score were used to calculate their positive (PPV) and negative (NPV) predictive values, positive (+ LR) and negative (-LR) likelihood ratios, and diagnostic odds ratios (DOR). Positive and negative predictive values that are closer to 1.0 are indicative of a more valid test result [64]. Higher positive likelihood ratios indicate a greater likelihood that the patient has the test condition (e.g., concussed) while lower negative likelihood ratios indicate a greater likelihood that the patient does not have the test condition (e.g., not concussed) [65]. Higher diagnostic odds ratios indicate that the test result has a greater ability to differentiate between patients with (e.g., concussed) and without (e.g., non-concussed) the test condition. All analyses were performed using SPSS (Version 27, IBM Corp., NY, USA). Alpha was set a priori at p < 0.05.

Results

Our sample consisted of 34 concussed (21 male [62%], age = 12.8 ± 0.86 years) and 44 non-concussed (31 male [70%], age = 12.4 ± 0.76 years) middle school children who participated in a variety of school-sponsored sports including football, wrestling, baseball, softball, volleyball, cheerleading, basketball, soccer, and track (Fig. 1). The participants in the concussed and non-concussed groups were not significantly different across any demographic variable (p’s > 0.05). Please see Table 1 for participant demographic and pre-existing health condition information.

Table 1 Descriptive statistics for our study sample
Full size table

The concussed children endorsed significantly more symptoms (median = 6.0 [IQR = 4–12] vs. median = 2.0 [IQR = 1–5], p < 0.001, \(r\)=0.45) and reported greater symptom severity (median = 7.5 [IQR = 5–17] vs. median = 3.0 [IQR = 1–9], p < 0.001, \(r\)=0.44) than the non-concussed group (Table 2, Fig. 2). The total number and severity of endorsed symptoms resulted in the highest diagnostic accuracy (AUC = 0.76–0.77) and negative predictive values (NPV = 0.84–0.88) and the lowest negative likelihood ratios (− LR = 0.22–0.31) of the Child SCAT5 scores (Table 3, Fig. 3A).

Table 2 Descriptive statistics for the Child Sport Concussion Assessment Tool – 5th Edition (Child SCAT5) scores
Full size table
Fig. 2
figure 2

Group comparisons for the Child Sport Concussion Assessment Tool 5th Edition (Child SCAT5) scores. Note Boxes represent the first, second, and third quartile values, error bars represent maximum (third quartile + 1.5*Interquartile Range) and minimum (third quartile – 1.5* Interquartile Range) values, X = group mean, SAC-C = child version of the Standardized Assessment of Concussion, mBESS = modified balance error scoring system. *P < .05

Full size image
Table 3 Diagnostic properties for the Child Sport Concussion Assessment Tool 5th edition (Child SCAT5) scores
Full size table
Fig. 3
figure 3

Receiver operator curves for the Child Sport Concussion Assessment Tool 5th Edition (Child SCAT5) scores. Note: Dashed line is reference line demonstrating equitable sensitivity and specificity

Full size image

None of the SAC-C scores were significantly different between the concussed and non-concussed children (p’s ≥ 0.54, Table 2). The SAC-C had the lowest diagnostic accuracy values (AUC = 0.51–0.54) of the Child SCAT5 scores (Table 3, Fig. 3B).

The concussed children committed significantly more errors in the double leg (median = 0.0 [IQR = 0–0] vs median = 0.0 [IQR = 0–0], p = 0.046, \(r\)=0.23) and single leg (median = 5.5 [IQR = 3–8] vs median = 3.0 [IQR = 2–6], p = 0.035, \(r\)=0.24) stances of the mBESS as compared to the non-concussed children (Table 2). Significantly higher total scores on the mBESS (median = 7.5 [IQR = 4–11] vs median = 5.0 [IQR = 2–7], p = 0.022, \(r\)=0.26) were observed for the concussed children as compared to the non-concussed children (Table 2). Committing at least one error in the double leg stance resulted in the highest specificity (Sp = 1.00) but the lowest sensitivity (Sn = 0.09; Table 3) values. A total mBESS score of at least nine errors had higher diagnostic accuracy (AUC = 0.64) than interpretation of the individual stances (AUC = 0.54–0.63; Table 3, Fig. 3C).

Discussion

Despite limited empirical evidence, the Child SCAT5 is recommended for use by healthcare professionals to assist with the clinical diagnosis of concussion in children [11,12,13,14]. This study was conducted to better understand the utility of the Child SCAT5 on the day of a suspected concussion. Our findings provide evidence that the symptom component was clinically useful, whereas the SAC-C and mBESS components of the Child SCAT5 were not useful for differentiating between concussed and non-concussed middle school children on the same day as a suspected concussion. As many children receive acute care for suspected head injuries in busy direct access settings (e.g., emergency departments or outpatient clinics), findings from our study suggest that healthcare professionals in these settings should prioritize the interpretation of the symptom evaluation components of the Child SCAT5 during the acute clinical evaluation of middle school age children with a suspected concussion.

Self-reported symptomology has been a cornerstone of concussion evaluation and remains the key component for informing clinical judgement [11]. Using the Child SCAT3 in an emergency department setting, Babl and colleagues [44], demonstrated that concussed children endorsed significantly more symptoms and reported greater symptom severity than non-concussed children. Similarly, using the Child SCAT5 for acute evaluation, we found that concussed children endorsed a significantly greater total number (median = 6.0 [IQR = 4–12] vs. median = 2.0 [IQR = 1–5]) and severity (median = 7.5 [IQR = 5–17] vs. median = 3.0 [IQR = 1–9] of symptoms than non-concussed children. Additionally, based on our calculated cutoff scores, children who endorsed less than four symptoms or reported a severity less than six points on the same day as the suspected concussion were less likely (− LR = 0.22–0.31) to be clinically diagnosed with a concussion. A notable finding of our study is that all children suspected of sustaining a concussion presented acutely with at least one symptom. However, the children that were clinically diagnosed with a concussion, endorsed a considerably greater number and severity of symptoms than those who were not diagnosed. This reveals the following complexities: (i) the lack of specificity of the individual symptom items in the Child SCAT5 may contribute to symptom endorsement among children that in fact do not have a concussion; (ii) however paradoxically, the total number and severity of symptoms endorsed are likely the most valuable clinical measure of the Child SCAT5 in terms of diagnostic accuracy. Thus, in direct-access settings, the endorsed number and severity of symptoms on the Child SCAT5 should inform clinical decision making. However, more research is necessary to investigate which individual symptoms or symptom clusters of the Child SCAT5 are the most clinically useful for the acute assessment of concussion in children.

The concussed children in our study did not perform significantly different on any component of the SAC-C as compared to the non-concussed children on the same day as the suspected concussion. Additionally, we detected no significant differences in the SAC-C composite scores between the concussed and non-concussed children and the values for each group were within the “broadly normal” interpretation of normative reference values for this population [46]. The lack of a significant difference between concussed and non-concussed children diverges from previous research that evaluated older athletic populations (using the SAC) [22, 23, 66,67,68,69]. These differences may be attributed to different age-ranges of the participants (e.g., high school and collegiate athletes) and different ranges of composite scores for the SAC (range = 0–30) and SAC-C (range = 0–26) [15]. Furthermore, the SAC and SAC-C were developed for acute and post-acute assessments of concussion, however, recent evidence suggests that the clinical utility of the SAC may decline after 3–5 days post-concussion [70]. Presently, it is unclear when the optimal clinical assessment time interval is for post-concussion interpretation of the SAC-C.

Concussed children in our study had significantly higher mBESS total scores (median = 7.5 [IQR = 4–11]; 7.8 ± 4.5 errors) than non-concussed children (median = 5.0 [IQR = 2–7]; 5.6 ± 4.2 errors) and also slightly higher than the normative reference values for this population (5.0 ± 3.7 errors) [46]. These findings are consistent with reports that concussed high school and college athletes perform worse on the BESS than non-concussed athletes [22, 23, 66,67,68,69]. However, the small effect sizes (r = 0.23–0.26) for the concussed versus non-concussed comparisons observed in our study suggest that these statistical differences may not be clinically meaningful. For example, the mean difference of approximately two errors on the mBESS total score between the concussed and non-concussed groups aligns well with expected variability in mBESS performance as supported by previously established values for determining a clinically meaningful change [22, 47, 71]. Thus, the differences observed between the concussed and non-concussed groups may be due to repeated administration of the mBESS rather their medical status. Additionally, the diagnostic accuracy of the individual stances of the mBESS as well as the total score were low (AUC = 0.54–0.64) further suggesting limited clinical utility of the mBESS when acutely administered to middle school children suspected of having a concussion.

When examining the least accurate diagnostic components of the Child SCAT5 (i.e., the SAC-C and mBESS), the highest positive predictive values and likelihood ratios were observed for interpretation of the double leg stance of the mBESS followed by the delayed recall domain of the SAC-C. However, inordinately low thresholds for a positive test result (e.g., diagnosed concussion) for the double leg stance of the mBESS (≤ 1 error) and the delayed recall domain of the SAC-C (≤ 1 point) yielded high specificity values (Sp = 0.98–1.00) which artificially elevated the calculated positive predictive values and likelihood ratios. Therefore, we caution healthcare professionals from independent interpretation of the double leg stance of the mBESS or the delayed recall domain of the SAC-C in their clinical decision-making at this time. Moreover, evidence of poor reliability of the SAC-C and mBESS components of the Child SCAT5 further demonstrates the limited clinical utility of these measures within this patient demographic [47]. Future research should investigate alternative assessment tools (e.g., tandem gait test[72]) or strategies (e.g., the dual task paradigm[73]) for the acute evaluation of children following a suspected concussion.

Overall, our findings support those of previous research [23, 44, 66, 68] which suggest that the symptom evaluation has the best combination of diagnostic properties and is the most effective component of the Child SCAT5 for differentiating between concussed and non-concussed children. Using similar methodology, Babl and colleagues [44], observed diagnostic accuracy values for Child SCAT3 scores that are comparable to those observed for the Child SCAT5 in our study [44]. While similar findings between Child SCAT3 and the Child SCAT5 affirms the value of symptoms, jointly these findings may also suggest that other components of the Child SCAT5 have not improved and that further refinement is necessary to improve its clinical utility for the acute assessment of concussion in children.

Healthcare professionals in direct access settings (e.g., emergency department, outpatient clinics) may be the first to evaluate a child following a suspected concussion [6] and commonly do not have preinjury (i.e., baseline) scores. As such it is vital that healthcare professionals are equipped with age-appropriate assessment tools that can effectively differentiate between those children who are and are not concussed in order to appropriately inform patient care. Recommendations based upon empirical data that may assist healthcare professionals with clinical interpretation of the Child SCAT5 have been published [46, 47]. These include normative reference values which account for demographic characteristics (e.g., gender and age) [46], as well as psychometric information about the Child SCAT5 [47]. In conjunction with our findings, these studies offer guidance on using the Child SCAT5 to support clinical decision-making when acutely evaluating children with a suspected concussion.

We recognize that our study is not without limitations. We analyzed data gathered from children (age 10–13 years) that participated in middle school-sponsored sports within a single public school division in Virginia, which limits the generalizability of our findings to all children for which the Child SCAT5 may be used. However, these data were derived from middle schools having diverse socio-demographic student profiles (71.5% racial or ethnic minority; 47% economically disadvantaged) which is perhaps a more representative sample of the total middle school age population than previously studied [49]. Another limitation is our inability to control for the variability in the time between the removal from sport and the concussion evaluation. However, all children were administered the Child SCAT5 on the same day as the suspected concussive event. More research is needed to better understand the optimal time interval using the Child SCAT5 in acute situations. Further, the Child SCAT5 incorporates a parent symptom report, however, we were unable to include these data in our study due to inconsistent access to parents/guardians within this cohort. Future research should investigate the clinical utility of parent symptom reporting outcomes of the Child SCAT5 following a suspected concussion. Finally, we utilized the 5-word immediate memory list for the SAC-C score generation. The clinical utility of the 10-word list, particularly for children who may need a more challenging task than the 5-word list, should be investigated.

Conclusion

The concussed middle school children endorsed more symptoms and reported greater symptom severity on the same day as the suspected concussion than children who were not diagnosed with a concussion. Furthermore, the total number and severity of the endorsed symptoms, on the Child SCAT5, resulted in the greatest combination of diagnostic properties as supported by the best sensitivity, diagnostic accuracy, negative predictive values, and negative likelihood ratios. Both the SAC-C and the mBESS failed to detect clinically meaningful differences between the concussed and non-concussed children and also had highly variable diagnostic properties. Collectively, our findings suggest that healthcare professionals working in direct access settings should prioritize symptom evaluation as it was the most effective component of the Child SCAT5 for the acute assessment of a child with a concussion.

Availability of data and materials

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

References

  1. School Enrollment in the United States: October 2018-Detailed Tables [Internet]. 2019 [cited 2021 Jan 15]. Available from: https://www.census.gov/content/census/en/data/tables/2018/demo/school-enrollment/2018-cps.html

  2. Kanters MA, Bocarro JN, Edwards MB, Casper JM, Floyd MF. School sport participation under two school sport policies: comparisons by race/ethnicity, gender, and socioeconomic status. Ann Behav Med. 2013;45:113–21.

    Article  Google Scholar 

  3. Sarmiento K, Daugherty J, DePadilla L, Breiding MJ. Examination of sports and recreation-related concussion among youth ages 12–17: results from the 2018 YouthStyles survey. Brain Inj. 2020;34:357–62. https://doi.org/10.1080/02699052.2020.1723165.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Browne GJ. Concussive head injury in children and adolescents related to sports and other leisure physical activities. Br J Sports Med. 2006;40:163–8. https://doi.org/10.1136/bjsm.2005.021220.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Pike AM, Pryor RR, Vandermark LW, Mazerolle SM, Casa DJ. Athletic trainer services in public and private secondary schools. J Athl Train. 2017;52:5–11.

    Article  Google Scholar 

  6. DePadilla L, Miller GF, Jones SE, Peterson AB, Breiding MJ. Self-reported concussions from playing a sport or being physically active among high school students — United States, 2017. MMWR Morb Mortal Wkly Rep. 2018;67:682–5.

    Article  Google Scholar 

  7. Arbogast KB, Curry AE, Pfeiffer MR, Zonfrillo MR, Haarbauer-Krupa J, Breiding MJ, et al. Point of health care entry for youth with concussion within a large pediatric care network. JAMA Pediatr. 2016;170:e160294. https://doi.org/10.1001/jamapediatrics.2016.0294.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Arora R, Shukla M, McQuillen E, Sethuraman U. Pediatric minor head injury related return visits to the emergency department and their outcome. Am J Emerg Med. 2021;45:71–4.

    Article  Google Scholar 

  9. Bressan S, Berlese P, Arpone M, Steiner I, Titomanlio L, Da Dalt L. Missed intracranial injuries are rare in emergency departments using the PECARN head injury decision rules. Childs Nerv Syst. 2021;37:55–62. https://doi.org/10.1007/s00381-020-04660-0.

    Article  PubMed  Google Scholar 

  10. Nigrovic LE, Stack AM, Mannix RC, Lyons TW, Samnaliev M, Bachur RG, et al. Quality improvement effort to reduce cranial CTs for children with minor blunt head trauma. Pediatrics. 2015;136:e227–33. https://doi.org/10.1542/peds.2014-3588.

    Article  PubMed  Google Scholar 

  11. McCrory P, Meeuwisse W, Dvorak J, Aubry M, Bailes J, Broglio S, et al. Consensus statement on concussion in sport—the 5th international conference on concussion in sport held in Berlin, October 2016. Br J Sports Med. 2017;51:838–47. https://doi.org/10.1136/bjsports-2017-097699.

    Article  PubMed  Google Scholar 

  12. NASN Position Statement. Concussions—the role of the school Nurse. NASN Sch Nurse. 2013;28:110–1. https://doi.org/10.1177/1942602X12473949.

    Article  Google Scholar 

  13. Broglio SP, Cantu RC, Gioia GA, Guskiewicz KM, Kutcher J, Palm M, et al. National athletic trainers’ association position statement: management of sport concussion. J Athl Train. 2014;49:245–65. https://doi.org/10.4085/1062-6050-49.1.07.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Harmon KG, Clugston JR, Dec K, Hainline B, Herring S, Kane SF, et al. American medical society for sports medicine position statement on concussion in sport. Br J Sports Med. 2019;53:213–25. https://doi.org/10.1136/bjsports-2018-100338.

    Article  PubMed  Google Scholar 

  15. Echemendia RJ, Meeuwisse W, McCrory P, Davis GA, Putukian M, Leddy JJ, et al. The sport concussion assessment tool 5th edition (SCAT5): background and rationale. Br J Sports Med. 2017;51:848–50.

  16. Davis GA, Purcell L, Schneider KJ, Yeates KO, Gioia GA, Anderson V, et al. The child sport concussion assessment tool 5th edition (Child SCAT5). Br J Sports. 2017;51:859–61. https://doi.org/10.1136/bjsports-2017-097492

  17. Lempke LB, Schmidt JD, Lynall RC. athletic trainers’ concussion-assessment and concussion-management practices: an update. J Athl Train. 2020;55:17–26. https://doi.org/10.4085/1062-6050-322-18.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Lynall RC, Laudner KG, Mihalik JP, Stanek JM. Concussion-assessment and -management techniques used by athletic trainers. J Athl Train. 2013;48:844–50. https://doi.org/10.4085/1062-6050-48.6.04.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Buckley TA, Burdette G, Kelly K. Concussion-management practice patterns of national collegiate athletic association division II and III athletic trainers: how the other half lives. J Athl Train. 2015;50:879–88. https://doi.org/10.4085/1062-6050-50.7.04.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Kelly KC, Jordan EM, Joyner AB, Burdette GT, Buckley TA. National collegiate athletic association division i athletic trainers’ concussion-management practice patterns. J Athl Train. 2014;49:665–73. https://doi.org/10.4085/1062-6050-49.3.25.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Barr WB, McCrea M. Sensitivity and specificity of standardized neurocognitive testing immediately following sports concussion. J Int Neuropsychol Soc. 2001;7:693–702.

    Article  CAS  Google Scholar 

  22. McLeod TCV, Barr WB, McCrea M, Guskiewicz KM. Psychometric and measurement properties of concussion assessment tools in youth sports. J Athl Train. 2006;41:399–408.

    Google Scholar 

  23. Chin EY, Nelson LD, Barr WB, McCrory P, McCrea MA. Reliability and validity of the sport concussion assessment tool–3 (SCAT3) in high school and collegiate athletes. Am J Sports Med. 2016;44:2276–85. https://doi.org/10.1177/0363546516648141.

    Article  PubMed  Google Scholar 

  24. Resch JE, Brown CN, Schmidt J, Macciocchi SN, Blueitt D, Cullum CM, et al. The sensitivity and specificity of clinical measures of sport concussion: three tests are better than one. BMJ Open Sport Exerc Med. 2016;2:e000012. https://doi.org/10.1136/bmjsem-2015-000012.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Broglio SP, Macciocchi SN, Ferrara MS. Sensitivity of the concussion assessment battery. Neurosurgery. 2007;60:1050–8.

    Article  Google Scholar 

  26. Broglio SP, Guskiewicz KM. Concussion in sports: the sideline assessment. Sports Health Multidiscip Approach. 2009;1:361–9. https://doi.org/10.1177/1941738109343158.

    Article  Google Scholar 

  27. CARE Consortium Investigators, Garcia G-GP, Broglio SP, Lavieri MS, McCrea M, McAllister T. Quantifying the value of multidimensional assessment models for acute concussion: an analysis of data from the NCAA-DoD care consortium. Sports Med. 2018;48:1739–49. https://doi.org/10.1007/s40279-018-0880-x

  28. Sullivan SJ, Hammond-Tooke GD, Schneiders AG, Gray AR, McCrory P. The diagnostic accuracy of selected neurological tests. J Clin Neurosci. 2012;19:423–7.

    Article  CAS  Google Scholar 

  29. Buckley TA, Munkasy BA, Clouse BP. Sensitivity and specificity of the modified balance error scoring system in concussed collegiate student athletes. Clin J Sport Med. 2017;1–3. Available from: http://Insights.ovid.com/crossref?an=00042752-900000000-99477

  30. Register-Mihalik JK, Guskiewicz KM, Mihalik JP, Schmidt JD, Kerr ZY, McCrea MA. Reliable change, sensitivity, and specificity of a multidimensional concussion assessment battery: implications for caution in clinical practice. J Head Trauma Rehabil. 2013;28:274–83.

    Article  Google Scholar 

  31. Putukian M, Echemendia R, Dettwiler-Danspeckgruber A, Duliba T, Bruce J, Furtado JL, et al. Prospective clinical assessment using sideline concussion assessment tool-2 testing in the evaluation of sport-related concussion in college athletes. Clin J Sport Med. 2015;25:7.

    Article  Google Scholar 

  32. Glaviano NR, Benson S, Goodkin H, Broshek D, Saliba S. Baseline SCAT2 assessment of healthy youth student-athletes. Clin J Sport Med. 2015;25:373–9.

    Article  Google Scholar 

  33. Norheim N, Kissinger-Knox A, Cheatham M, Webbe F. Performance of college athletes on the 10-item word list of SCAT5. BMJ Open Sport Exerc Med. 2018;4:e000412. https://doi.org/10.1136/bmjsem-2018-000412.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Snedden TR, Brooks MA, Hetzel S, McGuine T. normative values of the sport concussion assessment tool 3 (SCAT3) in high school athletes. Clin J Sport Med. 2017;27:462–7.

    Article  Google Scholar 

  35. Thomas RE, Alves J, Vaska MM, Magalhães R. SCAT2 and SCAT3 scores at baseline and after sports-related mild brain injury/concussion: qualitative synthesis with weighted means. BMJ Open Sport Exerc Med. 2016;2:e000095. https://doi.org/10.1136/bmjsem-2015-000095.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Valovich McLeod TC, Bay RC, Lam KC, Chhabra A. Representative baseline values on the sport concussion assessment Tool 2 (SCAT2) in adolescent athletes vary by gender, grade, and concussion history. Am J Sports Med. 2012;40:927–33. https://doi.org/10.1177/0363546511431573.

    Article  PubMed  Google Scholar 

  37. Zimmer A, Marcinak J, Hibyan S, Webbe F. Normative values of major SCAT2 and SCAT3 components for a college athlete population. Appl Neuropsychol Adult. 2015;22:132–40. https://doi.org/10.1080/23279095.2013.867265.

    Article  PubMed  Google Scholar 

  38. Kontos AP, Monti K, Eagle SR, et al. Test–retest reliability of the Vestibular Ocular Motor Screening (VOMS) tool and modified Balance Error Scoring System (mBESS) in US military personnel. J Sci Med Sport. 2021;24(3):264–8. https://doi.org/10.1016/j.jsams.2020.08.012.

  39. Cushman D, Hendrick J, Teramoto M, Fogg B, Bradley S, Hansen C. Reliability of the balance error scoring system in a population with protracted recovery from mild traumatic brain injury. Brain Inj. 2018;32(5):569–74.

    Article  Google Scholar 

  40. Hänninen T, Parkkari J, Howell DR, Palola V, Seppänen A, Tuominen M, et al. Reliability of the sport concussion assessment tool 5 baseline testing: A 2-week test–retest study. J Sci Med Sport. 2021;24:129–34.

    Article  Google Scholar 

  41. Porter S, Smith-Forrester J, Alhajri N, Kusch C, Sun J, Barrable B, et al. The Child Sport Concussion Assessment Tool (Child SCAT3): normative values and correspondence between child and parent symptom scores in male child athletes. BMJ Open Sport Exerc Med. 2015;1:e000029. https://doi.org/10.1136/bmjsem-2015-000029.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Brooks MA, Snedden TR, Mixis B, Hetzel S, McGuine TA. Establishing baseline normative values for the child sport concussion assessment tool. JAMA Pediatr. 2017;171:670. https://doi.org/10.1001/jamapediatrics.2017.0592.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Yengo-Kahn AM, Hale AT, Zalneraitis BH, Zuckerman SL, Sills AK, Solomon GS. The sport concussion assessment tool: a systematic review. Neurosurg Focus. 2016;40:14.

    Article  Google Scholar 

  44. Babl FE, Dionisio D, Davenport L, Baylis A, Hearps SJC, Bressan S, et al. Accuracy of components of scat to identify children with concussion. Pediatrics. 2017;140:e20163258. https://doi.org/10.1542/peds.2016-3258.

    Article  PubMed  Google Scholar 

  45. Cook NE, Kelshaw PM, Caswell SV, Iverson GL. Children with attention-deficit/hyperactivity disorder perform differently on pediatric concussion assessment. J Pediatr. 2019;214(168–74): e1.

    Google Scholar 

  46. Kelshaw PM, Cook NE, Terry DP, Iverson GL, Caswell SV. Child sport concussion assessment tool 5th edition: normative reference values in demographically diverse youth. Clin J Sport Med. 2022;32:e126–33. https://doi.org/10.1097/JSM.0000000000000921.

  47. Kelshaw PM, Cook NE, Terry DP, Cortes N, Iverson GL, Caswell SV. Interpreting change on the child sport concussion assessment tool 5th edition. J Sci Med Sport. 2022;25:492–8. https://doi.org/10.1016/j.jsams.2022.02.003.

  48. Stern RA, Seichepine D, Tschoe C, Fritts NG, Alosco ML, Berkowitz O, et al. Concussion care practices and utilization of evidence-based guidelines in the evaluation and management of concussion: a survey of new england emergency departments. J Neurotrauma. 2017;34:861–8. https://doi.org/10.1089/neu.2016.4475.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Middle Sch. Profiles - Prince William Cty. Public Sch. [cited 2020 Jan 14]. Available from: https://www.pwcs.edu/cms/One.aspx?portalId=340225&pageId=658553

  50. Nelson LD, Loman MM, LaRoche AA, Furger RE, McCrea MA. Baseline performance and psychometric properties of the child sport concussion assessment tool 3 (Child-SCAT3) in 5- to 13-year-old athletes. Clin J Sport Med Off J Can Acad Sport Med. 2017;27:381–7.

    Article  Google Scholar 

  51. Virginia General Assembly. § 22.1–271.5. Guidelines and policies and procedures on concussions in student-athletes. [Internet]. Code Va. [cited 2021 Jan 14]. Available from: https://law.lis.virginia.gov/vacode/title22.1/chapter14/section22.1-271.5/

  52. National Conference of State Legislatures. Traumatic brain injury legislation [Internet]. [cited 2021 Feb 16]. Available from: http://www.ncsl.org/research/health/traumatic-brain-injury-legislation.aspx

  53. Fritz C, Morris P, Richler J. Effect size estimates: current use, calculations, and interpretation. J Exp Psychol Gen. 2012;141:2–18.

    Article  Google Scholar 

  54. Cohen J. Statistical power analysis for the behvaioral sciences. 2nd ed. Hillsdale, NJ: Erlbaum; 1988.

    Google Scholar 

  55. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36. https://doi.org/10.1148/radiology.143.1.7063747.

    Article  CAS  PubMed  Google Scholar 

  56. Rochefort C, Walters-Stewart C, Aglipay M, Barrowman N, Zemek R, Sveistrup H. Balance markers in adolescents at 1 month postconcussion. Orthop J Sports Med. 2017;5:232596711769550. https://doi.org/10.1177/2325967117695507.

    Article  Google Scholar 

  57. Nelson LD, Furger RE, Gikas P, Lerner EB, Barr WB, Hammeke TA, et al. Prospective, head-to-head study of three computerized neurocognitive assessment tools part 2: utility for assessment of mild traumatic brain injury in emergency department patients. J Int Neuropsychol Soc. 2017;23:293–303.

    Article  Google Scholar 

  58. Resch JE, McCrea MA, Cullum CM. computerized neurocognitive testing in the management of sport-related concussion: an update. Neuropsychol Rev. 2013;23:335–49. https://doi.org/10.1007/s11065-013-9242-5.

    Article  PubMed  Google Scholar 

  59. Youden WJ. Index for rating diagnostic tests. Cancer. 1950;3:32–5.

    Article  CAS  Google Scholar 

  60. Eagle SR, Womble MN, Elbin RJ, Pan R, Collins MW, Kontos AP. Concussion symptom cutoffs for identification and prognosis of sports-related concussion: role of time since injury. Am J Sports Med. 2020;48:2544–51. https://doi.org/10.1177/0363546520937291.

    Article  PubMed  Google Scholar 

  61. Habibzadeh F, Habibzadeh P, Yadollahie M. On determining the most appropriate test cut-off value: the case of tests with continuous results. Biochem Medica [Internet]. 2016 [cited 2021 Feb 15];297–307. Available from: http://www.biochemia-medica.com/en/journal/26/3/10.11613/BM.2016.034

  62. Linens SW, Ross SE, Arnold BL, Gayle R, Pidcoe P. Postural-stability tests that identify individuals with chronic ankle instability. J Athl Train. 2014;49:15–23. https://doi.org/10.4085/1062-6050-48.6.09.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt PMM. The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol. 2003;56:1129–35.

    Article  Google Scholar 

  64. Biggerstaff BJ. Comparing diagnostic tests: a simple graphic using likelihood ratios. Stat Med. 2000;19:649–63.

    Article  CAS  Google Scholar 

  65. McGee S. Simplifying likelihood ratios. J Gen Intern Med. 2002;17:647–50. https://doi.org/10.1046/j.1525-1497.2002.10750.x.

    Article  PubMed Central  Google Scholar 

  66. McCrea M, Barr WB, Guskiewicz K, Randolph C, Marshall SW, Cantu R, et al. Standard regression-based methods for measuring recovery after sport-related concussion. J Int Neuropsychol Soc. 2005;11:58–69.

    Article  Google Scholar 

  67. McCrea M, Kelly JP, Kluge J, Ackley B, Randolph C. Standardized assessment of concussion in football players. Neurology. 1997;48:586–8. https://doi.org/10.1212/WNL.48.3.586.

    Article  CAS  PubMed  Google Scholar 

  68. Oldham JR, Difabio MS, Kaminski TW, Dewolf RM, Howell DR, Buckley TA. Efficacy of tandem gait to identify impaired postural control after concussion. Med Sci Sports Exerc. 2018;50:1162–8.

    Article  Google Scholar 

  69. Nelson LD, Guskiewicz KM, Barr WB, Hammeke TA, Randolph C, Ahn KW, et al. Age differences in recovery after sport-related concussion: a comparison of high school and collegiate athletes. J Athl Train. 2016;51:142–52. https://doi.org/10.4085/1062-6050-51.4.04.

    Article  PubMed  PubMed Central  Google Scholar 

  70. Echemendia RJ, Broglio SP, Davis GA, Guskiewicz KM, Hayden KA, Leddy JJ, et al. What tests and measures should be added to the SCAT3 and related tests to improve their reliability, sensitivity and/or specificity in sideline concussion diagnosis? A systematic review. Br J Sports Med. 2017;51:895–901. https://doi.org/10.1136/bjsports-2016-097466.

    Article  PubMed  Google Scholar 

  71. McCrea M, Guskiewicz KM, Marshall SW, Barr W, Randolph C, Cantu RC, et al. Acute effects and recovery time following concussion in collegiate football players: the NCAA concussion study. JAMA. 2003;290:2556. https://doi.org/10.1001/jama.290.19.2556.

    Article  CAS  PubMed  Google Scholar 

  72. Schneiders AG, Sullivan SJ, McCrory PR, Gray A, Maruthayanar S, Singh P, et al. The effect of exercise on motor performance tasks used in the neurological assessment of sports-related concussion. Br J Sports Med. 2007;42:1011–3. https://doi.org/10.1136/bjsm.2007.041665.

    Article  Google Scholar 

  73. Register-Mihalik JK, Littleton AC, Guskiewicz KM. Are divided attention tasks useful in the assessment and management of sport-related concussion? Neuropsychol Rev. 2013;23:300–13. https://doi.org/10.1007/s11065-013-9238-1.

    Article  PubMed  Google Scholar 

Download references

Funding

Dr. Shane V. Caswell has received funding from the Virginia Department of Health (Grant #709I832700) and the Centers for Disease Control and Prevention (Grant #NU17CE924832) as well as support from the Prince William County Public Schools.

Author information

Authors and Affiliations

  1. Sports Medicine Assessment Research & Testing (SMART) Laboratory, Athletic Training Education Program, School of Kinesiology, George Mason University, 10890 George Mason Circle, Katherine Johnson Hall 221, MSN 4E5, Manassas, VA, 20110, USA

    Nicholas K. Erdman, Samantha L. Hacherl & Shane V. Caswell

  2. Virginia Concussion Initiative, George Mason University, Manassas, VA, USA

    Nicholas K. Erdman, Patricia M. Kelshaw & Shane V. Caswell

  3. Advancing Healthcare Initiatives for Underserved Students (ACHIEVES) Project, George Mason University, Manassas, VA, USA

    Nicholas K. Erdman, Samantha L. Hacherl & Shane V. Caswell

  4. Brain Research and Assessment Initiative of New Hampshire (BRAIN) Laboratory, Department of Kinesiology, University of New Hampshire, Durham, NH, USA

    Patricia M. Kelshaw

Authors
  1. Nicholas K. Erdman
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Patricia M. Kelshaw
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Samantha L. Hacherl
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shane V. Caswell
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Dr. Nicholas K. Erdman conceptualized the design of the study, carried out the initial analyses, drafted the initial manuscript, and revised the manuscript. Dr. Patricia M. Kelshaw conceptualized the design of the study, designed the data collection instruments, collected data, and critically reviewed the manuscript for important intellectual content. Ms. Samantha Hacherl designed the data collection instruments, collected data, and critically reviewed the manuscript for important intellectual content. Dr. Shane V. Caswell conceptualized the design of the study, designed the data collection instruments, and critically reviewed the manuscript for important intellectual content. All authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work.

Corresponding author

Correspondence to Shane V. Caswell.

Ethics declarations

Ethics approval and consent to participate

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. Additionally, our study was approved by the George Mason University Institutional Review Board. Participants signed informed consent regarding publishing their data.

Consent for publication

Informed consent was obtained from all individual participants included in the study.

Competing interests

The authors have no competing interests to disclose.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Erdman, N.K., Kelshaw, P.M., Hacherl, S.L. et al. The Clinical Utility of the Child SCAT5 for Acute Concussion Assessment. Sports Med - Open 8, 104 (2022). https://doi.org/10.1186/s40798-022-00499-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40798-022-00499-8

Keywords

  • Neurocognitive
  • Balance
  • Symptomology
  • Children
  • Diagnostic accuracy