Verifying Head Impacts Recorded by a Wearable Sensor using Video Footage in Rugby League: a Preliminary Study
Sports Medicine - Open volume 5, Article number: 9 (2019)
Rugby league is a full-contact collision sport with an inherent risk of concussion. Wearable instrumented technology was used to observe and characterize the level of exposure to head impacts during game play.
To verify the impacts recorded by the x-patch™ with video analysis.
Observational case series.
The x-patch™ was used on eight men’s semi-professional rugby league players during the 2016 Newcastle Rugby League competition (five forwards and three backs). Game day footage was recorded by a trained videographer using a single camera located at the highest midfield location to verify the impact recorded by the x-patch™. Videographic and accelerometer data were time synchronized.
The x-patch™ sensors recorded a total of 779 impacts ≥ 20 g during the games, of which 732 (94.0%) were verified on video. In addition, 817 impacts were identified on video that did not record an impact on the sensors. The number of video-verified impacts ≥ 20 g, per playing hour, was 7.8 for forwards and 4.8 for backs (range = 3.9–19.0). Impacts resulting in a diagnosed concussion had much greater peak linear acceleration (M = 76.1 g, SD = 17.0) than impacts that did not result in a concussion (M = 34.2g, SD = 18.0; Cohen’s d = 2.4).
The vast majority (94%) of impacts ≥ 20 g captured by the x-patch™ sensor were video verified in semi-professional rugby league games. The use of a secondary source of information to verify impact events recorded by wearable sensors is beneficial in clarifying game events and exposure levels.
Wearable instrumented technology has the potential to quantify the kinematic responses of the head when exposed to head impact forces during contact and collision sports.
The vast majority of high acceleration impacts (≥ 20 g) recorded on sensor were verified on video review of the games, and impacts resulting in a medically diagnosed concussion had greater peak linear acceleration than impacts that did not result in a concussion.
There was a substantial number of possible false-positive high-acceleration impacts recorded on the sensors before, during, and after the games. It is recommended that until sensor technology improves, head impact sensor data are used in conjunction with video.
Rugby league is a high-intensity collision sport  with a risk of concussive injury for participants . Concussion can occur in rugby league through direct head impacts and potentially through indirect impacts, i.e., inertial or impulsive , because both can give rise to the necessary brain loadings considered to cause concussion. The incidence of medically diagnosed concussions in three clubs in the National Rugby League (NRL) was 14.8 and 8.9 per 1000 player match hours in 2013  and 2014 , respectively. The incidence rate of suspected concussions based on use of the “concussion interchange rule” was 24.0 per 1000 NRL player match hours . No study has reported on the incidence of concussion at semi-professional or amateur levels of competition . Accurately and quickly identifying a concussion is especially important in the NRL, both for player safety and team strategy. If a player is evaluated for but not diagnosed with a concussion, the team is forced to use one of their 12 “interchanges,” while if the player is diagnosed with a concussion, an interchange is not used.
Using technology to assist in identifying head impacts and concussion, diagnosis has been increasingly common. For instance, sideline video review and analysis has been introduced in a number of professional leagues worldwide to improve the recognition of a possible concussion . Several studies have reviewed the usefulness and limitations of sideline and post-game video review [15, 22, 38, 40]. For example, some studies evaluating video use in professional leagues [15, 19, 21, 22, 24, 38, 40, 41] reported that video injury surveillance can be difficult to interpret, but may provide a useful adjunct to the recognition of concussion . There has also been interest in examining whether impact sensors can identify head impacts. Impact sensors have been used in a number of research studies of helmeted (e.g., American football [4,5,6,7, 11, 16, 26, 29, 52, 54, 56, 61], ice hockey [45,46,47, 57, 58]), and non-helmeted sports (e.g., football/soccer [30, 43], rugby union [34, 36], rugby league , Australian rules football [33, 55], lacrosse , mixed martial arts ) to the kinematic responses to forces applied to the head during participation in sports. The validity of these impact sensors has been examined in controlled laboratory studies [1,2,3, 8, 9, 14, 28, 33, 39, 51, 53, 60], suggesting peak linear acceleration as measured by the x-patch™ has reasonable agreement with the Hybrid III anthropomorphic test device (ATD) head-neck system, but the angular velocity measured by the the x-patch™ had much poorer agreement. The low sampling frequency of the x-patch™ has been suggested to be a reason for the poor agreement . Although numerous studies recorded the total number of impacts that occurred while players wore the sensors [27, 28, 31,32,33, 35, 40, 46, 55], few of the studies verified those impacts via video [31, 49, 59] or were not able to differentiate direct head impacts from indirect impacts.
A growing body of research has combined the use of impact sensors with game video to verify the accuracy of impacts recorded by this wearable technology. However, a more complete assessment of the validity of all impacts using additional sources of information is required [12, 50]. For example, only 16% of recorded impacts were verified on video in a study of women’s collegiate football (soccer) , 65% in boys high school lacrosse , and 32% in girls high school lacrosse , suggesting that the wearable sensor technology may substantially overestimate impact events . Few studies have examined rugby league using these technological advances. Gardner and colleagues  reviewed video footage of concussions and suspected concussions in the NRL. They reported that 98% of initial (primary) impacts occurred to the head/face, but they did not localize the impact location any further. More recently, King and colleagues  reported a total of 1977 impacts in 88 h of game play during a single season of junior rugby league using the x-patch™ sensor, with 48% of impacts reported to have occurred to the side of the head, 26% to the front of the head, and 25% to the back of the head. However, every event (> 10 g) captured by the x-patch™ sensor will be deemed to be a direct head impact and assigned a location on the head, regardless of whether such an impact occurred. No previous studies have combined video analysis and impact data from sensors in rugby league. The primary aim of this study was to determine the reliability of x-patch™-derived measurements of head impact exposures. A secondary aim was to describe the playing characteristics and game play situation of the video-verified impacts in semi-professional men’s rugby league.
Data were prospectively collected from a men’s semi-professional rugby league team during the 2016 Newcastle Rugby League season. A total of 8 players (mean age 25.5 years, SD 4.7 years) from a single club consented to participate. The participant’s playing position consisted of five forwards and three backs. A typical rugby league team formation involves 13 players (7 backs, 5 forwards) on the field at one time. During the course of the season, there were six medically diagnosed concussions in four players. Concussion was diagnosed by a medical practitioner. The operational diagnosis was consistent with the Concussion in Sport Group (Berlin, 2016)  definition. The research protocol was approved by the University of Newcastle Human Research Ethics Committee (reference no. H-2015-0323). The study was also endorsed by the Newcastle Rugby League and the participating club.
All consenting participants wore x-patch™ sensors (X2 Biosystems) during all games that they participated in during the 2016 Newcastle Rugby League season. The x-patch™ sensors were attached to the skin covering the right mastoid process of each player because previous literature has suggested that sensor positioning over the mastoid process is crucial to ensure that it is not activated by soft tissue effects during impacts . Each sensor was uniquely labeled and applied to the players by a trained member of the research team in the change rooms. Sensors were affixed and activated before the team’s warm-up, approximately 30 min before the beginning of the game. An alcohol wipe was used to clean the skin behind the ear over the right mastoid process before a Convacare protective barrier wipe (ConvaTec Inc.) was applied to help with adhesion of the area. The sensor was attached using a double-sided adhesive patch and worn for the entire game.
The x-patch™ contains a triaxial accelerometer and gyroscope that measure linear and angular kinematics. These are applied to estimate the head’s kinematic responses, e.g., resultant linear acceleration and peak linear acceleration (PLA), peak rotational velocity and acceleration (PRV), and location of impact. The slope of the relationship between the actual PLA in a laboratory setting and the PLA measured by the x-patch™ has been reported as 0.972, which is similar to the expected relationship of 1.0 (p = .14) . However, the relationship between the actual peak angular acceleration (PAA) and the measured (PAA) was only 0.7745 (p = .0027), which is statistically different from the expected 1.0 relationship. Therefore, we decided to not report in detail the angular head kinematic data (i.e., angular velocity and angular acceleration). The x-patch™ does not measure impact force and cannot differentiate between a direct head impact and an impact to another part of the body that results in acceleration of the head, i.e., impulsive or inertial loading. The x-patch™ records data when linear acceleration exceeds 10 g; at which point, the x-patch™ saves 10 ms prior to the impact and 90 ms after, with a maximum of 1000 data points per channel. During the study, each x-patch™ was removed immediately after each game in the change room, and data were downloaded to the Injury Management Software (IMS; X2Biosystems). The IMS produces a time-stamped line output for each “impact” which included PLA, PRA, PAV, HIC, and other variables. The x-patch™ does not measure impact force, and therefore, any perturbation of the wearer that causes a linear head acceleration greater than 10 g is recorded as a “head impact,” even when direct head impact did not occur. The sensors were cleared of data before being charged and stored for the next game.
Each game was digitally recorded by a trained videographer. One single-view high-definition camera was positioned at the highest possible vantage point at the field’s midline (i.e., the center). Close-up shots panned left and right following the ball to maximize the visibility of game play, players, and potential impacts. Game footage was analyzed in conjunction with data obtained from the x-patch™. Video time was synchronized with time stamps from the sensors using the first three impacts from each player. Each half of the game was viewed from start to finish using QuickTime X (Apple Inc.) by one author (LC). The reviewer has experience in watching professional rugby league. Video was played back at an appropriate speed to verify whether or not an impact occurred. This consisted of pausing, replaying, and using slow motion as needed. Every impact on video was matched to the sensor data for validation. An impact was defined as “any contact, to the head or trunk/torso, made to the player wearing an x-patch™ by another player or the playing surface.” Sensor-recorded impacts not verified with video were identified. Similarly, impacts on video that did not correlate with x-patch™-recorded impacts were identified. Impacts were categorized as either direct (defined as an impact that made direct contact with the head) or indirect (defined as an inertial or impulsive impact from contact made to the body rather than directly to the head). Impacts were also characterized by play characteristics (i.e., attacking—running with the ball, defending—tackling, and off-the-ball incidents—no player was in possession of the ball when contact between players was made). They were also characterized into number of tacklers (i.e., 1–4), wrestling impacts that happen after the initial contact (yes/no), side of contact (i.e., left, right, back, or front on), area of contact (i.e., head, shoulder, chest, arm, waist, or below), and whether an impact appeared to be direct contact with the sensor (yes/no). The type of game-play scenario was also considered. As previously described in the video review of rugby league game play , the “hit-up” was defined as “a type of play where the ball carrier charges directly into an organized defensive line.” Data were coded in Microsoft Excel.
Descriptive statistics (i.e., frequencies, percentages, medians, IQRs, and standard deviations) of peak linear acceleration (PLA) and peak rotational velocity (PRV) for all verified head impacts ≥ 20 g were calculated by player position and game-play situation. Similar to criteria applied in previous studies [10, 43], the review of impacts was limited to ≥ 20 g to remove low acceleration events (< 20 g) commonly associated with physical activities of game play (e.g., jumping, hard stops, sharp changes of direction) and unlikely to result in deleterious neurophysiological changes. Impact rates per player game hours (PGH) with corresponding 95% confidence intervals (CIs) were constructed. The impact rate was calculated as the number of verified impacts divided by the number of PGH. The formula for calculating the impact rate is provided below.
Players engaged in game play for different amounts of time over the course of the season. We calculated verified impacts per minute. Cross tabulations were conducted between the impact sensors’ estimated head impact location and the characterization conducted using video analysis. Data were also reviewed for playing position (i.e., forward versus back) and play characteristics (i.e., attacking, defending, off-the-ball). An exploratory t test was used to compare the rate that forwards and backs sustained verified impacts. Exploratory analyses compared the acceleration (i.e., PLA) between verified/non-verified impacts, direct/indirect impacts, and concussion/non-concussion impacts using non-parametric tests because PLA was not normally distributed. The Mann-Whitney (MW) test was used when there was homogeneity of variances, and the Kolmogorov-Smirnov (KS) test was used when variances were unequal. All analyses were performed using SPSS 23 (IBM Corp.).
During the 2016 Newcastle Rugby League competition, eight participants were instrumented with the wearable sensors and game video was captured during all games. These athletes played a total of 91 games across the season (89.1 player game hours/5346 player game minutes). Stratified by playing position, data from forwards accounted for 39.6% (2117 min) and data from backs accounted for 60.4% (3229 min) of playing time. The x-patch™ became detached from each player at least once during the season, for a total of 183 min of lost data due to detached sensors for the season (backs M = 19 min, SD = 16.46, range = 15–50; forwards M = 12 min, SD = 19.38, range = 2–51). In addition, there was a 135-min game time lost due to faulty sensors (all forwards).
There were 2997 video-verified impacts to the eight players (Table 1). Of those, 732 were recorded as 20 g or greater (24%), 1448 video-verified direct and indirect impacts were recorded as between 10 g and 20 g (48%), and 817 (27%; 36 direct vs 781 indirect) were not recorded on the sensors (see Fig. 1). The video review revealed 36 direct head impacts (24 to the side of the head, 6 to the front, and 6 to the back) that did not result in any data being recorded on the x-patch™, in addition to 21 impacts (registered as > 30 g) recorded by the x-patch™ that were not verified on video. There was no significant difference in the PLA of video-verified versus non-video-verified impacts (verified M = 34.5, SD = 18.3; non-verified M = 41.2, SD = 29.2; KS Z = 0.96, p = .32; Cohen’s d = − 0.27).
There were 3705 sensor-recorded impacts to the 8 players (see Fig. 1). Of those, 1525 (41.2%) were not seen on video. Of the 1525 impacts that were not seen on video, 533 (35.0%) occurred before or after the game. Interestingly, there were 254 impacts registered as ≥ 20 g that were not seen on video, and of those, 119 occurred before the game (47%, presumably during warm up), 47 occurred during the game (19%), and 88 occurred after the game (35%). It seems particularly unusual that there would be 88 ≥ 20 g impacts and 207 10 to 20 g impacts to these 8 players occurring after the game had ended.
Direct Head Impacts by Game and Player Characteristics
Of the 732 video-verified impacts, 536 were identified as direct head impacts. Of the 536 video-verified direct head impacts, the ball carrier (attacker) recorded 261 (48.7%) and the tackler (defender) recorded 253 (47.2%), while 22 were recorded during an off-the-ball incident (4.1%; incidental contact n = 9; contact with the playing surface n = 4; melee/scuffle or fighting n = 6; contact celebrating tries n = 3). The number of impacts recorded in the first half (49.3%) compared to the second half of games (50.7%) was similar. Players sustained an average of 0.10 direct impacts per minute played (SD = 0.07, range = 0.04–0.27), which equates to an average of one verified impact per 10.0 min. Forwards sustained more verified impacts per minute compared to backs (forwards M = 0.13, SD = 0.08, 1 per 7.2 min; backs M = 0.08, SD = 0.03, 1 per 13.3 min). An exploratory independent sample t test suggests that forwards and backs did not statistically differ in the rate they sustained direct impacts (t(7) = 1.04, p = .33). However, effect size analysis shows a large, meaningful difference between the rates they sustained impacts based on playing position (Cohen’s d = 0.83). The individual player data by playing position, game time impact, and video verification are provided in Table 2.
Impact Mechanism and Location
When stratifying all video-verified direct head impacts (n = 536) by the location of impact from the x-patch™, the most impacts occurred to the front (n = 190, 35.4%) and side (n = 194, 36.2%), with fewer to the back (n = 121, 21.3%) and top (n = 31, 5.3%) of the head. When examining the location of the verified impacts on video review, the most impacts were determined to occur to the side (n = 498, 92.9%) and front (n = 27, 5.0%%), with fewer impacts to the back (n = 11, 2.1%). The x-patch™ accurately recorded the location of video-verified direct head impacts in 55.6% of video-verified impacts to the front of the head, 38.0% of video-verified impacts to the side of the head, and 54.5% of video-verified impacts to the back of the head. The sensor recorded 39 impacts to the top of the head, whereas no impact was verified by video review as impacting the top of the head (see Table 3).
Direct impacts (as determined by video review) had a greater PLA compared to indirect impacts (direct M = 37.59, SD = 20.09; indirect M = 26.22, SD = 7.67; KS Z = 4.14, p < .001, d = 0.75), as well as greater PRV compared to indirect impacts (direct M = 27.70, SD = 11.55; indirect M = 21.97, SD = 9.02; KS Z = 2.77, p < .001, d = 0.55). Secondary impacts during a tackle (i.e., impacts after the initial contact) accounted for 261 (35.7%) of total impacts (Table 4). There were 580 tackles that resulted in the 732 video-verified impacts. For 480 tackles, there was 1 impact recorded; for 83, there were 2 impacts recorded; for 15, there were 3 impacts recorded; and for 2, there were 4 impacts recorded. There were additional 32 tackles occurring off the ball that resulted in 33 video-verified impacts (31 with 1 impact recorded and 1 with 2 impacts). The hit-up was a play that accounted for approximately 52% (n = 301) of all x-patch™ recorded events. Of the hit-up plays, forward positions accounted for 44% (n = 132) of those impacts, while backs accounted for approximately 56% (n = 169) of impacts. A summary of the total impacts per play and the total impacts per play for forward and back positions is provided in Table 4.
There were six diagnosed concussions during the season. All six concussions (100%) occurred as a result of a direct head impact. The PLA of the impacts that resulted in a diagnosed concussion was much greater (M = 76.1g, SD = 17.02, range = 61.6–106.6 g) than video-verified direct impacts that did not result in a concussion that were > 20 g (M = 34.20 g, SD = 17.96; MW U = 183.50, p < .001, d = 2.39). Figure 1 shows the PLA and PRV for all video-verified impacts with the six concussions highlighted.
The purpose of this study was to verify the information recorded by wearable impact sensors to determine the reliability of the data, in addition to describing the playing characteristics and game-play situation of the video-verified impacts in semi-professional men’s rugby league. Eight semi-professional male rugby league players wore wearable impact sensors during a single season. The vast majority of high acceleration impacts during games were verified on video. Specifically, there were 779 in-game sensor-recorded impacts ≥20 g, of which 732 were verified on video (i.e., 94%; Table 2). Differences in the number of video-verified impacts per hour of playing time were observed based on playing position, such that forwards had greater exposure compared to backs, consistent with previous literature [17, 25]. As seen in Fig. 2, impacts resulting in a medically diagnosed concussion had much greater peak linear acceleration (M = 76.1 g, SD = 17.0) than impacts that did not result in a concussion (M = 34.2 g, SD = 18.0; d = 2.39). However, as seen in Fig. 1, there were six (0.82%) video-verified direct head impacts above the highest recorded concussion PLA, and 53 (7.2%) video-verified direct head impacts above the lowest recorded concussion PLA, that did not result in concussion—suggesting a host of factors beyond the impact acceleration may contribute to acute neurological disturbances of concussion.
There were 817 tackles or impacts on video review that did not result in any recording at all on the impact sensor (i.e., false negatives). It is difficult to determine the true level of false-negative data because video review does not enable determination of the observed impacts to the head that occur above or below the 10 g threshold (i.e., which impacts are at a sub-threshold and do not register on the x-patch™). In addition, given that for 101 (17%) tackles, there was more than 1 impact (i.e., in a single tackle, multiple impacts were recorded) registered by the x-patch™, the true level of false-negative data could also be much greater than the 817 because on video review, it was only the initial impact that was considered as being missed, and not any subsequent impact that may have been recorded during the same tackle.
Our reported rate of video-verified true sensor-detected impacts may be an overestimate, and it might be confounded by player position. Rugby league is a demanding physical contact game with frequent body contact. Defensive players and “hit-up” players (i.e., forwards) may have a greater body contact rate than backs. If the x-patch™ records spurious head impact events, as appeared to be the case before and after match play, by chance, the video review is likely to identify an impact event (i.e., some body contact) when the x-patch™ records a spurious head impact. Rugby league may not be the ideal setting for validating all characteristics of head impact sensors. The rate of false-positive sensor-detected impacts cannot be determined. There were 295 impacts recorded on the sensors after the game had ended. Of those, 88 were ≥ 20 g impacts. It seems unusual that there would be so many large impacts recorded after the game, and we cannot determine the extent to which the sensors yield false-positive findings before, during, or after the game. In general, the rate of false-positive impacts, in addition to the possibility that the device could register greater linear acceleration than was actually the case, raises concern that impact sensor studies that do not verify impacts may be over-reporting both the level of exposure of athletes (i.e., the number of true head impacts) and the severity of the head impacts (i.e., the magnitude of the head’s kinematic responses).
On average, players sustained 1 verified impact every 10.0 min. The rate that these athletes sustained impacts appeared to differ based on their playing position, with forwards sustaining impacts more frequently than backs. Our exploratory (and underpowered) independent sample t test did not show group differences, but this non-significant finding is likely an artifact of the small sample size in our pilot study; effect size analysis showed a large, meaningful difference in the number of impacts stratified by playing position (Cohen’s d = 1.15). We have previously reported that the concussion interchange rule (a rule used by club medical staff to remove and assess a player suspected of having sustained a concussion to determine the player’s suitability to remain in a game or be permanently removed) was used more commonly in forwards than in backs at the professional level (forwards 57%, backs 43%)  and the national youth level (forwards 66%, backs 34%) . In the current study of semi-professional rugby league players, the impact exposure levels (as measured by the x-patch™ and verified on video) revealed the forward positions are more commonly exposed to contact with the head during match play than the backline positions.
On-field play characteristics may also be associated with head impacts and potential concussions. A prior study showed that the concussion interchange rule was used to remove the tackler 55% and 61% of the time compared to 43% and 38% for the ball carrier at the professional and national youth level, respectively . In the current study, approximately 44% of the video-verified impacts involved the tackler, approximately 51% involved the ball carrier, and approximately 5% were recorded during an off-the-ball incident. A tackler making an upper body tackle high on the ball carrier making a hit-up was the most common play leading to the use of the concussion interchange rule, accounting for 26% of all uses at the professional level . In the current study of semi-professional rugby league players, the hit-up play accounted for approximately 49% (n = 301) of all verified x-patch™-recorded impacts, with the tackler accounting for 46% (n = 279) and 5% (n = 32) coming from off-the-ball incidents, a similar result as the professional level. In addition, the hit-up play data revealed that forward positions accounted for 44% (n = 132) and backs approximately 56% (n = 169) of impacts recorded.
The current study offers some insights into the level of impacts sustained in the sport of rugby league at the semi-professional level. Although the results are preliminary given the small sample size, it is clear that there appears to be variations in impact exposure by position (forwards versus backs), type of play (i.e., the hit-up), game situation (ball carrier versus tackler), and number of tacklers involved in a tackle. These findings also offer further insights into the previous rugby league video analysis studies that have been conducted at the professional level [19,20,21,22,23] examining risks for activation of a head injury assessment (HIA) and subsequent diagnosed concussion.
In the current study six concussions were diagnosed in players wearing the x-patch™. There was a large, statistically significant difference between the PLA of concussive impacts versus non-concussive impacts. Future studies should aim to collect a larger number of concussion events in order to calculate the possible thresholds of PLA (as well as other parameters) and sensitivity and specificity of those impact thresholds to determine the potential clinical application of the x-patch™ or similar devices for assisting in the clinical diagnosis of concussion.
There are a few limitations to the current study design. First, using only eight players is the small sample size and limits the generalizability of the findings. Second, the false-negative incidences only considered a single (i.e., initial) impact as missing, as such, the possibility that a second or subsequent impact registration was also not coded by the impact sensor was not calculated as a “missed impact” resulting in an underestimation of the potential false negatives. Third, each video was coded by a single researcher. It is possible that some impacts were missed by the researcher when reviewing video. Fourth, the current findings may not be generalizable to all levels of rugby league or other sports. Fifth, the current findings are limited to the x-patch™ impact sensor only and may not reflect the capabilities of other impact sensors. Finally, there is no accepted standard as to what head impact-related PLA represents a “subconcussive” hit (e.g., 10 to 20 g) apart from a strict clinical outcome, nor is it understood how or whether these impacts affect brain microstructure or function. Future studies with larger sample sizes may consider reviewing the role cumulative impacts may have on the vulnerability of an athlete to future concussive events. In addition, in view of the literature that suggests that cumulative head impact exposure is a predisposing factor for the onset of concussion [27, 55], reviewing the potential increased vulnerability for subsequent concussions in athletes who sustain multiple impacts and multiple concussions may also be an important focus in future larger studies. It may also be useful for future studies to extend video recordings to before and after the match so that non-match play head impacts can be better understood.
These data are consistent with the findings from Cortes and colleagues  who found that using a secondary source of information to verify head impact events recorded by wearable sensors was beneficial in clarifying game events. Similar to those boys and girls lacrosse players , a considerable number of false-positive head impacts were recorded by the wearable sensors in our semi-professional rugby league players. This illustrates the value of adding an additional source of information (i.e., video) when quantifying the impacts players sustain. The implementation of a standard verification method could assist in validating data and reducing false-positive rates. It is important that these false-positive results are described appropriately in impact sensor studies to more accurately communicate the findings of impact sensor research and better brain loading patterns, and inform scientists/industry leaders about the limitations of current wearable technology. Such findings have practical implications for how impact sensors should be used and how existing data should be interpreted. Video confirmation of impacts and time synchronization can support a more accurate measure of impact frequency/magnitude and characterization of head impact events . The use of a secondary source to verify impacts will assist in clarifying the severity of the impacts and the level of burden of exposure for an athlete.
Anthropomorphic test device
Head injury assessment
National Rugby League
Player game hours
Peak linear acceleration
Peak rotational velocity
Allison MA, Kang YS, Bolte JH 4th, Maltese MR, Arbogast KB. Validation of a helmet-based system to measure head impact biomechanics in ice hockey. Med Sci Sports Exerc. 2014;46:115–23.
Allison MA, Kang YS, Maltese MR, Bolte JH 4th, Arbogast KB. Measurement of Hybrid III head impact kinematics using an accelerometer and gyroscope system in ice hockey helmets. Ann Biomed Eng. 2015;43:1896–906.
Beckwith JG, Greenwald RM, Chu JJ. Measuring head kinematics in football: correlation between the head impact telemetry system and Hybrid III headform. Ann Biomed Eng. 2012;40:237–48.
Beckwith JG, Greenwald RM, Chu JJ, Crisco JJ, Rowson S, Duma SM, Broglio SP, McAllister TW, Guskiewicz KM, Mihalik JP, Anderson S, Schnebel B, Brolinson PG, Lund B, Collins MW. Timing of concussion diagnosis is related to head impact exposure prior to injury. Med Sci Sport Exerc. 2013;45:747–54.
Breedlove EL, Robinson M, Talavage TM, Morigaki KE, Yoruk U, O’Keefe K, King J, Leverenz LJ, Gilger JW, Nauman EA. Biomechanical correlates of symptomatic and asymptomatic neurophysiological impairment in high school football. J Biomech. 2012;45:1265–72.
Broglio SP, Eckner JT, Martini D, Sosnoff JJ, Kutcher JS, Randolph C. Cumulative head impact burden in high school football. J Neurotrauma. 2011;28:2069–78.
Brolinson PG, Manoogian S, McNeely D, Goforth M, Greenwald R, Duma S. Analysis of linear head accelerations from collegiate football impacts. Curr Sports Med Rep. 2006;5:23–8.
Camarillo DB, Shull PB, Mattson J, Shultz R, Garza D. An instrumented mouthguard for measuring linear and angular head impact kinematics in American football. Ann Biomed Eng. 2013;41:1939–49.
Campbell KR, Warnica MJ, Levine IC, Brooks JS, Laing AC, Burkhart TA, Dickey JP. Laboratory evaluation of the gForce tracker, a head impact kinematic measuring device for use in football helmets. Ann Biomed Eng. 2016;44:1246–56.
Caswell SV, Lincoln AE, Stone H, Kelshaw P, Putukian M, Hepburn L, Higgins M, Cortes N. Characterizing verified head impacts in high school girls' lacrosse. Am J Sports Med. 2017;45:3374-81.
Cobb BR, Urban JE, Davenport EM, Rowson S, Duma SM, Maldjian JA, Whitlow CT, Powers AK, Stitzel JD. Head impact exposure in youth football: elementary school ages 9-12 years and the effect of practice structure. Ann Biomed Eng. 2013;41:2463–73.
Cortes N, Lincoln AE, Myer GD, Hepburn L, Higgins M, Putukian M, Caswell SV. Video analysis verification of head impact events measured by wearable sensors. Am J Sports Med. 2017;45:2379–87.
Cortes N, Stone H, Lincoln A, Hepburn L, Putukian M, Myer G, Caswell S. Video analysis verification of wearable sensor-based head impacts. Med Sci Sport Exerc. 2016;25:2772.
Crisco JJ, Chu JJ, Grenwald RM. An algorithm for estimating acceleration magnitude and impact location using multiple nonorthogonal single-axis accelerometers. J Biomech Eng. 2004;126:849–54.
Davis G, Makdissi M. Use of video to facilitate sideline concussion diagnosis and management decision-making. J Sci Med Sport. 2016;19:898–902.
Funk JR, Rowson S, Daniel RW, Duma SM. Validation of concussion risk curves for collegiate football players derived from HITS data. Ann Biomed Eng. 2012;40:79–89.
Gabbett TJ. Influence of playing position on the site, nature, and cause of rugby league injuries. J Strength Cond Res. 2005;19:749–55.
Gardner A, Iverson GL, Levi CR, Schofield PW, Kay-Lambkin F, Kohler RMN, Stanwell P. A systematic review of concussion in rugby league. Br J Sports Med. 2014;49:495–8.
Gardner AJ, Howell DR, Levi CR, Iverson GL. Evidence of concussion signs in National Rugby League match play: a video review and validation study. Sport Med - Open. 2017;3:29.
Gardner AJ, Iverson GL, Quinn TN, Makdissi M, Levi CR, Shultz SR, Wright DK, Stanwell P. A preliminary video analysis of concussion in the National Rugby League. Brain Inj. 2015;29:1182–5.
Gardner AJ, Iverson GL, Stanwell P, Ellis J, Levi CR. A video analysis of use of the new “concussion interchange rule” in the National Rugby League. Int J Sports Med. 2016;37:267–73.
Gardner AJ, Kohler RMN, Levi CR, Iverson GL. Usefulness of video review of possible concussions in National Youth Rugby League. Int J Sports Med. 2016;38:71–5.
Gardner AJ, Wojtowicz M, Terry D, Levi CR, Zafonte RD, Iverson GL. Video and clinical screening of Australian National Rugby League players suspected of sustaining concussion. Brain Inj. 2017;31:1918–24.
Gardner RC, Yaffe K. Epidemiology of mild traumatic brain injury and neurodegenerative disease. Mol Cell Neurosci. 2015;66:75–80 Available from: https://doi.org/10.1016/j.mcn.2015.03.001.
Gissane C, Jennings DC, Cumine AJ, Stephenson SE, White JA. Differences in the incidence of injury between rugby league forwards and backs. Aust J Sci Med Sport. 1997;29:91–4.
Greenwald RM, Gwin JT, Chu JJ, Crisco JJ. Head impact severity measures for evaluating mild traumatic brain injury risk exposure. Neurosurgery. 2008;62:789–98.
Guskiewicz KM, Mihalik JP, Shankar V, Marshall SW, Crowell DH, Oliaro SM, Ciocca MF, Hooker DN. Measurement of head impacts in collegiate football players: relationship between head impact biomechanics and acute clinical outcome after concussion. Neurosurgery. 2007;61:1244–52.
Gwin JT, Chu JJ, Diamond SG, Halstead PD, Crisco JJ, Greenwald RM. An investigation of the NOCSAE linear impactor test method based on in vivo measures of head impact acceleration in American football. J Biomech Eng. 2010;132:11006.
Gysland SM, Mihalik JP, Register-Mihalik JK, Trulock SC, Shields EW, Guskiewicz KM. The relationship between subconcussive impacts and concussion history on clinical measures of neurologic function in collegiate football players. Ann Biomed Eng. 2012;40:14–22.
Hanlon EM, Bir CA. Real-time head acceleration measurement in girls’ youth soccer; 2012. p. 1102–8.
Hernandez F, Wu LC, Yip MC, Laksari K, Hoffman AR, Lopez J, Grant G, Kleiven S, Camarillo DB, Camarillo D, Biomed EA. Six degree of freedom measurements of human mild traumatic brain injury HHS public access. Ann Biomed Eng. 2015;43:1918–34.
Hoskins W, Pollard H, Hough K, Tully C. Injury in rugby league. J Sci Med Sport. 2006;9:46–56.
Jadischke R, Viano DC, Dau N, King AI, McCarthy J. On the accuracy of the Head Impact Telemetry (HIT) System used in football helmets. J Biomech. 2013;46:2310–5.
King DA, Hume PA, Gissane C, Clark TN. Similar head impact acceleration measured using instrumented ear patches in a junior rugby union team during matches in comparison with other sports, vol. 18; 2016. p. 65–72.
King D, Brughelli M, Hume P, Gissane C. Concussions in amateur rugby union identified with the use of a rapid visual screening tool. J Neurol Sci. 2013;326:59–63.
King D, Hume PA, Brughelli M, Gissane C. Instrumented mouthguard acceleration analyses for head impacts in amateur rugby union players over a season of matches. Am J Sports Med. 2015;43:614–24.
King D, Hume P, Gissane C, Clark T. Head impacts in a junior rugby league team measured with a wireless head impact sensor: an exploratory analysis. J Neurosurg Pediatr. 2017;19:13–23.
Kohler R, Makdissi M, McDonald W, Partridge B, Gardner AJ. A preliminary video review of in-game head injury incidents (HII) and use of the head injury assessment (HIA) from the 2015 Super Rugby season. Br J Sports Med. 2017;51:A78–9.
Kuo C, Wu LC, Hammoor BT, Luck JF, Cutcliffe HC, Lynall RC, Kait JR, Campbell KR, Mihalik JP, Bass CR, Camarillo DB. Effect of the mandible on mouthguard measurements of head kinematics. J Biomech. 2016;49:1845–53.
Makdissi M, Davis G. The reliability and validity of video analysis for the assessment of the clinical signs of concussion in Australian football. J Sci Med Sport. 2016;19:859–63.
Makdissi M, Davis G. Using video analysis for concussion surveillance in Australian football. J Sci Med Sport. 2016;19:958–63.
McCrory P, Meeuwisse W, Dvorak J, Aubry M, Bailes J, Broglio S, Cantu RC, Cassidy D, Echemendia RJ, Castellani RJ, Davis GA, Ellenbogen R, Emery C, Engebretsen L, Feddermann-Demont N, Giza CC, Guskiewicz KM, Herring S, Iverson GL, Johnston KM, Kissick J, Kutcher J, Leddy JJ, Maddocks D, Makdissi M, Manley G, McCrea M, Meehan WP, Nagahiro S, Patricios J, Putukian M, Schneider KJ, Sills A, Tator CH, Turner M, Vos PE. Consensus statement on concussion in sport—the 5th international conference on concussion in sport held in Berlin, October 2016. Br J Sports Med. 2017; Epub ahead of print.
McCuen E, Svaldi D, Breedlove K, Kraz N, Cummiskey B, Breedlove EL, Traver J, Desmond KF, Hannemann RE, Zanath E, Guerra A, Leverenz L, Talavage TM, Nauman EA. Collegiate women’s soccer players suffer greater cumulative head impacts than their high school counterparts. J Biomech. 2015;48:3729–32.
McIntosh AS, McCrory P, Comerford J. The dynamics of concussive head impacts in rugby and Australian rules football. Med Sci Sport Exerc. 2000;32:1980–4.
Mihalik JP, Blackburn T, Greenwald RM, Cantu RC, Marshall S, Guskiewicz KM. Collision type and player anticipation affect head impact severity among youth ice hockey players. Pediatrics. 2010;125:e1394–401.
Mihalik JP, Guskiewicz KM, Marshall SW, Blackburn JT, Cantu RC, Greenwald RM. Head impact biomechanics in youth hockey: comparisons across playing position, event types, and impact locations. Ann Biomed Eng. 2012;40:141–9.
Mihalik JP, Guskiewicz KM, Marshall SW, Greenwald RM, Blackburn JT, Cantu RC. Does cervical muscle strength in youth ice hockey players affect head impact biomechanics? Clin J Sport Med. 2011;21:416–21.
Nevins D, Smith L, Kensrud J. Laboratory evaluation of wireless head impact sensor. In: Procedia Engineering. 2015.
O’Day KM, Koehling EM, Vollavanh LR, Bradney D, May JM, Breedlove KM, Breedlove EL, Blair P, Nauman EA, Bowman TG. Comparison of head impact location during games and practices in division III men’s lacrosse players. Clin Biomech. 2017;43:23–7.
Press JN, Rowson S. Quantifying head impact exposure in collegiate women’s soccer. Clin J Sport Med Off J Can Acad Sport Med. 2016;0:1–7.
Rowson S, Beckwith JG, Chu JJ, Leonard DS, Greenwald RM, Duma SM. A six degree of freedom head acceleration measurement device for use in football. J Appl Biomech. 2011;27:8–14.
Rowson S, Brolinson G, Goforth M, Dietter D, Duma S. Linear and angular head acceleration measurements in collegiate football. J Biomed Eng. 2009;131:1–7.
Siegmund GP, Guskiewicz KM, Marshall SW, DeMarco AL, Bonin SJ. Laboratory validation of two wearable sensor systems for measuring head impact severity in football players. Ann Biomed Eng. 2016;44:1257–74.
Talavage TM, Nauman E, Breedlove EL, Yoruk U, Dye AE, Morigaki K, Feuer H, Leverenz LJ. Functionally-detected cognitive impairment in high school football players without clinically-diagnosed concussion. J Neurotrauma. 2010;31:327–38.
Temper BD, Shah A. S, Harezlak J, Rowson SR, Mihalik JP, Duma SM, Riggen LD, Brooks A, Cameron KL, Campbell D, DiFiori J, Giza CC, Guskiewicz KM, Jackson J, McGinty GT, Svoboda SJ, McAllister TW, Broglio SP, McCrea M. Comparison of head impact exposure between concussed football athletes and matched controls: evidence for a possible second mechanism of sport-related concussion. Ann Biomed Eng 2018; online first.
Urban JE, Davenport EM, Golman AJ, Maldjian JA, Whitlow CT, Powers AK, Stitzel JD. Head impact exposure in youth football: high school ages 14 to 18 years and cumulative impact analysis. Ann Biomed Eng. 2013;41:2474–87.
Wilcox BJ, Beckwith JG, Greenwald RM, Raukar NP, Chu JJ, McAllister TW, Flashman LA, Maerlender AC, Duhaime AC, Crisco JJ. Biomechanics of head impacts associated with diagnosed concussion in female collegiate ice hockey players. J Biomech. 2015;48:2201–4.
Wilcox BJ, Machan JT, Beckwith JG, Greenwald RM, Burmeister E, Crisco JJ. Head-impact mechanisms in men’s and women’s collegiate ice hockey. J Athl Train. 2014;49:514–20.
Willmott C, McIntosh AS, Howard T, Mitra B, Dimech-Betancourt B, Donovan J, Rosenfeld JV. SCAT3 changes from baseline and associations with X2 patch measured head acceleration in amateur Australian football players. J Sci Med Sport. 2017;21:442–46.
Wu LC, Nangia V, Bui K, Hammoor B, Kurt M, Hernandez F, Kuo C, Camarillo DB. In vivo evaluation of wearable head impact sensors. Ann Biomed Eng. 2016;44:1234–45.
Young TJ, Daniel RW, Rowson S, Duma SM. Head impact exposure in youth football: elementary school ages 7-8 years and the effect of returning players. Clin J Sport Med. 2014;24:416–21.
Not applicable. No financial support was received for the conduct of this study or preparation of this manuscript.
Availability of Data and Materials
The data generated during the current study are not publically available due to the institutional human ethics committee approval requirements that ‘only the researchers listed as investigators on the ethics application will have access to the data’ but may be available from the corresponding author on reasonable request.
Ethics Approval and Consent to Participate
The study was approved by The University of Newcastle’s Human Ethics Committee (reference number: H-2015-0323) and was performed in accordance with the standards of ethics outlined in the Declaration of Helsinki.
Consent for Publication
The authors, Lauchlan Carey, Peter Stanwell, Douglas Terry, Shane Caswell, Andrew McIntosh, Grant Iverson, and Andrew Gardner, declare that they have no competing interests.
The author, Andrew McIntosh, declares that he has no competing interests with regards to this paper. Dr. McIntosh is a self-employed consultant and adjunct professor. Dr. McIntosh undertakes consulting work for a number of sporting organizations, including Racing Australia, Cricket Australia, and the Australian Football League. He has no consulting relationship, past or present, with any rugby league organization, including the National Rugby League, or sensor manufacturer. As an adjunct (unpaid) academic researcher, he is involved in a number of projects evaluating and utilizing wearable technology.
The author, Grant Iverson, has received research support from test publishing companies in the past, including PAR, Inc., ImPACT Applications, Inc., and CNS Vital Signs. He receives royalties for one neuropsychological test (Wisconsin Card Sorting Test-64 Card Version). He has an independent practice in forensic neuropsychology, including expert testimony. He serves as a strategic scientific advisory for BioDirection, Inc. He acknowledges unrestricted philanthropic support from the Mooney-Reed Charitable Foundation, ImPACT Applications, Inc., and the Heinz Family Foundation.
The author, Andrew Gardner, has a clinical practice in neuropsychology involving individuals who have sustained sport-related concussion (including current and former athletes). He has been a contracted concussion consultant to the Rugby Australia since July 2016. He has received travel funding from the Australian Football League (AFL) to present at the Concussion in Football Conference in 2013 and 2017. Previous grant funding includes the NSW Sporting Injuries Committee, the Brain Foundation (Australia), and the Hunter Medical Research Institute (HMRI) supported by Jennie Thomas, and the HMRI supported by Anne Greaves. He is currently funded through an NHMRC Early Career Fellowship, and Hunter New England Local Health District’s Research, Innovation and Partnerships Health Research & Translation Centre and Clinical Research Fellowship Scheme, and the University of Newcastle’s Priority Research Centre for Stroke and Brain Injury.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Carey, L., Stanwell, P., Terry, D.P. et al. Verifying Head Impacts Recorded by a Wearable Sensor using Video Footage in Rugby League: a Preliminary Study. Sports Med - Open 5, 9 (2019). https://doi.org/10.1186/s40798-019-0182-3
- Head impacts
- Rugby league
- Wearable sensors
- Video review