Skip to main content

Advertisement

Sports Medicine - Open
Sports Medicine - Open Cover Image
Download PDF

Performance Analysis in Rugby Union: a Critical Systematic Review

Sports Medicine - Open volume 6, Article number: 4 (2020) Cite this article

Abstract

Background

Performance analysis in rugby union has become an integral part of the coaching process. Although performance analysis research in rugby and data collection has progressed, the utility of the insights is not well understood. The primary objective of this review is to consider the current state of performance analysis research in professional rugby union and consider the utility of common methods of analysing performance and the applicability of these methods within professional coaching practice.

Methods

SPORTDiscus electronic database was searched for relevant articles published between 1 January 1997 and 7 March 2019. Professional, male 15-a-side rugby union studies that included relevant data on tactical and performance evaluation, and statistical compilation of time-motion analysis were included. Studies were categorised based on the main focus and each study was reviewed by assessing a number of factors such as context, opposition analysis, competition and sample size.

Results

Forty-one studies met the inclusion criteria. The majority of these studies measured performance through the collection and analysis of performance indicators. The majority did not provide context relating to multiple confounding factors such as field location, match location and opposition information. Twenty-nine performance indicators differentiated between successful match outcomes; however, only eight were commonly shared across some studies. Five studies considered rugby union as a dynamical system; however, these studies were limited in analysing lower or national-level competitions.

Conclusions

The review highlighted the issues associated with assessing isolated measures of performance, lacking contextual information such as the opposition, match location, period within match and field location. A small number of studies have assessed rugby union performance through a dynamical systems lens, identifying successful characteristics in collective behaviour patterns in attacking phases. Performance analysis in international rugby union can be advanced by adopting these approaches in addition to methods currently adopted in other team sports.

Key Points

  • Rugby performance analysis continues to rely heavily on isolated measures of performance, such as performance indicators, without providing context to confounding factors such as opposition behaviour, pitch location, period within match and venue location.

  • Some studies have investigated team behaviour in rugby union; however, to facilitate a better understanding of group behaviour in international rugby, a dynamical systems analysis approach at an elite level is recommended.

  • Within and between team interactions have been measured in other sports including football and basketball. Rugby performance analysis may benefit from adopting strategies employed by these sports in order to gain a better understanding of team properties and the patterns that characterise their coordination.

Background

Performance analysis in team sports allows coaches to objectively assess the performance of the team while identifying their oppositions’ strengths and weaknesses, and opportunities to exploit these in competition. To do this effectively requires a comprehensive analysis of individual and collective actions, to provide objective summaries of game activities during competition [1]. There has been an exponential growth in performance analysis research over the last two decades, largely a consequence of the advancement and availability of computer and video technology. Broadly, performance analysis involves an objective assessment of documented behaviours recorded in a discrete sequential manner containing information on ‘what’, ‘who’, ‘when’ and ‘where’ the behaviours occurred. Behaviours are typically recorded through annotation software; however, advancements in video capture technologies are allowing player position information to be analysed with associated behaviours to provide a more meaningful understanding of game behaviours. This development has contributed considerably to our understanding the performance requirements in elite-level competition. However, fundamental issues remain in the questions underpinning the research in the field; the cause-and-effect-based observations inherently assume linear relationships to predict and control match outcome. For example, the direction and scope of the research in rugby union has primarily explored a single or a combination of action variables (performance indicators) deemed relevant to successful outcomes such as possession and tackle success [2]. Furthermore, the analysis of these performance indicators has primarily only focused on discrete, descriptive and comparative statistics. Other common research topics have simply studied technical and physical requirements during specific periods or game events, such as peak running intensities [1, 3, 4]. Thus, this type of research assumes human behaviour is causal, measurable and thus predictable.

A further limitation to much of the research on performance analysis in rugby is that there is a lack of evidence surrounding the implementation of this work into everyday practice by coaches and practitioners. The apparent limited influence is potentially due to an absence of consensus between practitioners and scientists, and the information that drives actions and implementation. Performance analysis research is commonly composed by researchers, directing methods and structuring studies, potentially neglecting the applicability and utility of the research findings. Developing the field of performance analysis in rugby needs collaboration between scientists and practitioners to improve the ability of science to influence practice. Bridging the theory-to-practice gap may require developing an applied research model that describes rugby performance in an integrated manner.

To overcome the current methods beset by various issues, it seems pertinent to understand rugby performance as a complex dynamical system. In this sense, the patterns of game behaviour emerge from the self-organising interactions between players operating within task, and environmental and physical constraints [5]. A corollary to this is that rugby performance is highly complex and requires players to perform coordinated tactical behaviours and high-intensity movements with adept technical proficiency, making it difficult to reduce game analysis to isolated measures of performance. Therefore, there is a clear need for performance analysis to reflect and capture this complexity and create a global understanding of performance.

This paper systematically reviews the literature to describe the state of rugby union performance analysis, highlighting the various methods of analysis and exploring variables used to assess performance. We then conclude with some recommendations for future research drawing upon research from Association Football (football [soccer]) as a means of envisaging where the field of rugby could evolve to in the future.

Methods

A systematic review of the relevant literature was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines. The SPORTDiscus electronic database was searched on 8 March 2019 for relevant articles published between 1 January 1997 and 7 March 2019 using the following search terms:

Rugby AND “collective behav*” OR “tactic* analysis” OR “tactic* performance” OR “tactical indicator*” OR “performance indicator*” OR “performance analysis” OR “notational analysis” OR “game analysis” OR “observational analysis” OR “Pattern* of play” OR “dynamic* system” OR “tactic* behave*” OR “neural network” OR “system* think*” OR “performance model*” OR “player selection” OR “player evaluation” OR “game statistics”.

The inclusion criteria were as follows: included relevant data on tactical performance, time-motion analysis, such as assessments of team movement patterns in relation to time; participants included professional adult male rugby players; the sport analysed was 15-a-side rugby union; and articles were published in English. Articles were limited to journal articles where the full text was available. Studies were excluded if they included females; involved males under the age of 18; analysed rugby league or 7-a-side rugby union; were a conference abstract or doctoral thesis; and did not include relevant data for the study. Major research topics of game analysis that emerged from the detailed analysis were identified and the studies grouped accordingly: performance indicators, attack and defence. Research topics were decided upon by authors deeming the majority of the observations included (a) variables relating to the attacking team; (b) variables relating to the defensive team; or (c) predominantly involved the assessment of performance indicators. Successful and unsuccessful match outcomes were defined as match won and lost, respectively.

Quality of Studies

Quality of studies was not assessed based on a recognised classification method as the nature of the research valued observational, tactical studies. Therefore, as no experimental studies were included, Delphi, PEDro or Cochrane was not utilised as scales of evaluation. All 41 articles outlined in Table 1 were assessed for suitability and evaluated by the panel of authors prior to inclusion. All studies had to meet every item on the criteria list to be included in the analysis.

Table 1 A description of the reviewed studies
Full size table

Results

The initial search revealed 110 papers. Titles were screened by two members of the research team for inclusion/exclusion criteria. Ninety articles were then removed. The abstracts of the 20 remaining articles were then read by the same two members of the research team where a further six articles were removed, resulting in 14 articles remaining for review. After reading the full texts, all papers were deemed suitable for review. An iterative reference check was then performed of all eligible papers and any commonly cited papers were also included and a further 27 papers were identified. In total, 41 papers were included for discussion (Fig. 1).

Fig. 1
figure1

PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow diagram summarising the search results

Full size image

Data Organisation

The following variables were analysed in each study: (1) competition level (including geographic location); (2) main focus; (3) key performance indicators (including selection process, successful indicators and operational definitions); (4) contextualised variables; (5) opposition analysis; and (6) studies that used a dynamical systems approach (Tables 1, 2, and 3).

Table 2 A summary of performance indicators related to success
Full size table
Table 3 A summary of performance indicators
Full size table

Year of Publication and Competition

The 41 articles reviewed are presented in Table 1. In short, the articles were grouped into 5-year intervals by year of publication which resulted in an inverse parabolic curve representation of publication dates where 49% of the articles were published between 2008 and 2013 (Fig. 2). When articles were grouped into year of data collection and analysis, ~ 50% of the articles analysed data from games played between 2000 and 2008 (Fig. 2). Following this period, there has been a linear decrease in the collection of data for publication in rugby union performance analysis research.

Fig. 2
figure2

Distribution of articles by years of publication and years of analysis

Full size image

The year with the most publications was 2013 (n = 5) (Table 1), followed by 2010 (n = 4). The year of data collection and analysis was additionally considered important when interpreting results as game styles may have evolved from the time data were collected to the date of publication (Fig. 2). The period from 2003 to 2007 was the most heavily investigated time interval, with 2003 representing the most popular year of analysis (Table 1). Multiple competitions at various levels were investigated in the reviewed studies, ranging from elite domestic leagues to the Rugby World Cup. The most recurrently investigated competition was the Super Rugby Championship with 2006 representing the most frequently investigated season. The 2003 Rugby World Cup was the most investigated World Cup year, followed by 2007 and 2011.

Analysis of Opposition and Context

The majority of the articles did not include the opposition in their analysis. The ~ 20% that considered the opposition included events such as ball carries (Table 1), tackles, rucks, scrums and performance indicators. Seventy-one percent of the articles that investigated performance indicators contextualised the data (Table 3). Variables were contextualised to field location, match outcome, period during match, numbers of players involved, match phase, team ranking and competition level. Of the 22 articles that contextualised their measures of performance, only five accounted for multiple contextual variables.

Sample Size and Events

The sample sizes ranged from seven matches to 313 matches, with a mean number of 67 match observations (Table 1). Analysis of individual events ranged from 35, when try scoring incidences were explored, to 8563 ruck contests. The events analysed included ball carries, line breaks, tackles, ruck contests, try scoring observations and scrums. Ruck contests were the most commonly investigated individual events, totalling 15,677 individual events analysed across three studies.

Performance Indicators

A total of 392 performance indicators were identified across the reviewed articles (Table 3). Performance indicators were classified as either attack (n = 204); defence (n = 85); set piece (n = 53); or other (n = 50). Variables related to attack were the most frequently assessed measures of performance, followed by those related to defence.

Understanding the genesis of performance indicators might serve as a starting point for developing valid sets of quantitative tactical indicators. Therefore, the method utilised to select variables related to performance was also considered important. The method of selection utilised by the investigators included the following: a collaboration with investigators and coaches and/or experts; those selected solely by the research group; those sourced from a third-party company; and those where the method of selection was not stated.

Providing a detailed description of each performance indicator is essential to maintain transparency when measuring performance-related variables. These operational definitions allow the shared understanding of the variables used ensuring their meaning is unambiguous and understood [43]. Only seven articles provided full operational definitions, while the remaining 15 provided no definitions for the variables investigated (Table 3). Additionally, the majority of the articles that provided full operational definitions developed these in collaboration with coaches and/or experts.

Indicators linked to successful performance are displayed in Table 2. Across the articles investigating performance indicators, 29 variables differentiated between successful and unsuccessful match outcomes. Possession kicked was positively related to performance in three separate studies [22, 25, 37] at the international and Super Rugby level of competition. The second most frequently observed variables were lineout success on opposition ball; tries scored; points scored (including when possession starts in the opposition 22 m area); conversions; tackles completed; turnovers won; and kicks out of hand (Table 2).

Discussion

The purpose of this literature review was to describe the state of rugby union performance analysis, highlight the various methods of analysis and explore variables used to assess performance. We have revealed that in the last two decades of rugby research, the approach to describing performance has remained largely unchanged. Investigations into successful performance typically continue to rely on univariate measures of performance, reducing performance to singular values (Table 3). In fact, 22 of the 41 studies retrieved focused on descriptive and comparative statistics and often lacked context. Confounding factors such as match venue, officials, weather and the nature of the opposing team have all been suggested to influence team performance, yet are rarely considered in the majority of the research [17]. This level of information details the origin of the data and arguably allows for more meaningful interpretations. Critical information may, therefore, be lost if performance-related variables are not contextualised and measured while considering these factors [44]. For instance, a major confounding factor is the opposition team yet only eight of the articles retrieved considered the opposing team in the analysis [10, 11, 14, 15, 28, 32, 33, 40]. More than half of the articles investigated successful and unsuccessful measures of performance by quantifying performance indicators over entire competitions. Although this approach is useful as a means to increase the number of data, this level of analysis ignores the variation in playing style over each match and typically lacks consideration of the influence of opposition. Ignoring data from the opposition will likely distort any relationships present [41], particularly when one considers that various studies included data over multiple competitions [3, 4, 6, 25, 38] as well as over several seasons [9, 21, 22, 25, 30, 34] potentially misrepresenting performance outcomes. One paper examined the efficacy of two methods of data analysis to predict match outcomes [41]; isolated performance indicators, considering only the isolated data from a single team, were compared to a descriptive conversion method by calculating the differences between each team’s data for each individual match. That study showed match outcomes were better predicted by relative data sets. Relative predictors of success included an effective kicking game, ball carrying abilities and not conceding penalties when the opposition are in possession.

Although the majority of the studies included contextualised results, it should be noted that some research included contextual information from multiple confounding factors such as pitch location, match period and team ranking. For example, a study of effective strategies at the ruck in the 2010 Six Nations Championship accounted for team ranking, pitch location and number of players involved [33]. The results indicated greater success in regaining possession with a higher ratio of defenders to attackers in ruck situations. Similarly, pitch location and the timing of ruck strategies influenced the outcome of ball possession in the 2011 Super Rugby competition [15]. Defending teams were more likely to turnover possession using an early counter ruck strategy in the wide attacking channels. Conversely, a jackal (a player on the defending team competing for the ball using his hands after a tackle was made but prior to the formation of a ruck) was the most effective strategy in the central field areas. Another study identified quick rucks within the first 20 min and within the 60–70 min time interval had the largest positive effect on match outcome [30], whereas slow rucks had the largest negative effect on winning a match, regardless of the time interval. These results highlight the importance of contextualising performance indicators, as game tactics may need to be adapted depending on the field location, time interval and ruck strategy employed.

Applying the outcome from research using simple, descriptive and isolated variables without consideration of confounding variables is problematic in tactical preparation. For example, set piece tries discriminated between successful and unsuccessful teams [28]; however, without contextual information such as score differential, weather conditions, pitch location or team ranking, little inference can be made regarding how or why behaviours occurred. One study [14] investigating defending strategies in tackle contact events which considered the playing situation, defensive characteristics and phase outcomes bore some insights into effective defensive processes such as defensive speed, field location and period within a match. This study demonstrated that the period of the match and the distance of the contact event in relation to the previous phase are key variables that predict the likelihood of a successful phase outcome. In a practical sense, teams execute different lineout plays depending on the field location (i.e. 5, 6, 7 man; they may play off the top or maul). They may also be more reluctant to throw the ball to the back of the lineout in poor weather conditions. On this basis, set piece selection is commonly dependent on context and, therefore, it is important to consider these factors when assessing performance indicators. Furthermore, analysing the performance of a team assumes that the behaviours in one game will provide insights into future performance in subsequent matches. The fundamental issue is that game behaviours may only specifically represent the performance of a team at the time the data were captured [45].

Performance Definitions and Indicators

Over 300 performance indicators were identified across 22 studies (Table 3). Interestingly, only 29 were identified as related to successful performance. International tests demonstrated 14 variables (Table 2) discriminating winning and losing teams including higher points scored, kicks, turnovers and penalties conceded between the opposition's 50- and 22-m line. In regional-level competitions, such as Super Rugby in the Southern Hemisphere, 25 variables were identified as successful indicators of performance including a greater number of metres gained, kicks out of hand, line breaks and percentage tackles made compared to losing teams. To illustrate differences in styles of play at different levels of competition, performance indicators that discriminated between winning and losing teams in international test matches and Super Rugby games were investigated [25]. Winners of Super Rugby games kicked more possessions, made more tackles, completed more passes and made less errors. No performance indicators were able to discriminate between winners and losers in international test matches played during 2003 and 2006 when only close matches were investigated (< 15 points difference) [22]. In contrast, another investigation of international games in the same time period showed that winning teams had higher points scoring-related statistics, turn overs and kicks and were more successful at set piece [22]. This discrepancy in outcomes may be a function of close games potentially being played by two opposing high-quality teams, demonstrating similar levels of performance behaviours. This continues to highlight the importance of contextualising performance indicators as vital information is likely to be lost when confounding factors are not considered.

There is typically a lack of transparency in the operational definitions used to describe and analyse rugby performance. Twenty-two retrieved articles quantified performance using performance indicators; however, only 7 actually defined the variables analysed. Furthermore, of the 22 articles, only 16 were explicit about the process of selecting the indicators used. The selection process included expert opinion and research group [1, 17, 21], commonly available statistics by a third-party company [22, 23, 25, 28, 38] and those selected solely by the research group [3, 18, 29, 39] (Table 3). The method used when selecting performance indicators in the remaining articles was undisclosed. Challenges may arise given a lack of clarity (i.e. lack of definitions or objectivity when selecting performance indicators) when comparing or replicating investigations, making it difficult to advance the body of research and for coaching staff to implement the suggested practices. However, a summary of the research and performance indicators relevant to successful performance can provide useful insights.

As mentioned earlier, performance indicators provide an overview of certain events that may contribute to and predict successful performance. However, isolated performance indicators do not consider the opposition, nor do they account for unpredictability and inherent match specificity. For example, game behaviours tend to be inconsistent and performance indicators will most likely be influenced by player-opponent interactions. It is therefore unlikely that a complex, dynamic game such as rugby can be represented by isolated measures of frequency data.

Evolution of Performance Assessment

Studies relating to attack are more common than investigations into defence (Table 1). Topics such as try scoring, possession duration and ball carries were investigated in relation to the attacking team, whereas tackle contest events and rucks were detailed as measures of defence. Most studies analysing performance indicators investigated both attack and defence situations. Specific investigations into defensive strategies only appeared from 2013 most likely related to rule changes [36] favouring the defensive team during breakdown situations.

To accommodate changing game styles, rule changes were introduced in rugby during 2007 and 2013 expediting the speed of play to increase appeal and competitiveness [36, 46]. The period prior to, during and thereafter should be considered and compared, understanding that successful performance indicators prior to 2007 may not be relevant thereafter. For example, amendments to laws surrounding the ruck led to a decrease in players involved in ruck situations [19]. Teams are instead favouring committing more players to the defensive line in preparation for subsequent phases. As a result, game actions have increased due to the added pressure on attacking teams to expedite the speed of play [36].

Between 2004 and 2007, winning teams won more lineouts on the opposition's throw, scored more tries, had greater metres gained, kicks out of hand, line breaks and percentage tackles made in international, Super Rugby and professional domestic competitions [17, 22, 23]. Successful teams also had higher points scored, conversions, successful drop goals, mauls won, line breaks, possession kicked, tackles completed and turnovers won. In contrast, losing teams lost more scrums and lineouts. Following this epoch, between 2007 and 2013, winning teams conceded more penalties between 50 m and opposition 22 m, and had more total kicks, including kicks out of hand, than losing teams. After 2013, variables likely to result in winning included higher average carry metres, clean breaks made and kicks made relative to the opposition in a professional domestic league. Negative outcomes were more likely when teams conceded penalties while the opposition was in possession. Data were considered in relation to the opposition rather than isolated data of each team considered discretely [41]. Isolated methods of analysis indicated winning teams missed less tackles in the Super Rugby competition [38]. Analysis of knockout stages of the Rugby World Cup, however, indicated that winning teams kicked a greater percentage of possession in the opposition 22–50 m and won more lineouts on the opposition ball [37], suggesting that successful test rugby may require a territory style of play. Performance indicators investigated were inconsistent across the studies, making it difficult to compare and assess the relevance and impact of key attacking and defensive variables. As such, although points scored were unrelated to match outcome post 2013 [41], it is problematic to suggest that point scoring is not important in rugby performance.

Factors such as competition location may rationalise the differing game styles observed. Approximately 20% of studies reported on Northern Hemisphere teams known to have a different style of play to [47] to Southern Hemisphere competitions. Southern Hemisphere teams tend to exhibit higher overall ball-in-play periods resulting in more game actions and injuries due to greater game continuity [47]. Additionally, ~ 40% of articles investigated teams competing in international competitions (Table 1) and 13% included data sets from multiple competitions, possibly decreasing their relevance as some information may be missed given the loss of contextual information [48]. Maintaining the integrity of each individual match when using the established descriptive conversion method of analysis, which considers all performance indicators in relation to the opposition, is preferred [41].

In summary, studies of performance analysis in rugby often show methodological shortcomings regarding the genesis of performance indicators and selection process, a lack of transparency and operational definitions with the investigated performance indicators and issues related to investigating performance indicators over entire competitions. The problems associated with investigating performance indicators without the consideration of contextual and situational factors limit the application of research outcomes into the rugby community.

Advancing Rugby Performance Analysis

There are some notable studies that have explored the performance processes in rugby union. Recently, researchers have used clustering approaches to identify important patterns in match data associated with certain game outcomes [35, 42]. These methods are useful for reducing large volumes of high-dimensional data to visualisable, low-dimensional output maps or identifying key playing patterns. One method identified that multiple game styles tended to result in success, such as a ball carrying, high-contact style of play. A low possession and strategic kicking style of play was observed to be just as effective. However, it is important to consider that data were not explored in relation to opposition game style for each specific match. This means that support for an ideal game style could not be established. Moreover, the level of competition analysed was low and restricted to a single nation. A K-modes cluster analysis was used to identify common playing patterns that preceded a try [42], suggesting plays following lineouts, scrums and kick receipts were common approaches to scoring tries in Super Rugby. A limitation to these approaches is the data related to collective team behaviour, such as player positioning and movements, were not collected in either of these studies.

Multiple studies have considered rugby union performance using a dynamical systems approach to analyse game characteristics [27, 32, 49,50,51,52,53,54,55]; however, to the authors’ knowledge, only three studies have used this approach in professional, male adult rugby union contexts [26, 27, 32]. In this approach, important characteristics of complexity are assessed by emergent patterns, due to the interactions between components in the system (i.e. players) over time [51]. This method has been found to successfully identify self-organising, emergent patterns from slight changes in interactions between players [56]. This suggests that players’ decisions and actions are governed not only by prior instruction provided by coaches, but by constraints in the player-environment interaction. In team sports, these behaviours emerge in space and continuously change over time, under the influence of constraints such as task (rules governing the game), environmental (weather) and individual constraints (physical capacity of the athlete) [57], resulting in the spontaneous reorganisations of intrapersonal and interpersonal coordination [58]. Some research has measured the constraining influences of one team on the opposing team’s playing system formation [32]. Attackers were observed to act as a coordinated sub-unit, measured through correlation values, accounting for distance and relative velocity values between each player within the sub-unit (two players from one team) [58]. When the sub-unit of the attacking team was able to disturb the coordination tendencies of the defending team’s sub-unit, this resulted in opportunities for the attacking team to cross the gain line (an imaginary line parallel to the score line, set between the attackers and defenders every time that attackers and defenders perform a ruck, maul, scrum or lineout [32]). However, when both sub-units remained equally coordinated, neither the attacking nor the defending team was successful in crossing the gain line or regaining possession of the ball, respectively. Small adjustments in players’ interpersonal distances and running line speed were considered useful tools to disturb the opponent’s coordination patterns. Using a similar approach, pass decisional behaviour was found to be predicted by the time-to-contact between the attacker and the defender [27]. The type of pass that emerged was significantly correlated (p < 0.001) with the variables available in the interaction between players and the environment, suggesting that intrateam coordination is necessary for crossing the gain line as well as effective passing in rugby union.

Capturing movements at the team level associated with successful attacking phases of play, such as advances in territory (achieving a more advanced position in the field of play), have additionally been explored in rugby union [26]. Investigating the multi-player sub-phases, ball displacement trajectory patterns were analysed, revealing the maximum distance the ball travelled backwards from a pass was lower in successful phases of attack. Greater advances in territory were additionally observed when lower backward movements of the ball were coupled with rapid ball delivery. Assessing the macroscopic order therefore suggests successful characteristics in collective behaviour patterns in attacking phases involve a fast ball delivery to a receiver within a close distance [26].

This constraint-led approach is commonly used in the field of skill acquisition and motor learning and proposes novel actions might emerge by manipulating key practice task constraints [51]. This approach has additionally been used to identify the interaction between the intrinsic dynamics and the external constraints within critical match events [27]. Examining the inter- and intrateam coordination patterns that influence successful performance may, therefore, yield critical insights into behaviours associated with successful match events, such as line breaks [22] and try scoring [42]. These methods have yet to be explored in international rugby union and should be addressed in future research.

Future Direction

A small number of studies have started to progress the field of performance analysis in rugby union [26, 27, 32, 35, 42]. However, compared to various other team sports, the field of dynamical systems analysis in rugby remains largely unexplored. Sports such as football, basketball and AFL have adopted dynamical system approaches in their analysis of tactical performance; however, there is limited understanding of the value of such approaches in a ‘gain line’ team sport, such as rugby union, where teams in possession of the ball aim to gain ground relative to the initial starting position, referenced by a projected line that runs parallel to the try line known as the gain line.

Recognising the need for a multi-dimensional approach to analysing performance, many football researchers have explored the use of novel indicators to assess the tactical behaviour of players [59, 60]. Using positional-derived metrics (such as x- and y-coordinates), the synchronisation of players’ movements were analysed, revealing positive outcomes associated with time spent synchronised with players from the same team [61]. Variables such as team centre, team dispersion, team interaction and coordination networks and sequential patterns have been explored to generate knowledge about team properties and the patterns that characterise their organisations [62]. These metrics capture intrateam coordination tendencies by measuring the synchronisation of a pair of teammates, known as a dyad, defined as a pair of two players who share the same environment and intentionality, and pursuing common goal-directed behaviours [63]. These dyads form the basis of local social interactions inherent to complex systems, in which individual agents (players) modify their behaviours on the basis of these local interactions and spontaneously organise themselves into coordinated patterns [64]. The local interaction rules are in fact context-dependent, given the presence of other teammates and opponents, demanding the continuous adaptive behaviour of players. Investigators have captured this context dependency through analysing the interpersonal distances between attacker-defender dyads and identifying periods of equilibrium when distances remain a specific distance apart [50]. When interpersonal distance decreases, these systems evolve from a state of balance to critical performance moments, as the contextual dependency rules governing performance require constant co-adaptations of each player to their opponent [50, 51]. It is these local interactions, or system components, governed by their simple local rules, that cause the system to evolve, forming new patterns of dynamics to emerge [51]. By understanding group behaviours and team dynamics during critical performance moments (goal scoring), football analysts are describing the phasic shifts in team dynamics, using team centroids, that can lead to scoring opportunities [65]. Social network theories have also been used to develop a deeper understanding of the passing interactions between team members that demonstrate the local interactions within the wider system [66, 67]. As many of these methods have only been explored in football and basketball, investigating the coordinated patterns of players and continuous interactions as the rugby game evolves is needed to provide a deeper understanding about why certain patterns emerge in critical regions and/or periods in elite-level competition.

Exploring collective system measures and assessing the coordination dynamics between players and teams in elite international level competition may provide valuable insights into team behaviours [68]. This information can then be used to identify patterns of interactions between teammates [62] which coaches can harness to enhance task representation design in training [69].

Conclusions

The aim of this paper was to critically review the performance analysis research in professional male, 15-a-side rugby union. Studies were assessed based on a number of elements such as context, opposition analysis, competition and number of events analysed.

Studies utilising performance indicators were additionally assessed to establish the genesis of performance indicators and inclusion of operational definitions. Twenty-nine variables were related to successful match outcomes. Possession kicked, lineout success on opposition ball, tries scored, points scored from conversions; tackles completed; turnovers won; and kicks out of hand were the most frequently observed variables. Despite the majority of these articles including context in their analyses, very few accounted for multiple contextual variables, limiting insights into the process of game behaviours due to the player-opponent interaction and the effect of multiple confounding factors, such as field location, number of players involved and period within a match.

Only a third of the studies investigating performance indicators defined the variables used in their analyses. These findings highlight the need for clarity when measuring performance-related variables by providing full operational definitions, to continue to advance the field of performance analysis.

Despite the number of studies published in the last two decades, only a few studies have begun to advance the field, while the majority of the studies reviewed involved a reductionist view of performance. The limited number of studies adopting an alternate view of performance has assessed rugby union performance through a dynamical systems approach by observing emergent patterns. The examination of inter- and intrateam coordination patterns that influence successful performance has the potential to yield critical insights into behaviours associated with successful match events; however, these methods have yet to be explored in international rugby union.

Finally, the advancements in other team sports are discussed to illustrate the potential of a range of performance analysis methods that assess team properties and patterns that characterise their organisation. These methods have been applied to develop a deeper understanding into collective system measures providing valuable insights into sports such as football and basketball.

Availability of Data and Materials

Not applicable

References

  1. 1.

    Jones NMP, James N, Mellalieu SD. An objective method for depicting team performance in elite professional rugby union. J Sports Sci. 2008;26:691–700 https://doi.org/10.1080/02640410701815170.

  2. 2.

    Hughes M, Bartlett R. The use of performance indicators in performance analysis. J Sports Sci. 2002;20:739–54 https://doi.org/10.1080/026404102320675602.

  3. 3.

    Smart D, Hopkins WG, Quarrie KL, Gill N. The relationship between physical fitness and game behaviours in rugby union players. Eur J Sport Sci. 2014;14:S8–17 https://doi.org/10.1080/17461391.2011.635812.

  4. 4.

    van Rooyen KM. A statistical analysis of tackling performance during international rugby union matches from 2011. Int J Perform Anal Sport. 2012;12:517–30 https://doi.org/10.1080/24748668.2012.11868616.

  5. 5.

    McGarry T. Applied and theoretical perspectives of performance analysis in sport: scientific issues and challenges. Int J Perform Anal Sport. 2009;9:128–40 https://doi.org/10.1080/24748668.2009.11868469.

  6. 6.

    Laird P, Lorimer R. An examination of try scoring in rugby union: a review of international rugby statistics. Int J Perform Anal Sport. 2004;4:72–80 https://doi.org/10.1080/24748668.2004.11868293.

  7. 7.

    Sayers MGL, Washington-King J. Characteristics of effective ball carries in Super 12 rugby. Int J Perform Anal Sport. 2005;5:92–106 https://doi.org/10.1080/24748668.2005.11868341.

  8. 8.

    van Rooyen KM, Noakes DT. Movement time as a predictor of success in the 2003 Rugby World Cup Tournament. Int J Perform Anal Sport. 2006;6:30–9 https://doi.org/10.1080/24748668.2006.11868353.

  9. 9.

    Sasaki K, Furukawa T, Murakami J, Shimozono H, Nagamatsu M, Miyao M, et al. Scoring profiles and defense performance analysis in Rugby Union. Int J Perform Anal Sport. 2007;7:46–53 https://doi.org/10.1080/24748668.2007.11868409.

  10. 10.

    Wheeler K, Sayers M. Contact skills predicting tackle-breaks in rugby union. Int J Sports Sci Coach. 2009;4:535–44. https://doi.org/10.1260/174795409790291420.

  11. 11.

    Wheeler KW, Askew CD, Sayers MG. Effective attacking strategies in rugby union. Eur J Sport Sci. 2010;10:237–42 https://doi.org/10.1080/17461391.2010.482595.

  12. 12.

    Diedrick E, van Rooyen M. Line break situations in international rugby. Int J Perform Anal Sport. 2011;11:522–34 https://doi.org/10.1080/24748668.2011.11868570.

  13. 13.

    Lim E, Lay B, Dawson B, Wallman K, Anderson S. Predicting try scoring in super 14 rugby union—the development of a superior attacking team scoring system. Int J Perform Anal Sport 2011;11:464-475. https://doi.org/10.1080/24748668.2011.11868565

  14. 14.

    Hendricks S, Roode B, Matthews B, Lambert M. Defensive strategies in rugby union. Percept Mot Skills. 2013;117:65–87 https://doi.org/10.2466/30.25.PMS.117x17z6.

  15. 15.

    Wheeler KW, Mills D, Lyons K, Harrinton W. Effective defensive strategies at the ruck contest in rugby union. Int J Sports Sci Coach. 2013;8:481–92 https://doi.org/10.1260/1747-9541.8.3.481.

  16. 16.

    Bracewell P. Monitoring meaningful rugby ratings. J Sports Sci. 2003;21:611–20 https://doi.org/10.1080/0264041031000102006.

  17. 17.

    Jones NMP, Mellalieu SD, James N. Team performance indicators as a function of winning and losing in rugby union. Int J Perform Anal Sport. 2004;4:61–71 https://doi.org/10.1080/24748668.2004.11868292.

  18. 18.

    James N, Mellalieu S, Jones N. The development of position-specific performance indicators in professional rugby union. J Sports Sci. 2005;23:63–72 https://doi.org/10.1080/02640410410001730106.

  19. 19.

    Prim S, van Rooyen M, Lambert M. A comparison of performance indicators between the four South African teams and the winners of the 2005 Super 12 Rugby competition. What separates top from bottom? Int J Perform Anal Sport. 2006;6:126–33 https://doi.org/10.1080/24748668.2006.11868378.

  20. 20.

    van Rooyen KM, Lambert IM, Noakes DT. A retrospective analysis of the IRB statistics and video analysis of match play to explain the performance of four teams in the 2003 Rugby World Cup. Int J Perform Anal Sport. 2006;6:57–72 https://doi.org/10.1080/24748668.2006.11868355.

  21. 21.

    Lim E, Lay B, Dawson B, Wallman K, Aanderson S. Development of a player impact ranking matrix in Super 14 rugby union. Int J Perform Anal Sport. 2009;9:354–67 https://doi.org/10.1080/24748668.2009.11868492.

  22. 22.

    Ortega E, Villarejo D, Palao JM. Differences in game statistics between winning and losing rugby teams in the Six Nations Tournament. J Sports Sci Med. 2009;8:523–7.

  23. 23.

    Van den Berg P, Malan D. Match analysis of the 2006 Super 14 Rugby Union tournament: biokinetics and sport science. Afr J Phys Health Educ Recreat Dance. 2010;16:580–93.

  24. 24.

    van Rooyen KM, Diedrick E, Noakes DT. Ruck Frequency as a predictor of success in the 2007 Rugby World Cup Tournament. Int J Perform Anal Sport. 2010;10:33–46 https://doi.org/10.1080/24748668.2010.11868499.

  25. 25.

    Vaz L, Rooyen MV, Sampaio J. Rugby game-related statistics that discriminate between winning and losing teams in IRB and Super Twelve close games. J Sports Sci Med. 2010;9:51–5.

  26. 26.

    Correia V, Araújo D, Davids K, Fernandes O, Fonseca S. Territorial gain dynamics regulates success in attacking sub-phases of team sports. Psychol Sport Exerc. 2011;12:662–9. https://doi.org/10.1016/j.psychsport.2011.06.001.

  27. 27.

    Correia V, Araujo D, Craig C, Passos P. Prospective information for pass decisional behavior in rugby union. Hum Mov Sci. 2011;30:984–97 https://doi.org/10.1016/j.humov.2010.07.008.

  28. 28.

    Hughes M, Hughes MD, Williams J, James N, Vuckovic G, Locke D. Performance indicators in rugby union. J Hum Sport Exerc. 2012;7:383–401 https://doi.org/10.23736/S0022-4707.18.08448-7.

  29. 29.

    Bishop L, Barnes A. Performance indicators that discriminate winning and losing in the knockout stages of the 2011 Rugby World Cup. Int J Perform Anal Sport. 2013;13:149–59 https://doi.org/10.1080/24748668.2013.11868638.

  30. 30.

    Bremner S, Robinson G, Williams MD. A retrospective evaluation of team performance indicators in rugby union. Int J Perform Anal Sport. 2013;13:461–73 https://doi.org/10.1080/24748668.2013.11868662.

  31. 31.

    Gaviglio MC, James N, Crewther TB, Kilduff PL, Cook JC. Relationship between match statistics, game outcome and pre-match hormonal state in professional rugby union. Int J Perform Anal Sport. 2013;13:522–34 https://doi.org/10.1080/24748668.2013.11868667.

  32. 32.

    Rodrigues M, Passos P. Patterns of interpersonal coordination in rugby union: analysis of collective behaviours in a match situation. Adv Physiol Educ. 2013;3:209 https://doi.org/10.4236/ape.2013.34034.

  33. 33.

    Kraak WJ, Welman KE. Ruck-play as performance indicator during the 2010 Six Nations Championship. Int J Sports Sci Coach. 2014;9:525–37 https://doi.org/10.1260/1747-9541.9.3.525.

  34. 34.

    Schoeman R, Coetzee DF. Time-motion analysis discriminating between winning and losing teams in professional rugby. South African J Res Sport Phys Educ Recreat. 2014;36:167–78.

  35. 35.

    Croft H, Lamb P, Middlemas S. The application of self-organising maps to performance analysis data in rugby union. Int J Perform Anal Sport. 2015;15:1037–46 https://doi.org/10.1080/24748668.2015.11868849.

  36. 36.

    Vahed Y, Kraak W, Venter R. Changes on the match profile of the South African Currie Cup tournament during 2007 and 2013. Int J Sports Sci Coach. 2016;11:85–97 https://doi.org/10.1177/1747954115624826.

  37. 37.

    Hughes A, Barnes A, Churchill SM, Stone JA. Performance indicators that discriminate winning and losing in elite men’s and women’s Rugby Union. Int J Perform Anal Sport. 2017;17:534–44 https://doi.org/10.1080/24748668.2017.1366759.

  38. 38.

    Schoeman R, Coetzee D, Schall R. Comparisons of performance indicators between Super Rugby and Currie Cup Competition during 2014 season. South African J Res Sport Phys Educ Recreat. 2014;39:136–44.

  39. 39.

    Watson N, Durbach I, Hendricks S, Stewart T. On the validity of team performance indicators in rugby union. Int J Perform Anal Sport. 2017;17:609–21 https://doi.org/10.1080/24748668.2017.1376998.

  40. 40.

    Sherwood S, Masters RS, Smith TB. Examining deceptive behaviours by attackers in rugby union: the influence of decoy runners on defensive performance. Int J Sports Sci Coach. 2018;13:1100–7 https://doi.org/10.1177/1747954118800577.

  41. 41.

    Bennett M, Bezodis N, Shearer DA, Locke D, Kilduff LP. Descriptive conversion of performance indicators in rugby union. J Sci Med Sport. 2019;22:330–4 https://doi.org/10.1016/j.jsams.2018.08.008.

  42. 42.

    Coughlan M, Mountifield C, Sharpe S, Mara JK. How they scored the tries: applying cluster analysis to identify playing patterns that lead to tries in super rugby. Int J Perform Anal Sport. 2019:1–17 https://doi.org/10.1080/24748668.2019.1617018.

  43. 43.

    O’Donoghue P. Reliability issues in performance analysis. Int J Perform Anal Sport. 2007;7:35–48 https://doi.org/10.1080/24748668.2007.11868386.

  44. 44.

    Davids K, Araújo D. Applications of dynamical systems theory to football. Science and football V. London: Routledge; 2005. p. 547–60.

  45. 45.

    Mackenzie R, Cushion C. Performance analysis in football: a critical review and implications for future research. J Sports Sci. 2013;31:639–76. https://doi.org/. https://doi.org/10.1080/02640414.2012.746720.

  46. 46.

    Olds T. The evolution of physique in male rugby union players in the twentieth century. J Sports Sci. 2001;19:253–62 https://doi.org/10.1080/026404101750158312.

  47. 47.

    Williams J, Hughes M, O’Donoghue P. The effect of rule changes on match and ball in play time in rugby union. Int J Perform Anal Sport. 2005;5:1–11 https://doi.org/10.1080/24748668.2005.11868333.

  48. 48.

    Carling C, Wright C, Nelson LJ, Bradley PS. Comment on Performance analysis in football: a critical review and implications for future research. J Sports Sci. 2014;32:2–7 https://doi.org/10.1080/02640414.2013.807352.

  49. 49.

    Correia V, Passos P, Araújo D, Davids K, Diniz A, Kelso JS. Coupling tendencies during exploratory behaviours of competing players in rugby union dyads. Eur J Sport Sci. 2016;16:11–9 https://doi.org/10.1080/17461391.2014.915344.

  50. 50.

    Passos P, Araújo D, Davids K, Gouveia L, Milho J, Serpa S. Information-governing dynamics of attacker–defender interactions in youth rugby union. J Sports Sci. 2008;26:1421–9 https://doi.org/10.1080/02640410802208986.

  51. 51.

    Passos P, Araújo D, Davids K, Milho J, Gouveia L. Power law distributions in pattern dynamics of attacker-defender dyads in the team sport of rugby union: phenomena in a region of self- organized criticality? Emergence: Complexity and Organization. 2009;11:37-45. https://doi.org/10.emerg/10.17357.ec0c50ba0baffa66291a8ec74c7f5dce.

  52. 52.

    Passos P, Araújo D, Davids K, Shuttleworth R. Manipulating constraints to train decision making in rugby union. Int J Sports Sci Coach. 2008;3:125–40 https://doi.org/10.1260/174795408784089432.

  53. 53.

    Passos P, Araújo D, Davids K, Shuttleworth R. Manipulating tasks constraints to improve tactical knowledge and collective decision making in rugby union. Mot Learn Pract Constraints-Led Approach. 2010;120–30. https://doi.org/10.1260/174795408784089432

  54. 54.

    Passos P, Cordovil R, Fernandes O, Barreiros J. Perceiving affordances in rugby union. J Sports Sci. 2012;30:1175–82. https://doi.org/. https://doi.org/10.1080/02640414.2012.695082.

  55. 55.

    Passos P, Araujo D, Davids KW, Gouveia L, Milho J, Serpa S. Interpersonal coordination tendencies, decision-making and information governing dynamics in rugby union. Perspect Cogn Action Sport. Nova Science Publishers, Inc.; 2009. p. 27–42.

  56. 56.

    Passos P, Araújo D, Davids K, Gouveia L, Serpa S. Interpersonal dynamics in sport: the role of artificial neural networks and 3-D analysis. Behav Res Methods. 2006;38:683–91. https://doi.org/. https://doi.org/10.3758/BF03193901.

  57. 57.

    Davids K, Button C, Araújo D, Renshaw I, Hristovski R. Movement models from sports provide representative task constraints for studying adaptive behavior in human movement systems. Adapt Behav. 2006;14:73–95 https://doi.org/10.1177/105971230601400103.

  58. 58.

    Balague N, Torrents C, Hristovski R, Davids K, Araújo D. Overview of complex systems in sport. J Syst Sci Complex. 2013;26:4–13 https://doi.org/10.1007/s11424-013-2285-0.

  59. 59.

    Folgado H, Gonçalves B, Sampaio J. Positional synchronization affects physical and physiological responses to preseason in professional football (soccer). Res Sports Med. 2018;26:51–63. https://doi.org/. https://doi.org/10.1080/15438627.2017.1393754.

  60. 60.

    Folgado H, Duarte R, Fernandes O, Sampaio J. Competing with lower level opponents decreases intra-team movement synchronization and time-motion demands during pre-season soccer matches. Haddad JM, editor. PLoS ONE. 2014;9:e97145. https://doi.org/10.1371/journal.pone.0097145

  61. 61.

    Folgado H, Duarte R, Marques P, Sampaio J. The effects of congested fixtures period on tactical and physical performance in elite football. J Sports Sci. 2015;33:1238–47 https://doi.org/10.1080/02640414.2015.1022576.

  62. 62.

    Sarmento H, Clemente FM, Araújo D, Davids K, McRobert A, Figueiredo A. What performance analysts need to know about research trends in association football (2012–2016): a systematic review. Sports Med. 2018;48:799–836 https://doi.org/10.1007/s40279-017-0836-6.

  63. 63.

    McGarry T, Anderson DI, Wallace SA, Hughes MD, Franks IM. Sport competition as a dynamical self-organizing system. J Sports Sci. 2002;20:771–81 https://doi.org/10.1080/026404102320675620.

  64. 64.

    Passos P, Araújo D, Davids K. Self-organization processes in field-invasion team sports: implications for leadership. Sports Med. 2013;43:1–7 https://doi.org/10.1007/s40279-012-0001-1.

  65. 65.

    Frencken W, de Poel H, Visscher C, Lemmink K. Variability of inter-team distances associated with match events in elite-standard soccer. J Sports Sci. 2012;30:1207–13 https://doi.org/10.1080/02640414.2012.703783.

  66. 66.

    Clemente FM, Martins FML, Wong PD, Kalamaras D, Mendes RS. Midfielder as the prominent participant in the building attack: a network analysis of national teams in FIFA World Cup 2014. Int J Perform Anal Sport. 2015;15:704–22 https://doi.org/10.1080/24748668.2015.11868825.

  67. 67.

    Cotta C, Mora AM, Merelo JJ, Merelo-Molina C. A network analysis of the 2010 FIFA world cup champion team play. J Syst Sci Complex. 2013;26:21–42 https://doi.org/10.1007/s11424-013-2291-2.

  68. 68.

    Bartlett R, Button C, Robins M, Dutt-Mazumder A, Kennedy G. Analysing team coordination patterns from player movement trajectories in soccer: methodological considerations. Int J Perform Anal Sport. 2012;12:398–424 https://doi.org/10.1080/24748668.2012.11868607.

  69. 69.

    Passos P, Milho J, Fonseca S, Borges J, Araújo D, Davids K. Interpersonal distance regulates functional grouping tendencies of agents in team sports. J Mot Behav. 2011;43:155–63 https://doi.org/10.1080/00222895.2011.552078.

Download references

Acknowledgements

The authors would like to acknowledge the Australian Rugby Foundation and Brumbies Rugby for their support during the study.

Funding

The authors would like to recognize the Australian Rugby Foundation and Brumbies Rugby for their funding during the study.

Author information

Affiliations

  1. Research Institute for Sport and Exercise, University of Canberra, Canberra, Australia
    • Carmen M. E. Colomer
    • , David B. Pyne
    • , Andrew McKune
    •  & Benjamin G. Serpell
  2. Brumbies Rugby, University of Canberra, Building 29, University Drive, Bruce, Canberra, ACT, 2617, Australia
    • Carmen M. E. Colomer
    •  & Benjamin G. Serpell
  3. Netball Australia, Melbourne, Australia
    • Mitch Mooney
  4. School of Exercise Science, Australian Catholic University, Melbourne, Australia
    • Mitch Mooney
Authors
  1. Carmen M. E. Colomer
    View author publications
    You can also search for this author in
  2. David B. Pyne
    View author publications
    You can also search for this author in
  3. Mitch Mooney
    View author publications
    You can also search for this author in
  4. Andrew McKune
    View author publications
    You can also search for this author in
  5. Benjamin G. Serpell
    View author publications
    You can also search for this author in

Contributions

CMEC and BGS and DBP designed the research question and drafted the first manuscript. CMEC conducted the entire literature search, critically reviewed the papers and performed the statistical analyses. BGS, DBP, AM and MM contributed substantially to all sections of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Carmen M. E. Colomer.

Ethics declarations

Ethics Approval and Consent to Participate

Not applicable

Consent for Publication

Not applicable

Competing Interests

The authors, Carmen Colomer, David Pyne, Mitch Mooney, Andrew McKune, and Benjamin Serpell, declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Colomer, C.M.E., Pyne, D.B., Mooney, M. et al. Performance Analysis in Rugby Union: a Critical Systematic Review. Sports Med - Open 6, 4 (2020). https://doi.org/10.1186/s40798-019-0232-x

Download citation

Keywords

  • Performance indicators
  • Tactical analysis
  • Game analysis