Study | Methodological quality | Risk of bias | ||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Internal validity | Statistical validity | External validity | Total score [%] | Sequence | Allocation | Blinding | Outcome | Report | Other | |||||||||||||||||||||||||||||||
1.1 a | 1.2 a | 1.3 a | 1.4 a | 2.1A b | 2.1B b | 2.1C b | 2.1D b | 2.1E b | 2.1F b | 2.1G b | 2.2A b | 2.2B b | 3A b | 3B b | Score [%] | 4 a | 5 a | Score [%] | 6.1 a | 6.2 a | 7A b | 7B b | 7C b | 7D b | 7E b | 7F b | 8A b | 8B b | 8C b | 8D b | 8E b | Score [%] | Â | Â | Â | Â | Â | Â | ||
Albracht et al., 2013 [15] | + | - | - | + | - | + | + | + | - | + | - | / | / | - | + | 51 | + | - | 50 | + | + | + | + | + | + | + | + | - | + | + | + | + | 95 | 65 | Unclear | Unclear | Unclear | Yes | Yes | Yes |
Arampatzis et al., 2007 [29] | + | + | + | + | - | + | + | + | - | + | - | + | + | + | - | 87 | + | - | 50 | + | + | + | + | + | + | + | + | + | + | + | + | - | 95 | 77 | Unclear | Unclear | Unclear | Yes | Yes | Yes |
Arampatzis et al., 2010 [28] | + | + | + | - | - | + | + | + | - | + | - | + | + | + | - | 72 | + | - | 50 | + | + | + | + | + | + | + | + | + | + | + | + | - | 95 | 72 | Unclear’ | Unclear’ | Unclear | Yes | Yes | Yes |
Bohm et al. [31] | + | + | + | + | - | + | + | + | + | + | + | + | + | + | + | 98 | + | + | 100 | + | + | + | + | + | + | + | + | + | + | + | + | + | 100 | 99 | Unclear | Unclear | Unclear | Yes | Yes | Yes |
Carroll et al., 2011 [61] | + | + | + | - | + | - | - | - | - | + | + | + | + | - | + | 70 | + | - | 50 | + | + | + | - | + | + | + | + | + | + | + | + | + | 96 | 72 | Unclear’ | Unclear’ | Yes | Yes | Yes | Yes |
Fletcher et al., 2010 [17] | + | - | - | + | - | + | + | - | + | + | - | / | / | + | + | 60 | + | - | 50 | + | + | + | + | + | + | + | + | + | + | + | + | + | 100 | 70 | Unclear | Unclear | Unclear | Yes | Yes | Yes |
Fouré et al., 2009 [71] | + | - | - | + | - | + | - | - | - | - | - | / | / | + | + | 46 | + | - | 50 | + | + | - | - | + | - | + | + | + | + | + | + | + | 88 | 61 | Unclear | Unclear | Unclear | Unclear | Yes | Yes |
+ | - | + | + | - | + | - | - | - | + | - | - | + | + | + | 63 | + | - | 50 | + | + | - | - | + | - | + | + | + | + | + | + | + | 88 | 67 | Unclear | Unclear | Unclear | Yes | Yes | Yes | |
Foure et al., 2013 [43] | + | - | + | + | - | + | - | - | - | + | - | - | + | + | + | 63 | + | - | 50 | + | + | - | - | + | - | + | + | + | + | + | + | + | 88 | 67 | Unclear | Unclear | Unclear | Yes | Yes | Yes |
Hansen et al., 2003 [62] | + | - | + | - | - | - | - | + | + | + | - | + | + | - | + | 56 | + | - | 50 | + | + | - | + | + | + | + | + | + | + | + | + | + | 96 | 67 | Unclear’ | Unclear’ | Unclear | Yes | Yes | Yes |
Hougthon et al., 2013 [39] | + | + | + | + | - | + | + | + | + | + | - | - | + | + | + | 84 | + | + | 100 | + | + | - | - | + | + | + | + | + | + | + | + | + | 92 | 92 | Unclear | Unclear | Unclear | Yes | Yes | Unclear+ |
Kongsgaard et al., 2007 [24] | + | + | + | - | + | + | - | + | - | + | - | + | + | + | + | 74 | + | - | 50 | + | + | + | - | + | + | + | + | + | + | + | + | + | 96 | 73 | Unclear’ | Unclear’ | Yes | Yes | Yes | Yes |
+ | + | + | - | - | - | - | - | - | - | + | + | - | + | + | 66 | + | - | 50 | + | + | + | + | + | + | + | + | + | + | + | + | + | 100 | 72 | Unclear’ | Unclear’ | Unclear | Yes | Yes | Yes | |
Kubo et al., 2002 [25] | + | - | + | - | - | - | - | - | - | - | + | + | - | + | + | 52 | + | - | 50 | + | + | + | - | + | + | + | + | + | + | + | + | + | 96 | 66 | Unclear’ | Unclear’ | Unclear | Yes | Yes | Yes |
Kubo et al., 2003 [63] | + | + | + | + | - | - | - | - | - | - | + | / | / | + | + | 86 | + | - | 50 | + | + | + | - | + | + | + | + | + | + | + | + | + | 96 | 77 | Unclear | Unclear | Unclear | Yes | Yes | Yes |
Kubo et al., 2006a [40] | + | - | + | - | - | - | - | + | - | + | + | + | - | + | - | 49 | + | - | 50 | + | + | + | + | + | + | + | + | + | + | + | + | - | 95 | 65 | Unclear’ | Unclear’ | Unclear | Yes | Yes | Yes |
Kubo et al., 2006b [87] | + | - | + | + | + | - | - | + | - | + | + | + | + | + | + | 80 | + | - | 50 | + | + | + | + | + | + | + | + | + | + | + | + | + | 100 | 77 | Unclear | Unclear | Unclear | Yes | Yes | Yes |
Kubo et al., 2006c [88] | + | - | + | - | + | - | - | + | - | + | - | + | + | + | - | 56 | + | - | 50 | + | + | + | + | + | + | + | + | + | + | + | + | - | 95 | 67 | Unclear’ | Unclear’ | Unclear | Yes | Yes | Yes |
Kubo et al., 2007 [59] | + | - | + | - | - | - | - | + | - | + | + | + | - | + | + | 56 | + | - | 50 | + | + | + | + | + | + | + | + | + | + | + | + | + | 100 | 69 | Unclear’ | Unclear’ | Unclear | Yes | Yes | Yes |
Kubo et al., 2009 [60] | + | - | + | - | + | - | - | + | - | + | - | + | + | + | - | 56 | + | - | 50 | + | + | + | + | + | + | + | + | + | + | + | + | - | 95 | 67 | Unclear’ | Unclear’ | Unclear | Yes | Yes | Yes |
Kubo et al., 2010 [52] | + | - | + | + | - | - | - | + | - | + | + | + | + | + | + | 78 | + | - | 50 | + | + | + | + | + | + | + | + | + | + | + | + | + | 100 | 76 | Unclear | Unclear | Unclear | Yes | Yes | Yes |
Kubo et al., 2012 [72] | + | - | + | + | - | - | - | + | - | + | + | + | + | + | - | 70 | + | - | 50 | + | + | + | + | + | + | + | + | + | + | + | + | + | 100 | 73 | Unclear | Unclear | Unclear | Yes | Yes | Yes |
Malliaras et al., 2013 [41] | + | + | + | + | + | - | - | + | - | + | + | - | - | + | + | 80 | + | - | 50 | + | + | + | + | + | + | + | + | + | + | + | + | + | 100 | 77 | Unclear | Yes | Yes | Yes | Yes | Yes |
Seynnes et al., 2009 [30] | + | + | + | - | + | - | - | + | + | - | - | + | + | + | + | 78 | + | - | 50 | + | + | + | - | + | + | + | + | + | + | + | + | + | 96 | 74 | Unclear’ | Unclear’ | Unclear | Yes | Yes | Yes |