Table 2 Results of the QAREL checklist
Item | Brink et al [9] | Kraft et al [10] | Barnes et al [11] | De Bruijn et al [12] | Doeven [13] | Redvka et al [14] | Scantlebury et al [15] | Vaquera et al [16] | Brink et al [17] | Rabelo et al [18] | Andrade Nogueira et al [19] | de Andrade et al [20] | Barroso et al [21] | Murphy et al [22] | Rodriguez-Marroyo et al [23] | Brink et al. [24] | Viveiros et al [25] | Wallace et al [26] | Foster et al [27] | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Was the test evaluated in a sample of subjects who were representative of those to whom the authors intended the results to be applied? | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
2 | Was the test performed by raters who were representative of those to whom the authors intended the results to be applied? | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
3 | Were raters blinded to the finding of other raters during the study? | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
4 | Were raters blinded to their own prior findings of the test under evaluation? | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N |
5 | Were raters blinded to the results of the accepted reference standard or diseased status for the target disorder (or variable) being evaluated? | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA |
6 | Were raters blinded to clinical information that was not intended to be provided as part of the testing procedure or study design? | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N |
7 | Were raters blinded to additional cues that were not part of the test? | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N |
8 | Was the order of examination varied? | Unclear | Unclear | Unclear | Unclear | Unclear | Unclear | Unclear | Unclear | Unclear | Unclear | Unclear | Unclear | Unclear | Unclear | Unclear | Unclear | Unclear | Unclear | Unclear |
9 | Was the stability (or theoretical stability) of the variable being measured taken into account when determining the suitability of the time interval between repeated measures? | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
10 | Was the test applied correctly and interpreted appropriately? | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
11 | Were appropriate statistical measures of agreement used? | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |