| |
RSNA by rater 1
|
RSNA by rater 2
|
---|
| |
RSNA negative
|
RSNA atypical
|
RSNA indeterminate
|
RSNA typical
|
RSNA negative
|
RSNA atypical
|
RSNA indeterminate
|
RSNA typical
|
---|
RSNA by rater 2
|
RSNA negative
|
63
|
7
|
3
|
2
| | | | |
RSNA atypical
|
3
|
23
|
3
|
0
| | | | |
RSNA indeterminate
|
9
|
16
|
26
|
9
| | | | |
RSNA typical
|
1
|
7
|
17
|
62
| | | | |
RSNA by rater 3
|
RSNA negative
|
54
|
7
|
6
|
1
|
54
|
2
|
10
|
2
|
RSNA atypical
|
10
|
30
|
6
|
2
|
7
|
22
|
16
|
3
|
RSNA indeterminate
|
11
|
13
|
21
|
10
|
12
|
5
|
24
|
14
|
RSNA typical
|
1
|
3
|
16
|
60
|
2
|
0
|
10
|
68
|
Inter-rater agreement
| |
---|
Model, type
|
Two-way random, single measurement
|
Definition
|
Absolute agreement
|
Number of subjects (n), number of raters (k)
|
251, 3
|
Intra class correlation coefficient (ICC)
|
0.77*
|
95% CI
|
0.72–0.81
|
- Data in cross-tables are counts. 95% CI = 95% confidence interval
- *An ICC of 0.77 denotes good inter-rater reliability for RSNA classification