Skip to main content

Table 3 Inter-rater agreement for RSNA classification

From: Comparison of the RSNA chest CT classification system and CO-RADS system in reporting COVID-19 pneumonia in symptomatic and asymptomatic patients

  

RSNA by rater 1

RSNA by rater 2

  

RSNA negative

RSNA atypical

RSNA indeterminate

RSNA typical

RSNA negative

RSNA atypical

RSNA indeterminate

RSNA typical

RSNA by rater 2

RSNA negative

63

7

3

2

    

RSNA atypical

3

23

3

0

    

RSNA indeterminate

9

16

26

9

    

RSNA typical

1

7

17

62

    

RSNA by rater 3

RSNA negative

54

7

6

1

54

2

10

2

RSNA atypical

10

30

6

2

7

22

16

3

RSNA indeterminate

11

13

21

10

12

5

24

14

RSNA typical

1

3

16

60

2

0

10

68

Inter-rater agreement

 

Model, type

Two-way random, single measurement

Definition

Absolute agreement

Number of subjects (n), number of raters (k)

251, 3

Intra class correlation coefficient (ICC)

0.77*

95% CI

0.72–0.81

  1. Data in cross-tables are counts. 95% CI = 95% confidence interval
  2. *An ICC of 0.77 denotes good inter-rater reliability for RSNA classification