Skip to main content

Table 3 Inter-rater agreement for RSNA classification

From: Comparison of the RSNA chest CT classification system and CO-RADS system in reporting COVID-19 pneumonia in symptomatic and asymptomatic patients

   RSNA by rater 1 RSNA by rater 2
   RSNA negative RSNA atypical RSNA indeterminate RSNA typical RSNA negative RSNA atypical RSNA indeterminate RSNA typical
RSNA by rater 2 RSNA negative 63 7 3 2     
RSNA atypical 3 23 3 0     
RSNA indeterminate 9 16 26 9     
RSNA typical 1 7 17 62     
RSNA by rater 3 RSNA negative 54 7 6 1 54 2 10 2
RSNA atypical 10 30 6 2 7 22 16 3
RSNA indeterminate 11 13 21 10 12 5 24 14
RSNA typical 1 3 16 60 2 0 10 68
Inter-rater agreement  
Model, type Two-way random, single measurement
Definition Absolute agreement
Number of subjects (n), number of raters (k) 251, 3
Intra class correlation coefficient (ICC) 0.77*
95% CI 0.72–0.81
  1. Data in cross-tables are counts. 95% CI = 95% confidence interval
  2. *An ICC of 0.77 denotes good inter-rater reliability for RSNA classification