Validation of imaging reporting and data system of coronavirus disease 2019 lexicons CO-RADS and COVID-RADS with radiologists’ preference: a multicentric study

Egyptian Journal of Radiology and Nuclear Medicine

Table 3 Interobserver reliability and performance

Observer no.	Κ value^a	AUC^b vs. RT-PCR	AUC vs. clinical suspicion index
COVID-RADS
Observer 1	0.89 (0.84–0.98)	0.94 (0.87–0.98)	0.95 (0.93–0.99)
Observer 2	0.78 (0.84–0.92)	0.91 (0.78–0.97)	0.91 (0.85–0.98)
Observer 3	0.75 (0.84–0.87)	0.89 (0.74–0.95)	0.90 (0.84–0.97)
Overall	0.82 (0.84–0.91)	0.92 (0.85–0.96)	0.93 (0.87–0.99)
CO-RADS
Observer 1	0.86 (0.64–0.97)	0.88 (0.81–0.97)	0.93 (0.88–0.99)
Observer 2	0.91 (0.77–0.99)	0.84 (0.79–0.93)	0.92 (0.87–0.98)
Observer 3	0.91 (0.77–0.99)	0.81 (0.75–0.92)	0.89 (0.82–0.96)
Overall	0.78 (0.59–0.91)	0.85 (0.76–0.94)	0.94 (0.90–0.99)