Skip to main content

A detailed statistical analysis of the performance of CO-RADS and CT-severity score in the diagnosis of COVID-19 pneumonia compared to RT-PCR test: a prospective cohort study

Abstract

Background

Reports from international studies regarding the role of CT scan and RT-PCR test in the diagnosis of coronavirus disease has been a subject of controversy. The purpose of this study was to statistically compare the performance of CT in reporting chest CT scans of coronavirus disease according to Coronavirus Disease Reporting and Data System (CO-RADS) and CT severity score (CTSS) with the performance of RT-PCR test.

Results

The analyzed CT scans of 144 participants were consistent with CO-RADS 1 (n = 38), CO-RADS 2 (n = 11), CO-RADS 3 (n = 35), CO-RADS 4 (n = 23), and CO-RADS 5 (n = 37). CTSS in CO-RADS 1 was (0.9 ± 4), CO-RADS 2 (4 ± 2), CO-RADS 3 (10.2 ± 2), CO-RADS 4 (14 ± 6) and CO-RADS 5 (19 ± 7). There was direct correlation between CO-RADS groups and CTSS (p < 0.001). The mean total CTSS was 10 ± 9 for the whole study population. Ninety-five CT scans were compatible with CO-RADS 3, 4 or 5 and 49 CT scans were compatible with CO-RADS 1 or 2, with a positive rate of 66% (95% CI 49%, 65%), PPV (55.41%), NPV (45.18%), accuracy (86.8%) and the overall sensitivity (93.18%) and specificity (76.8%) of CT in detecting COVID-19 pneumonia when categorized and analyzed according to CO-RADS and CTSS. Sixty-four patients had positive initial RT-PCR tests and 80 patients had negative initial RT-PCR test, with a positive rate of 44.4% (95% CI 35%, 51%), PPV (41.13%), NPV (59.51%), accuracy (74.3%), sensitivity (64.2%) and specificity (93.9%). The Kappa (κ) value of average inter-reader agreement was 88% (95% CI 80%, 96%).

Conclusions

RT-PCR test showed higher specificity and NPV compared to CT in detecting COVID-19 pneumonia, while CT showed higher sensitivity, PPV, accuracy and positive rate, respectively. CT was superior to RT-PCR test in detecting COVID-19 pneumonia especially at early stages of the disease.

Background

Since December 2019 the corona virus disease (COVID-19 pneumonia) has caused 5,310,502 deaths so far, with more than 4355,579,240 are confirmed infected [1, 2] by February 2022. COVID-19 pneumonia is highly contagious; thus it is necessary to identify the carriers of the virus to limit its spread. The definitive diagnosis occurs using RT-PCR test for viral RNA obtained with pharyngeal swab or bronchoalveolar lavage [3,4,5]. However, its reported sensitivities vary from 42 to 83%, and it can take several days to obtain [3,4,5,6,7]. CT plays a central role in the diagnosis of COVID-19 pneumonia, which is suspected when ground-glass opacities (GGO) with or without consolidations are present, yet CT is not considered as a definitive diagnostic tool as a positive RT-PCR test [7]. Whether CT or RT-PCR test is more reliable in the diagnosis of COVID-19 pneumonia, has been debated in previous studies [3,4,5,6,7]. The Dutch Radiological Society has developed a COVID-19 pneumonia reporting and data system (CO-RADS) to categorize chest CT scans with pulmonary changes that can be compatible with the COVID-19 pneumonia [8]. According to findings on CT, graded from CO-RADS 1 to CO-RADS 5, COVID-19 pneumonia is unlikely in CO-RADS-1 and highly suspected in CO-RADS 5. In Addition, several studies encouraged the use of a CT severity score (CTSS) combined with CO-RADS to estimate the degree of lung involvement [9,10,11,12,13,14]. Consensus on standardized radiology reports combined with clinical assessment of symptoms may justify further management in case of negative (RT-PCR) test [7].

The purpose of this study was to statistically compare the performance of CT as analyzed according to CO-RADS and CTSS, with the performance of RT-PCR in detecting COVID-19 pneumonia. As far as we know, this is one the few studies (if any) providing a detailed statistical analysis of both CT and RT-PCR test in detecting coronavirus disease including sensitivity, specificity, positive predictive value, negative predictive value, accuracy and positive rate for each test.

Methods

Study population

After obtaining approval from the ethical authorities, this prospective cohort study was conducted in 283 consecutive patients admitted to our hospitals between October 2021 and May 2022. The patients’ characteristics and comorbidities appear in Tables 1 and 2, respectively. Inclusion criteria included: fever, respiratory and or gastrointestinal symptoms, imaging features of pneumonia (Table 3), abnormal infection parameters including high CRP (> 8 mg/l), and lymphocytopenia (< 1.3 10^9/l) (Table 4), contact with SARS-CoV-2 patients in the last 14 days including travel history to epidemic region and had at least one valid RT-PCR test performed at least 5 days after symptoms debut.

Table 1 Characteristics of the study population
Table 2 Overview over the comorbidities of the study population
Table 3 The signs and symptoms of the current study population
Table 4 The paraclinical parameters of our patients

Patients were excluded due to: known parenchymal lunge disease or malignancy (n = 35), lack of CT scan (n = 53), insufficient CT scan quality (n = 34) and indeterminate RT-PCR test results in case of normal CT scan (n = 17), leaving 144 eligible patients (Fig. 1).

Fig. 1
figure 1

Flow diagram of the total study population showing the initial numbers of participants, exclusion criteria and the final number of the included eligible participants

Reference standard

As there has not been a definitive gold standard for the diagnosis of COVID-19 pneumonia so far, we chose to apply (high clinical suspicion for COVID-19 pneumonia) as reference standard for CT and RT-PCR test. The high clinical suspicion for COVID-19 pneumonia was included in two categories based on CDC (Center for Disease Control and Prevention) case definition of COVID-19 pneumonia cases, which included:

  • Category A—Acute onset or worsening of at least two of the following symptoms or signs: Fever, chills, rigors, myalgia, headache, sore throat, nausea or vomiting, diarrhea, fatigue, congestion or runny nose.

  • Category B—Acute onset or worsening of any one of the following symptoms or signs:

    1. o

      Cough, shortness of breath, difficulty of breathing, olfactory disorder, taste disorder, confusion, persistent pain or pressure in the chest, pale, gray, or blue-colored skin, lips, or nail beds, depending on skin tone, inability to awake or stay awake.

    2. o

      The patients were divided into two groups as follows:

  • Group 1: Low suspected group including patients with atypical signs and symptoms that were not compatible with category A or B, and had been under restricted isolation without contact with SARS-CoV-2 positive patients in the last 14 days and without travel history to an epidemic region.

  • Group 2: High suspected group including patients with symptoms compatible with either category A or B and with close contact with SARS-CoV-2 positive patients in the last 14 days or travel history to an epidemic region.

According to CDC, close contact to with SARS-CoV-2 positive patients is defined as being within 6 feet close to the patient for at least 15 minutes (cumulative over a 24-hour period).

CT

The CT scans were of patients with symptoms ≥ 5 days, to avoid misinterpretation in case of (normal) CT scan in early cases. The CT scans were evaluated according to the CO-RADS and CTSS. Two radiologists, blinded to the patients’ symptoms and RT-PCR test, evaluated the CT scans independently. The radiologists had 13 and 30 years of experience, respectively. The participants were placed supine, arms above the head, and held breath at full inspiration. Initially, a topogram ensured covering from the base of the neck to the costophrenic angle. We used GE Revolution EVO CT scanner (GE, Milwaukee, USA), Auto mA: range 60–500 mA, 120 kV, noise-index 24.00, pitch 0.984:1, matrix 512, slice thickness 1.25 mm (3 mm sagittal and 5 mm coronal reconstructions) and beam collimation 40 mm. Window width level 1600/-600 Hounsfield units for the lungs and 450/55 Hounsfield units for the mediastinum.

The COVID-19 reporting and data system (CO-RADS)

Imaging analyses were according to the CO-RADS categorical system (Table 5).

Table 5 Overview of the COVID-19 reporting and data system categories (CO-RADS) [8]

In CO-RADS 1, the findings are normal or non-infectious, CO-RADS 2 is typical for other infections but not COVID-19 pneumonia, CO-RADS 3 resembles COVID-19 pneumonia but also other infections, CO-RADS 4 and 5 highly compatible with COVID-19 pneumonia but with atypical features as well in CO-RADS 4 (Table 5).

CT severity score (CTSS)

We used CTSS to assess the pulmonary involvement. A single lunge lobe scored "1" if the involvement was < 5%, "2" if the involvement was 5–25%, "3" if the involvement was 26–49%, "4" if the involvement was 50–75%, and "5" if the involvement was > 75%. The total score was achieved by calculating five lobes, ranging from 5 to 25. The CTSS was categorized as mild (≤ 7), moderate (8–16) and severe ( ≥17).

Statistical analysis

We used the SPSS version 25.0 (IBM Inc., Chicago, IL, USA) for statistical analysis. Continuous variables are presented as the median and range, and categorical variables as frequency and percentage. Differences between groups were analyzed using the Independent-Samples Kruskal–Wallis test and Pairwise Comparison test. Significance values were adjusted by the Bonferroni correction for multiple tests. A two-sided p value of less than 0.05 was considered statistically significant. Using high clinical suspicion as a reference standard, the sensitivity, specificity, positive predictive value (PPV), negative predicitve value (NPV) and accuracy of the chest CT scans and RT-PCR were calculated. The Wilson-score test was used to calculate the 95% confidence interval (CI) for the sensitivity. If the features of the CT scans were compatible with CO-RADS 3, 4 or 5 and moderate to severe CTSS, in the high suspected patients`group, the results were considered true positive (TP), and were considered false negative (FN) if they were compatible with CO-RADS 1 or 2 and mild CTSS. If the features of the CT scans were compatible with CO-RADS 1 or 2 and mild CTSS, in the low suspected patients`group, the results were considered true negative (TN), and were considered false positive (FP) if they were compatible with CO-RADS 3, 4, or 5 and moderate or severe CTSS.

The RT-PCR test sensitivity and specificity was calculated depending on the results of the initial test. If the first RT-PCR test was positive in the high suspected patiens` group, the result was considered TP, and FN if the test results were negative. If the initial RT-PCR test was negative in the low suspected patiens` group, the result was considered TN, and FP if the test results were positive. The Kappa method was used to quantify the inter-reader agreement. Kappa (κ value) was interpretated as follows: Kappa between 0.00 and 0.40 was considered as slight to fair agreement, Kappa between 0.41 and 0.80 moderate to substantial agreement and Kappa between 0.81 and 1.00 almost perfect agreement.

Results

In total, 144 patients were enrolled in this study (Fig. 1), their characteristics appear from (Table 1). The mean patients` age was 73 (± 15) yrs. including 85 men and 59 women. Men (mean age 67.5 yrs. range; 30–96 yrs.) were younger than women (mean age 73.3 yrs. range; 30–94 yrs.), (p = 0.02). After comparing the laboratory tests with CO-RADS groups, statistical differences were CRP (p < 0.001), WBC (p < 0.001), Neutrophils (p < 0.004), thrombocytes (p < 0.003) and (p < 0.18) for lymphocytes (Table 6).

Table 6 Correlating COVID-19 reporting and data system (CO-RADS), CT scoring (CTSS), and laboratory tests

Statistical analysis of CT findings

The CT findings were consistent with CO-RADS 1 (n = 38 (26%)) (Fig. 2), CO-RADS 2 (n = 11 (8%)) (Fig. 3), CO-RADS 3 (n = 35 (24%)) (Fig. 4), CO-RADS 4 (n = 23 (16%)) (Fig. 5), and CO-RADS 5 (n = 37 (26%)) (Fig. 6). CTSS of the 144 scans were calculated and compared with CO-RADS categories (Table 6).

Fig. 2
figure 2

Axial unenhanced CT scan of the thorax of a 71-year-old male, with negative RT-PCR test for COVID-19 pneumonia. The patient presented with tirdness, loss of appetite, cough and dyspnea for 5 days. The CT scan was normal in accordance with CO-RADS 1

Fig. 3
figure 3

A 75-year-old male with negative RT-PCR test for COVID-19 pneumonia. The patient presented with progressive cough and dyspnea over 7 days. An unenhanced CT scan showed small solid infiltrates (white arrows) and mild tree-in-bud infiltrates (black arrows) consistent with CO-RADS 2. The final diagnosis was infective bronchiolitis

Fig. 4
figure 4

A, B Axial unenhanced CT scan of the the lungs (A) and chest-radiograph, postero-anterior erect view (B) of a 67-year-old male with a positive RT-PCR test for COVID-19 pneumonia. The patient presented with sore throat, tirdness, cough and slight fever of 4 days duration. The CT scan that was performed on the 5th day after symptoms debut showed bilateral perihillar ground-glass opacities (black arrows) and semi solid patcy infiltrates (white arrows), which were compatible with CO-RADS 3. The infiltrates were subtle on the chest-radiograph taken on the 7th day after symptoms debut to ensure adequate drainage of the bilateral pleural exudate that was found on the CT scan

Fig. 5
figure 5

Axial chest CT scan of a 51-year-old female with positive RT-PCR test for COVID-19 pneumonia. The patient presented with cough, tiredness, dyspnea and fever of 2 days duration. Due to clinical suspicion of pulmonary embolism, a CT angiography of the thorax was performed on the 6th days after symptoms debut, showing unilateral and perihillar groud-glass opacities (white arrows) consistent with CO-RADS 4

Fig. 6
figure 6

An unenhanced CT scan of the thorax of a 38-year-old male with positive RT-PCR test for COVID-19 pneumonia. The patient presented with dyspnea, severe cough, tiredness and loss of smell sense that persisted for at least 5 days. The scan showed bilateral severe ground-glass opacities (black stars) with reverse hallo sig in the right upper lobe consistent with CO-RADS 5 (black arrow)

There was an evident direct positive correlation between the CO-RADS groups and the CTSS. The mean total CTSS was 10 ± 9 for the whole study population. The mean severity score in CO-RADS 1 was consistent with (mild CTSS 0.9 ± 0.4), CO-RADS 2 (mild CTSS 4 ± 2), CO-RADS 3 (moderate CTSS 10.2 ± 2), CO-RADS 4 (moderate—severe CTSS 14 ± 6) and CO-RADS 5 (moderate—severe CTSS 19 ± 7). The CTSS was statistically different among the CO-RADS groups (p < 0.001) (Table 6).

In total, the CT scans of 95 patients were compatible with CO-RADS 3, 4 or 5 (high clinical suspicion: N = 82, low clinical suspicion: N = 13) and the scans of 49 patients were compatible with CO-RADS 1 or 2 (high clinical suspicion: N = 6, low clinical suspicion: N = 43), with a positive rate of 66% (95% CI 49%, 65%), accuracy (86.8%), positive predictive value (55.41%), negative predictive value (45.18%) and the overall sensitivity (93.18%) and specificity (76.8%) of CT in detecting COVID-19 pneumonia when categorized and analyzed according to CO-RADS and CTSS (Table 7). The κ value of the average inter-reader agreement was 88% (95% CI 80%, 96%), which was consistent with almost perfect agreement.

Table 7 The sensitivity and specificity of CT when categorized and analyzed according to CO-RADS and CTSS, respectively, compared to the sensitivity and specificity of RT-PCR test

Statistical analysis of RT-PCR test findings

In total, 64 patients had positive initial RT-PCR tests and 80 patients had negative initial RT-PCR test, with a positive rate of 44.4% (95% CI 35%, 51%), accuracy (74.3%), positive predictive value (41.13%), negative predictive value (59.51%). The overall sensitivity and specificity of RT-PCR test in detecting COVID-19 pneumonia was (64.2%) and (93.9%), respectively (Table 7). Of the 64 patients with positive initial RT-PCR test results, 3 patients (2%)were categorized as low suspected group and their CT scans were compatible with CO-RADS 1 (N = 2) and CO-RADS 2 (N = 1) and had a mild CTSS. The remaining 61 patients with positive initial RT-PCR test were categorized as high suspected group and had CT findings compatible with CO-RADS 3 (N = 14), CO-RADS 4 (N = 19) and CO-RADS 5 (N = 28). There were 18 (13%) patients with the positive results came 1–2 weeks after the CT scan that showed changes compatible with COVID-19 pneumonia. The RT-PCR test of those patients was repeated 2–5 times as the initial results were negative.

Analysis of CT scans according to CO-RADS

All lobes were dominantly involved in CO-RADS 5 (Table 8). There was dominant right upper lobe (100%) and right lower lobe (91%) involvement in CO-RADS 4. In CO-RADS 3, lobe involvement predominated in the right upper lobe (83%), right lower lobe (89%), left upper lobe (80%) and left lower lobe (83%). The left lower lobe was predominantly involved in CO-RADS 2 group (91%).

Table 8 Pulmonary lobar involvement correlated to COVID-19 pneumonia reporting and data system (CO-RADS) groups

Other features included (Table 9): GGO in CO-RADS 4 and 5 (100% each), peripheral and subpleural distribution including the inter-septal fissures (91.3% CO-RADS 4 and 95% CO-RADS 5), vascular thickening (65.2% CO-RADS 4 and 81.1% CO-RADS 5), consolidations (61% CO-RADS 4 and 76% CO-RADS 5), crazy paving (52.2% CO-RADS 4 and 60% CO-RADS 5), pleural thickening (48% CO-RADS 4 and 73% CO-RADS 5) and subpleural bands (61% CO-RADS 4 and 73% CO-RADS 5). Lymphadenopathy was seen in 35% in CO-RADS 4 and 60% in CO-RADS 5. Pleural effusion was seen in 48% in CO-RADS 4 and 38% in CO-RADS 5. Mild GGO was predominant (100%), and subpleural involvement was common (82.2%) in CO-RADS 3 group, while the other features that were recognized in CO-RADS 4 and 5 were uncommon. Patchy opacities were present in 91%, and tree-in-bud opacities in 18.2% in CO-RADS 2, but both patterns of opacities were not recognized in CO-RADS 4 and 5 (Table 9).

Table 9 Computed tomography features of coronavirus disease 2019 reporting and data system (CO-RADS) groups

Chest-radiograph failed to detect COVID-19 pneumonia in 17 (12%) patients with positive RT-PCR test (Fig. 4). Twelve patients had blank chest-radiographs performed within two days from the CT scan that showed CO-RADS 2 (n = 1), CO-RADS 3 (n = 7), CO-RADS 4 (n = 3), and crazy-paving pattern with CO-RADS 5 (n = 1). The chest-radiographs of three patients showed scattered nonspecific infiltrates. CT scans were performed on the same day in two patients and after four days in the 3rd patient, were compatible with CO-RADS 5. Pleura plaques have obscured the pneumonic infiltrates in one patient, who after two days underwent CT scan that showed CO-RADS 5. One patient with a poor health condition underwent a supine chest-radiographs that didn`t show signs of COVID-19 pneumonia. CT scan performed on the same day showed CO-RADS 3.

Discussion

COVID-19 pneumonia is a highly contagious disease that led to global challenges to health care systems. Early diagnosis has been proven to be crucial for disease control and treatment [9, 14]. The definitive diagnosis of COVID-19 pneumonia occurs by means of positive RT-PCR test, yet it has limitations. RT-PCR test may take several days before it is obtainable and its availability has been challenging in the epidemic regions [3, 4, 7]. Its efficiency depends on the adequate collection of the viral RNA, which varies between patients and even in a single individual during the course of the disease. Additionally, the efficiency of collecting the swabs varies according to the performer's experience, resulting in variable amounts of the collected material and increasing the chances of false-negative results [4]. Due to its availability, CT has been embraced by numerous health centers as it has been helpful in alleviating the burden faced by the healthcare facilities [8, 9]. CO-RADS categorizes pulmonary changes in COVID-19 pneumonia according to the degree of suspicion based on CT findings, while CTSS estimates the degree of parenchymal lung involvement [12, 14]. The current study shows that CO-RADS has a direct positive relation with CTSS and they prevailed to depict cases of coronavirus disease when RT-PCR test and/or chest-radiograph failed. Correspondingly, studies by Lessmann et al. [11] and Leiveld et al. [12] showed that analyzing CT scans according to CO-RADS and CTSS has promoted the performance of CT in the diagnosis of COVID-19 pneumonia. We found that the specificity (93.9%) and the NPV (59.51%) of the initial RT-PCR test were superior to the specificity (76.8%) and NPV (45.18%) of CT, yet the sensitivity of CT (93.18%) was superior to that of the initial RT-PCR test (64.2%) in detecting COVID-19 pneumonia. In addition, PPV (55.41%), positive rate (66%) and accuracy (86.8%) of CT were higher in comparison with PPV (41.13%), positive rate (44.4%) and accuracy (74.3%) of RT-PCR test (Table 7). This is in accordance with a study by Fang et al. [15], that showed that CT has a higher sensitivity (98%) than the initial RT-PCR test (71%) in detecting COVID-19 Pneumonia. Ai et al. [7] showed similar results compared to ours, with 97% sensitivity of CT in detecting COVID-19 pneumonia and PPV of 65%. The same study showed lower specificity (25%) and accuracy (68%), respectively, compared to our results with specificity (76.8%) and accuracy (86.8%). This discrepancy can be due to differences in the studys’ designs and in the included patients` populations. The current study showed a high inter-reader agreement with 88% κ value (95% CI 80%, 96%). In a study carried out by Prokop et al. [8], the study population was divided into two groups: a group with positive RT-PCR test results as reference standard, and a group with negative RT-PCR test results using the high clinical suspicion as reference standard. After analyzing the two patient groups, the study showed a high inter-reader agreement in analyzing CT scan according to CO-RADS in the first group with positive RT-PCR test results (91% (CI 85%, 97%)) and even higher values were noticed in the second group with the high clinical suspicion as a reference standard (95% (CI 91%, 99%)), which was in accordance with our study.

In our study, 18 patients (13%) had an initial negative RT-PCR test with CT scans suggestive of COVID-19 pneumonia. Ai T et al. [7] reported in their study 413 patients with negative initial RT-PCR test. Of those patients, 308 (75%) had CT features compatible with COVID-19 pneumonia. Likewise our study, two studies by Kortela et al. [3] and Clerici et al. [6], chose to refer to high clinical suspicion as reference standard, their studies showed that the sensitivity of the initial RT-PCR test in detecting COVID-19 pneumonia was [47.3%, 95% CI 44.4%, 50.3%)) and (77%, 95% CI (73%, 81%)), respectively, which was in accordance with our results.

Thirty-eight CT scans were compatible with CO-RADS 1, including 2 patients with positive RT-PCR test. Sixteen patients were discharged to home isolation, including the patients with positive RT-PCR test. The remaining patients had COPD exacerbation, malignant infiltrates, and granulomatous inflammation. They were admitted for treatment, accordingly.

Eleven CT scans showed tree-in-bud changes and/or patchy opacities without GGO, which was atypical for COVID-19 pneumonia, consistent with CO-RADS 2. The one participant with a positive RT-PCT test was managed symptomatically. The remaining participants received treatment for bronchogenic pneumonia according to the causative agent.

GGO occurs in viral pneumonia in general [16]. Their pathogenesis probably results from the incomplete filling of the air cavities with cells and liquids (such as edema, pus, and hemorrhage), interstitial thickening due to inflammation, edema, or fibrosis and partial alveolar depression, and alveolar damage, while the bronchopneumonia consolidations result from inflammatory reactions localized in patches around the bronchioles [17, 18].

Most types of viral pneumonia share similar imaging features in the same Viridea family due to similarities in the pathogenesis [19, 20], including Corona Viridea, thus the imaging features of COVID-19 pneumonia are comparable to those of other members of this viral family, like SARS-Co-V and MERS-Co-V. That can explain the indistinctness in CO-RADS 3 group, where the RT-PCR test was positive in 14 patients and negative in 21 patients. Both sub-categories had similar CT features, consisting of unsharp GGO or small nodular infiltrates with a background of mild GGO.

Frequent CT findings in patients with positive RT-PCR were multifocal bilateral GGO with or without consolidations close to the pleura, subpleural bands, and vascular thickening. The GGO had a typical rounded and unsharp pattern. The “crazy-paving” pattern with visible interlobular lines and consolidations within the GGO areas, opacities with reverse halo sign, and subpleural consolidations were noticed in the lathe course of the disease [7,8,9,10,11,12,13,14, 17,18,19,20,21,22,23,24,25,26,27]. Those findings were found in CO-RADS 5 group in our study, while CO-RADS 4 group was with similar findings, but with accompanying atypical features including unilateral distribution without a close relation to the pleura, as described by others [8,9,10,11,12,13,14, 21]. We didn’t recognize the predominant lobar distribution of the infiltrates compared to other studies that showed predominantly lower lobe involvement [8,9,10,11,12,13,14]. Only two scans showed pericardial exudates, which also was uncommon in other studies [8,9,10,11,12,13,14].

Chest-radiograph failed in detecting COVID-19 pneumonia in 17 (12%) patients. Twelve chest-radiographs were normal at the same time when CT revealed changes compatible with CO-RADS 2–4. The remaining chest-radiographs were inconclusive as the pneumonic infiltrates were obscured by interstitial lunge changes or because of improper cooperation to the examination. Other studies found that the sensitivity of CT versus chest-radiograph was 97–98% versus 33–69%, respectively [28,29,30].

Our study has limitations. It was conducted in only two centers with a relatively small population. Only to observers evaluated the CT scans. We included only symptomatic participants, many of them had severe manifestations on CT. Asymptomatic participants weren`t included, which may have resulted in bias in selecting patients with a more manifest disease, hence affecting CO-RADS performance appraisal.

Conclusions

We found that RT-PCR test showed higher specificity and NPV compared to CT in detecting COVID-19 pneumonia, yet CT showed higher sensitivity, PPV, accuracy and positive rate when categorized and analyzed according to CO-RADS and CTSS compared to RT-PCR test. Although we didn’t find it applicable solely to diagnose COVID-19 pneumonia, CT prevailed to show signs of COVID-19 pneumonia at early stages when RT-PCR test failed, thus we recommend to use it as a primary diagnostic tool, which can provide a significant advantage especially in the settings of rapid onset of a pandemic disease.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

CO-RAD:

Coronavirus disease 2019 reporting and data system

CTSS:

CT severity score

CIVID-19:

Coronavirus disease 2019 reporting and data system

RT-PCR test:

Reverse transcription polymerase chain reaction

GGO:

Ground glass opacities

CRP:

C-reactive protein

WBC:

White blood cells

mg/l:

Milligrams per liter

l:

Liter

FEU:

Forty-foot equivalent unit

References

  1. Guo W, Ran LY, Zhu JH et al (2021) Identifying critically ill patients at risk of death from coronavirus disease. World J Emerg Med 12(1):18–23. https://doi.org/10.5847/wjem.j.1920-8642.2021.01.003

    Article  PubMed  PubMed Central  Google Scholar 

  2. De Oliveira Lima H, da Silva LM, de Campos Vieira Abib A et al (2022) Coronavirus disease-related in-hospital mortality: a cohort study in a private healthcare network in Brazil. Sci Rep 12(1):6371. https://doi.org/10.1038/s41598-022-10343-4

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Kortela E, Kirjavainen V, Ahava MJ et al (2021) Real-life clinical sensitivity of SARS-CoV-2 RT-PCR test in symptomatic patients. PLoS ONE 16(5):e0251661. https://doi.org/10.1371/journal.pone.0251661

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Kanji JN, Zelyas N, MacDonald C et al (2021) False negative rate of COVID-19 PCR testing: a discordant testing analysis. Virol J 18(1):1–6. https://doi.org/10.1186/s12985-021-01489-0

    Article  CAS  Google Scholar 

  5. Congrave-Wilson Z, Lee Y, Jumarang J et al (2021) Change in saliva RT-PCR sensitivity over the course of SARS-CoV-2 infection. JAMA 326(11):1065–1067. https://doi.org/10.1001/jama.2021.13967

    Article  CAS  PubMed Central  Google Scholar 

  6. Clerici B, Muscatello A, Bai F et al (2021) Sensitivity of SARS-CoV-2 detection with nasopharyngeal swabs. Front Public Health 8:1098. https://doi.org/10.3389/fpubh.2020.593491

    Article  Google Scholar 

  7. Ai T, Yang Z, Hou H et al (2020) Correlation of chest CT and RT-PCR testing for coronavirus disease 2019 (COVID-19) in China: a report of 1014 cases. Radiology 296(2):E32–E40. https://doi.org/10.1148/radiol.2020200642

    Article  CAS  Google Scholar 

  8. Prokop M, Van Everdingen W, van Rees VT et al (2020) CO-RADS: a categorical CT assessment scheme for patients suspected of having COVID-19—definition and evaluation. Radiology 296(2):E97–E104. https://doi.org/10.1148/radiol.2020201473

    Article  Google Scholar 

  9. Bellini D, Panvini N, Rengo M et al (2020) Diagnostic accuracy and interobserver variability of CO-RADS in patients with suspected coronavirus disease-2019: a multireader validation study. Eur Radiol 31(4):1932–1940. https://doi.org/10.1007/s00330-020-07273-y

    Article  CAS  PubMed Central  Google Scholar 

  10. Fonseca EKUN, Loureiro BMC, Strabelli DG et al (2021) Evaluation of the RSNA and CORADS classifications for COVID-19 on chest computed tomography in the Brazilian population. Clinics 76:e2476. https://doi.org/10.6061/clinics/2021/e2476

    Article  PubMed  PubMed Central  Google Scholar 

  11. Lessmann N, Sánchez CI, Beenen L et al (2020) Automated assessment of CO-RADS and chest CT severity scores in patients with suspected COVID-19 using artificial intelligence. Radiology 298(1):E18–E28. https://doi.org/10.1148/radiol.2020202439

    Article  PubMed  Google Scholar 

  12. Lieveld AW, Azijli K, Teunissen BP et al (2021) Chest CT in COVID-19 at the ED: validation of the COVID-19 reporting and data system (CO-RADS) and CT severity score: a prospective, multicenter, observational study. Chest 159(3):1126–1135. https://doi.org/10.1016/j.chest.2020.11.026

    Article  CAS  Google Scholar 

  13. Liu H, Ren H, Wu Z et al (2021) CT radiomics facilitates more accurate diagnosis of COVID-19 pneumonia: compared with CO-RADS. J Transl Med 19(1):1–12. https://doi.org/10.1186/s12967-020-02692-3

    Article  CAS  Google Scholar 

  14. Özel M, Aslan A, Araç S (2021) Use of the COVID-19 reporting and data system (CO-RADS) classification and chest computed tomography involvement score (CT-IS) in COVID-19 pneumonia. Radiol Med 126(5):679–687. https://doi.org/10.1007/s11547-021-01335-x

    Article  PubMed  PubMed Central  Google Scholar 

  15. Fang Y, Zhang H, Xie J et al (2020) Sensitivity of Chest CT for COVID-19: comparison to RT-PCR. Radiology 296:E115–E117. https://doi.org/10.1148/radiol.2020200432

    Article  PubMed  Google Scholar 

  16. Chong S, Kim T, Cho E (2010) Herpes simplex virus pneumonia: high-resolution CT findings. Br J Radiol 83(991):585–589. https://doi.org/10.1259/bjr/51409455

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  17. Carotti M, Salaffi F, Sarzi-Puttini P et al (2020) Chest CT features of coronavirus disease 2019 (COVID-19) pneumonia: key points for radiologists. Radiol Med (Torino) 125(7):636–646. https://doi.org/10.1007/s11547-020-01237-4

    Article  PubMed  Google Scholar 

  18. Koo HJ, Lim S, Choe J et al (2018) Radiographic and CT features of viral pneumonia. Radiographics 38(3):719–739. https://doi.org/10.1148/rg.2018170048

    Article  Google Scholar 

  19. Xu X, Yu C, Qu J et al (2020) Imaging and clinical features of patients with 2019 novel coronavirus SARS-CoV-2. Eur J Nucl Med Mol Imaging 47(5):1275–1280. https://doi.org/10.1007/s00259-020-04735-9

    Article  CAS  PubMed Central  Google Scholar 

  20. Altmayer S, Zanon M, Pacini GS et al (2020) Comparison of the computed tomography findings in COVID-19 and other viral pneumonia in immunocompetent adults: a systematic review and meta-analysis. Eur Radiol 30(12):6485–6496. https://doi.org/10.1007/s00330-020-07018-x

    Article  CAS  PubMed Central  Google Scholar 

  21. Zayed NE, Bessar MA, Lutfy S (2021) CO-RADS versus CT-SS scores in predicting severe COVID-19 patients: retrospective comparative study. Egypt J Bronchol 15:1–10. https://doi.org/10.1186/s43168-021-00060-3

    Article  Google Scholar 

  22. Simpson S, Kay FU, Abbara S et al (2020) Radiological society of North America expert consensus document on reporting chest CT findings related to COVID-19: endorsed by the society of thoracic radiology, the American college of Radiology, and RSNA. Radiol Cardiothorac Imaging 2(2):e200152. https://doi.org/10.1097/RTI.0000000000000524

    Article  PubMed Central  Google Scholar 

  23. Kwee TC, Kwee RM (2020) Chest CT in COVID-19: what the radiologist needs to know. Radiographics 40(7):1848–1865. https://doi.org/10.1148/rg.2020200159

    Article  Google Scholar 

  24. Hefeda MM (2020) CT chest findings in patients infected with COVID-19: review of literature. Egypt J Radiol Nucl Med 51(1):1–15. https://doi.org/10.1186/s43055-020-00355-3

    Article  Google Scholar 

  25. de Jaegere TM, Krdzalic J, Fasen BA et al (2020) Radiological Society of North America chest CT classification system for reporting COVID-19 pneumonia: interobserver variability and correlation with reverse-transcription polymerase chain reaction. Radiol Cardiothorac Imaging 2(3):e200213. https://doi.org/10.1148/ryct.2020200213

    Article  PubMed Central  Google Scholar 

  26. Dai M, Ouyang L, Yang F et al (2021) Chest CT Imaging features of typical covert COVID-19 cases. Int J Med Sci 18(10):2128. https://doi.org/10.7150/ijms.48614

    Article  CAS  PubMed Central  Google Scholar 

  27. Bai HX, Hsieh B, Xiong Z et al (2020) Performance of radiologists in differentiating COVID-19 from non-COVID-19 viral pneumonia at chest CT. Radiology 296(2):E46–E54. https://doi.org/10.1148/radiol.2020200823

    Article  Google Scholar 

  28. Öztürk Ş, Özkaya U, Barstuğan M (2021) Classification of Coronavirus (COVID-19) from X-ray and CT images using shrunken features. Int J Imaging Syst Technol 31(1):5–15. https://doi.org/10.1002/ima.22469

    Article  Google Scholar 

  29. Sverzellati N, Ryerson CJ, Milanese G et al (2020) Chest x-ray or CT for COVID-19 pneumonia? Comparative study in a simulated triage setting. Eur Respir J 58:2004188. https://doi.org/10.1183/13993003.04188-2020

    Article  CAS  Google Scholar 

  30. Saygılı A (2021) A new approach for computer-aided detection of coronavirus (COVID-19) from CT and X-ray images using machine learning methods. Appl Soft Comput 105:107323. https://doi.org/10.1016/j.asoc.2021.107323

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge Dr. Mette Lund and Dr. Dritan Shallow, MD for their efforts and substantial contributions.

Funding

No funding was obtained for this study.

Author information

Authors and Affiliations

Authors

Contributions

ZS (the corresponding author) and PA had made substantial contributions to all of the following: The conception and design of the study, the acquisition, analysis and interpretation of the CT scans, acquisition, analysis and interpretation of clinical and laboratory data and drafting the work and revising it. All authors approved the final manuscript.

Corresponding author

Correspondence to Zeina Hadad.

Ethics declarations

Ethics approval and consent to participate

The local medical ethics authority’s rules were considered and respected. The study was approved by NIDO Institutional in The Regional Hospital of West Jutland, Goedstrup. The patient consent was waived in this observational study by the Research Ethics Board and was in accordance with personal data protection law in west Europe, ensuring respect of both patient and medical records confidentiality.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hadad, Z., Afzelius, P. A detailed statistical analysis of the performance of CO-RADS and CT-severity score in the diagnosis of COVID-19 pneumonia compared to RT-PCR test: a prospective cohort study. Egypt J Radiol Nucl Med 54, 148 (2023). https://doi.org/10.1186/s43055-023-01099-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s43055-023-01099-6

Keywords