Performance Evaluation of the NASNet Convolutional Network in the Automatic Identification of COVID-19

Fredy Martínez (1), Fernando Martínez (2), Edwar Jacinto (3)
(1) Facultad Tecnológica, Universidad Distrital Francisco José de Caldas Carrera 7 No. 40B-53, Bogotá D.C., Colombia
(2) Facultad Tecnológica, Universidad Distrital Francisco José de Caldas Carrera 7 No. 40B-53, Bogotá D.C., Colombia
(3) Facultad Tecnológica, Universidad Distrital Francisco José de Caldas Carrera 7 No. 40B-53, Bogotá D.C., Colombia
Fulltext View | Download
How to cite (IJASEIT) :
Martínez, Fredy, et al. “Performance Evaluation of the NASNet Convolutional Network in the Automatic Identification of COVID-19”. International Journal on Advanced Science, Engineering and Information Technology, vol. 10, no. 2, Apr. 2020, pp. 662-7, doi:10.18517/ijaseit.10.2.11446.
This paper evaluates the performance of the Neural Architecture Search Network (NASNet) in the automatic detection of COVID-19 (Coronavirus Disease 2019) from chest x-ray images. COVID-19 is a disease caused by Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) that produces in patients fever, cough, shortness of breath, muscle pain, sputum production, diarrhea, and even sore throat. The virus spreads through the air, and to date, is expanding as a global pandemic. There is no vaccine, and it is fatal to approximately 2-7% of the infected population. Among the clinical and paraclinical characteristics of infected patients, nodules have been identified in images of chest x-rays that can be visually identified, producing a simple, rapid, and generally available method of identification. However, the rapid spread of the disease means that there is a lack of specialized medical personnel capable of identifying it, which is why automated schemes are being developed. We propose the tuning of a NASNet-type convolutional model to automatically determine the initial state of a patient in the triage process or intervention protocol of health care centers. The neural network is trained with public images of cases positively identified as patients infected with the virus and patients in normal conditions without infection. Performance evaluation is also done with real images unknown to the neuronal model. As for performance metrics, we use the function of loss of cross-entropy (categorical cross-entropy), the accuracy (or success rate), and the MSE (Mean Squared Error). The tuned model was able to correctly classify the test images with an accuracy of 97%.

P. Masters, “Coronavirus genomic RNA packaging”, Virology, vol. 537, no. 1, pp. 198-207, 2019, ISSN 0042-6822, doi:https://doi.org/10.1016/j.virol.2019.08.031.

X. Xuanyang, G. Yuchang, W. Shouhong, and L. Xi, “Computer aided detection of SARS based on radiographs data mining”, IEEE Engineering in Medicine and Biology 27th Annual Conference, pp. 7459-7462, 2005, doi:10.1109/IEMBS.2005.1616237.

K. Das, E. Lee, R. Singh, M. Enani, K. Dossari, K. Gorkom, S. Larsson, and R. Langer, “Follow-up chest radiographic findings in patients with MERS-CoV after recovery”, Indian Journal of Radiology and Imaging, vol. 27, no. 3, pp. 342-349, 2017, ISSN 0970-3016, doi:10.4103/ijri.IJRI_469_16.

M. Saad, A. Omrani, K. Baig, A. Bahloul, F. Elzein, M. Abdul, M. Selim, M. Mutairi, D. Nakhli, A. Aidaroos, N. Sherbeeni, H. Khashan, Z. Memish, and A. Albarrak, “Clinical aspects and outcomes of 70 patients with middle east respiratory syndrome coronavirus infection: a single-center experience in saudi arabia”, International Journal of Infectious Diseases, vol. 29, no. 1, pp. 301-306, 2014, ISSN 1201-9712, doi:https://doi.org/10.1016/j.ijid.2014.09.003.

E. Sabeti, J. Drews, N. Reamaroon, J. Gryak, M. Sjoding, and K. Najarian, “Detection of acute respiratory distress syndrome by incorporation of label uncertainty and partially available privileged information”, 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2019), pp. 1717-1720, 2019, doi:10.1109/EMBC.2019.8857434.

F. Pan, T. Ye, P. Sun, S. Gui, B. Liang, L. Li, D. Zheng, J. Wang, R. Hesketh, L. Yang, and C. Zheng, “Time course of lung changes on chest CT during recovery from 2019 novel coronavirus (COVID-19) pneumonia”, Radiology, vol. 295, no. 2, pp. 1-15, 2020, ISSN 0033-8419, doi:https://doi.org/10.1148/radiol.2020200370.

F. Kofi, C. Dzuvor, M. Kormla, N. Bennita, and A. Habib, “Updates on Wuhan 2019 novel coronavirus epidemic”, Journal of Medical Virilogy, vol. 92, no. 4, pp. 403-407, 2020, ISSN 1096-9071, doi:10.1002/jmv.25695.

M. Malta, A. Rimoin, and S. Strathdee, “The coronavirus 2019-nCoV epidemic: Is hindsight 20/20?”, EClinicalMedicine, vol. 20, no. 100289, pp. 1-2, 2020, ISSN 2589-5370, doi:https://doi.org/10.1016/j.eclinm.2020.100289.

T. Ai, Z. Yang, H. Hou, C. Zhan, C. Chen, W. Lv, Q. Tao, and Z. S. andL. Xia, “Correlation of chest ct and rt-pcr testing in coronavirus disease 2019 (COVID-19) in China: A report of 1014 cases”, Radiology, vol. 295, no. 2, pp. 1-23, 2020, ISSN 0033-8419, doi:https://doi.org/10.1148/radiol.2020200642.

Y. Fang, H. Zhang, J. Xie, M. Lin, L. Ying, P. Pang, and W. Ji, “Sensitivity of chest CT for COVID-19: comparison to RT-PCR”, Radiology, vol. 295, no. 2, pp. 1-8, 2020, ISSN 0033-8419, doi:https://doi.org/10.1148/radiol.2020200432.

H. Bai, B. Hsieh, Z. Xiong, K. Halsey, J. Choi, T. Linh, I. Pan, D. Wang, J. Mei, X. Jiang, Q. Zeng, T. Egglin, P. Hu, S. Argarwal, F. Xie, S. Li, T. Healey, M. Atalay, and W. Liao, “Performance of radiologists in differentiating COVID-19 from viral pneumonia on chest CT”, Radiology, vol. 295, no. 2, pp. 1-28, 2020, ISSN 0033-8419, doi:https://doi.org/10.1148/radiol.2020200823.

C. Huang, Y. Wang, X. Li, L. Ren, J. Zhao, Y. Hu, L. Zhang, G. Fan, J. Xu, X. Gu, Z. Cheng, T. Yu, J. Xia, Y. Wei, W. Wu, X. Xie, W. Yin, H. Li, M. Liu, Y. Xiao, H. Gao, L. Guo, J. Xie, G. Wang, R. Jiang, Z. Gao, and Q. Jin, “Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China”, The Lancet Journal, vol. 395, no. 10223, pp. 497-506, 2020, ISSN 0140-6736, doi:https://doi.org/10.1016/S0140-6736(20)30183-5.

L. Li, L. Qin, Z. Xu, Y. Yin, X. Wang, B. Kong, J. Bai, Y. Lu, Z. Fang, Q. Song, K. Cao, D. Liu, G. Wang, Q. Xu, X. Fang, S. Zhang, J. Xia, and J. Xia, “Artificial intelligence distinguishes COVID-19 from community acquired pneumonia on chest CT”, Radiology, vol. 295, no. 2, pp. 1-16, 2020, ISSN 0033-8419, doi:https://doi.org/10.1148/radiol.2020200905.

M. Ng, Y. Lee, J. Yang, F. Yang, L. Xia, H. Wang, M. Lui, C. Lo, B. Leung, P. Khong, C. Hui, K. Yuen, and M. Kuo, “Imaging profile of the COVID-19 infection: Radiologic findings and literature review”, Radiology: Cardiothoracic imaging, vol. 2, no. 1, pp. 1-26, 2020, ISSN 2638-6135, doi:https://doi.org/10.1148/ryct.2020200034.

N. Muller, C. Ooi, L. Pek, and N. Savvas, “Severe acute respiratory syndrome: Radiographic and CT findings”, American Journal of Roentgenology, vol. 181, no. 1, pp. 3-8, 2003, ISSN 0361-803X, doi:10.2214/ajr.181.1.1810003.

K. Gostic, A. Gomez, R. Munnah, A. Kucharski, and J. Lloyd, “Estimated effectiveness of symptom and risk screening to prevent the spread of COVID-19”, eLife, vol. 9, no. 1, pp. 1-18, 2020, ISSN 2050-084X, doi:10.7554/eLife.55570.

H. Rothan and S. Byrareddy, “The epidemiology and pathogenesis of coronavirus disease (COVID-19) outbreak”, Journal of Autoimmunity, vol. 109, no. 1, pp. 1-4, 2020, ISSN 0896-8411, doi:https://doi.org/10.1016/j.jaut.2020.102433.

K. Santosh, “AI-Driven tools for coronavirus outbreak: Need of active learning and cross-population train/test models on multitudinal/multimodal data”, Journal of Medical Systems, vol. 44, no. 93, pp. 1-5, 2020, ISSN 0148-5598, doi:https://doi.org/10.1007/s10916-020-01562-1.

O. Gozes, M. Frid-Adar, H. Greenspan, P. Browning, A. Bernheim, and E. Siegel, “Rapid ai development cycle for the coronavirus (COVID-19) pandemic: Initial results for automated detection & patient monitoring using deep learning CT image analysis”, arXiv, 2020, Eprint: 2003.05037v2.

X. Xu, X. Jiang, C. Ma, P. Du, X. Li, S. Lv, L. Yu, Y. Chen, J. Su, G. Lang, Y. Li, H. Zhao, K. Xu, L. Ruan, and W. Wu, “Deep learning system to screen coronavirus disease 2019 pneumonia”, arXiv, 2020, Eprint: 2002.09334v1.

D. Kermany, M. Goldbaum, W. Cai, C. Valentim, H. Liang, S. Baxter, A. McKeown, G. Yang, X. Wu, F. Yan, J. Dong, M. Prasadha, J. Pei, M. Ting, J.Zhu, C. Li, S. Hewett, J. Dong, I. Ziyar, A. Shi, R. Zhang, L. Zheng, R. Hou, W. Shi, X. Fu, Y. Duan, V. Huu, C. Wen, E. Zhang, C. Zhang, O. Li, X. Wang, M. Singer, X. Sun, J. Xu, A. Tafreshi, M. Lewis, H. Xia, and K. Zhang, “Identifying medical diagnoses and treatable diseases by image-based deep learning”, Cell, vol. 172, no. 5, pp. 1122-1131, 2018, ISSN 0092-8674, doi:https://doi.org/10.1016/j.cell.2018.02.010.

F. Martí­nez, C. Herní¡ndez, and F. Martí­nez, “Evaluation of deep neural network architectures in the identification of bone fissures”, Telkomnika, vol. 18, no. 2, pp. 807-814, 2020, ISSN 1693-6930, doi:10.12928/TELKOMNIKA.v18i2.14754.

K. Radhik, K. Devika, T. Aswathi, P. Sreevidya, V. Sowmya, and K. Soman, “Performance analysis of NASNet on unconstrained ear recognition”, Nature Inspired Computing for Data Science, vol. 871, no. 1, pp. 57-82, 2019, ISSN 1860-949X, doi:https://doi.org/10.1007/978-3-030-33820-6_3.

A. Rendón, F. Martí­nez, and C. Herní¡ndez, “Deep regression model for predictive control in a vegetable waste carbonization plant”, Contemporary Engineering Sciences, vol. 10, no. 21, pp. 1047-1055, 2017, ISSN 1314-7641, doi:https://doi.org/10.12988/ces.2017.79107.

J. Cohen, “COVID-19 image data collection”, On line, 2020, https://github.com/ieee8023/covid-chestxray-dataset.

P. Mooney, “Chest x-ray images (pneumonia)”, On line, 2020, https://www.kaggle.com/paultimothymooney/chest-xray-pneumonia.

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with this journal agree to the following terms:

    1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
    2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
    3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).