An Analysis of Several Optimizers on CNNSVM and CNNRF for COVID–19 Chest X–ray Images

Zuherman Rustam (1), Jane Eva Aurelia (2), Fevi Novkaniza (3), Sri Hartini (4), Rahmat Hidayat (5), Mostafa Ezziyyani (6)
(1) Department of Mathematics, University of Indonesia, Depok, Indonesia
(2) Department of Mathematics, University of Indonesia, Depok, Indonesia
(3) Department of Mathematics, University of Indonesia, Depok, Indonesia
(4) Department of Mathematics, University of Indonesia, Depok, Indonesia
(5) Department Information Technology, Politeknik Negeri Padang, Padang, Indonesia
(6) University Abdelmalek Essaadi, Faculty of Sciences and Techniques of Tangier, Morocco
Fulltext View | Download
How to cite (IJASEIT) :
Rustam, Zuherman, et al. “An Analysis of Several Optimizers on CNNSVM and CNNRF for COVID–19 Chest X–ray Images”. International Journal on Advanced Science, Engineering and Information Technology, vol. 13, no. 4, Aug. 2023, pp. 1486-91, doi:10.18517/ijaseit.13.4.18925.
COVID-19 is a new type of ailment caused by the strenuous acute respiratory syndrome, namely SARS-CoV-2, also frequently well-known as the Coronavirus. An early tendency of COVID-19 for some sufferers can cause no symptoms at all as no experience is referred to as asymptomatic confirmation cases, yet these sufferers can still transmit COVID-19 to other people. Therefore, the authors developed a program using Machine Learning that sustains data to be analyzed based on the input served under the proposed methods of Convolutional Neural Network-Support Vector Machine (CNNSVM) and Convolutional Neural Network-Random Forest(CNNRF), along with several optimizers to be compared. Convolutional Neural Networks is a deep learning algorithm that can train large data sets with millions of parameters and has attracted attention in various fields that are commonly used for the classification and detection of Convolution in Neural Networks. In amalgamation with Support Vector Machines, a technique that uses two vectors to form a dividing line or side and fairly high accuracy,y random forests classification. In the manner of image data obtained from ChestX-ray images of people with COVID-19 from the Italian Society of Medical and Interventional Radiology (SIRM), a total of 1750 observations consisting of 1000 data for COVID¬-19 images and 750 data for non-COVID-19 images. This research aims to determine which optimizer is better for analyzing COVID-19 ChestX-ray images by evaluating both methods. Hopefully, both methods can provide higher accuracy for future studies with wider databases to provide better results for analyzing different ailments.

Adam Jacobi, Michael Chung, Adam Bernheim, Corey Eber. "Portable chest X-ray in coronavirus disease-19 (COVID-19): A pictorial review". 2020. Clinical Imaging. Vol. 64, pp. 35-42. https://doi.org/10.1016/j.clinimag.2020.04.001.

Aras M. Ismael, Abdulkadir Åžengí¼r. "Deep learning approaches for COVID-19 detection based on chest X-ray images." 2021. Expert Systems with Applications. Vol. 164, p. 114054. https://doi.org/10.1016/j.eswa.2020.114054.

Abbas, A., Abdelsamea, M.M. & Gaber, M.M. "Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network. "2021. Applied Intelligence. Vol. 51, pp. 854-864. https://doi.org/10.1007/s10489-020-01829-7.

Wang, L., Lin, Z.Q. & Wong, A. "COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images ". 2020. Scientific Reports. Vol. 10, p. 19549. https://doi.org/10.1038/s41598-020-76550-z.

Shervin Minaee, Rahele Kafieh, Milan Sonka, Shakib Yazdani, Ghazaleh Jamalipour Soufi. "Deep-COVID: Predicting COVID-19 from chest X-ray images using deep transfer learning ". 2020. Medical Image Analysis. Vol. 65, p. 101794. https://doi.org/10.1016/j.media.2020.101794.

Jain, R., Gupta, M., Taneja, S. "Deep learning based detection and analysis of COVID-19 on chest X-ray images ". 2021. Applied Intelligence. Vol. 51, pp. 1690-1700. https://doi.org/10.1007/s10489-020-01902-1.

Borghesi, A., Maroldi, R. "COVID-19 outbreak in Italy: experimental chest X-ray scoring system for quantifying and monitoring disease progression ". 2020. La Radiologia medica. Vol. 125, pp. 509-513. https://doi.org/10.1007/s11547-020-01200-3.

Ni Zhang, Yi-Xin Cai, Yong-Yong Wang, Yi-Tao Tian, Xiao-Li Wang, Benjamin Badami. "Skin cancer diagnosis based on optimized convolutional neural network ". 2020. Artificial Intelligence in Medicine. Vol. 102, p. 101756. https://doi.org/10.1016/j.artmed.2019.101756.

Fang, X., Liu, W., Ai, J. "Forecasting incidence of infectious diarrhea using random forest in Jiangsu Province, China ". 2020. BMC Infectious Diseases. Vol. 20, p. 222. https://doi.org/10.1186/s12879-020-4930-2.

Yang, L., Wu, H., Jin, X. "Study of cardiovascular disease prediction model based on random forest in eastern China ". 2020. Scientific Reports. Vol. 10, p. 5245. https://doi.org/10.1038/s41598-020-62133-5.

Yao, P., Wu, H., Gao, B. "Fully hardware-implemented memristor convolutional neural network ". 2020. Nature. Vol. 577, pp. 641-646. https://doi.org/10.1038/s41586-020-1942-4.

M.V. Valueva, N.N. Nagornov, P.A. Lyakhov, G.V. Valuev, N.I. Chervyakov. "Application of the residue number system to reduce hardware costs of the convolutional neural network implementation ". 2020. Mathematics and Computers in Simulation. Vol. 177, pp. 232-243. https://doi.org/10.1016/j.matcom.2020.04.031.

Zhiqiang Geng, Yanhui Zhang, Chengfei Li, Yongming Han, Yunfei Cui, Bin Yu. "Energy optimization and prediction modeling of petrochemical industries: An improved convolutional neural network based on cross-feature ". 2020. Energi. Vol. 194, p. 116851. https://doi.org/10.1016/j.energy.2019.116851.

Wei Wang, Yiyang Hu, Ting Zou, Hongmei Liu, Jin Wang, Xin Wang. "A New Image Classification Approach via Improved MobileNet Models with Local Receptive Field Expansion in Shallow Layers ". 2020. Computational Intelligence and Neuroscience. Vol. 2020, p. 817-849. https://doi.org/10.1155/2020/8817849.

Yu Zhang, Yu Liu, Peng Sun, Han Yan, Xiaolin Zhao, Li Zhang. "IFCNN: A general image fusion framework based on convolutional neural network ". 2020. Information Fusion. Vol. 54, pp. 99-118. https://doi.org/10.1016/j.inffus.2019.07.011.

Dhillon, A., Verma, G.K. "Convolutional neural network: a review of models, methodologies and applications to object detection. 2020. Progress in Artificial Intelligence. Vol. 9, pp. 85-112. https://doi.org/10.1007/s13748-019-00203-0.

Derek A. Pisner, David M. Schnyer. "Chapter 6 - Support vector machine. "2020. Machine Learning: Methods and Applications to Brain Disorders. pp. 101-121. https://doi.org/10.1016/B978-0-12-815739-8.00006-7.

Jair Cervantes, Farid Garcia-Lamont, Lisbeth Rodrí­guez-Mazahua, Asdrubal Lopez. "A comprehensive survey on support vector machine classification: Applications, challenges and trends ". 2020. Neurocomputing. Vol. 408, pp. 189-215. https://doi.org/10.1016/j.neucom.2019.10.118.

Dou, J., Yunus, A.P., Bui, D.T. "Improved landslide assessment using support vector machine with bagging, boosting, and stacking ensemble machine learning framework in a mountainous watershed, Japan ". 2020. Landslides. Vol. 17, pp. 641-658. https://doi.org/10.1007/s10346-019-01286-5.

Fazil Kaytez. "A hybrid approach based on autoregressive integrated moving average and least-square support vector machine for long-term forecasting of net electricity consumption ". 2020. Energi. Vol. 197, p. 117-200. https://doi.org/10.1016/j.energy.2020.117200.

Melgani, Farid & Bruzzone, Lorenzo. "Classification of Hyperspectral Remote Sensing Images with Support Vector Machines ". 2004. Geoscience and Remote Sensing. IEEE Transactions. Vol. 42, pp. 1778-1790. https://doi.org/10.1109/TGRS.2004.831865.

Onuwa Okwuashi, Christopher E. Ndehedehe. "Deep support vector machine for hyperspectral image classification ". 2020. Pattern Recognition. Vol. 103, p. 107-298. https://doi.org/10.1016/j.patcog.2020.107298.

Mingjing Wang, Huiling Chen. "Chaotic multi-swarm whale optimizer boosted support vector machine for medical diagnosis ". 2020. Applied Soft Computing. Vol. 88, p. 105946. https://doi.org/10.1016/j.asoc.2019.105946.

Yanyu Chen, Wenzhe Zheng, Wenbo Li, Yimiao Huang. "Large group activity security risk assessment and risk early warning based on random forest algorithm ". 2021. Pattern Recognition Letters. Vol. 144, pp. 1-5. https://doi.org/10.1016/j.patrec.2021.01.008.

Rakesh Katuwal, P.N. Suganthan, Le Zhang. "Heterogeneous oblique random forest ". 2020. Pattern Recognition. Vol. 99, p. 107078. https://doi.org/10.1016/j.patcog.2019.107078.

Emma Izquierdo-Verdiguier, Raíºl Zurita-Milla. "An evaluation of Guided Regularized Random Forest for classification and regression tasks in remote sensing. "2020. International Journal of Applied Earth Observation and Geoinformation. Vol. 88, p. 102051. https://doi.org/10.1016/j.jag.2020.102051.

Moor, Lieven & Luitel, Prabesh & Sercu, Piet & Vanpí©e, Rosanne. "Subjectivity in Sovereign Credit Ratings ". 2017. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.2934287.

Wengang Zhang, Chongzhi Wu, Haiyi Zhong, Yongqin Li, Lin Wang. "Prediction of undrained shear strength using extreme gradient boosting and random forest based on Bayesian optimization ". 2021. Geoscience Frontiers. Vol. 12, Issue 1, pp. 469-477. https://doi.org/10.1016/j.gsf.2020.03.007.

Ding-Xuan Zhou. "Theory of deep convolutional neural networks: Downsampling. "2020. Neural Networks. Vol. 124, pp. 319-327. https://doi.org/10.1016/j.neunet.2020.01.018.

Xianwei Jiang, Bo Hu, Suresh Chandra Satapathy, Shui-Hua Wang, Yu-Dong Zhang. "Fingerspelling Identification for Chinese Sign Language via AlexNet-Based Transfer Learning and Adam Optimizer ". 2020. Scientific Programming. Vol. 2020, p. 3291426. https://doi.org/10.1155/2020/3291426.

J. -K. Fang, C. -M. Fong, P. Yang, C. -K. Hung, W. -L. Lu and C. -W. Chang. "AdaGrad Gradient Descent Method for AI Image Management. "2020. IEEE International Conference on Consumer Electronics - Taiwan. pp. 1-2. https://doi.org/10.1109/ICCE-Taiwan49838.2020.9258085.

Kamsing, P., Torteeka, P. & Yooyen, S. An enhanced learning algorithm with a particle filter-based gradient descent optimizer method. 2020. Neural Computing & Applications. Vol. 32, pp. 12789-12800. https://doi.org/10.1007/s00521-020-04726-9.

Jianfeng Xu, Yuanjian Zhang, Duoqian Miao. "Three-way confusion matrix for classification: A measure driven view ". 2020. Information Sciences. Vol. 507, pp. 772-794. https://doi.org/10.1016/j.ins.2019.06.064.

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with this journal agree to the following terms:

    1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
    2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
    3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).