Performance of ShuffleNet and VGG-19 Architectural Classification Models for Face Recognition in Autistic Children

Melinda Melinda (1), Maulisa Oktiana (2), Yudha Nurdin (3), Indah Pujiati (4), Muhammad Irhamsyah (5), Nurlida Basir (6)
(1) Department of Electrical and Computer Engineering, Faculty of Engineering, Universitas Syiah Kuala, Banda Aceh, 23111, Indonesia
(2) Department of Electrical and Computer Engineering, Faculty of Engineering, Universitas Syiah Kuala, Banda Aceh, 23111, Indonesia
(3) Department of Electrical and Computer Engineering, Faculty of Engineering, Universitas Syiah Kuala, Banda Aceh, 23111, Indonesia
(4) Department of Electrical and Computer Engineering, Faculty of Engineering, Universitas Syiah Kuala, Banda Aceh, 23111, Indonesia
(5) Department of Electrical and Computer Engineering, Faculty of Engineering, Universitas Syiah Kuala, Banda Aceh, 23111, Indonesia
(6) Fakulti Sains dan Teknologi, Universiti Sains Islam Malaysia, Bandar Baru Nilai, 71800 Nilai, Negeri Sembilan, Malaysia
Fulltext View | Download
How to cite (IJASEIT) :
Melinda, Melinda, et al. “Performance of ShuffleNet and VGG-19 Architectural Classification Models for Face Recognition in Autistic Children”. International Journal on Advanced Science, Engineering and Information Technology, vol. 13, no. 2, Apr. 2023, pp. 674-80, doi:10.18517/ijaseit.13.2.18274.
This study discusses the face recognition of children with special needs, especially those with autism. Autism Spectrum Disorder (ASD) is a complex neurodevelopmental disorder that affects social skills, ways of interacting, and communication disorders. Facial recognition in autistic children is needed to help detect autism quickly to minimize the risk of further complications. There is extraordinarily little research on facial recognition of autistic children, and the resulting system is not fully accurate. This research proposes using the Convolution Neural Network (CNN) model using two architectures: ShuffleNet, which uses randomization channels, and Visual Geometry Group (VGG)-19, which has 19 layers for the classification process. The research object used in the face recognition system is secondary data obtained through the Kaggle site with a total of 2,940 image data consisting of images of autism and non-autism. The faces of autistic children are visually difficult to distinguish from those of normal children. Therefore, this system was built to recognize the faces of people with autism. The method used in this research is applying the CNN model to autism face recognition through images by comparing two architectures to see their best performance. Autism and non-autism data are grouped into training data, 2,540, and test data, as much as 300. In the training stage, the data was validated using validation data consisting of 50 autism image data and 50 non-autism image data. The experimental results show that the VGG-19 has high accuracy at 98%, while ShuffleNet is 88%.

S. Singh, D. Singh, and V. Yadav, “Face Recognition Using HOG Feature Extraction and Svm Classifier,” Int. J. Emerg. Trends Eng. Res., vol. 8, no. 9, pp. 6437-6440, 2020, doi: 10.30534/ijeter/2020/244892020.

A. P. Ismail and N. M. Tahir, “Human Gait Silhouettes Extraction Using Haar Cascade Classifier on OpenCV,” Proc. - 2017 UKSim-AMSS 19th Int. Conf. Model. Simulation, UKSim 2017, pp. 105-110, 2018, doi: 10.1109/UKSim.2017.25.

A. Almansour, G. Alsaeedi, H. Almazroui, and H. Almuflehi, “I-Privacy Photo: Face Recognition and Filtering,” ACM Int. Conf. Proceeding Ser., pp. 131-141, 2020, doi: 10.1145/3388142.3388161.

E. Setiawan and A. Muttaqin, “Implementation of K-Nearest Neightbors Face Recognition on Low-power Processor,” Telkomnika (Telecommunication Comput. Electron. Control., vol. 13, no. 3, p. 949, 2015, doi: 10.12928/telkomnika.v13i3.713.

M. M. Ghazi and H. K. Ekenel, “A Comprehensive Analysis of Deep Learning Based Representation for Face Recognition,” IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Work., pp. 102-109, 2016, doi: 10.1109/CVPRW.2016.20.

M. Beary, A. Hadsell, R. Messersmith, and M. P. Hosseini, “Diagnosis of autism in children using facial analysis and deep learning,” arXiv, 2020.

P. Catherine Lord, P. Susan Risi, P. Pamela S. DiLavore, P. Cory Shulman, P. Audrey Thurm and P. Andrew Pickles, "Autism From 2 to 9 Years of Age," American Medical Association. All rights reserved, vol. 63, no. 6, pp.694-701, 2006.

V. Anagnostopoulou, "The Effectiveness of Social StoriesTM on children with Autism Spectrum Disorder," School Teacher & Special Education Teacher, MA, National and Kapodistrian University of Athens, University of Nottingham, vol. ix, pp. 16, 2020.

L. Mapeli, T. Soda, E. D'angelo and F. Prestori, "The Cerebellar Involvement in Autism Spectrum Disorder from the Social Brain to Mouse Models,"International Journal of Molecular Sciences, 2022

M. P. Kazunari Yoshida, P. Emiko Koyama, P. Clement C. Zai, M. Joseph H. Beitchman, M. James L. Kennedy, P. C. P. Yona Lunsky,

M. Pushpal Desarkar and M. P. Daniel J. Muller, "Pharmacogenomic Studies in Intellectual Disabilities and Autism Spectrum Disorder: A Systematic Review," The Canadian Journal of Psychiatry La Revue Canadienne de Psychiatrie, pp. 1-23, 2020.

B. Robson, "Autism spectrum disorder: A review of the current understanding of pathophysiology and complementary therapies in children,"Australian Journal of Herbal Medicine, pp. 128-151, 2013.

S. Jahanara, “Detecting autism from facial image,” Int. J. Adv. Res. Ideas Innov. Technol., no. March, pp. 1-8, 2021, doi: 10.13140/RG.2.2.35268.35202.

T. Akter et al., “Improved transfer-learning-based facial recognition framework to detect autistic children at an early stage,” Brain Sci., vol. 11, no. 6, 2021, doi: 10.3390/brainsci11060734.

H. Kalantarian et al., “Labeling images with facial emotion and the potential for pediatric healthcare,” Artif. Intell. Med., vol. 98, no. April 2018, pp. 77-86, 2019, doi: 10.1016/j.artmed.2019.06.004.

B. Banire, D. Al Thani, M. Qaraqe, and B. Mansoor, “Face-Based Attention Recognition Model for Children with Autism Spectrum Disorder,” J. Healthc. Informatics Res., vol. 5, no. 4, pp. 420-445, 2021, doi: 10.1007/s41666-021-00101-y.

J. Hernandez-Ortega, J. Galbally, J. Fierrez, R. Haraksim, and L. Beslay, “FaceQnet: Quality Assessment for Face Recognition based on Deep Learning,” 2019 Int. Conf. Biometrics, ICB 2019, 2019, doi: 10.1109/ICB45273.2019.8987255.

S. Albawi, O. Bayat, S. Al-Azawi, and O. N. Ucan, “Social touch gesture recognition using convolutional neural network,” Comput. Intell. Neurosci., vol. 2018, 2018, doi: 10.1155/2018/6973103.

J. Alamri, R. Harrabi, and S. Ben Chaabane, “Face Recognition based on Convolution Neural Network and Scale Invariant Feature Transform,” Int. J. Adv. Comput. Sci. Appl., vol. 12, no. 2, pp. 644-654, 2021, doi: 10.14569/IJACSA.2021.0120281.

B. Banire, D. Al Thani, M. Qaraqe, and B. Mansoor, “Face-Based Attention Recognition Model for Children with Autism Spectrum Disorder,” J. Healthc. Informatics Res., 2021, doi: 10.1007/s41666-021-00101-y.

Zhang, X., Zhou, X., Lin, M., and Sun, J. "ShuffleNet : An extremely efficeint convolutional neural network for mobile devices," Proceeedings of the IEEE conference on computer vision and pattern recognition., pp. 6848-6856, 2018

L. Tidmarsh and F. R. Volkmar, “Diagnosis and Epidemiology of Autism Spectrum Disorders,” Can. J. Psychiatry, vol. 48, no. 8, pp. 517-525, 2003, doi: 10.1177/070674370304800803.

A. K. Jain, “Handbook of Face Recognition,” pp. 1-40, 2014, [Online]. Available: papers3://publication/uuid/17FEF3DC-D6F9-408B-96E5-871ED133A4F1. [Diakses: 10 September 2021]

K. H. Teoh, R. C. Ismail, S. Z. M. Naziri, R. Hussin, M. N. M. Isa, and M. S. S. M. Basir, “Face Recognition and Identification using Deep Learning Approach,” J. Phys. Conf. Ser., vol. 1755, no. 1, 2021, doi: 10.1088/1742-6596/1755/1/012006.

A. K. Dubey and V. Jain, "Automatic Facial Recognition Using VGG16 based Transfer Learning Model," Journal of Information and Optimization Sciences, vol. 41, no. 7, pp. 1589-1596, 2020.

M. A. Aghdam, A. Sharifi and M. M. Pedram, "Diagnosis of Autism Spectrum Disorders in Young Children Based on Resting-State Functional Magnetic Resonance Imaging Data Using Convolutional Neural Networks,"Journal of Digital Imaging, vol. 32, no. 6, pp. 899-918, 2019.

M. P. Hosseini, M. Beary, A. Hadsell, R. Messermith and H. Soltanian Zadeh, "Deep Learning for Autism Diagnosis and Facial Analysis in Children," Frontiers in Computational Neuroscience, 2022.

Y. Lecun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, vol. 521, no. 7553, pp. 436-444, 2015, doi: 10.1038/nature14539.

A. A. Cruz-Roa, J. E. Arevalo Ovalle, A. Madabhushi, and F. A. Gonzí¡lez Osorio, “A deep learning architecture for image representation, visual interpretability and automated basal-cell carcinoma cancer detection,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 8150 LNCS, no. PART 2, pp. 403-410, 2013, doi: 10.1007/978-3-642-40763-5_50.

J. S. Asri and G. Firmansyah, “Implementasi Objek Detection Dan Tracking Menggunakan Deep Learning Untuk Pengolahan Citra Digital,” Knsi 2018, pp. 717-723, 2018..

S. J. Rashid, A. I. Abdullah and M. A Shihab, “Face Recognition System Based on Gabor Wavelets Transform, Principal Component Analysis and Support Vector Machine,” International Journal on Advanced Science, Engineering and Information Technology, vol.10,no. 3. pp. 959—963, 2020.

B. Achmad and K. Firdausy, “Neural Network-based Face Pose Tracking for Interactive Face Recognition System,” International Journal on Advanced Science, Engineering and Information Technology, 1 vol.2, no. 1. pp.105—108, 2012.

F. H. K. Zaman, A. A Sulaiman, I. M. Yassin, N. M. Tahir and Z. I. Rizman, “Development of Mobile Face Verification Based on Locally Normalized Gabor Wavelets,” International Journal on Advanced Science, Engineering and Information Technology, vol.7, no. 4. pp. 1198--1205, 2017.

J. Xiao, J. Wang, S. Cao, and B. Li, “Application of a Novel and Improved VGG-19 Network in the Detection of Workers Wearing Masks,” in Journal of Physics: Conference Series, 2020, vol. 1518, no. 1, doi: 10.1088/1742-6596/1518/1/012041.

“Autism_Image_Data_Kaggle.” [Online]. Available: https://www.kaggle.com/cihan063/autism-image-data.

C. He, M. Ma, and P. Wang, “Extract interpretability-accuracy balanced rules from artificial neural networks: A review,” Neurocomputing, vol. 387, pp. 346-358, 2020, doi: 10.1016/j.neucom.2020.01.036.

Authors who publish with this journal agree to the following terms:

    1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
    2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
    3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).