Deep Learning and Statistical Process Control Approach to Improve Quality in Immigration Services

Pontiselly (1), Muhammad Ahsan (2), Muhammad Hisyam Lee (3)
(1) Department of Statistics, Institut Teknologi Sepuluh Nopember, Surabaya, Indonesia
(2) Department of Statistics, Institut Teknologi Sepuluh Nopember, Surabaya, Indonesia
(3) Department of Mathematical Sciences, Universiti Teknologi Malaysia, Johor Bahru, Malaysia
Fulltext View | Download
How to cite (IJASEIT) :
Pontiselly, et al. “Deep Learning and Statistical Process Control Approach to Improve Quality in Immigration Services”. International Journal on Advanced Science, Engineering and Information Technology, vol. 14, no. 5, Oct. 2024, pp. 1564-73, doi:10.18517/ijaseit.14.5.19978.
Technological advancements have profoundly influenced various sectors, including tourism, by simplifying international travel and increasing the demand for passports. In this context, public feedback on the Surabaya Immigration Office's services, gathered from Google Maps reviews, presents an invaluable dataset for analysis. This study introduces a novel approach to quality management systems in immigration services by applying the Convolutional Long Short-Term Memory (Co-LSTM) for sentiment analysis of public reviews and p-attribute control charts for statistical process control. Focusing on the Surabaya Immigration Office, we analyze public feedback from Google Maps to assess service quality. Our methodology preprocesses and classifies opinion data into sentiment classes, employing Co-LSTM for its superior accuracy over traditional models. The sentiment analysis reveals a predominance of positive over negative reviews, with classification accuracy demonstrating Area Under Curve (AUC) values of 98.61% for training and 85.66% for testing data. Furthermore, the p-attribute control charts are utilized to monitor service defects, identifying areas of uncontrolled variability and suggesting the necessity for service improvement interventions. The study uncovers that the primary public grievance relates to the perceived lack of friendliness and politeness from office staff. By integrating sentiment analysis with statistical process control, this research offers a comprehensive approach for immigration service providers to enhance service quality, respond proactively to public sentiment, and ensure customer satisfaction.

BPS, Statistik Wisatawan Nasional 2022, Jakarta: Badan Pusat Statistik, 2023.

H. Ditjenim, "Aplikasi M-Paspor Siap Digunakan di Seluruh Indonesia Mulai 27 Januari 2022," 2022. [Online]. Available: https://www.imigrasi.go.id/id/2022/01/23/aplikasi-m-paspor-siap-digunakan-di-seluruh-indonesia-mulai-27-januari-2022/.

R. K. Behera, M. Jena, S. K. Rath and S. Misra, "Co-LSTM: Convolutional LSTM Model for Sentiment Analysis in Social Big Data," Information Processing and Management, vol. 58, no. 1, 2021.

M. Mashuri, M. Ahsan, M. H. Lee and D. D. Prastyo, "PCA-based Hotelling’s T2 chart with Fast Minimum Covariance Determinant (FMCD) Estimator and Kernel Density Estimation (KDE) for Network Intrusion Detection," Computers & Industrial Engineering, vol. 158, p. 107447, 2021.

M. Imran, J. Sun, X. Hu, F. S. Zaidi and A. Tang, "Investigating zero-state and steady-state performance of MEWMA-CoDa control chart using variable sampling interval," Journal of Applied Statistics, pp. 1-22, 2023.

A. Zaka, M. Naveed and R. Jabeen, "Performance of attribute control charts for monitoring the shape parameter of modified power function distribution in the presence of measurement error," Quality and Reliability Engineering International, vol. 38, no. 2, pp. 1060-1073, 2022.

A. Karenina, "Sentiment Analysis on User Reviews of Mobile Banking BRIMO Using Naive Bayes Classifier and Support Vector Machine Models," Institut Teknologi Sepuluh Nopember, Surabaya, 2023.

N. T. Apsari, M. Ahsan and M. H. Lee, "Monitoring the Quality of PeduliLindungi Application based on Customer Reviews on Google Play Using Hybrid Naive Bayes - Laney p' Attribute Control Chart," International Journal on Advanced Science Engineering Information Technology, vol. 13, 2023.

D. Firmansyah, "Monitoring Kualitas pada Aplikasi MyPertamina Berdasarkan Ulasan Pengguna di Google Play Menggunakan Diagram Kendali Laney p' Berbasis Convolutional Neural Network," Institut Teknologi Sepuluh Nopember, Surabaya, 2022.

P. Naila Adelia and A. Muhammad, "Monitoring Quality of KAI Access Application Based on Customer Reviews on Google Play Store Using Laney p’Control Chart Based on Convolutional Neural Network," 5th International Conference on Statistics, Mathematics, Teaching, and Research 2023 (ICSMTR 2023), pp. 175-184, 2023.

S. Kim, S. Park and M. Kwak, "Review-Based Control Charts For Service Quality Monitoring: A Brief Review And Future Directions," ICIC International, pp. 707-714, 2020.

T. Zhang, Z. He and A. Mukherjee, "Monitoring negative sentiment scores and time between customer complaints via one-sided distribution-free EWMA schemes," Computers & Industrial Engineering, 2023.

M. Muchson, Statistika Deskriptif, Guepedia: Jakarta, 2012.

D. Montgomery, Introduction to Statistical Quality Control, 7th ed, New York: Wiley and Sons Inc, 2013.

E. Senave, M. J. Jans and R. P. Srivastava, "The Application of Text Mining in Accounting," International Journal of Accounting Information System, 2023.

R. G. Katryn, "Text Preprocessing: Tahap Awal dalam Natural Language Processing (NLP)," 2020. [Online]. Available: https://medium.com/mandiri-engineering/text-preprocessing-tahap-awal-dalam-natural-language-processing-nlp-bc5fbb6606a.

S. Kala, "Data Visualization: Word Clouds with Python," Juli 2020. [Online]. Available: https://medium.com/analytics-vidhya/data-visualization-word-clouds-with-python-fbb6395be18f.

S. R. Goniwada, "Sentiment Analysis," in Introduction to Datafication, Apress, Berkeley, CA, 2023, pp. 1-14.

S. Lai, X. Hu, H. Xu, Z. Ren and Z. Liu, "Multimodal Sentiment Analysis: A survey," Displays, vol. 80, 2023.

K. Devi, "Understanding Hold-Out Methods for Training Machine Learning Models," 14 August 2023. [Online]. Available: https://www.comet.com/site/blog/understanding-hold-out-methods-for-training-machine-learning-models/. [Accessed 23 February 2024].

S. Kulkarni, "Word Embedding using Word2Vec," 3 January 2024. [Online]. Available: https://www.geeksforgeeks.org/python-word-embedding-using-word2vec/. [Accessed 25 February 2024].

D. Montgomery, Introduction to Statistical Quality Control, 8th ed, Hoboken: John Wiley & Sons, Inc, 2020.

S. Turney, "Probability Distribution | Formula, Types, & Examples," 21 June 2023. [Online]. Available: https://www.statisticalaid.com/binomial-distribution-definition-density-function-properties-and-application/. [Accessed 25 February 2024].

K. I. K. I. K. T. Surabaya, "Visi dan Misi," 2022. [Online]. Available: https://kanimsurabaya.kemenkumham.go.id/tentang-kami/visi-dan-misi/.

R. Hidayatillah, "Pengukuran Ketidakpuasan Pelanggan Menggunakan Attribute Control Chart Berdasarkan Data Customer Review Sebagai Dasar Penyusunan Rekomendasi Perbaikan Layanan," Institut Teknologi Sepuluh Nopember, Surabaya, 2022.

R. N. Cikania, "Analisis Sentimen Review Pengguna Layanan Telemedicine Halodoc Menggunakan Algoritma Naïve Bayes Classifier dan Support Vector Machine," Institut Teknologi Sepuluh Nopember, Surabaya, 2021.

M. Romadhona, "Analisis Klasifikasi Sentimen Review Mobile JKN Menggunakan Naïve Bayes Classifier dan Support Vector Machine," Institut Teknologi Sepuluh Nopember, Surabaya, 2021.

J. Kim and C. Lim, "Customer Complaints Monitoring with Customer Review Data Analytics: An Integrated Method of Sentiment and Statistical Process Control Analyses," Advanced Engineering Informatics, pp. 2-13, 2021.

M. Ahsan, M. Mashuri and H. Khusna, "Kernel Principal Component Analysis (PCA) Control Chart for Monitoring Mixed Non-Linear Variable and Attribute Quality Characteristics," Heliyon, vol. 8, no. 6, 2022.

M. Ahsan, M. Mashuri, H. Kuswanto, D. D. Prastyo and H. Khusna, "Outlier Detection Using PCA Mix Based T2 Control Chart for Continous and Categorical Data," Communications in Statistics - Simulation and Computation, vol. 50, no. 5, pp. 1496-1523, 2021.

A. A. Aly, N. A. Saleh and M. A. Mahmoud, "An adaptive EWMA control chart for monitoring zero-inflated Poisson processes," Communication in Statistics, vol. 51, no. 4, pp. 1564-1577, 2022.

A. Johannssen, N. Chukhrova and P. Castagliola, "The performance of the hypergeometric np chart wih estimated parameter," Stochastics and Statistics, vol. 296, no. 3, pp. 873-899, 2022.

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with this journal agree to the following terms:

    1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
    2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
    3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).