Application of Reinforcement Learning Techniques in Software Testing of Android Applications: A Systematic Literature Review
How to cite (IJASEIT) :
A. Abo-eleneen, A. Palliyali, and C. Catal, "The role of reinforcement learning in software testing," Inf. Softw. Technol., vol. 165, Dec. 2023, doi: 10.1016/j.infsof.2023.107325.
K. Sugali, C. Sprunger, and V. N. Inukollu, "Software testing: Issues and challenges of artificial intelligence & machine learning," Int. J. Artif. Intell. Appl., vol. 12, no. 1, pp. 101-112, Jan. 2021, doi:10.5121/ijaia.2021.12107.
H. You et al., "Navigating the testing of evolving deep learning systems: An exploratory interview study," in Proc. IEEE/ACM 47th Int. Conf. Softw. Eng. (ICSE), 2025, p. 643, doi:10.1109/ICSE55347.2025.00106.
M. Idham et al., "Test case prioritization for software product line: A systematic mapping study," JOIV Int. J. Inf. Vis., vol. 7, p. 2126, Nov. 2023, doi: 10.30630/joiv.7.3-2.1340.
J. Wang et al., "Software testing with large language models: Survey, landscape, and vision," IEEE Trans. Softw. Eng., vol. 50, no. 4, pp. 911-936, Apr. 2024, doi: 10.1109/TSE.2024.3368208.
S. Haldar, M. Pierce, and L. F. Capretz, "Exploring the integration of generative AI tools in software testing education: A case study on ChatGPT and Copilot for preparatory testing artifacts in postgraduate learning," IEEE Access, vol. 13, 2025, doi:10.1109/access.2025.3545882.
Y. Matsuo et al., "Deep learning, reinforcement learning, and world models," Neural Netw., vol. 152, pp. 267-275, Aug. 2022, doi:10.1016/j.neunet.2022.03.037.
M. Binjubier et al., "A GPU accelerated parallel genetic algorithm for the traveling salesman problem," J. Soft Comput. Data Min., vol. 5, no. 2, pp. 137-150, 2024, doi: 10.30880/jscdm.2024.05.02.010.
F. Pecorelli et al., "Software testing and Android applications: A large-scale empirical study," Empir. Softw. Eng., vol. 27, no. 2, Mar. 2022, doi: 10.1007/s10664-021-10059-5.
Z. Chen et al., "Exploring better black-box test case prioritization via log analysis," ACM Trans. Softw. Eng. Methodol., vol. 32, no. 3, Apr. 2023, doi: 10.1145/3569932.
X. Li, "GUI testing for Android applications: A survey," in Proc. 7th Int. Conf. Comput., Softw. Model. (ICCSM), 2023, pp. 6-10, doi:10.1109/iccsm60247.2023.00010.
M. Naeem, S. T. H. Rizvi, and A. Coronato, "A gentle introduction to reinforcement learning and its application in different fields," IEEE Access, vol. 8, pp. 209320-209344, 2020, doi:10.1109/access.2020.3038605.
P. S. N. Mindom, A. Nikanjam, and F. Khomh, "Integrating reinforcement learning in software testing automation: A promising approach," Empir. Softw. Eng., 2023, doi: 10.5753/ise.2023.235976.
S. Elbaum, G. Rothermel, and J. Penix, "Techniques for improving regression testing in continuous integration development environments," in Proc. ACM SIGSOFT Symp. Found. Softw. Eng., 2014, pp. 235-245, doi: 10.1145/2635868.2635910.
H. A. M. Shaffril, S. F. Samsuddin, and A. A. Samah, "The ABC of systematic literature review: The basic methodological guidance for beginners," Qual. Quant., vol. 55, no. 4, pp. 1319-1346, Aug. 2021, doi: 10.1007/s11135-020-01059-6.
B. Kitchenham and S. Charters, "Guidelines for performing systematic literature reviews in software engineering," Keele Univ., Keele, UK, Tech. Rep. EBSE-2007-01, 2007.
H. Eljak et al., "E-learning-based cloud computing environment: A systematic review, challenges, and opportunities," IEEE Access, vol. 12, pp. 7329-7355, 2024, doi: 10.1109/access.2023.3339250.
C. Tao et al., "A reinforcement learning-based approach to testing GUI of mobile applications," World Wide Web, vol. 27, no. 2, Mar. 2024, doi: 10.1007/s11280-024-01252-9.
E. Collins et al., "Deep reinforcement learning based Android application GUI testing," in Proc. ACM Int. Conf. Proceeding Ser., 2021, pp. 186-194, doi: 10.1145/3474624.3474634.
L. Cai et al., "Automated testing of Android applications integrating residual network and deep reinforcement learning," in Proc. IEEE Int. Conf. Softw. Qual., Rel. Secur. (QRS), 2021, pp. 189-196, doi:10.1109/qrs54544.2021.00030.
L. Cai et al., "Reinforcement learning application testing method based on multi-attribute fusion," in Proc. 9th Int. Conf. Dependable Syst. Appl. (DSA), 2022, pp. 24-33, doi: 10.1109/DSA56465.2022.00013.
Y. Zhao, B. Harrison, and T. Yu, "DinoDroid: Testing Android apps using deep Q-networks," ACM Trans. Softw. Eng. Methodol., vol. 33, no. 5, Jun. 2024, doi: 10.1145/3652150.
H. Guo et al., "SQDroid: A semantic-driven testing for Android apps via Q-learning," in Proc. IEEE Int. Conf. Softw. Qual., Rel. Secur. (QRS), 2021, pp. 301-310, doi: 10.1109/qrs54544.2021.00041.
Y. P. Lopez et al., "Q-funcT: A reinforcement learning approach for automated black box functionality testing," in Proc. 2nd IEEE Int. Conf. Softw. Eng. Artif. Intell. (SEAI), 2022, pp. 119-123, doi:10.1109/seai55746.2022.9832177.
H. Wang et al., "CamDroid: Context-aware model-based automated GUI testing for Android apps," Tsinghua Sci. Technol., vol. 30, no. 1, pp. 55-67, Feb. 2024, doi: 10.26599/tst.2024.9010038.
Y. Lan et al., "Deeply reinforcing Android GUI testing with deep reinforcement learning," in Proc. Int. Conf. Softw. Eng., Feb. 2024, doi: 10.1145/3597503.3623344.
M. Pan et al., "Reinforcement learning based curiosity-driven testing of Android applications," in Proc. 29th ACM SIGSOFT Int. Symp. Softw. Test. Anal., Jul. 2020, pp. 153-164, doi:10.1145/3395363.3397354.
Z. Lv et al., "Fastbot2: Reusable automated model-based GUI testing for Android enhanced by reinforcement learning," in Proc. ACM Int. Conf. Proceeding Ser., Sep. 2022, doi: 10.1145/3551349.3559505.
K. Murase and S. Takada, "Applying reinforcement learning for automated testing of mobile application focusing on state definition, reward, and learning method," in Proc. Int. Conf. Softw. Eng. Knowl. Eng., 2023, pp. 64-69, doi: 10.18293/SEKE23-154.
C. Peng et al., "Hawkeye: Change-targeted testing for Android apps based on deep reinforcement learning," in Proc. ACM Int. Conf. Proceeding Ser., Apr. 2024, pp. 298-308, doi:10.1145/3639477.3639749.
Y. Gao et al., "A deep reinforcement learning-based approach for Android GUI testing," in Lect. Notes Comput. Sci., vol. 13975, pp. 262-276, 2023, doi: 10.1007/978-3-031-25201-3_20.
F. Wang, C. Tao, and J. Gao, "REDQT: A method for automated mobile application GUI testing based on deep reinforcement learning algorithms," Softw. Syst. Model., 2024, doi: 10.1007/s11761-024-00413-y.
Z. Zhang et al., "UniRLTest: Universal platform-independent testing with reinforcement learning via image understanding," in Proc. 31st ACM SIGSOFT Int. Symp. Softw. Test. Anal., Jul. 2022, pp. 805-808, doi: 10.1145/3533767.3543292.
H. N. Yasin, S. H. A. Hamid, and R. J. R. Yusof, "Droidbotx: Test case generation tool for android applications using q-learning," Symmetry, vol. 13, no. 2, Feb. 2021, doi: 10.3390/sym13020310.
M. K. Khan and R. Bryce, "Android GUI test generation with SARSA," in Proc. IEEE 12th Annu. Comput. Commun. Workshop Conf., 2022, pp. 487-493, doi: 10.1109/ccwc54503.2022.9720807.
A. Usman et al., "Test case generation approach for Android applications using reinforcement learning," Eng., Technol. Appl. Sci. Res., vol. 14, no. 4, pp. 15127-15132, Aug. 2024, doi:10.48084/etasr.7422.
Y. Koroglu and A. Sen, "Functional test generation from UI test scenarios using reinforcement learning for android applications," Softw. Test., Verif. Reliab., May 2021, doi:10.1002/stvr.1752.
M. Waqar et al., "Test suite prioritization based on optimization approach using reinforcement learning," Appl. Sci., vol. 12, no. 13, Jul. 2022, doi: 10.3390/app12136772.
M. K. Khan et al., "Post prioritization techniques to improve code coverage for SARSA generated test cases," in Proc. IEEE 13th Annu. Comput. Commun. Workshop Conf., 2023, pp. 1029-1035, doi:10.1109/CCWC57344.2023.10099120.

This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).