DOI : https://doi.org/10.18517/ijaseit.11.1.10171

Test Case Prioritization Approach for Sequence of Events Using Complexity Factor

Emyreema Ja’afar (1), Sa’adah Hassan (2), Salmi Baharom (3), Johanna Ahmad (4)
(1) Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, 43400 UPM Serdang, Selangor, Malaysia
(2) Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, 43400 UPM Serdang, Selangor, Malaysia
(3) Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, 43400 UPM Serdang, Selangor, Malaysia
(4) Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, 43400 UPM Serdang, Selangor, Malaysia
Fulltext View | Download
How to cite (IJASEIT) :
Ja’afar, Emyreema, et al. “Test Case Prioritization Approach for Sequence of Events Using Complexity Factor”. International Journal on Advanced Science, Engineering and Information Technology, vol. 11, no. 1, Feb. 2021, pp. 400-7, doi:10.18517/ijaseit.11.1.10171.
Citation Format :
Test case prioritization (TCP) is a method to prioritize and schedule test cases. Some approaches have been introduced to minimize the time, cost, and effort for testing the software based on the test cases that are higher priority. Since the more complex the software program, the more intensive the test should be carried out. Thus, complexity is one of the factors that affect the effectiveness of the test case prioritization. However, the existing approaches for measuring complexity have some limitations. This is due to inaccuracy in finding the weightage value for complexity as the value is useful to determine the test case prioritization. Consequently, a complexity metric measurement is needed to determine the weightage value. Hence, this paper presents work on TCP using complexity factors to enhance the accuracy in prioritizing the test cases for event sequences. This work uses Branch Coverage Expectation (BCE) for complexity measurement, in which BCE has been proven its usefulness empirically in the previous research. The event-weightage value based on the complexity is then assigned and used to prioritize the test cases while the Average Percentage of Fault Detected (APFD) metric is used to evaluate the proposed approach. A tool has been developed to ease the process as well as to facilitate the evaluation purposes. The results show the need to combine the complexity factor with other factors to improve the proposed TCP's effectiveness.

G. Duggal and B. Suri, “Understanding Regression Testing Techniques,” COIT, 2008, India.

C. Catal and D. Mishra, “Test case prioritization: A systematic mapping study,” Software Quality Journal, vol. 21(3), pp.445-478, 2013.

H. Srikanth, M. Cashman, and M. B. Cohen, “Test case prioritization of build acceptance tests for an enterprise cloud application: An industrial case study,” J. Syst. Softw., vol. 119, pp. 122-135, 2016.

X. Zhang, X. Xie, and T. Y. Chen, “Test case prioritization using adaptive random sequence with category-partition-based distance,” 2016 IEEE Int. Conf. Softw. Qual. Reliab. Secur., 2016, p. 374-385.

A. Marchetto, M. Islam, and W. Asghar, “A multi-objective technique to prioritize test cases,” IEEE Transactions, 42(10), pp. 918-940, 2016.

C. Y. Huang, J. R. Chang, and Y. H. Chang, “Design and analysis of GUI test-case prioritization using weight-based methods,” Journal of Systems and Software, vol. 83(4), pp.646-659, 2010.

J. Ahmad and S. Baharom, “Comparision of software complexity metrics in measuring the complexity of event sequences,” Information Science and Applications, vol. 424, 2017.

R. Krishnamoorthi and S. A. Sahaaya Arul Mary, “Factor oriented requirement coverage-based system test case prioritization of new and regression test cases,” Information and Software Technology, vol. 51(4), pp. 799-808, 2009.

A. K. Joseph, G. Radhamani, and V. Kallimani, “Improving Test Efficiency through Multiple Criteria Coverage based Test Case Prioritization using Modified Heuristic Algorithm,” in International Conference on Computer and Information Sciences, 2016, p. 430-435.

G. Chaurasia, S. Agarwal, and S. S. Gautam, “Clustering based novel test case prioritization technique,” 2015 IEEE Students Conference on Engineering and Systems (SCES), 2015, pp.1-5.

R. Huang, J. Chen, D. Towey, A. T. S. Chan, and Y. Lu, “Aggregate-strength interaction test suite prioritization,” Journal of Systems and Software, 99, pp. 36-51, 2015.

S. Nayak, C. Kumar, and S. Tripathi, “Effectiveness of prioritization of test cases based on Faults,” 2016 3rd International Conference on Recent Advances in Information Technology, 2016, p. 657-662.

C. Hettiarachchi, H. Do, and B. Choi, “Risk-based test case prioritization using a fuzzy expert system,” Information and Software Technology, vol. 69, pp. 1-15, 2016.

A. Marchetto, M. M. Islam, W. Asghar, A. Susi, and G. Scanniello, G, “A Multi-Objective Technique to Prioritize Test Cases,” IEEE Transactions on Software Engineering, 42(10), pp. 918-940, 2016.

K. H. Priyanka and N. Chauhan, “A Novel Approach for Selecting an Effective Regression Testing Technique,” 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom), IEEE, 2016, p.1122-1125.

T. B. Noor, and H. Hemmati, “A similarity-based approach for test case prioritization using historical failure data,” 2015 IEEE 26th International Symposium on Software Reliability Engineering (ISSRE), 2015, p. 58-68.

Y. Wang, X. Zhao, and X. Ding, “An effective test case prioritization method based on fault severity,” in 2015 6th IEEE International Conference on Software Engineering and Service Science (ICSESS), 23-25 Sept. 2015, p.737-741.

J. Ferrer, F. Chicano, and E. Alba, “Estimating software testing complexity,” Information and Software Technology, vol. 55(12), pp. 2125-2139, 2013.

J. Ferrer, “Optimization Techniques for Automated Software Test Data Generation,” PhD Thesis, University of Malaga, 2016.

S. Baharom and Z. Shukur, “The conceptual design of module documentation-based testing tool,” Journal of Computer Science, vol. 4 (6), pp.454-462, 2008.

S. Elbaum, A. Malishevsky, and G. Rothermel, “Prioritizing test cases for regression testing,” in Proc. lnt'l. Symp. Softw. Testing and Analysis, Aug. 2000, p. 102-112.

A. Ansari, A. Khan, A. Khan, and K. Mukadam, “Optimized regression test using test case prioritization,” Procedia Comput. Sci., vol. 79, pp. 152-160, 2016.

P. Mahapatra and S. Tripathy, “Code based test case prioritization using APFD metric,” Global J. of Mech., Eng. & Comp. Sciences, vol.3(2), pp.3-5, 2013.

Y. Jia and M. Harman, “An Analysis and Survey of the Development of Mutation Testing,” IEEE Transactions on Software Engineering, vol. 7, no. 2, pp.77-84, 2006.

I. Moore, (2001). “Jester and Pester,” http://jester.sourceforge.net/

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with this journal agree to the following terms:

    1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
    2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
    3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).