Regression test case prioritization by code combinations coverage
Regression test case prioritization (RTCP) aims to improve the rate of fault detection by executing more important test cases as early as possible. Various RTCP techniques have been proposed based on different coverage criteria. Among them, a majority of techniques leverage code coverage information...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2020
|
| Subjects: | |
| Online Access: | https://eprints.nottingham.ac.uk/61146/ |
| _version_ | 1848799844833951744 |
|---|---|
| author | Huang, Rubing Zhang, Quanjun Towey, Dave Sun, Weifeng Chen, Jinfu |
| author_facet | Huang, Rubing Zhang, Quanjun Towey, Dave Sun, Weifeng Chen, Jinfu |
| author_sort | Huang, Rubing |
| building | Nottingham Research Data Repository |
| collection | Online Access |
| description | Regression test case prioritization (RTCP) aims to improve the rate of fault detection by executing more important test cases as early as possible. Various RTCP techniques have been proposed based on different coverage criteria. Among them, a majority of techniques leverage code coverage information to guide the prioritization process, with code units being considered individually, and in isolation. In this paper, we propose a new coverage criterion, code combinations coverage, that combines the concepts of code coverage and combination coverage. We apply this coverage criterion to RTCP, as a new prioritization technique, code combinations coverage based prioritization (CCCP). We report on empirical studies conducted to compare the testing effectiveness and efficiency of CCCP with four popular RTCP techniques: total, additional, adaptive random, and search-based test prioritization. The experimental results show that even when the lowest combination strength is assigned, overall, the CCCP fault detection rates are greater than those of the other four prioritization techniques. The CCCP prioritization costs are also found to be comparable to the additional test prioritization technique. Moreover, our results also show that when the combination strength is increased, CCCP provides higher fault detection rates than the state-of-the-art, regardless of the levels of code coverage. |
| first_indexed | 2025-11-14T20:42:08Z |
| format | Article |
| id | nottingham-61146 |
| institution | University of Nottingham Malaysia Campus |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-14T20:42:08Z |
| publishDate | 2020 |
| publisher | Elsevier |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | nottingham-611462020-07-30T06:11:47Z https://eprints.nottingham.ac.uk/61146/ Regression test case prioritization by code combinations coverage Huang, Rubing Zhang, Quanjun Towey, Dave Sun, Weifeng Chen, Jinfu Regression test case prioritization (RTCP) aims to improve the rate of fault detection by executing more important test cases as early as possible. Various RTCP techniques have been proposed based on different coverage criteria. Among them, a majority of techniques leverage code coverage information to guide the prioritization process, with code units being considered individually, and in isolation. In this paper, we propose a new coverage criterion, code combinations coverage, that combines the concepts of code coverage and combination coverage. We apply this coverage criterion to RTCP, as a new prioritization technique, code combinations coverage based prioritization (CCCP). We report on empirical studies conducted to compare the testing effectiveness and efficiency of CCCP with four popular RTCP techniques: total, additional, adaptive random, and search-based test prioritization. The experimental results show that even when the lowest combination strength is assigned, overall, the CCCP fault detection rates are greater than those of the other four prioritization techniques. The CCCP prioritization costs are also found to be comparable to the additional test prioritization technique. Moreover, our results also show that when the combination strength is increased, CCCP provides higher fault detection rates than the state-of-the-art, regardless of the levels of code coverage. Elsevier 2020-11 Article PeerReviewed application/pdf en cc_by https://eprints.nottingham.ac.uk/61146/1/Title%20Pages.pdf Huang, Rubing, Zhang, Quanjun, Towey, Dave, Sun, Weifeng and Chen, Jinfu (2020) Regression test case prioritization by code combinations coverage. Journal of Systems and Software, 169 . p. 110712. ISSN 01641212 Software testing；Regression testing；Test case prioritization Code combinations coverage http://dx.doi.org/10.1016/j.jss.2020.110712 doi:10.1016/j.jss.2020.110712 doi:10.1016/j.jss.2020.110712 |
| spellingShingle | Software testing；Regression testing；Test case prioritization Code combinations coverage Huang, Rubing Zhang, Quanjun Towey, Dave Sun, Weifeng Chen, Jinfu Regression test case prioritization by code combinations coverage |
| title | Regression test case prioritization by code combinations coverage |
| title_full | Regression test case prioritization by code combinations coverage |
| title_fullStr | Regression test case prioritization by code combinations coverage |
| title_full_unstemmed | Regression test case prioritization by code combinations coverage |
| title_short | Regression test case prioritization by code combinations coverage |
| title_sort | regression test case prioritization by code combinations coverage |
| topic | Software testing；Regression testing；Test case prioritization Code combinations coverage |
| url | https://eprints.nottingham.ac.uk/61146/ https://eprints.nottingham.ac.uk/61146/ https://eprints.nottingham.ac.uk/61146/ |