An empirical comparison of fixed-strength and mixed-strength for interaction coverage based prioritization
Test case prioritization (TCP) plays an important role in identifying, characterizing, diagnosing and correcting faults quickly. TCP has been widely used to order test cases of different types, including model inputs (also called abstract test cases). Model inputs are constructed by modeling the pro...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Institute of Electrical and Electronics Engineers
2018
|
| Subjects: | |
| Online Access: | https://eprints.nottingham.ac.uk/55515/ |
| _version_ | 1848799176153890816 |
|---|---|
| author | Huang, Rubing Zhang, Quanjun Chen, Tsong Yueh Hamlyn-Harris, James Towey, Dave Chen, Jinfu |
| author_facet | Huang, Rubing Zhang, Quanjun Chen, Tsong Yueh Hamlyn-Harris, James Towey, Dave Chen, Jinfu |
| author_sort | Huang, Rubing |
| building | Nottingham Research Data Repository |
| collection | Online Access |
| description | Test case prioritization (TCP) plays an important role in identifying, characterizing, diagnosing and correcting faults quickly. TCP has been widely used to order test cases of different types, including model inputs (also called abstract test cases). Model inputs are constructed by modeling the program according to its input parameters, values, and constraints, and has been used in different testing methods, such as combinatorial interaction testing, and software product line testing. Interaction coveragebased test case prioritization (ICTCP) uses interaction coverage information derived from the model input to order inputs. Previous studies have focused generally on the fixed-strength ICTCP, which adopts a fixed strength(i.e.,thelevelofparameterinteractions)tosupporttheICTCPprocess.Itisgenerallyacceptedthat using more strengths for ICTCP, i.e., mixed-strength ICTCP, may give better ordering than fixed-strength. To confirm whether mixed-strength is better than fixed-strength, in this paper we report on an extensive empirical study using five real-world programs (written in C), each of which has six versions. The results oftheempiricalstudiesshowthatmixed-strengthhasbetterratesofinteractioncoverageoverallthanfixedstrength, but they have very similar rates of fault detection. Our results also show that fixed-strength should be used instead of the mixed-strength at the later stage of software testing. Finally, we offer some practical guidelinesfortesterswhenusinginteractioncoverageinformationtoprioritizemodelinputs,underdifferent testing scenarios and resources. |
| first_indexed | 2025-11-14T20:31:30Z |
| format | Article |
| id | nottingham-55515 |
| institution | University of Nottingham Malaysia Campus |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-14T20:31:30Z |
| publishDate | 2018 |
| publisher | Institute of Electrical and Electronics Engineers |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | nottingham-555152018-11-13T11:57:55Z https://eprints.nottingham.ac.uk/55515/ An empirical comparison of fixed-strength and mixed-strength for interaction coverage based prioritization Huang, Rubing Zhang, Quanjun Chen, Tsong Yueh Hamlyn-Harris, James Towey, Dave Chen, Jinfu Test case prioritization (TCP) plays an important role in identifying, characterizing, diagnosing and correcting faults quickly. TCP has been widely used to order test cases of different types, including model inputs (also called abstract test cases). Model inputs are constructed by modeling the program according to its input parameters, values, and constraints, and has been used in different testing methods, such as combinatorial interaction testing, and software product line testing. Interaction coveragebased test case prioritization (ICTCP) uses interaction coverage information derived from the model input to order inputs. Previous studies have focused generally on the fixed-strength ICTCP, which adopts a fixed strength(i.e.,thelevelofparameterinteractions)tosupporttheICTCPprocess.Itisgenerallyacceptedthat using more strengths for ICTCP, i.e., mixed-strength ICTCP, may give better ordering than fixed-strength. To confirm whether mixed-strength is better than fixed-strength, in this paper we report on an extensive empirical study using five real-world programs (written in C), each of which has six versions. The results oftheempiricalstudiesshowthatmixed-strengthhasbetterratesofinteractioncoverageoverallthanfixedstrength, but they have very similar rates of fault detection. Our results also show that fixed-strength should be used instead of the mixed-strength at the later stage of software testing. Finally, we offer some practical guidelinesfortesterswhenusinginteractioncoverageinformationtoprioritizemodelinputs,underdifferent testing scenarios and resources. Institute of Electrical and Electronics Engineers 2018-11-05 Article PeerReviewed application/pdf en cc_by https://eprints.nottingham.ac.uk/55515/1/Author.Version.08523673.pdf Huang, Rubing, Zhang, Quanjun, Chen, Tsong Yueh, Hamlyn-Harris, James, Towey, Dave and Chen, Jinfu (2018) An empirical comparison of fixed-strength and mixed-strength for interaction coverage based prioritization. IEEE Access . ISSN 2169-3536 Test case prioritization; model input; interaction coverage; mixed-strength; fixed-strength. https://ieeexplore.ieee.org/document/8523673 doi:10.1109/ACCESS.2018.2879638 doi:10.1109/ACCESS.2018.2879638 |
| spellingShingle | Test case prioritization; model input; interaction coverage; mixed-strength; fixed-strength. Huang, Rubing Zhang, Quanjun Chen, Tsong Yueh Hamlyn-Harris, James Towey, Dave Chen, Jinfu An empirical comparison of fixed-strength and mixed-strength for interaction coverage based prioritization |
| title | An empirical comparison of fixed-strength and mixed-strength for interaction coverage based prioritization |
| title_full | An empirical comparison of fixed-strength and mixed-strength for interaction coverage based prioritization |
| title_fullStr | An empirical comparison of fixed-strength and mixed-strength for interaction coverage based prioritization |
| title_full_unstemmed | An empirical comparison of fixed-strength and mixed-strength for interaction coverage based prioritization |
| title_short | An empirical comparison of fixed-strength and mixed-strength for interaction coverage based prioritization |
| title_sort | empirical comparison of fixed-strength and mixed-strength for interaction coverage based prioritization |
| topic | Test case prioritization; model input; interaction coverage; mixed-strength; fixed-strength. |
| url | https://eprints.nottingham.ac.uk/55515/ https://eprints.nottingham.ac.uk/55515/ https://eprints.nottingham.ac.uk/55515/ |