Design and implementation of a t-way test data generation strategy with automated execution tool support

To ensure an acceptable level of quality and reliability of a typical software product, it is desirable to test every possible combination of input data under various configurations. However, due to the combinatorial explosion problem, exhaustive testing is practically impossible. Resource constrain...

Full description

Bibliographic Details
Main Authors: Zamli, Kamal Zuhairi, Klaib, Mohamed Fadel Jamil, Younis, Mohammed Issam, Mat Isa, Nor Ashidi, Abdullah, Rusli
Format: Article
Language:English
Published: Elsevier 2011
Online Access:http://psasir.upm.edu.my/id/eprint/18520/
http://psasir.upm.edu.my/id/eprint/18520/1/Design%20and%20implementation%20of%20a%20t-way%20test%20data%20generation%20strategy%20with%20automated%20execution%20tool%20support..pdf
_version_ 1848843530131210240
author Zamli, Kamal Zuhairi
Klaib, Mohamed Fadel Jamil
Younis, Mohammed Issam
Mat Isa, Nor Ashidi
Abdullah, Rusli
author_facet Zamli, Kamal Zuhairi
Klaib, Mohamed Fadel Jamil
Younis, Mohammed Issam
Mat Isa, Nor Ashidi
Abdullah, Rusli
author_sort Zamli, Kamal Zuhairi
building UPM Institutional Repository
collection Online Access
description To ensure an acceptable level of quality and reliability of a typical software product, it is desirable to test every possible combination of input data under various configurations. However, due to the combinatorial explosion problem, exhaustive testing is practically impossible. Resource constraints, cost factors, and strict time-to-market deadlines are some of the main factors that inhibit such a consideration. Earlier research has suggested that a sampling strategy (i.e., one that is based on a t-way parameter interaction) can be effective. As a result, many helpful t-way sampling strategies have been developed and can be found in the literature. Several advances have been achieved in the last 15 years, which have, in particular, served to facilitate the test planning process by systematically minimizing the test size required (based on certain t-way parameter interactions). Despite this significant progress, the integration and automation of strategies (from planning process to execution) are still lacking. Additionally, strategizing to sample (and construct) a minimum test set from the exhaustive test space is an NP-complete problem; that is, it is often unlikely that an efficient strategy exists that could regularly generate an optimal test set. Motivated by these challenges, this paper discusses the design, implementation, and validation of an efficient strategy for t-way testing, the GTWay strategy. The main contribution of GTWay is the integration of t-way test data generation with automated (concurrent) execution as part of its tool implementation. Unlike most previous methods, GTWay addresses the generation of test data for a high coverage strength (t > 6).
first_indexed 2025-11-15T08:16:29Z
format Article
id upm-18520
institution Universiti Putra Malaysia
institution_category Local University
language English
last_indexed 2025-11-15T08:16:29Z
publishDate 2011
publisher Elsevier
recordtype eprints
repository_type Digital Repository
spelling upm-185202020-07-24T08:07:24Z http://psasir.upm.edu.my/id/eprint/18520/ Design and implementation of a t-way test data generation strategy with automated execution tool support Zamli, Kamal Zuhairi Klaib, Mohamed Fadel Jamil Younis, Mohammed Issam Mat Isa, Nor Ashidi Abdullah, Rusli To ensure an acceptable level of quality and reliability of a typical software product, it is desirable to test every possible combination of input data under various configurations. However, due to the combinatorial explosion problem, exhaustive testing is practically impossible. Resource constraints, cost factors, and strict time-to-market deadlines are some of the main factors that inhibit such a consideration. Earlier research has suggested that a sampling strategy (i.e., one that is based on a t-way parameter interaction) can be effective. As a result, many helpful t-way sampling strategies have been developed and can be found in the literature. Several advances have been achieved in the last 15 years, which have, in particular, served to facilitate the test planning process by systematically minimizing the test size required (based on certain t-way parameter interactions). Despite this significant progress, the integration and automation of strategies (from planning process to execution) are still lacking. Additionally, strategizing to sample (and construct) a minimum test set from the exhaustive test space is an NP-complete problem; that is, it is often unlikely that an efficient strategy exists that could regularly generate an optimal test set. Motivated by these challenges, this paper discusses the design, implementation, and validation of an efficient strategy for t-way testing, the GTWay strategy. The main contribution of GTWay is the integration of t-way test data generation with automated (concurrent) execution as part of its tool implementation. Unlike most previous methods, GTWay addresses the generation of test data for a high coverage strength (t > 6). Elsevier 2011-05-01 Article PeerReviewed application/pdf en http://psasir.upm.edu.my/id/eprint/18520/1/Design%20and%20implementation%20of%20a%20t-way%20test%20data%20generation%20strategy%20with%20automated%20execution%20tool%20support..pdf Zamli, Kamal Zuhairi and Klaib, Mohamed Fadel Jamil and Younis, Mohammed Issam and Mat Isa, Nor Ashidi and Abdullah, Rusli (2011) Design and implementation of a t-way test data generation strategy with automated execution tool support. Information Sciences, 181 (9). pp. 1741-1758. ISSN 0020-0255; ESSN: 1872-6291 https://www.sciencedirect.com/science/article/pii/S002002551100003X?via%3Dihub#! 10.1016/j.ins.2011.01.002
spellingShingle Zamli, Kamal Zuhairi
Klaib, Mohamed Fadel Jamil
Younis, Mohammed Issam
Mat Isa, Nor Ashidi
Abdullah, Rusli
Design and implementation of a t-way test data generation strategy with automated execution tool support
title Design and implementation of a t-way test data generation strategy with automated execution tool support
title_full Design and implementation of a t-way test data generation strategy with automated execution tool support
title_fullStr Design and implementation of a t-way test data generation strategy with automated execution tool support
title_full_unstemmed Design and implementation of a t-way test data generation strategy with automated execution tool support
title_short Design and implementation of a t-way test data generation strategy with automated execution tool support
title_sort design and implementation of a t-way test data generation strategy with automated execution tool support
url http://psasir.upm.edu.my/id/eprint/18520/
http://psasir.upm.edu.my/id/eprint/18520/
http://psasir.upm.edu.my/id/eprint/18520/
http://psasir.upm.edu.my/id/eprint/18520/1/Design%20and%20implementation%20of%20a%20t-way%20test%20data%20generation%20strategy%20with%20automated%20execution%20tool%20support..pdf