A comparative study on testing optimization techniques with combinatorial interaction testing for optimizing software product line testing

A software product line (SPL) is a combination of software products that have similarities in features and functions. These combinations usually result in many feature combinations that challenge the testing process. The explosion of the combination of features can lead to exhaustive testing. This e...

Full description

Bibliographic Details
Main Authors: Maidin, Nur Farrahin, Hassan, Sa’Adah, Baharom, Salmi, Md. Sultan, Abu Bakar
Format: Article
Language:English
Published: Semarak Ilmu Publishing 2025
Online Access:http://psasir.upm.edu.my/id/eprint/118516/
http://psasir.upm.edu.my/id/eprint/118516/1/118516.pdf
_version_ 1848867533675823104
author Maidin, Nur Farrahin
Hassan, Sa’Adah
Baharom, Salmi
Md. Sultan, Abu Bakar
author_facet Maidin, Nur Farrahin
Hassan, Sa’Adah
Baharom, Salmi
Md. Sultan, Abu Bakar
author_sort Maidin, Nur Farrahin
building UPM Institutional Repository
collection Online Access
description A software product line (SPL) is a combination of software products that have similarities in features and functions. These combinations usually result in many feature combinations that challenge the testing process. The explosion of the combination of features can lead to exhaustive testing. This exhaustive testing will affect the time and cost for the product to be delivered to the market. This paper aims to identify the best algorithm and interaction strength to avoid exhausting testing and reduce the time and cost of the testing process. An experiment has been conducted on the most commonly used optimization algorithms in previous studies. The optimization algorithms we explored are the Genetic Algorithm, Cuckoo Search algorithm, Ant Colony algorithm, and Particle Swarm Optimization algorithm. Each algorithm has been tested with different combinatorial interaction strengths from two to six. This paper aims to get the best meta-heuristic algorithm and the optimum number of interaction strengths for optimizing the number of configurations in the SPL testing. Results show the best optimization algorithm is the Genetic Algorithm and the optimum interaction strength is t=5. This interaction strength achieves the optimum number of features combination that is sufficient for the testing process and thus can avoid the exhaustive testing in SPL testing. By using the best optimization algorithm with the optimum number of interaction strengths, the complexity of the SPL testing process could be reduced without prejudicing the quality of the software system itself.
first_indexed 2025-11-15T14:38:01Z
format Article
id upm-118516
institution Universiti Putra Malaysia
institution_category Local University
language English
last_indexed 2025-11-15T14:38:01Z
publishDate 2025
publisher Semarak Ilmu Publishing
recordtype eprints
repository_type Digital Repository
spelling upm-1185162025-07-15T07:00:55Z http://psasir.upm.edu.my/id/eprint/118516/ A comparative study on testing optimization techniques with combinatorial interaction testing for optimizing software product line testing Maidin, Nur Farrahin Hassan, Sa’Adah Baharom, Salmi Md. Sultan, Abu Bakar A software product line (SPL) is a combination of software products that have similarities in features and functions. These combinations usually result in many feature combinations that challenge the testing process. The explosion of the combination of features can lead to exhaustive testing. This exhaustive testing will affect the time and cost for the product to be delivered to the market. This paper aims to identify the best algorithm and interaction strength to avoid exhausting testing and reduce the time and cost of the testing process. An experiment has been conducted on the most commonly used optimization algorithms in previous studies. The optimization algorithms we explored are the Genetic Algorithm, Cuckoo Search algorithm, Ant Colony algorithm, and Particle Swarm Optimization algorithm. Each algorithm has been tested with different combinatorial interaction strengths from two to six. This paper aims to get the best meta-heuristic algorithm and the optimum number of interaction strengths for optimizing the number of configurations in the SPL testing. Results show the best optimization algorithm is the Genetic Algorithm and the optimum interaction strength is t=5. This interaction strength achieves the optimum number of features combination that is sufficient for the testing process and thus can avoid the exhaustive testing in SPL testing. By using the best optimization algorithm with the optimum number of interaction strengths, the complexity of the SPL testing process could be reduced without prejudicing the quality of the software system itself. Semarak Ilmu Publishing 2025-07 Article PeerReviewed text en cc_by_nc_4 http://psasir.upm.edu.my/id/eprint/118516/1/118516.pdf Maidin, Nur Farrahin and Hassan, Sa’Adah and Baharom, Salmi and Md. Sultan, Abu Bakar (2025) A comparative study on testing optimization techniques with combinatorial interaction testing for optimizing software product line testing. Journal of Advanced Research in Applied Sciences and Engineering Technology, 49 (1). pp. 77-94. ISSN 2462-1943; eISSN: 2462-1943 https://semarakilmu.com.my/journals/index.php/applied_sciences_eng_tech/article/view/2044 10.37934/araset.49.1.7794
spellingShingle Maidin, Nur Farrahin
Hassan, Sa’Adah
Baharom, Salmi
Md. Sultan, Abu Bakar
A comparative study on testing optimization techniques with combinatorial interaction testing for optimizing software product line testing
title A comparative study on testing optimization techniques with combinatorial interaction testing for optimizing software product line testing
title_full A comparative study on testing optimization techniques with combinatorial interaction testing for optimizing software product line testing
title_fullStr A comparative study on testing optimization techniques with combinatorial interaction testing for optimizing software product line testing
title_full_unstemmed A comparative study on testing optimization techniques with combinatorial interaction testing for optimizing software product line testing
title_short A comparative study on testing optimization techniques with combinatorial interaction testing for optimizing software product line testing
title_sort comparative study on testing optimization techniques with combinatorial interaction testing for optimizing software product line testing
url http://psasir.upm.edu.my/id/eprint/118516/
http://psasir.upm.edu.my/id/eprint/118516/
http://psasir.upm.edu.my/id/eprint/118516/
http://psasir.upm.edu.my/id/eprint/118516/1/118516.pdf