One-domain-one-input: adaptive random testing by orthogonal recursive bisection with restriction

One goal of software testing may be the identification or generation of a series of test cases that can detect a fault with as few test executions as possible. Motivated by insights from research into failure-causing regions of input domains, the even-spreading (even distribution) of tests across t...

Full description

Bibliographic Details
Main Authors: Ackah-Arthur, Hilary, Chen, Jinfu, Towey, Dave, Omari, Michael, Xi, Jiaxiang, Huang, Rubing
Format: Article
Language:English
Published: 2019
Subjects:
Online Access:https://eprints.nottingham.ac.uk/59663/
_version_ 1848799660002508800
author Ackah-Arthur, Hilary
Chen, Jinfu
Towey, Dave
Omari, Michael
Xi, Jiaxiang
Huang, Rubing
author_facet Ackah-Arthur, Hilary
Chen, Jinfu
Towey, Dave
Omari, Michael
Xi, Jiaxiang
Huang, Rubing
author_sort Ackah-Arthur, Hilary
building Nottingham Research Data Repository
collection Online Access
description One goal of software testing may be the identification or generation of a series of test cases that can detect a fault with as few test executions as possible. Motivated by insights from research into failure-causing regions of input domains, the even-spreading (even distribution) of tests across the input domain has been identified as a useful heuristic to more quickly find failures. This finding has encouraged a shift in focus from traditional random testing (RT) to its enhancement, adaptive random testing (ART), which retains the randomness of test input selection, but also attempts to maintain a more evenly distributed spread of test inputs across the input domain. Given that there are different ways to achieve the even distribution, several different ART methods and approaches have been proposed. This paper presents a new ART method, called ART-ORB, which explores the advantages of repeated geometric bisection of the input domain, combined with restriction regions, to evenly spread test inputs. Experimental results show a better performance in terms of fewer test executions than RT to find failures. Compared with other ART methods, ART-ORB has comparable performance (in terms of required test executions), but incurs lower test input selection overheads, especially in higher dimensional input space. It is recommended that ART-ORB be used in testing situations involving expensive test input execution.
first_indexed 2025-11-14T20:39:11Z
format Article
id nottingham-59663
institution University of Nottingham Malaysia Campus
institution_category Local University
language English
last_indexed 2025-11-14T20:39:11Z
publishDate 2019
recordtype eprints
repository_type Digital Repository
spelling nottingham-596632020-01-09T03:12:18Z https://eprints.nottingham.ac.uk/59663/ One-domain-one-input: adaptive random testing by orthogonal recursive bisection with restriction Ackah-Arthur, Hilary Chen, Jinfu Towey, Dave Omari, Michael Xi, Jiaxiang Huang, Rubing One goal of software testing may be the identification or generation of a series of test cases that can detect a fault with as few test executions as possible. Motivated by insights from research into failure-causing regions of input domains, the even-spreading (even distribution) of tests across the input domain has been identified as a useful heuristic to more quickly find failures. This finding has encouraged a shift in focus from traditional random testing (RT) to its enhancement, adaptive random testing (ART), which retains the randomness of test input selection, but also attempts to maintain a more evenly distributed spread of test inputs across the input domain. Given that there are different ways to achieve the even distribution, several different ART methods and approaches have been proposed. This paper presents a new ART method, called ART-ORB, which explores the advantages of repeated geometric bisection of the input domain, combined with restriction regions, to evenly spread test inputs. Experimental results show a better performance in terms of fewer test executions than RT to find failures. Compared with other ART methods, ART-ORB has comparable performance (in terms of required test executions), but incurs lower test input selection overheads, especially in higher dimensional input space. It is recommended that ART-ORB be used in testing situations involving expensive test input execution. 2019-12-01 Article PeerReviewed application/pdf en cc_by https://eprints.nottingham.ac.uk/59663/1/Dave-%E5%B7%B2%E8%9E%8D%E5%90%88.pdf Ackah-Arthur, Hilary, Chen, Jinfu, Towey, Dave, Omari, Michael, Xi, Jiaxiang and Huang, Rubing (2019) One-domain-one-input: adaptive random testing by orthogonal recursive bisection with restriction. IEEE Transactions on Reliability, 68 (4). pp. 1404-1428. ISSN 0018-9529 Random testing; adaptive random testing partition testing; orthogonal recursive bisection; restricted random testing. http://dx.doi.org/10.1109/TR.2019.2907577 doi:10.1109/TR.2019.2907577 doi:10.1109/TR.2019.2907577
spellingShingle Random testing; adaptive random testing
partition testing; orthogonal recursive bisection; restricted random testing.
Ackah-Arthur, Hilary
Chen, Jinfu
Towey, Dave
Omari, Michael
Xi, Jiaxiang
Huang, Rubing
One-domain-one-input: adaptive random testing by orthogonal recursive bisection with restriction
title One-domain-one-input: adaptive random testing by orthogonal recursive bisection with restriction
title_full One-domain-one-input: adaptive random testing by orthogonal recursive bisection with restriction
title_fullStr One-domain-one-input: adaptive random testing by orthogonal recursive bisection with restriction
title_full_unstemmed One-domain-one-input: adaptive random testing by orthogonal recursive bisection with restriction
title_short One-domain-one-input: adaptive random testing by orthogonal recursive bisection with restriction
title_sort one-domain-one-input: adaptive random testing by orthogonal recursive bisection with restriction
topic Random testing; adaptive random testing
partition testing; orthogonal recursive bisection; restricted random testing.
url https://eprints.nottingham.ac.uk/59663/
https://eprints.nottingham.ac.uk/59663/
https://eprints.nottingham.ac.uk/59663/