Dynamic random testing of web services: a methodology and evaluation

In recent years, Service Oriented Architecture (SOA) has been increasingly adopted to develop distributed applications in the context of the Internet. To develop reliable SOA-based applications, an important issue is how to ensure the quality of web services. In this paper, we propose a dynamic rand...

Full description

Bibliographic Details
Main Authors: Sun, Chang-Ai, Dai, Hepeng, Wang, Guan, Towey, Dave, Chen, Tsong Yueh, Cai, Kai-Yuan
Format: Article
Language:English
Published: 2019
Subjects:
Online Access:https://eprints.nottingham.ac.uk/61351/
_version_ 1848799865175277568
author Sun, Chang-Ai
Dai, Hepeng
Wang, Guan
Towey, Dave
Chen, Tsong Yueh
Cai, Kai-Yuan
author_facet Sun, Chang-Ai
Dai, Hepeng
Wang, Guan
Towey, Dave
Chen, Tsong Yueh
Cai, Kai-Yuan
author_sort Sun, Chang-Ai
building Nottingham Research Data Repository
collection Online Access
description In recent years, Service Oriented Architecture (SOA) has been increasingly adopted to develop distributed applications in the context of the Internet. To develop reliable SOA-based applications, an important issue is how to ensure the quality of web services. In this paper, we propose a dynamic random testing (DRT) technique for web services, which is an improvement over the widely-practiced random testing (RT) and partition testing (PT). We examine key issues when adapting DRT to the context of SOA, including a framework, guidelines for parameter settings, and a prototype for such an adaptation. Empirical studies are reported where DRT is used to test three real-life web services, and mutation analysis is employed to measure the effectiveness. Our experimental results show that, compared with the three baseline techniques, RT, Adaptive Testing (AT) and Random Partition Testing (RPT), DRT demonstrates higher fault-detection effectiveness with a lower test case selection overhead. Furthermore, the theoretical guidelines of parameter setting for DRT are confirmed to be effective. The proposed DRT and the prototype provide an effective and efficient approach for testing web services. IEEE
first_indexed 2025-11-14T20:42:27Z
format Article
id nottingham-61351
institution University of Nottingham Malaysia Campus
institution_category Local University
language English
last_indexed 2025-11-14T20:42:27Z
publishDate 2019
recordtype eprints
repository_type Digital Repository
spelling nottingham-613512020-08-19T08:09:57Z https://eprints.nottingham.ac.uk/61351/ Dynamic random testing of web services: a methodology and evaluation Sun, Chang-Ai Dai, Hepeng Wang, Guan Towey, Dave Chen, Tsong Yueh Cai, Kai-Yuan In recent years, Service Oriented Architecture (SOA) has been increasingly adopted to develop distributed applications in the context of the Internet. To develop reliable SOA-based applications, an important issue is how to ensure the quality of web services. In this paper, we propose a dynamic random testing (DRT) technique for web services, which is an improvement over the widely-practiced random testing (RT) and partition testing (PT). We examine key issues when adapting DRT to the context of SOA, including a framework, guidelines for parameter settings, and a prototype for such an adaptation. Empirical studies are reported where DRT is used to test three real-life web services, and mutation analysis is employed to measure the effectiveness. Our experimental results show that, compared with the three baseline techniques, RT, Adaptive Testing (AT) and Random Partition Testing (RPT), DRT demonstrates higher fault-detection effectiveness with a lower test case selection overhead. Furthermore, the theoretical guidelines of parameter setting for DRT are confirmed to be effective. The proposed DRT and the prototype provide an effective and efficient approach for testing web services. IEEE 2019-12-18 Article PeerReviewed application/pdf en cc_by https://eprints.nottingham.ac.uk/61351/1/ilovepdf_merged%20%2816%29.pdf Sun, Chang-Ai, Dai, Hepeng, Wang, Guan, Towey, Dave, Chen, Tsong Yueh and Cai, Kai-Yuan (2019) Dynamic random testing of web services: a methodology and evaluation. IEEE Transactions on Services Computing . p. 1. ISSN 2372-0204 Software testing; random testing; dynamic random testing; web service; service oriented architecture; software cybernetics http://dx.doi.org/10.1109/TSC.2019.2960496 doi:10.1109/TSC.2019.2960496 doi:10.1109/TSC.2019.2960496
spellingShingle Software testing; random testing; dynamic random testing; web service; service oriented architecture; software cybernetics
Sun, Chang-Ai
Dai, Hepeng
Wang, Guan
Towey, Dave
Chen, Tsong Yueh
Cai, Kai-Yuan
Dynamic random testing of web services: a methodology and evaluation
title Dynamic random testing of web services: a methodology and evaluation
title_full Dynamic random testing of web services: a methodology and evaluation
title_fullStr Dynamic random testing of web services: a methodology and evaluation
title_full_unstemmed Dynamic random testing of web services: a methodology and evaluation
title_short Dynamic random testing of web services: a methodology and evaluation
title_sort dynamic random testing of web services: a methodology and evaluation
topic Software testing; random testing; dynamic random testing; web service; service oriented architecture; software cybernetics
url https://eprints.nottingham.ac.uk/61351/
https://eprints.nottingham.ac.uk/61351/
https://eprints.nottingham.ac.uk/61351/