Metamorphic testing: a review of challenges and opportunities

Metamorphic testing is an approach to both test case generation and test result verification. A central element is a set of metamorphic relations, which are necessary properties of the target function or algorithm in relation to multiple inputs and their expected outputs. Since its first publication...

Full description

Bibliographic Details
Main Authors: Chen, Tsong Yueh, Kuo, Fei-Ching, Liu, Huai, Poon, Pak-Lok, Towey, Dave, Tse, T. H., Zhou, Zhi Quan
Format: Article
Language:English
Published: ACM 2018
Subjects:
Online Access:https://eprints.nottingham.ac.uk/51607/
_version_ 1848798531199959040
author Chen, Tsong Yueh
Kuo, Fei-Ching
Liu, Huai
Poon, Pak-Lok
Towey, Dave
Tse, T. H.
Zhou, Zhi Quan
author_facet Chen, Tsong Yueh
Kuo, Fei-Ching
Liu, Huai
Poon, Pak-Lok
Towey, Dave
Tse, T. H.
Zhou, Zhi Quan
author_sort Chen, Tsong Yueh
building Nottingham Research Data Repository
collection Online Access
description Metamorphic testing is an approach to both test case generation and test result verification. A central element is a set of metamorphic relations, which are necessary properties of the target function or algorithm in relation to multiple inputs and their expected outputs. Since its first publication, we have witnessed a rapidly increasing body of work examining metamorphic testing from various perspectives, including metamorphic relation identification, test case generation, integration with other software engineering techniques, and the validation and evaluation of software systems. In this paper, we review the current research of metamorphic testing and discuss the challenges yet to be addressed. We also present visions for further improvement of metamorphic testing and highlight opportunities for new research.
first_indexed 2025-11-14T20:21:15Z
format Article
id nottingham-51607
institution University of Nottingham Malaysia Campus
institution_category Local University
language English
last_indexed 2025-11-14T20:21:15Z
publishDate 2018
publisher ACM
recordtype eprints
repository_type Digital Repository
spelling nottingham-516072018-05-12T04:33:53Z https://eprints.nottingham.ac.uk/51607/ Metamorphic testing: a review of challenges and opportunities Chen, Tsong Yueh Kuo, Fei-Ching Liu, Huai Poon, Pak-Lok Towey, Dave Tse, T. H. Zhou, Zhi Quan Metamorphic testing is an approach to both test case generation and test result verification. A central element is a set of metamorphic relations, which are necessary properties of the target function or algorithm in relation to multiple inputs and their expected outputs. Since its first publication, we have witnessed a rapidly increasing body of work examining metamorphic testing from various perspectives, including metamorphic relation identification, test case generation, integration with other software engineering techniques, and the validation and evaluation of software systems. In this paper, we review the current research of metamorphic testing and discuss the challenges yet to be addressed. We also present visions for further improvement of metamorphic testing and highlight opportunities for new research. ACM 2018-04-14 Article PeerReviewed application/pdf en https://eprints.nottingham.ac.uk/51607/1/__MTChallOpporCSUR.accepted.20170922.pdf Chen, Tsong Yueh, Kuo, Fei-Ching, Liu, Huai, Poon, Pak-Lok, Towey, Dave, Tse, T. H. and Zhou, Zhi Quan (2018) Metamorphic testing: a review of challenges and opportunities. ACM Computing Surveys, 51 (1). 4/1-4/27. ISSN 1557-7341 Software and its engineering; Software verification and validation; Software testing and debugging; https://dl.acm.org/citation.cfm?doid=3177787.3143561 doi:10.1145/3143561 doi:10.1145/3143561
spellingShingle Software and its engineering; Software verification and validation; Software testing and debugging;
Chen, Tsong Yueh
Kuo, Fei-Ching
Liu, Huai
Poon, Pak-Lok
Towey, Dave
Tse, T. H.
Zhou, Zhi Quan
Metamorphic testing: a review of challenges and opportunities
title Metamorphic testing: a review of challenges and opportunities
title_full Metamorphic testing: a review of challenges and opportunities
title_fullStr Metamorphic testing: a review of challenges and opportunities
title_full_unstemmed Metamorphic testing: a review of challenges and opportunities
title_short Metamorphic testing: a review of challenges and opportunities
title_sort metamorphic testing: a review of challenges and opportunities
topic Software and its engineering; Software verification and validation; Software testing and debugging;
url https://eprints.nottingham.ac.uk/51607/
https://eprints.nottingham.ac.uk/51607/
https://eprints.nottingham.ac.uk/51607/