Swinburne
Browse

Does adaptive random testing deliver a higher confidence than random testing?

Download (429.64 kB)
conference contribution
posted on 2024-07-26, 14:15 authored by Tsong ChenTsong Chen, Fei-Ching Kuo, Huai LiuHuai Liu, W. Eric Wong
Random testing (RT) is a fundamental software testing technique. Motivated by the rationale that neighbouring test cases tend to cause similar execution behaviours, adaptive random testing (ART) was proposed as an enhancement of RT, which enforces random test cases evenly spread over the input domain. ART has always been compared with RT from the perspective of the failure-detection capability. Previous studies have shown that ART can use fewer test cases to detect the first software failure than RT. In this paper, we aim to compare ART and RT from the perspective of program-based coverage. Our experimental results show that given the same number of test cases, ART normally has a higher percentage of coverage than RT. In conclusion, ART outperforms RT not only in terms of the failure-detection capability, but also in terms of the thoroughness of program-based coverage. Therefore, ART delivers a higher confidence of the software under test than RT even when no failure has been revealed.

Funding

Failure-Based Testing: An In-Depth Theoretical and Experimental Study

Australian Research Council

Find out more...

History

Available versions

PDF (Published version)

ISBN

9780769533124

ISSN

1550-6002

Journal title

Proceedings - International Conference on Quality Software

Conference name

International Conference on Quality Software

Pagination

9 pp

Publisher

IEEE

Copyright statement

Copyright © 2008 IEEE. The published version is reproduced in accordance with the copyright policy of the publisher. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.

Language

eng

Usage metrics

    Publications

    Categories

    No categories selected

    Keywords

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC