Enhancing software reliability estimates using modified adaptive testing
文献类型:会议论文
作者 | Hu, Hai (1) ; Jiang, Chang-Hai (1) ; Cai, Kai-Yuan (1) ; Wong, W. Eric (3) ; Mathur, Aditya P. (4) |
出版日期 | 2013 |
关键词 | Software engineering Software reliability Software testing |
页码 | 288-300 |
通讯作者 | Hu, H.(huhai.orion@gmail.com) |
中文摘要 | Context: Most software reliability models are based on a binary notion of correctness, i.e. "successful" or "failed." However, in several instances, it is important to account of failure severity to obtain more descriptive and accurate estimates of the reliability of the software. Objective: In this paper, we develop a set of extended metrics based on the Nelson's software reliability model to account for information gained from a user's point of view regarding the severity of the observed failures. Model formulation based on multi-granularity failure severity is provided, and the proposed metrics are proved to be backward compatible. Method: In order to estimate the software reliability through testing, an extended adaptive testing strategy, namely Modified Adaptive Testing (MAT) is proposed. The use of test history information allows the resulting test process to be adaptive in the selection of tests under limited test budget. Simulations and experiments on real-life programs are conducted to evaluate the effectiveness of MAT. Results: Data show that the reliability estimates obtained using MAT (a) are closer to the "true" reliability than those obtained using random testing and (b) lead to lower variance than the techniques used for comparison, which means MAT can be applied to help testers and reliability engineers better understand the reliability of their programs. Conclusion: It is concluded that the proposed approach can enhance the software reliability estimation testing by guiding the test case selection process by providing more descriptive and accurate results. © 2012 Elsevier B.V. All rights reserved. |
英文摘要 | Context: Most software reliability models are based on a binary notion of correctness, i.e. "successful" or "failed." However, in several instances, it is important to account of failure severity to obtain more descriptive and accurate estimates of the reliability of the software. Objective: In this paper, we develop a set of extended metrics based on the Nelson's software reliability model to account for information gained from a user's point of view regarding the severity of the observed failures. Model formulation based on multi-granularity failure severity is provided, and the proposed metrics are proved to be backward compatible. Method: In order to estimate the software reliability through testing, an extended adaptive testing strategy, namely Modified Adaptive Testing (MAT) is proposed. The use of test history information allows the resulting test process to be adaptive in the selection of tests under limited test budget. Simulations and experiments on real-life programs are conducted to evaluate the effectiveness of MAT. Results: Data show that the reliability estimates obtained using MAT (a) are closer to the "true" reliability than those obtained using random testing and (b) lead to lower variance than the techniques used for comparison, which means MAT can be applied to help testers and reliability engineers better understand the reliability of their programs. Conclusion: It is concluded that the proposed approach can enhance the software reliability estimation testing by guiding the test case selection process by providing more descriptive and accurate results. © 2012 Elsevier B.V. All rights reserved. |
收录类别 | SCI ; EI |
会议录出版地 | Elsevier, P.O. Box 211, Amsterdam, 1000 AE, Netherlands |
语种 | 英语 |
ISSN号 | 9505849 |
源URL | [http://ir.iscas.ac.cn/handle/311060/16557] ![]() |
专题 | 软件研究所_软件所图书馆_会议论文 |
推荐引用方式 GB/T 7714 | Hu, Hai ,Jiang, Chang-Hai ,Cai, Kai-Yuan ,et al. Enhancing software reliability estimates using modified adaptive testing[C]. 见:. |
入库方式: OAI收割
来源:软件研究所
浏览0
下载0
收藏0
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。