热门
how well does test case prioritization integrate with statistical fault localization?
文献类型：期刊论文
| 作者 | Jiang Bo ; Zhang Zhenyu ; Chan W.K. ; Tse T.H. ; Chen Tsong Yueh |
| 刊名 | Information and Software Technology
 |
| 出版日期 | 2012 |
| 卷号 | 54期号:7页码:739-758 |
| ISSN号 | 9505849 |
| 英文摘要 | Context: Effective test case prioritization shortens the time to detect failures, and yet the use of fewer test cases may compromise the effectiveness of subsequent fault localization. Objective: The paper aims at finding whether several previously identified effectiveness factors of test case prioritization techniques, namely strategy, coverage granularity, and time cost, have observable consequences on the effectiveness of statistical fault localization techniques. Method: This paper uses a controlled experiment to examine these factors. The experiment includes 16 test case prioritization techniques and four statistical fault localization techniques using the Siemens suite of programs as well as grep, gzip, sed, and flex as subjects. The experiment studies the effects of the percentage of code examined to locate faults from these benchmark subjects after a given number of failures have been observed. Results: We find that if testers have a budgetary concern on the number of test cases for regression testing, the use of test case prioritization can save up to 40% of test case executions for commit builds without significantly affecting the effectiveness of fault localization. A statistical fault localization technique using a smaller fraction of a prioritized test suite is found to compromise its effectiveness seriously. Despite the presence of some variations, the inclusion of more failed test cases will generally improve the fault localization effectiveness during the integration process. Interestingly, during the variation periods, adding more failed test cases actually deteriorates the fault localization effectiveness. In terms of strategies, Random is found to be the most effective, followed by the ART and Additional strategies, while the Total strategy is the least effective. We do not observe sufficient empirical evidence to conclude that using different coverage granularity levels have different overall effects. Conclusion: The paper empirically identifies that strategy and time-cost of test case prioritization techniques are key factors affecting the effectiveness of statistical fault localization, while coverage granularity is not a significant factor. It also identifies a mid-range deterioration in fault localization effectiveness when adding more test cases to facilitate debugging. © 2012 Elsevier B.V. All rights reserved. |
| 收录类别 | EI |
| 语种 | 英语 |
| WOS记录号 | WOS:000304387600006 |
| 公开日期 | 2012-11-12 |
| 源URL | [http://ir.iscas.ac.cn/handle/311060/14726]  |
| 专题 | 软件研究所_软件所图书馆_期刊论文 |
| 推荐引用方式 GB/T 7714 | Jiang Bo,Zhang Zhenyu,Chan W.K.,et al. how well does test case prioritization integrate with statistical fault localization?[J]. Information and Software Technology,2012,54(7):739-758. |
| APA | Jiang Bo,Zhang Zhenyu,Chan W.K.,Tse T.H.,&Chen Tsong Yueh.(2012).how well does test case prioritization integrate with statistical fault localization?.Information and Software Technology,54(7),739-758. |
| MLA | Jiang Bo,et al."how well does test case prioritization integrate with statistical fault localization?".Information and Software Technology 54.7(2012):739-758. |
入库方式： OAI收割
来源：软件研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。