A Test Case Prioritization through Correlation of Requirement and Risk

Miso Yoon, Eunyoung Lee, Mikyoung Song, Byoungju Choi

Department of Computer Science, Ewha Womans University, Seoul, Korea.

DOI: 10.4236/jsea.2012.510095                

Abstract

Test case prioritization techniques have been focused on regression testing which is conducted on an already executed test suite. In fact, the test case prioritization for new testing is also required. In this paper, we propose a method to prioritize new test cases by calculating risk exposure value for requirements and analyzing risk items based on the calculation to evaluate relevant test cases and thereby determining the test case priority through the evaluated values. Moreover, we demonstrate effectiveness of our technique through empirical studies in terms of both APFD and fault severity.

Keywords

Test Case Priority; Risk-Based Testing; Requirement Analysis; Risk Exposure

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	G. Rothermel, R. H. Untch, C. Chu and M. J. Harrold, “Prioritizing Test Cases for Regression Testing,” IEEE Transactions Software Engineering, Vol. 27, No. 10, 2001, pp. 929-948.
[2]	R. Krishnamoorthi and S. A. Mary, “Factor Oriented Requirement Coverage Based System Test Case Prioritization of New and Regression Test Cases,” Information and Software Technology, Vol. 51, No. 4, 2009, pp. 799-808.
[3]	S. Yoo and M. Harman, “Regression Testing Minimization, Selection and Prioritization: A Survey,” Software Testing, Verification and Reliability, Vol. 22, No. 9, 2012, pp. 67-120.
[4]	H. Do and G. Rothermel, “On the Use of Mutation Faults in Empirical Assessments of Test Case Prioritization Techniques,” IEEE Transactions on Software Engineering, Vol. 32, No. 9, 2006, pp. 733-752.
[5]	H. Stallbaum, A. Metzger and K. Pohl, “An Automated Technique for Risk-Based Test Case Generation and Prioritization,” Proceedings of the 3rd International Workshop on Automation of Software Test, New York, 11 May 2008, pp. 67-70.
[6]	Y. Chen, R. Probert and D. P. Sims, “Specification-Based Regression Test Selection with Risk analysis,” Proceedings of the 2002 Conference of the Centre for Advanced Studies on Collaborative Research, Toronto, 30 September-3 October 2002, pp. 1-14.
[7]	B. W. Boehm, “Software Risk Management: Principles and Practices,” Software, Vol. 8, No. 1, 1991, pp. 32-41.
[8]	P. Gerrad and N. Thompson, “Risk-Based E-Business Testing,” Artech House, Norwood, 2002.
[9]	Institute of Electrical and Electronics Engineers, IEEE. Std 1044.1-1995, “IEEE Guide to Classification for Soft-Ware Anomalies,” 5 August 1996.
[10]	D. R. Wallace and D. R. Kuhn, “Failure Modes in Medical Device Software: An Analysis of 15 Years of Recall Data,” Reliability, Quality and Safety Engineering, Vol. 8, No. 4, 2001, pp. 301-3011.
[11]	M. Sullivan and R. Chillarege, “A Comparison of Software Defects in Database Management Systems and Operating Systems,” Digest of Papers FTCS-22, the 22nd International Symposium on Fault Tolerant Computing, Boston, 8-10 July 1992, pp. 475-484.
[12]	A. Jha, “A Risk Catalog for Mobile Applications Computer Sciences,” Florida Institute of Technology, Melbourne, 2007.
[13]	J. Bach, “Heuristic Risk-Based Testing,” Software Testing and Quality Engineering Magazine, Vol. 1, No. 6, 1999, pp. 96-98.
[14]	S. Pertet and P. Narasimhan, “Causes of Failure in Web Applications,” Parallel Data Laboratory, Carnegie Mellon University, 2005.
[15]	T. L. Saaty, “How to Make a Decision: The Analytic Hierarchy Process,” European Journal of Operational Research, Vol. 24, No. 6, 1990, pp. 9-26.
[16]	S. Amland, “Risk-Based Testing: Risk Analysis Fundamentals and Metrics for Software Testing Including a Financial Application Case Study,” Journal of Systems and Software, Vol. 53, No. 3, 2000, pp. 287-295.
[17]	“Siemens Program,” 2012.http://pleuma.cc.gatech.edu/aristotle/Tools/subjects/
[18]	S. Elbaum, A. G. Malishevsky and G. Rothermel, “Test Case Prioritization: A Family of Empirical Studies,” IEEE Transactions Software Engineering, Vol. 28, No. 2, 2002, pp.159-182.
[19]	D. Jeffrey and N. Gupta, “Test Case Prioritization Using Relevant Slices,” Proceedings of the 30th Annual International Computer Software and Applications Conference, Chicago, 17-21 September 2006, pp. 411-420.