An Agent-Based Framework for Automated Testing of Web-Based Systems

Samad Paydar, Mohsen Kahani

.

DOI: 10.4236/jsea.2011.42010                

Abstract

Parallel to the considerable growth in applications of web-based systems, there are increasing demands for methods and tools to assure their quality. Testing these systems, due to their inherent complexities and special characteristics, is complex, time-consuming and challenging. In this paper a novel multi-agent framework for automated testing of web-based systems is presented. The main design goals have been to develop an effective and flexible framework that supports different types of tests and utilize different sources of information about the system under test to automate the test process. A prototype of the proposed framework has been implemented and is used to perform some experiments. The results are promising and prove the overall design of the framework.

Keywords

Web Application, Web Service, Agent, Framework, Test, Test Script

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	A. G. Lucca and A. R. Fasolino, “Testing Web-Based Applications: The State of the Art and Future Trends,” Information and Software Technology, Vol. 48, No. 12, 2006, pp. 1172-1186.
[2]	A. G. Lucca and A. R. Fasolino, “Web Application Testing,” Web Engineering, Springer, Berlin, Chapter 7, 2006, pp. 219-260. doi:10.1007/3-540-28218-1_7
[3]	S. Murugesan, “Web Application Development: Challenges and the Role of Web Engineering,” J. Karat and J. Vanderdonckt, Eds., Web Engineering, Modelling and Implementing Web Applications, Springer, Berlin, 2008, pp. 7-32.
[4]	A. G. Lucca and M. Penta, “Considering Browser Interaction in Web Application Testing,” Proceedings of the 5th IEEE International Workshop on Web Site Evolution, IEEE Computer Society Press, Los Alamitos, 2003, pp. 74-83.
[5]	F. Ricca and P. Tonella, “Web Testing: A Roadmap for the Empirical Research,” Proceedings of the Seventh IEEE International Symposium on Web Site Evolution, Budapest, 26 September 2005, pp. 63-70.
[6]	S. Sampath, V. Mihaylov, A. Souter and L. Pollock, “Composing a Framework to Automate Testing of Operational Web-Based Software,” 20th IEEE Conference on Software Maintenance, Chicago, 11-14 September 2004, pp. 104-113. doi:10.1109/ICSM.2004.1357795
[7]	S. Elbaum, S. Karre and G. Rothermel, “Improving Web Application Testing with User Session Data,” Proceedings of the 25th International Conference on Software Engineering, Portland, 3-10 May 2003, pp. 49-59. doi:10.1109/ICSE.2003.1201187
[8]	S. Elbaum, G. Rothermel, S. Karre and M. Fisher, “Leveraging User-Session Data to Support Web Application Testing,” IEEE Transactions on Software Engineering, Vol. 31, No. 3, 2005, pp. 187-202. doi:10.1109/TSE.2005.36
[9]	H. Zhu, “A Framework for Service-Oriented Testing of Web Services,” 30th International Computer Software and Applications Conference, Chicago, Vol. 2, 17-21 Sep- tember 2006.
[10]	P. Dhavachelvan, G. V. Uma and V. Venkatachalapathy, “A New Approach in Development of Distributed Framework for Automated Software Testing Using Agents,” Knowledge-Based Systems, Vol. 19, No. 4, 2006, pp. 235-247. doi:10.1016/j.knosys.2005.12.002
[11]	B. Stepien, L. Peyton and P. Xiong, “Framework Testing of Web Applications Using TTCN-3,” International Journal on Software Tools for Technology Transfer (STTT), Vol. 10, No. 4, 2008, pp. 371-381. doi:10.1007/s10009-008-0082-1
[12]	ETSIES 203 873-1, “The Testing and Test Control Notation Version 3: TTCN-3 Core Notation,” V3.2.1, February 2007.
[13]	Y. Huang, C. Tsai, T. Lin, S. Huang, D. Lee and S. Kuo, “A Testing Framework for Web Application Security Assessment,” Computer Networks, Vol. 48, No. 5, 2005, pp. 739-761. doi:10.1016/j.comnet.2005.01.003
[14]	D. Kung, “An Agent-Based Framework for Testing Web Applications,” Proceedings of the 1st International Work- shop on Quality Assurance and Testing Web-Based Applications, Hong Kong, 28-30 September 2004, pp. 174- 177.
[15]	Y. Qi, D. Kung and E. Wong, “An Agent-Based Data-Flow Testing Approach for Web Applications,” Journal of Information and Software Technology, Vol. 48, No. 12, 2006, pp. 1159-1171. doi:10.1016/j.infsof.2006.06.005
[16]	J. Pava, C. Enoex and Y. Hernandez, “A Self-Configuring Test Harness for Web Applications,” Proceedings of the 47th Annual Southeast Regional Conference, South Carolina, 2009, pp. 1-6. doi:10.1145/1566445.1566533
[17]	H. Raffelt, T. Margaria, B. Steffen and M. Merten, “Hybrid Test of Web Applications with Webtest,” Proceedings of the 2008 Workshop on Testing, Analysis, and Verification of Web Services and Applications, Seattle, 2008, pp. 1-7. doi:10.1145/1390832.1390833
[18]	P. Tonella and F. Ricca, “A 2-Layer Model for the White- Box Testing of Web Applicaions,” Proceedings of the 6th IEEE International Workshop on the Web Site Evolution, Chicago, 11 September 2004, pp. 11-19.
[19]	P. Tonella and F. Ricca, “Statistical Testing of Web Applications,” Journal of Software Maintenance and Evolution: Research and Practices, Vol. 16, No. 1-2, 2004, pp. 103-127. doi:10.1002/smr.284
[20]	S. Paydar and M. Kahani, “Ontology-Based Web Application Testing,” In: T. Sobh, K. Elleithy and A. Mahmood, Eds., Novel Algorithms and Techniques in Telecommunications and Networking, Springer, Berlin, 2010, pp. 23-27.
[21]	W. C. Richardson, D. Avondolio, S. Schrager, M. W. Mitchell and J. Scanlon, “Professional Java JDK,” 6 Edition Wiley Publishing, Hoboken, 2007, p. 32.
[22]	OWASP Application Security Verification Standard (ASVS), January 2011. URL http://www.owasp.org/index. php/ASVS