Model-based Performance Testing of Web Services using Probabilistic Timed Automata

Fredrik Abbors, Tanwir Ahmad, Dragos Truscan, Ivan Porres

2013

Abstract

In this paper, we present an approach for performance testing of web services in which we use abstract models, specified using Probabilistic Timed Automata, to describe how users interact with the system. The models are used in the load generation process to generate load against the system. The abstract actions from the model are sent in real-time to the system via an adapter. Different performance indicators are monitored during the test session and reported at the end of the process. We exemplify with an auction web service case study on which we have run several experiments.

References

  1. Abbors, F., Ahmad, T., Truscan, D., and Porres, I. (2012). MBPeT: A Model-Based Performance Testing Tool. 2012 Fourth International Conference on Advances in System Testing and Validation Lifecycle.
  2. Ahmad, T., Abbors, F., Truscan, D., and Porres, I. (2013). Model-Based Performance Testing Using the MBPeT Tool. Technical Report 1066, Turku Centre for Computer Science (TUCS).
  3. Alur, R. and Dill, D. L. (1994). A theory of timed automata. Theor. Comput. Sci., 126(2):183-235.
  4. Barna, C., Litoiu, M., and Ghanbari, H. (2011). Modelbased performance testing (NIER track). In Proceedings of the 33rd International Conference on Software Engineering, ICSE 7811, pages 872-875, New York, NY, USA. ACM.
  5. Calzarossa, M., Massari, L., and Tessera, D. (2000). Workload Characterization Issues and Methodologies. In Performance Evaluation: Origins and Directions, pages 459-481, London, UK, UK. Springer-Verlag.
  6. Denaro, G., Polini, A., and Emmerich, W. (2004). Early performance testing of distributed software applications. In Proceedings of the 4th international workshop on Software and performance, WOSP 7804, pages 94-103, New York, NY, USA. ACM.
  7. Django (2012). Online at https://www.djangoproject.com/.
  8. Ferrari, D. (1984). On the foundations of artificial workload design. In Proceedings of the 1984 ACM SIGMETRICS conference on Measurement and modeling of computer systems, SIGMETRICS 7884, pages 8-14, New York, NY, USA. ACM.
  9. Kwiatkowska, M., Norman, G., Parker, D., and Sproston, J. (2006). Performance analysis of probabilistic timed automata using digital clocks. Formal Methods in System Design, 29:33-78.
  10. Menasce, D. A. (2002). Load Testing of Web Sites. IEEE Internet Computing, 6:70-74.
  11. Menasce, D. A. and Almeida, V. (2001). Capacity Planning for Web Services: metrics, models, and methods. Prentice Hall PTR, Upper Saddle River, NJ, USA, 1st edition.
  12. Mosberger, D. and Jin, T. (1998). httperfa tool for measuring web server performance. SIGMETRICS Perform. Eval. Rev., 26(3):31-37.
  13. Petriu, D. C. and Shen, H. (2002). Applying the UML Performance Profile: Graph Grammar-based Derivation of LQN Models from UML Specifications. pages 159-177. Springer-Verlag.
  14. Python (2012). Python programming language. Online at http://www.python.org/.
  15. Richardson, L. and Ruby, S. (2007). Restful web services. O'Reilly, first edition.
  16. Ruffo, G., Schifanella, R., Sereno, M., and Politi, R. (2004). WALTy: A User Behavior Tailored Tool for Evaluating Web Application Performance. Network Computing and Applications, IEEE International Symposium on, 0:77-86.
  17. SeleniumHQ (2012). Online at http://seleniumhq.org/.
  18. Shams, M., Krishnamurthy, D., and Far, B. (2006). A model-based approach for testing the performance of web applications. In SOQUA 7806: Proceedings of the 3rd international workshop on Software quality assurance, pages 54-61, New York, NY, USA. ACM.
  19. Shaw, J. (2000). Web Application Performance Testing - a Case Study of an On-line Learning Application. BT Technology Journal, 18(2):79-86.
Download


Paper Citation


in Harvard Style

Abbors F., Ahmad T., Truscan D. and Porres I. (2013). Model-based Performance Testing of Web Services using Probabilistic Timed Automata . In Proceedings of the 9th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST, ISBN 978-989-8565-54-9, pages 99-104. DOI: 10.5220/0004372000990104


in Bibtex Style

@conference{webist13,
author={Fredrik Abbors and Tanwir Ahmad and Dragos Truscan and Ivan Porres},
title={Model-based Performance Testing of Web Services using Probabilistic Timed Automata},
booktitle={Proceedings of the 9th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,},
year={2013},
pages={99-104},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004372000990104},
isbn={978-989-8565-54-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,
TI - Model-based Performance Testing of Web Services using Probabilistic Timed Automata
SN - 978-989-8565-54-9
AU - Abbors F.
AU - Ahmad T.
AU - Truscan D.
AU - Porres I.
PY - 2013
SP - 99
EP - 104
DO - 10.5220/0004372000990104