A Formal Passive Performance Testing Approach for Distributed Communication Systems

Xiaoping Che, Stephane Maag

Abstract

Conformance testing of communicating protocols is a functional test which verifies whether the behaviors of the protocol satisfy defined requirements, while the performance testing of communicating protocols is a qualitative and quantitative test, aiming at checking whether the performance requirements of the protocol have been satisfied under certain conditions. It raises the interesting issue of converging these two kinds of tests by using the same formal approach. In this paper, we present a novel logic-based approach to test the protocol performance through real execution traces and formally specified properties. In order to evaluate and assess our methodology, we have developed a prototype and present experiments with a set of IMS/SIP properties. Finally, the relevant verdicts and discussions are provided.

References

  1. Aguilera, M. K., Mogul, J. C., Wiener, J. L., Reynolds, P., and Muthitacharoen, A. (2003). Performance debugging for distributed systems of black boxes. SIGOPS Oper. Syst. Rev., 37(5):74-89.
  2. Alliance, O. M. (2005). Internet messaging and presence service features and functions.
  3. Alliance, O. M. (2006). Push to talk over cellular requirements.
  4. Che, X., Lalanne, F., and Maag, S. (2012). A logic-based passive testing approach for the validation of communicating protocols. In ENASE 2012 - Proceedings of the 7th International Conference on Evaluation of Novel Approaches to Software Engineering, Wroclaw, Poland, pages 53-64.
  5. Denaro, G., Bicocca, U. D. M., Polini, A., and Emmerich, W. (2004). Early performance testing of distributed software applications. In SIGSOFT Software Engineering Notes, pages 94-103.
  6. Dumitrescu, C., Raicu, I., Ripeanu, M., and Foster, I. (2004). Diperf: An automated distributed performance testing framework. In 5th International Workshop in Grid Computing, pages 289-296. IEEE Computer Society.
  7. Emden, M. V. and Kowalski, R. (1976). The semantics of predicate logic as a programming language. Journal of the ACM, pages 23(4):733-742.
  8. Hewlett-Packard (2004). SIPp. http://sipp.sourceforge.net/.
  9. Hierons, R. M., Krause, P., Luttgen, G., and Simons, A. J. H. (2009). Using formal specifications to support testing. ACM Computing Surveys, page 41(2):176.
  10. Hofmann, R., Klar, R., Mohr, B., Quick, A., and Siegle, M. (1994). Distributed performance monitoring: Methods, tools and applications. IEEE Transactions on Parallel and Distributed Systems, 5:585-597.
  11. Lalanne, F., Che, X., and Maag, S. (2011). Datacentric property formulation for passive testing of communication protocols. In Proceedings of the 13th IASME/WSEAS, ACC'11/MMACTEE'11, pages 176-181.
  12. Lalanne, F. and Maag, S. (2012). A formal data-centric approach for passive testing of communication protocols. In IEEE / ACM Transactions on Networking.
  13. Lee, D. and Miller, R. (2006). Network protocol system monitoring-a formal approach with passive testing. IEEE/ACM Transactions on Networking, pages 14(2):424-437.
  14. Mills, D. L. (1991). Internet time synchronization: the network time protocol. IEEE Transactions on Communications, 39:1482-1493.
  15. Rosenberg, J., Schulzrinne, H., Camarillo, G., Johnston, A., and Peterson, J. (2002). Sip: Session initiation protocol.
  16. Shin, M., Park, M., Oh, D., Kim, B., and Lee, J. (2011). Clock synchronization for one-way delay measurement: A survey. In Kim, T.-h., Adeli, H., Robles, R., and Balitanas, M., editors, Advanced Communication and Networking, volume 199 of Communications in Computer and Information Science, pages 1- 10. Springer Berlin Heidelberg.
  17. Taufer, M. and Stricker, T. (2003). A performance monitor based on virtual global time for clusters of pcs. In In Proceedings of IEEE International Conference on Cluster Computing, pages 64-72.
  18. Weyuker, E. J. and Vokolos, F. I. (2000). Experience with performance testing of software systems: Issues, an approach, and case study. IEEE Trans. Software Eng., 26(12):1147-1156.
  19. Yilmaz, C., Krishna, A. S., Memon, A., Porter, A., Schmidt, D. C., Gokhale, A., and Natarajan, R. (2005). Main effects screening: a distributed continuous quality assurance process for monitoring performance degradation in evolving software systems. In ICSE 05: Proceedings of the 27th international conference on Software engineering, pages 293-302. ACM Press.
  20. Yuen, C.-H. and Chan, S.-H. (2012). Scalable realtime monitoring for distributed applications. IEEE Transactions on Parallel and Distributed Systems, 23(12):2330 -2337.
Download


Paper Citation


in Harvard Style

Che X. and Maag S. (2013). A Formal Passive Performance Testing Approach for Distributed Communication Systems . In Proceedings of the 8th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE, ISBN 978-989-8565-62-4, pages 74-84. DOI: 10.5220/0004444000740084


in Bibtex Style

@conference{enase13,
author={Xiaoping Che and Stephane Maag},
title={A Formal Passive Performance Testing Approach for Distributed Communication Systems},
booktitle={Proceedings of the 8th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE,},
year={2013},
pages={74-84},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004444000740084},
isbn={978-989-8565-62-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 8th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE,
TI - A Formal Passive Performance Testing Approach for Distributed Communication Systems
SN - 978-989-8565-62-4
AU - Che X.
AU - Maag S.
PY - 2013
SP - 74
EP - 84
DO - 10.5220/0004444000740084