An Online Passive Testing Approach for Communication Protocols

Jorge Lopez, Xiaoping Che, Stephane Maag

2014

Abstract

Testing a protocol at runtime in an online way is a complex and challenging work. It requires the same preciseness in conformance testing and efficiency in performance testing, where conformance testing is a functional test which verifies whether the behaviors of the protocol satisfy defined requirements, and performance testing is a qualitative and quantitative test which checks whether the performance requirements of the protocol have been satisfied under certain conditions. As a matter of course, it raises an interesting issue of converging these two kinds of testing by using the same formal approach, and applying the approach online. In this paper, we present a novel logic-based online testing approach to test the protocol conformance and performance through formally specified properties. In order to evaluate and assess our methodology, we developed a prototype and experimented it with a set of Session Initiation Protocol properties in a real IP Multimedia Subsystem environment. Finally, the relevant verdicts and discussions are provided.

References

  1. Bauer, A., Leucker, M., and Schallhart, C. (2011). Runtime verification for ltl and tltl. ACM Transactions on Software Engineering and Methodology, 20(4):14.
  2. Cao, T.-D., Félix, P., Castanet, R., and Berrada, I. (2010). Online testing framework for web services. In Third International Conference on Software Testing, Verification and Validation, pages 363-372.
  3. Che, X., Lalanne, F., and Maag, S. (2012). A logic-based passive testing approach for the validation of communicating protocols. In Proceedings of the 7th International Conference on Evaluation of Novel Approaches to Software Engineering, Wroclaw, Poland, pages 53- 64.
  4. Che, X. and Maag, S. (2013). A formal passive performance testing approach for distributed communication systems. In ENASE 2013 - Proceedings of the 8th International Conference on Evaluation of Novel Approaches to Software Engineering, Angers, France, 4-6 July, 2013, pages 74-84.
  5. Dumitrescu, C., Raicu, I., Ripeanu, M., and Foster, I. (2004). Diperf: An automated distributed performance testing framework. In 5th International Workshop in Grid Computing, pages 289-296. IEEE Computer Society.
  6. Emden, M. V. and Kowalski, R. (1976). The semantics of predicate logic as a programming language. Journal of the ACM, pages 23(4):733-742.
  7. ETSI (2004). Methods for testing and specification (mts); conformance test specification for sip.
  8. Hallé, S. and Villemaire, R. (2012). Runtime enforcement of web service message contracts with data. IEEE Transactions on Services Computing, 5(2):192-206.
  9. Hofmann, R., Klar, R., Mohr, B., Quick, A., and Siegle, M. (1994). Distributed performance monitoring: Methods, tools and applications. IEEE Transactions on Parallel and Distributed Systems, 5:585-597.
  10. Lalanne, F. and Maag, S. (2013). A formal data-centric approach for passive testing of communication protocols. In IEEE / ACM Transactions on Networking, volume 21, pages 788-801.
  11. Larsen, K. G., Mikucionis, M., and Nielsen, B. (2004). Online testing of real-time systems using uppaal. In Formal Approaches to Software Testing, 4th International Workshop, pages 79-94.
  12. Lee, D. and Miller, R. (2006). Network protocol system monitoring-a formal approach with passive testing. IEEE/ACM Transactions on Networking, pages 14(2):424-437.
  13. Nguyen, H. N., Poizat, P., and Zaïdi, F. (2012). Online verification of value-passing choreographies through property-oriented passive testing. In 14th International IEEE Symposium on High-Assurance Systems Engineering, pages 106-113.
  14. Raimondi, F., Skene, J., and Emmerich, W. (2008). Efficient online monitoring of web-service slas. In Proceedings of the 16th ACM SIGSOFT International Symposium on Foundations of Software Engineering, pages 170- 180.
  15. Rosenberg, J., Schulzrinne, H., Camarillo, G., Johnston, A., and Peterson, J. (2002). Sip: Session initiation protocol.
  16. Veanes, M., Campbell, C., Schulte, W., and Tillmann, N. (2005). Online testing with model programs. In Proceedings of the 10th European Software Engineering Conference held jointly with 13th ACM SIGSOFT International Symposium on Foundations of Software Engineering, pages 273-282.
  17. Wei, W., Suh, K., Wang, B., Gu, Y., Kurose, J. F., Towsley, D. F., and Jaiswal, S. (2009). Passive online detection of 802.11 traffic using sequential hypothesis testing with tcp ack-pairs. IEEE Transactions on Mobile Computing, 8(3):398-412.
  18. Yuen, C.-H. and Chan, S.-H. (2012). Scalable realtime monitoring for distributed applications. IEEE Transactions on Parallel and Distributed Systems, 23(12):2330 -2337.
Download


Paper Citation


in Harvard Style

Lopez J., Che X. and Maag S. (2014). An Online Passive Testing Approach for Communication Protocols . In Proceedings of the 9th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE, ISBN 978-989-758-030-7, pages 136-143. DOI: 10.5220/0004885501360143


in Bibtex Style

@conference{enase14,
author={Jorge Lopez and Xiaoping Che and Stephane Maag},
title={An Online Passive Testing Approach for Communication Protocols},
booktitle={Proceedings of the 9th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE,},
year={2014},
pages={136-143},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004885501360143},
isbn={978-989-758-030-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE,
TI - An Online Passive Testing Approach for Communication Protocols
SN - 978-989-758-030-7
AU - Lopez J.
AU - Che X.
AU - Maag S.
PY - 2014
SP - 136
EP - 143
DO - 10.5220/0004885501360143