– Accessibility: if the packet can reach a destina-
tion.
– Communication bandwidth: the data transfer rate
between two nodes.
– Maximum frame rate: the maximum transmission
rate of the device under test.
– Communication Latency: the time required for
delivering the packet to destination.
– Frame loss rate: the ratio of loss packets and sent
packets during the data transport.
We can build a passive performance benchmark-
ing system if all these norms are measurable. Cur-
rently, the result of property 1 already showed we
could certainly test the Accessibility and Frame loss
rate by detecting the number of resent packets from
the inconclusive verdicts. But if we want to test the
Communication Latency, a timer function needs to be
added in order to test the arrival time.
6 CONCLUSIONS
This paper introduces a novel approach to passive
testing of network protocol implementation, with a
particular focus on IMS services. This approach al-
lows to define high-level relations between messages
or message data, and then use such relations in or-
der to define properties that will be evaluated on the
trace. The property evaluation returns a pass, f ail or
inconclusive result for a given trace. To verify and
test the approach, we design several properties for the
evaluation. The approach has been implemented into
a framework, and results from testing these properties
on tremendous traces collected from IMS service.
The results are positive, the implemented ap-
proach allows to define and test complex data rela-
tions efficiently, and evaluate the properties success-
fully. Besides, as described in the Section 5, some
improvements can be proposed as future works for
performance testing, such as: Testing the accessi-
bility and loss rate of traces by measuring the time
complexity, Introducing a timer function to the ap-
proach for testing the communication latency. More-
over, we guess that some properties need, for various
reasons as mentioned in this paper, to be specified us-
ing timers. In this objective, other perspectives are to
enhance our syntax and semantics as well as study the
more relevant way of formulating an RFC property.
REFERENCES
Abiteboul, S., Hull, R., and Vianu, V. (1995). Datalog and
Recursion. Addison-Wesley, 2nd edition.
Apt, K. R. and Van Emden, M. H. (1982). Contributions to
the theory of logic programming. Journal of the ACM
(JACM), 29(3):841–862.
Barringer, H., Goldberg, A., Havelund, K., and Sen, K.
(2004). Rule-based runtime verification. In Verifi-
cation, Model Checking, and Abstract Interpretation,
pages 277–306.
Bauer, A. and Leucker, M. (2007). Runtime verification for
ltl and tltl. ACM Transactions on Software Engineer-
ing and Methodology, pages 1–68.
Bayse, E., Cavalli, A., Nunez, M., and Zaidi, F. (2005). A
passive testing approach based on invariants: applica-
tion to the wap. Computer Networks.
Bradner, S. (1991). Benchmarking terminology for network
interconnection devices.
Bradner, S. and McQuaid, J. (1991). Benchmarking
methodology for network interconnect devices.
Cao, T.-D., Phan-Quang, T.-T., Felix, P., and Castanet, R.
(2010). Automated runtime verification for web ser-
vices. IEEE International Conference on Web Ser-
vices, pages 76–82.
Cuppens, F., Cuppens-Boulahia, N., and Nomad, T. S.
(2005). A security model with non atomic actions and
deadlines. IEEE.
Emden, M. V. and Kowalski, R. (1976). The semantics of
predicate logic as a programming language. Journal
of the ACM, pages 23(4):733–742.
ETSI (2004). Methods for testing and specification (mts);
conformance test specification for sip.
Hewlett-Packard (2004). SIPp. http://sipp.sourceforge.net/.
Hierons, R. M., Krause, P., Luttgen, G., and Simons,
A. J. H. (2009). Using formal specifications to support
testing. ACM Computing Surveys, page 41(2):176.
Lee, D. and Miller, R. (2006). Network protocol sys-
tem monitoring-a formal approach with passive test-
ing. IEEE/ACM Transactions on Networking, pages
14(2):424–437.
Leucker, M. and Schallhart, C. (2009). A brief account of
runtime verification. Journal of Logic and Algebraic
Programming, pages 78(5):293–303.
Maag, S. and Lalanne, F. (2011). A formal data-centric ap-
proach for passive conformance testing of communi-
cation protocols. Technical report, Telecom Sud-Paris.
Morales, G., Maag, S., Cavalli, A., Mallouli, W., and
De Oca, E. M. (2010). Timed extended invariants
for the passive testing of web services. IEEE Inter-
national Conference of Web Services.
Nilsson, U. and Maluszynski, J. (1990). Logic, program-
ming and Prolog. Wiley, 2nd edition.
Open Mobile Alliance (2005). Internet messaging and pres-
ence service features and functions.
Open Mobile Alliance (2006). Push to talk over cellular
requirements.
Rosenberg, J., Schulzrinne, H., and Levin, O. (2006). A
session initiation protocol (sip) event package for con-
ference state.
Rosenberg, J. and Schulzrinne, H. and Camarillo, G. and
Johnston, A. and Peterson, J. (2002). Sip: Session
initiation protocol.
Ural, H. and Xu, Z. (2007). An efsm-based passive fault de-
tection approach. Lecture Notes in Computer Science,
pages 335–350.
ENASE2012-7thInternationalConferenceonEvaluationofNovelSoftwareApproachestoSoftwareEngineering
64