A Dataset and a Comparison of Out-of-Order Event Compensation Algorithms

Wolfgang Weiss, Víctor Juan Expósito Jiménez, Herwig Zeiner

2017

Abstract

Event processing is order and time sensitive and therefore assumes temporally correct ordered event streams, even in distributed systems, to be able to create correct results. In this work we discuss implementations of four different out-of-order event compensation algorithms that use different kinds of dynamic time-out buffering techniques, and we compare those to a static buffering method. This is an approach which is generally applicable and easy to integrate for existing distributed systems such as for Internet of Things applications. For the evaluation, specific datasets were recorded, which are introduced in this paper, and which are freely available under a Creative Commons license. Results show, that even with a restrictive buffer setting, most of the out-of-order events can be compensated. Dynamic time-out buffering is still a trade-off between reaction time and out-of-order event compensation, but it is useful in various applications.

References

  1. (2008). IEEE Standard for a Precision Clock Synchronization Protocol for Networked Measurement and Control Systems. IEEE Std 1588-2008, pages 1-269.
  2. Arthur, C. M., Girma, D., Harle, D., and Lehane, A. (2004). The effects of packet reordering in a wireless multimedia environment. In 1st Int. Symposium on Wireless Communication Systems, pages 453-457.
  3. Chen, W. and Dömer, R. (2013). Optimized out-of-order parallel discrete event simulation using predictions. In Design, Automation Test in Europe Conference Exhibition (DATE), 2013, pages 3-8.
  4. Della Valle, E., Schlobach, S., Krötzsch, M., Bozzon, A., Ceri, S., and Horrocks, I. (2013). Order matters! harnessing a world of orderings for reasoning over massive data. Semant. web, 4(2):219-231.
  5. Etzion, O. and Niblett, P. (2011). Event Processing in Action. Manning Publications Co., Greenwich, CT, USA, 1st edition.
  6. Li, M., Liu, M., Ding, L., Rundensteiner, E. A., and Mani, M. (2007). Event stream processing with out-of-order data arrival. In 27th Int. Conf. on Distributed Computing Systems Workshops, pages 67-67.
  7. Mattern, F. (1989). Virtual time and global states of distributed systems. In Proc. Workshop on Parallel and Distributed Algorithms, pages 215-226, NorthHolland / Elsevier.
  8. Mills, D. L. (2010). Computer Network Time Synchronization: The Network Time Protocol on Earth and in Space, Second Edition. CRC Press, Inc., Boca Raton, FL, USA, 2nd edition.
  9. Mutschler, C. and Philippsen, M. (2013a). Distributed lowlatency out-of-order event processing for high data rate sensor streams. In IEEE 27th Int. Symposium on Parallel Distributed Processing, pages 1133-1144.
  10. Mutschler, C. and Philippsen, M. (2013b). Runtime migration of stateful event detectors with low-latency ordering constraints. In IEEE Int. Conf. on Pervasive Computing and Commun. Workshops, pages 609-614.
  11. Neville-Neil, G. V. (2015). Time is an illusion lunchtime doubly so. Commun. ACM, 59(1):50-55.
  12. Wu, E., Diao, Y., and Rizvi, S. (2006). High-performance complex event processing over streams. In Proceedings of the 2006 ACM SIGMOD Int. Conf. on Management of Data, pages 407-418, New York. ACM.
Download


Paper Citation


in Harvard Style

Weiss W., Expósito Jiménez V. and Zeiner H. (2017). A Dataset and a Comparison of Out-of-Order Event Compensation Algorithms . In Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS, ISBN 978-989-758-245-5, pages 36-46. DOI: 10.5220/0006235400360046


in Bibtex Style

@conference{iotbds17,
author={Wolfgang Weiss and Víctor Juan Expósito Jiménez and Herwig Zeiner},
title={A Dataset and a Comparison of Out-of-Order Event Compensation Algorithms},
booktitle={Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS,},
year={2017},
pages={36-46},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006235400360046},
isbn={978-989-758-245-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS,
TI - A Dataset and a Comparison of Out-of-Order Event Compensation Algorithms
SN - 978-989-758-245-5
AU - Weiss W.
AU - Expósito Jiménez V.
AU - Zeiner H.
PY - 2017
SP - 36
EP - 46
DO - 10.5220/0006235400360046