PROVIDING PHYSICAL SECURITY VIA VIDEO EVENT AWARENESS

Dimitrios Georgakopoulos, Donald Baker

Abstract

The Video Event Awareness System (VEAS) analyzes surveillance video from thousands of video cameras and automatically detects complex events in near real-time—at pace with their input video streams. For events of interest to security personnel, VEAS generates and routes alerts and related video evidence to subscribing security personnel that facilitate decision making and timely response. In this paper we introduce VEAS’s novel publish/subscribe run-time system architecture and describe VEAS’s event detection approach. Event processing in VEAS is driven by user-authored awareness specifications that define patterns of inter-connected spatio-temporal event stream operators that consume and produce facility-specific events described in VEAS’s surveillance ontology. We describe how VEAS integrates and orchestrates continuous and tasked video analysis algorithms (e.g., for entity tracking and identification), how it fuses events from multiple sources and algorithms in an installation-specific entity model, how it can proactively seek additional information by tasking video analysis algorithms and security personnel to provide it, and how it deals with late arriving information due to out-of-band video analysis tasks and overhead. We use examples from the physical security domain, and discuss related and future work.

References

  1. Abadi, D. J., D. Carney, U. Çetintemel, M. Cherniack, C. Convey, S. Lee, M. Stonebraker, N. Tatbul, S. Zdonik (2003). Aurora: a new model and architecture for data stream management. VLDB Journal, 12(2).
  2. Abadi, D. J., Y. Ahmad, M. Balazinska, U. Çetintemel, M. Cherniack, J.-H. Hwang, W. Lindner, A. Maskey, A. Rasin, E. Ryvkina, N. Tatbul, Y. Xing, and S. Zdonik (2005). The Design of the Borealis Stream Processing Engine. Second Biennial Conference on Innovative Data Systems Research (DR 2005).
  3. Aref, W., A. C. Catlin, A. Elmagarmid, J. Fan, J. Guo, M. Hammad, I. Ilyas, M. Marzouk, S. Prabhakar, A. Rezgui, S. Teoh, E. Terzi, Y. Tu, A. Vakali and X. Zhu (2002). A distributed server for continuous media. 18th International Conference on Data Engineering (ICDE'02).
  4. VACE (2006). VACE Phase III BAA Discussion. Retrieved 2006 from http://www.nbc.gov/fort_h /vaceiii/BidderBrief-final.ppt.
  5. Baker, D., D. Georgakopoulos, H. Schuster, and A. Cichocki (2002). Customized Process and Situation Awareness. International Journal of Cooperative Information Systems, 11(3 & 4), World Scientific.
  6. Baker D., A. Cassandra, and M. Rashid (1999). CEDMOS: Complex Event Detection and Monitoring System. MCC Technical Report CEDMOS-002-99. Retrieved 2005 from http://citeseer.ist.psu.edu/ baker99cedmos.html
  7. BEA (nd). WebLogic. Retrieved 2005 from http://www.bea.com/.
  8. Borealis Project. Borealis Second Generation Stream Processing Engine. Retrieved 2005 from http://nms.lcs.mit.edu/projects/borealis/.
  9. Chakravarthy, S. (1994). Snoop: An Expressive Event Specification Language for Active Databases. IEEE Data and Knowledge Engineering, 14(10).
  10. EMC (nd). Documentum. Retrieved 2005 from http://software.emc.com/.
  11. FatWire (nd). Content Server. Retrieved 2005 from http://www.fatwire.com/.
  12. FileNet (nd). Content and Workflow Managers. Retrieved 2005 from http://www.filenet.com/.
  13. Georgakopoulos, D., H. Schuster, D. Baker, and A. Cichocki (2000). Managing Escalation of Collaboration Processes in Crisis Mitigation Situations. 16th International Conference on Data Engineering (ICDE'00).
  14. Georgakopoulos, D. (2004). Teamware: An Evaluation of Key Technologies and Open Problems. Distributed and Parallel Databases, 15(1).
  15. GVI (nd). GVI TRAK. Retrieved 2005 from http://www.samsung-security.com/.
  16. Hongeng, S., R. Nevatia, and F. Bremond (2003). Videobased Event Recognition: Activity Representation and Probabilistic Recognition Methods. In Computer Vision and Image Understanding, 96.
  17. Moser, F., A. Kraiss, and W. L. Klas (1995). A buffer management strategy for interactive continuous data flows in a multimedia DBMS. 21st International Conference on Very Large Data Bases (VLDB'95).
  18. Nodine, M., J. Fowler, T. Ksiezyk, B. Perry, M. Taylor and A. Unruh (2000). Active Information Gathering in InfoSleuth. International Journal of Cooperative Information Systems, 9(1/2).
  19. Stanford University (nd). STREAM: The Stanford Stream Data Manager. Retrieved 2005 from http://wwwdb.stanford.edu/stream/.
  20. Streambase (nd). Streambase System. Retrieved 2005 from http://www.streambase.com/.
  21. TIBCO (nd). TIBCO Staffware Process Suite. Retrieved 2006 from http://www.tibco.com.
  22. UC Berkeley (nd). TinyDB: A Declarative Database for Sensor Networks. Retrieved 2005 from http://telegraph.cs.berkeley.edu/tinydb/.
  23. Vitria (nd). BusinessWare. Retrieved 2005 from http://www.vitria.com/.
Download


Paper Citation


in Harvard Style

Georgakopoulos D. and Baker D. (2006). PROVIDING PHYSICAL SECURITY VIA VIDEO EVENT AWARENESS . In Proceedings of the International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2006) ISBN 978-972-8865-64-1, pages 240-251. DOI: 10.5220/0001573202400251


in Bibtex Style

@conference{sigmap06,
author={Dimitrios Georgakopoulos and Donald Baker},
title={PROVIDING PHYSICAL SECURITY VIA VIDEO EVENT AWARENESS},
booktitle={Proceedings of the International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2006)},
year={2006},
pages={240-251},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001573202400251},
isbn={978-972-8865-64-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2006)
TI - PROVIDING PHYSICAL SECURITY VIA VIDEO EVENT AWARENESS
SN - 978-972-8865-64-1
AU - Georgakopoulos D.
AU - Baker D.
PY - 2006
SP - 240
EP - 251
DO - 10.5220/0001573202400251