Dimitrios Georgakopoulos, Donald Baker


The Video Event Awareness System (VEAS) analyzes surveillance video from thousands of video cameras and automatically detects complex events in near real-time—at pace with their input video streams. For events of interest to security personnel, VEAS generates and routes alerts and related video evidence to subscribing security personnel that facilitate decision making and timely response. In this paper we introduce VEAS’s novel publish/subscribe run-time system architecture and describe VEAS’s event detection approach. Event processing in VEAS is driven by user-authored awareness specifications that define patterns of inter-connected spatio-temporal event stream operators that consume and produce facility-specific events described in VEAS’s surveillance ontology. We describe how VEAS integrates and orchestrates continuous and tasked video analysis algorithms (e.g., for entity tracking and identification), how it fuses events from multiple sources and algorithms in an installation-specific entity model, how it can proactively seek additional information by tasking video analysis algorithms and security personnel to provide it, and how it deals with late arriving information due to out-of-band video analysis tasks and overhead. We use examples from the physical security domain, and discuss related and future work.


  1. Abadi, D. J., D. Carney, U. Çetintemel, M. Cherniack, C. Convey, S. Lee, M. Stonebraker, N. Tatbul, S. Zdonik (2003). Aurora: a new model and architecture for data stream management. VLDB Journal, 12(2).
  2. Abadi, D. J., Y. Ahmad, M. Balazinska, U. Çetintemel, M. Cherniack, J.-H. Hwang, W. Lindner, A. Maskey, A. Rasin, E. Ryvkina, N. Tatbul, Y. Xing, and S. Zdonik (2005). The Design of the Borealis Stream Processing Engine. Second Biennial Conference on Innovative Data Systems Research (DR 2005).
  3. Aref, W., A. C. Catlin, A. Elmagarmid, J. Fan, J. Guo, M. Hammad, I. Ilyas, M. Marzouk, S. Prabhakar, A. Rezgui, S. Teoh, E. Terzi, Y. Tu, A. Vakali and X. Zhu (2002). A distributed server for continuous media. 18th International Conference on Data Engineering (ICDE'02).
  4. VACE (2006). VACE Phase III BAA Discussion. Retrieved 2006 from /vaceiii/BidderBrief-final.ppt.
  5. Baker, D., D. Georgakopoulos, H. Schuster, and A. Cichocki (2002). Customized Process and Situation Awareness. International Journal of Cooperative Information Systems, 11(3 & 4), World Scientific.
  6. Baker D., A. Cassandra, and M. Rashid (1999). CEDMOS: Complex Event Detection and Monitoring System. MCC Technical Report CEDMOS-002-99. Retrieved 2005 from baker99cedmos.html
  7. BEA (nd). WebLogic. Retrieved 2005 from
  8. Borealis Project. Borealis Second Generation Stream Processing Engine. Retrieved 2005 from
  9. Chakravarthy, S. (1994). Snoop: An Expressive Event Specification Language for Active Databases. IEEE Data and Knowledge Engineering, 14(10).
  10. EMC (nd). Documentum. Retrieved 2005 from
  11. FatWire (nd). Content Server. Retrieved 2005 from
  12. FileNet (nd). Content and Workflow Managers. Retrieved 2005 from
  13. Georgakopoulos, D., H. Schuster, D. Baker, and A. Cichocki (2000). Managing Escalation of Collaboration Processes in Crisis Mitigation Situations. 16th International Conference on Data Engineering (ICDE'00).
  14. Georgakopoulos, D. (2004). Teamware: An Evaluation of Key Technologies and Open Problems. Distributed and Parallel Databases, 15(1).
  15. GVI (nd). GVI TRAK. Retrieved 2005 from
  16. Hongeng, S., R. Nevatia, and F. Bremond (2003). Videobased Event Recognition: Activity Representation and Probabilistic Recognition Methods. In Computer Vision and Image Understanding, 96.
  17. Moser, F., A. Kraiss, and W. L. Klas (1995). A buffer management strategy for interactive continuous data flows in a multimedia DBMS. 21st International Conference on Very Large Data Bases (VLDB'95).
  18. Nodine, M., J. Fowler, T. Ksiezyk, B. Perry, M. Taylor and A. Unruh (2000). Active Information Gathering in InfoSleuth. International Journal of Cooperative Information Systems, 9(1/2).
  19. Stanford University (nd). STREAM: The Stanford Stream Data Manager. Retrieved 2005 from
  20. Streambase (nd). Streambase System. Retrieved 2005 from
  21. TIBCO (nd). TIBCO Staffware Process Suite. Retrieved 2006 from
  22. UC Berkeley (nd). TinyDB: A Declarative Database for Sensor Networks. Retrieved 2005 from
  23. Vitria (nd). BusinessWare. Retrieved 2005 from

Paper Citation

in Harvard Style

Georgakopoulos D. and Baker D. (2006). PROVIDING PHYSICAL SECURITY VIA VIDEO EVENT AWARENESS . In Proceedings of the International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2006) ISBN 978-972-8865-64-1, pages 240-251. DOI: 10.5220/0001573202400251

in Bibtex Style

author={Dimitrios Georgakopoulos and Donald Baker},
booktitle={Proceedings of the International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2006)},

in EndNote Style

JO - Proceedings of the International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2006)
SN - 978-972-8865-64-1
AU - Georgakopoulos D.
AU - Baker D.
PY - 2006
SP - 240
EP - 251
DO - 10.5220/0001573202400251