Event-complementing Online Human Life Summarization based on Social Latent Semantic Analysis

Klimis S. Ntalianis, Anastasios D. Doulamis

2015

Abstract

In this paper, online human life summarization is performed, based on multimedia content, published on social media. The life summaries are also automatically annotated with events, persons, places etc. Towards this direction, initially a content preparation module is activated that includes an intelligent wrapper. The content preparation module scans social networks, extracts their pages and segments them into tokens, in an unsupervised way. Next multimedia content is kept and it is associated to its respective metadata. In the following step, a novel ranking mechanism puts multimedia content in order of importance based on usercontent interactions. Finally the event-complementing summarization module produces a meaningful annotated video clip, based on a spectral visual clustering technique and the innovative Social Latent Semantic Analysis algorithm. Experimental results illustrate the promising performance of the proposed architecture and set some foundations for future research.

References

  1. Chua, F. C. T. and Asur, S., 2013 Automatic Summarization of Events From Social Media. 7th International AAAI Conference on Weblogs and Social Media, Cambridge, USA.
  2. Doulamis, N., and Doulamis, A., 2006. Evaluation of Relevance Feedback Schemes in Content-based in Retrieval Systems. Signal Processing: Image Communication, Vol. 21, No 4, April.
  3. Doulamis, N., Yiakoumettis, C., Miaoulis, G. 2013. Personalised 3D navigation and understanding of Georeferenced Scenes. IEEE 14th International Symposium on a World of Wireless, Mobile and Multimedia Networks, WoWMoM.
  4. Doulamis, N., Yiakoumettis, C., Miaoulis, G., Protopapadakis, E., 2013. A constraint inductive learning-spectral clustering methodology for personalized 3D navigation. Lecture Notes in Computer Science.
  5. Fabro, M., Sobe, A. and Boszormenyi, L., 2012. Summarization of Real-Life Events Based on Community-Contributed Content. Fourth International Conferences on Advances in Multimedia, pp. 119 - 126, France, May.
  6. Gentili, E., Milani A., and Poggioni, V., 2012 Data Summarization Model for User Action Log Files. In Proc. of the International Conference on Computational Science and Its Applications (ICCSA), vol. 7335, pp. 539-549.
  7. Griggs, B., 2014. Your Facebook life in 62 seconds,” CNN, February 6, http://edition.cnn.com/2014/02/04/tech/socialmedia/facebook-look-back-video/.
  8. Hu, P., Sun, C., Wu, L., Ji, D., and Teng, C., 2011. Social Summarization via Automatically Discovered Social Context. In Proc. of the International Joint Conference on Natural Language Processing, p.p. 483-490, 2011.
  9. Huberman, B., Romero, D., and Wu, F., 2008. Social networks that matter: Twitter under the microscope,” arXiv:0812.1045v1, December.
  10. K. Raftopoulos, K. Ntalianis, D. Sourlas and S. Kollias, 2013. Mining User Queries with Markov Chains: Application to Online Image Retrieval. IEEE Transactions on Knowledge and Data Engineering, Vol. 25, No. 2, p.p. 433 - 447, Feb. 2013.
  11. Kokkinos, P., Koumoutsos, K., Doulamis, N., et al 2013. PERIKLIS - Electronic democracy in the 21st century using mobile and social network technologies. Lecture Notes in Informatics (LNI), Proceedings - Series of the Gesellschaft fur Informatik (GI).
  12. Landauer T.K., and. Dumais, S.T, 1997. A solution to Plato's problem: the latent semantic analysis theory of the acquisition, induction, and representation of knowledge. Psychological Review, Vol. 104, p.p. 211- 240, 1997.
  13. Lee, Y.J., Ghosh, J., and Grauman, K., 2012. Discovering important people and objects for egocentric video summarization. In Proc. of the Computer Vision and Pattern Recognition Conference (CVPR), p.p. 1346- 1353.
  14. Meng, X., Wei, F., Liu, X., Zhou, M., Li, S., and Wang, H., 2012. Entity-Centric Topic-Oriented Opinion Summarization in Twitter. In Proc. of the International Conference of Knowledge Discovery and Data Mining (KDD), p.p. 379-387, 2012.
  15. Money, A. G., and Agius, H., 2008. Video summarisation: A conceptual framework and survey of the state of the art. Journal of Visual Communication and Image Representation, Vol. 19, No. 2, p.p. 121-143.
  16. Ntalianis, K. S., Doulamis, A., and Doulamis, N., 2014. An Automatic Event-Oriented Human Life Summarization Scheme based on Social Computing over Social Media Content. Multimedia Tools and Applications, Springer.
  17. Ntalianis, K.S., Doulamis, A., Doulamis, N., and Tsapatsoulis, N., 2013. Video Abstraction in Social Media: Augmenting Facebook's Edgerank Algorithm in Video Content Presentation. In Proc. of the IEEE International Conference on Image Processing (ICIP 7813), Melbourne, Australia, September.
  18. Rosten E., and Drummond, T., 2006. Machine Learning for High-Speed Corner Detection. In Proceedings of the European Conference on Computer Vision (ECCV), pp. 430-443.
  19. Rublee, E., Rabaud, V., Konolige, K., and Bradski, G., 2011. ORB: An efficient alternative to SIFT or SURF. In Proc. the IEEE International Conference on Computer Vision (ICCV), 2011.
  20. Sinha, P., Mehrotra S., and Jain, R., 2011. Summarization of personal photologs using multidimensional content and context. In Proc. of the 1st ACM International Conference on Multimedia Retrieval, p.p. 4.1 - 4.8, New York, USA.
  21. Spala, P., Malamos, A.G., Doulamis, A., Mamakis, G., 2012. Extending MPEG-7 for efficient annotation of complex web 3D scenes. Multimedia Tools and Applications, Springer, vol. 52, no. 2, pp. 463-504.
  22. Truong, B. T., and Venkatesh, S., 2007. Video abstraction: A systematic review and classification. ACM Transactions on Multimedia Computing, Communications and Applications, Vol. 3, No. 1.
  23. Voulodimos, A., Doulamis, N., Tsafarakis, S. 2013. Behavior recognition from video based on human constrained descriptor and adaptable neural networks. ARTEMIS 2013 - Proceedings of the 4th ACM/IEEE International Workshop on Analysis and Retrieval of Tracked Events and Motion in Imagery Stream.
  24. Wang, M., Hong, R., Li, G.,. Zha, Z.-J, Yan, S. and Chua, T.-S., 2012. Event Driven Web Video Summarization by Tag Localization and Key-Shot Identification. IEEE Transactions on Multimedia, Vol. 14, No. 4, p.p. 975 - 985.
  25. Wang, Z., Li, S., Fang, K. and Zhou, G., 2013. Collective Personal Profile Summarization with Social Networks. In Proc. of the Conference on Empirical Methods in Natural Language Processing, Seattle, Washington, p.p. 715-725, October.
  26. Yang, Z., Cai, K., Tang, J., Zhang, L., Su, Z., and Li., J., 2011. Social Context Summarization. In Proc. of the Special Interest Group on Information Retrieval (SIGIR), p.p. 255 - 264, 2011.
  27. Yiakoumettis, C., Doulamis, N., Miaoulis, G., Ghazanfarpour, D., 2014. Active learning of user's preferences estimation towards a personalized 3D navigation of geo-referenced scenes. GeoInformatica, 18 (1), pp. 27-62.
Download


Paper Citation


in Harvard Style

Ntalianis K. and Doulamis A. (2015). Event-complementing Online Human Life Summarization based on Social Latent Semantic Analysis . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: MMS-ER3D, (VISIGRAPP 2015) ISBN 978-989-758-090-1, pages 611-622. DOI: 10.5220/0005456506110622


in Bibtex Style

@conference{mms-er3d15,
author={Klimis S. Ntalianis and Anastasios D. Doulamis},
title={Event-complementing Online Human Life Summarization based on Social Latent Semantic Analysis},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: MMS-ER3D, (VISIGRAPP 2015)},
year={2015},
pages={611-622},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005456506110622},
isbn={978-989-758-090-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: MMS-ER3D, (VISIGRAPP 2015)
TI - Event-complementing Online Human Life Summarization based on Social Latent Semantic Analysis
SN - 978-989-758-090-1
AU - Ntalianis K.
AU - Doulamis A.
PY - 2015
SP - 611
EP - 622
DO - 10.5220/0005456506110622