DEPTH-BASED DETECTION OF SALIENT MOVING OBJECTS IN SONIFIED VIDEOS FOR BLIND USERS

Benoît Deville, Guido Bologna, Michel Vinckenbosch, Thierry Pun

Abstract

The context of this work is the development of a mobility aid for visually impaired persons. We present here an original approach for a real time alerting system, based on the use of feature maps for detecting visual salient parts in images. In order to improve the quality of this method, we propose here to benefit from a new feature map constructed from the depth gradient. A specific distance function is described, which takes into account both stereoscopic camera limitations and users choices. We demonstrate here that this additional depth-based feature map allows the system to detect the salient regions with good accuracy in most situations, even with noisy disparity maps.

References

  1. Bay, H., Tuytelaars, T., and Gool, L. V. (2006). Surf: Speeded up robust features. In Proceedings of the 9th European Conference on Computer Vision, pages 7- 13.
  2. Bologna, G., Deville, B., Pun, T., and Vinckenbosch, M. (2007a). Identifying major components of pictures by audio encoding of colors. In IWINAC2007, 2nd. International Work-conference on the Interplay between Natural and Artificial Computation.
  3. Bologna, G., Deville, B., Pun, T., and Vinckenbosch, M. (2007b). Transforming 3d coloured pixels into musical instrument notes for vision substitution applications. EURASIP Journal on Image and Video Processing.
  4. Hoffman, D. and Singh, M. (1997). Salience of visual parts. Cognition, 63:29-78.
  5. Itti, L., Koch, C., and Niebur, E. (1998). A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machcine Intelligence, 20(11):1254-1259.
  6. Jost, T., Ouerhani, N., von Wartburg, R., Müri, R., and Hügli, H. (2004). Contribution of depth to visual attention: comparison of a computer model and human. In Early cognitive vision workshop, Isle of Skye, Scotland.
  7. Kadir, T. and Brady, M. (2001). Scale, saliency and image description. International Journal of Computer Vision, 45(2):83-105.
  8. Landragin, F. (2004). Saillance physique et saillance cognitive. Cognition, Reprsentation, Langage, 2(2).
  9. Lowe, D. (1999). Object recognition from local scaleinvariant features. In Seventh International Conference on Computer Vision (ICCV'99), volume 2.
  10. Maki, A., Nordlund, P., and Eklundh, J. (1996). A computational model of depth-based attention. In Proceedings of the International Conference on Pattern Recognition (ICPR 7896).
  11. Milanese, R., Gil, S., and Pun, T. (1995). Attentive mechanism for dynamic and static scene analysis. Optical Engineering, 34(8):2428-2434.
  12. Ouerhani, N. and Hügli, H. (2000). Computing visual attention from scene depth. In Proceedings of the 15th International Conference on Pattern Recognition, volume 1, pages 375-378.
Download


Paper Citation


in Harvard Style

Deville B., Bologna G., Vinckenbosch M. and Pun T. (2008). DEPTH-BASED DETECTION OF SALIENT MOVING OBJECTS IN SONIFIED VIDEOS FOR BLIND USERS . In Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008) ISBN 978-989-8111-21-0, pages 434-439. DOI: 10.5220/0001084104340439


in Bibtex Style

@conference{visapp08,
author={Benoît Deville and Guido Bologna and Michel Vinckenbosch and Thierry Pun},
title={DEPTH-BASED DETECTION OF SALIENT MOVING OBJECTS IN SONIFIED VIDEOS FOR BLIND USERS},
booktitle={Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)},
year={2008},
pages={434-439},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001084104340439},
isbn={978-989-8111-21-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)
TI - DEPTH-BASED DETECTION OF SALIENT MOVING OBJECTS IN SONIFIED VIDEOS FOR BLIND USERS
SN - 978-989-8111-21-0
AU - Deville B.
AU - Bologna G.
AU - Vinckenbosch M.
AU - Pun T.
PY - 2008
SP - 434
EP - 439
DO - 10.5220/0001084104340439