Sang Min Yoon, Arjan Kuijper


Sketches drawn by users are one of the most intuitive forms of Human Computer Interaction. Users can easily express their intention by sketching simple hand-drawn lines. In this paper, we consider the problem of target object detection and retrieval from a query by a sketch which is not in the database. Our novel approach consists of three steps: (1) Preprocessing to extract the skeletal features from a sketched query using size normalization, labelling, and binarization, (2) Skeletal feature extraction of query and data images in the space of diffusion tensor fields, and (3) Similarity measure using tensorial information between sketched query and database to retrieve the most similar target object in database. Experiments are conducted to evaluate the performance of our methodology, which shows to be an efficient and mature retrieval system.


  1. Alexander, D., Gee, J., and Bajcsy, R. (1999). Similarity measures for matching diffusion tensor images. In Proceedings of BMVC.
  2. Bai, X., Latecki, L. J., and Liu, W. Y. (2007). Skeleton Pruning by Contour Partitioning with Discrete Curve Evolution. IEEE trans. on PAMI.
  3. Basser, P. J., Mattiello, J., and Le Bihan, D. (1994). MR diffusion tensor spectroscopy and imaging. Biophys Journal.
  4. Bitter, I., Kaufman, A. E., and Sato, M. (2001). Penalizeddistance volumetric skeleton algorithm. IEEE trans. on Visualization and Computer Graphics.
  5. Blum, H. (1976). A transformation of extracting new descriptions of shape. Models for Perception of Speech and Visual Forum.
  6. Chalecheale, A., Naghdy, G., and Mertins, A. (2005). Sketch-Based Image Matching Using Angular Partitioning. IEEE trans. on Systems, man, and cybernetics.
  7. Delarcelle, T., and Hesselink, L. (1994). The topology of symmetric, second-order tensor fields. In Proceedings of IEEE Visualization.
  8. Funkhouser, T., Min, P., Kazhdan, M., Chen, J., Halderman, A., Dobkin, D., and Jacobs, D. (2003). A search engine for 3D model ACM trans. on Graphics.
  9. Han, J. Y. (2006). Multi-touch interaction wall. In SIGGRAPH 7806: ACM SAIGGRAPH Emerging technologies.
  10. Hassouna, M. S., and Farg, A. A. (2007). On the extraction of Curve skeletons using Gradient Vector Flow. In Proceedings of ICCV.
  11. Hou S., and Ramani, K. (2007). Classifier combination for sketch-based 3D part retrieval. Journal of Computers Graphics.
  12. Ip, H. H. S., Cheng, A. K. Y., Wong, W. Y. F., and Feng, J. (2001). Affine-invariant sketch-based retrieval of images. InProceedings of ICCG.
  13. Kim, J., Park, J., Kim, H., and Lee, C. (2007). HCI using multi-touch tabletop display. Communications, Computers, and Signal Processing, PacRim.
  14. Ma, W. C., Wu, F. C., and Ouhyoung, M. (2003). Skeleton extraction of 3D objects with radial basis functions In Proceedings of the Shape Modeling.
  15. Maree, R., Geurts, P., and Wehenkel, L. (2007). ContentBased Image Retrieval by Indexing Random Subwindows with Randomized Trees. In Proceedings of ACCV.
  16. Matusiak, S., Daoudi, M., Blu, T., and Avaro, O. (1998). Sketch-based images database retrieval. In Proceedings of Int. Workshop Adv. Multimedia Information System.
  17. Vasconcelos, N., and Lippman, A. (2000). A Probabilistic Architecture for Content-based Image Retrieval. In Proceedings of CVPR.
  18. Veltkamp, R. C., Burkhardt, H., and Kriegel, H. P. (2001). State-of-the Art in Content Based Image and Video Retrieval. Kluwer Adcademic Publshers.
  19. Xu, C., and Prince, J. L. (1998). Snakes, shapes, and gradient vector flow. IEEE trans. on Image processing.
  20. Yang, G., and Xiao, Y. (2008). A robust similarity measure method in CBIR system. In Proceedings of Congress on ISP.
  21. Yoon, S. M., and Graf, H. (2009). Automatic skeleton extraction and splitting of target objects. IEEE ICIP.
  22. Yoon, S. M., Malerczyk, C., and Graf, H. (2009). 3D skeleton extraction from volume data based on Normalized Gradient Vector Flow. In Proceedings of WSCG.
  23. Yu, Z., and Bajaj, R. (2002). Normalized gradient vector diffusion and image segmentation. In Proceedings of ECCV.
  24. Zhang, E., Hays, J., and Turk, G. (2007). Interactive tensor field design and visualization on surfaces. IEEE trans. on Visualization and Computer Graphics.

Paper Citation

in Harvard Style

Min Yoon S. and Kuijper A. (2010). OBJECT RETRIEVAL BASED ON USER-DRAWN SKETCHES . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2010) ISBN 978-989-674-029-0, pages 292-299. DOI: 10.5220/0002818702920299

in Bibtex Style

author={Sang Min Yoon and Arjan Kuijper},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2010)},

in EndNote Style

JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2010)
SN - 978-989-674-029-0
AU - Min Yoon S.
AU - Kuijper A.
PY - 2010
SP - 292
EP - 299
DO - 10.5220/0002818702920299