MOBILE DEVICE AND INTELLIGENT DISPLAY INTERACTION VIA SCALE-INVARIANT IMAGE FEATURE MATCHING

Leigh Herbert, Nick Pears, Dan Jackson, Patrick Olivier

2011

Abstract

We present further developments of our system that allows direction interaction between a camera-equipped hand-held device and a remote display. The essence of this system is the ability to estimate a planar projectivity between the remote display and the displayed image of that display on the handheld device. We describe how to achieve this by matching scale invariant SURF features across the two displays (remote and hand-held). We implement a prototype system and a drawing application and conduct both performance and usability evaluations. The feedback given indicates that our system is responsive, accurate and easy to use.

References

  1. Bay, H., Ess, A., Tuytelaars, T., and Gool, L. V. (2008). Speeded-up robust features (surf). Computer Vision and Image Understanding, 100(3):346-359.
  2. Boring, B., D.Baur, Butz, A., Gustafson, S., and Baudisch, P. (2010). Touch projector: Mobile interaction through video. In ACM Conference on Human Factors in Computing Systems (CHI 2010), pages 2287-2296.
  3. Fischler and Bolles (1981). Random sample consensus: a pardigm for model fitting with application to image analysis and automated cartography. Commun. Assoc. Comp. Mach., 24:381-395.
  4. Fitzmaurice, G. W. (1993). Situated information spaces and spatially aware palmtop computers. Communications of the ACM, 36(7):39-49.
  5. Hinckley, K., Pierce, J., Sinclair, M., and Horvitz, E. (2000). Sensing techniques for mobile interaction. In 13th Annual ACM Symposium on User interface Software and Technology, pages 91-100.
  6. Lowe, D. G. (2004). Distinctive image features from scaleinvariant keypoints. International Journal of Computer Vision, 60:91-110.
  7. Lowe, D. G. (2009). Demo software: Sift keypoint detector. http://www.cs.ubc.ca/ lowe/keypoints/.
  8. Myers, B., Stiel, H., and Gargiulo, R. (1998). Collaboration using multiple pdas connected to a pc. In Proc. 1998 ACM Conference on Computer Supported Cooperative Work, pages 285-294.
  9. Pears, N. E., Jackson, D. G., and Olivier, P. L. (2009). Smartphone interaction with registered displays. IEEE Pervasive Computing, 8(2):14-21.
  10. Pears, N. E., Olivier, P. L., and Jackson, D. G. (2008). Display registration for device interaction. In Proc. 3rd Int. Conf. on Computer Vision Theory and Applications (VISAPP'08).
  11. Strandmark, P. (2009). Demo software: Surfmex. http:// www.maths.lth.se/matematiklth/petter/surfmex.php.
  12. Tani, M., Yamaashi, K., K.Tanikoshi, Futakawa, M., and Tanifuji, S. (1992). Object-oriented video: Interaction with real-world objects through live video. In ACM Conference on Human Factors in Computing Systems (CHI 1992), pages 593-598.
  13. Wang, J., Zhai, S., and Canny, J. (2006). Camera phone based motion sensing: Interaction techniques, applications and performance study. In 19th Annual ACM Symposium on User interface Software and Technology (UIST'06), pages 101-110.
  14. Yee, K. (2003). Peephole displays: Pen interaction on spatially aware handheld computers. In SIGCHI Conference on Human Factors in Computing Systems, pages 1-8.
  15. Yoshida, Y., Miyaoku, K., and Satou, T. (2007). Mobile magic hand: Camera phone based interaction using visual code and optical flow. In Human-Computer Interaction Part II, LNCS 4551, pages 513-521.
Download


Paper Citation


in Harvard Style

Herbert L., Pears N., Jackson D. and Olivier P. (2011). MOBILE DEVICE AND INTELLIGENT DISPLAY INTERACTION VIA SCALE-INVARIANT IMAGE FEATURE MATCHING . In Proceedings of the 1st International Conference on Pervasive and Embedded Computing and Communication Systems - Volume 1: PECCS, ISBN 978-989-8425-48-5, pages 207-214. DOI: 10.5220/0003368302070214


in Bibtex Style

@conference{peccs11,
author={Leigh Herbert and Nick Pears and Dan Jackson and Patrick Olivier},
title={MOBILE DEVICE AND INTELLIGENT DISPLAY INTERACTION VIA SCALE-INVARIANT IMAGE FEATURE MATCHING},
booktitle={Proceedings of the 1st International Conference on Pervasive and Embedded Computing and Communication Systems - Volume 1: PECCS,},
year={2011},
pages={207-214},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003368302070214},
isbn={978-989-8425-48-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 1st International Conference on Pervasive and Embedded Computing and Communication Systems - Volume 1: PECCS,
TI - MOBILE DEVICE AND INTELLIGENT DISPLAY INTERACTION VIA SCALE-INVARIANT IMAGE FEATURE MATCHING
SN - 978-989-8425-48-5
AU - Herbert L.
AU - Pears N.
AU - Jackson D.
AU - Olivier P.
PY - 2011
SP - 207
EP - 214
DO - 10.5220/0003368302070214