The “Everywhere Switch” using a Projector and Camera

Akira Nozaki, Katsuto Nakajima

2015

Abstract

We propose a virtual remote control interface called the “Everywhere Switch” as an alternative to multiple remote controllers for many computerized home appliances. The interface consists of a group of virtual touch buttons projected near the user from a projector affixed to a pan-tilt mount just below the living-room ceiling. Methods to implement our system, including methods to search for a place to project the virtual touch buttons, to extract finger and shadow regions on the virtual button area and determine their ratio, and to detect touch operations, are described. We evaluated the precisions of the foreground extraction (finger or its shadow) and the segmentation of the finger and its shadow under three different brightness conditions (dim, semi-bright, and bright). The foreground extraction showed an F value of more than 0.97, and the finger/shadow segmentation showed an F value of about 0.8 in all tested brightness conditions.

References

  1. Borkowski, S., Letessier, J., and Crowley, J.L. (2004). Spatial Control of Interactive Surfaces in an Augmented Environment. EHCI/DS-VIS Lecture Notes in Computer Science, vol. 3425, pages 228-244.
  2. Borkowski, S., Letessier, J., Bérard, F., and Crowley, J.L. (2006). User-Centric Design of a Vision System for Interactive Applications. IEEE Conf. on Computer Vision Systems (ICVS 7806), pages 9.
  3. Dung, L., Lai, and G., Wu, Y. (2013). Shadow touching for interactive projectors. IEEE International Conference, pages 1798-1802.
  4. Goto, H., Kawasaki, Y., and Nakamura, A. (2010). Development of an Information Projection Interface using a Projector-Camera System. 19th IEEE International Symposium on Robot and Human Interactive Communication, pages 50-55.
  5. Hartmann G., and Wunsche, B.C. (2012). A Virtual Touchscreen with Depth Recognition. Proceedings of the Thirteenth Australasian User Interface Conference (AUIC2012), pages 39-48.
  6. Homma, H., and Nakajima, K. (2014). Virtual Touch Screen “VIRTOS” - Implementing Virtual Touch Buttons and Virtual Sliders using a Projector and Camera. Proceedings of the 9th International Conference on Computer Vision Theory and Applications, pages 34-43.
  7. Jiang, Y., Liu, and Y., Matsumaru, T. (2012). Applying infrared radiation image sensor to step-on interface: Touched point detection and tracking. IEEE SICE International Symposium, pages 752-757.
  8. Kim, S., Takahashi, S. and Tanaka, J. (2010). New interface using palm and fingertip without marker for ubiquitous environment. 9th IEEE/ACIS International Conference on Computer and Information Science, pages 819-824.
  9. LG Electronics. (2013). HomeChat. www:http:// www.lgnewsroom.com/newsroom/contents/64064.
  10. Logbar. (2014). Ring. www:http://logbar.jp/ring/.
  11. Otsu, N. (1972). A Threshold Selection Method from Gray-Level Histograms. IEEE Transactions on Systems. Man. and Cybernetics. Vol. SMC-9. No. 1, pages 62-66.
  12. Shimada, A., Yamashita, T., and Taniguchi, R., (2013). Hand gesture based TV control system - Towards both user- & machine-friendly gesture applications. IEEE Frontiers of Computer Vision, pages 121-126.
Download


Paper Citation


in Harvard Style

Nozaki A. and Nakajima K. (2015). The “Everywhere Switch” using a Projector and Camera . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-091-8, pages 115-122. DOI: 10.5220/0005307601150122


in Bibtex Style

@conference{visapp15,
author={Akira Nozaki and Katsuto Nakajima},
title={The “Everywhere Switch” using a Projector and Camera},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={115-122},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005307601150122},
isbn={978-989-758-091-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015)
TI - The “Everywhere Switch” using a Projector and Camera
SN - 978-989-758-091-8
AU - Nozaki A.
AU - Nakajima K.
PY - 2015
SP - 115
EP - 122
DO - 10.5220/0005307601150122