COMPUTER VISION BASED INTERFACES FOR INTERACTIVE SIMULATIONS

Ben Ward, Anthony Dick

Abstract

3D environments are commonplace in applications for simulation, gaming and design. However, interaction with these environments has traditionally been limited by the use of 2D interface devices. This paper explores the use of computer vision to capture the 3D motion of a handheld object by tracking known features. Captured motion is translated into control of an object onscreen, allowing 3D interaction with a rendered environment. Objects are tracked in real-time in video from a single webcam. The technique is demonstrated using two real-time interactive applications.

References

  1. Alter, T. D., 1992. 3D Pose from 3 Corresponding points under weak-Perspective Projection. Technical Report 1378, MIT Artificial Intelligence Laboratory.
  2. Chung, J., Kim, N., Kim, G.J., & Park, C.M., 2002. Real Time Motion Tracking System For Interactive Entertainment Applications. Proceedings of the 5th International Conference on System Simulation and Scientific Computing.
  3. Haralick, R.M., Sternberg, S.R., & Zhuang, X., 1987. Image analysis using mathematical morphology. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 9, No. 4, pp. 532-550.
  4. Hartley, R., Zisserman, A., 2000. Multiple View Geometry In Computer Vision, Cambridge University Press.
  5. Kim, K., Ramakrishna, R.S., 1999. Vision-Based EyeGaze Tracking for Human Computer Interface. Proceedings of the IEEE SMC'99 Conference, No.2, pp. 324-329.
  6. Nielsen, F., Nock, R., 2004. Approximating smallest enclosing disks. Proceedings of the 16th Canadian Conference on Computational Geometry, pp. 124-127.
  7. Rosenfeld, A., Pfaltz, J.L., October 1966. Sequential operations in digital picture processing. Journal of the ACM, Vol. 13, No. 4, pp. 471-494.
  8. Smith, A.R., 1978. Color Gamut Transform Pairs. Proceedings of SIGGRAPH 78, pp. 12-19.
  9. Yang, M-H., Ahuja, N., 1999. Recognizing hand gesture using motion trajectories. Proceedings of the IEEE CS Conference on Computer Vision and Pattern Recognition, pp. 468-472.
  10. 10cm X
  11. 10cm Z
  12. 45° Z
  13. 45° X
Download


Paper Citation


in Harvard Style

Ward B. and Dick A. (2006). COMPUTER VISION BASED INTERFACES FOR INTERACTIVE SIMULATIONS . In Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, ISBN 972-8865-40-6, pages 389-394. DOI: 10.5220/0001366403890394


in Bibtex Style

@conference{visapp06,
author={Ben Ward and Anthony Dick},
title={COMPUTER VISION BASED INTERFACES FOR INTERACTIVE SIMULATIONS},
booktitle={Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,},
year={2006},
pages={389-394},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001366403890394},
isbn={972-8865-40-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,
TI - COMPUTER VISION BASED INTERFACES FOR INTERACTIVE SIMULATIONS
SN - 972-8865-40-6
AU - Ward B.
AU - Dick A.
PY - 2006
SP - 389
EP - 394
DO - 10.5220/0001366403890394