User Awareness for Collaborative Multi-touch Interaction

Markus Schlattmann, Yuelong Yu, Nils Gruendl, Manfred Bogen, Alexander Kulik, David d'Angelo, Bernd Froehlich, Reinhard Klein

2013

Abstract

Multi-touch enables direct manipulation of graphical computer interfaces. This intuitive interaction paradigm rapidly became popular, particularly in the domain of individual mobile devices. Collaborative work on large scale multi-touch devices, instead, suffers from mutual interferences if many simultaneous touch events cannot be attributed to individual users. On the example of a large, adjustable, high-resolution (4K) multi-touch device, we describe a lightweight and robust method to solve this issue. An additional depth camera above the tabletop device tracks the users around the table and their respective hands. This environment tracking and the multi-touch sensor are automatically calibrated to the same coordinate system. We discuss relevant implementation details to help practitioners building similar systems. Besides improved multi-user coordination we reveal general usability benefits including the reduction of false positives. Exploiting the developed system, we implemented several novel test applications to analyze the capabilities of such a system with regard to different interaction metaphors. Finally, we combined several of the analyzed metaphors to a novel application serving as an intuitive multi-touch application and environment for seismic interpretation.

References

  1. Annett, M., Grossman, T., Wigdor, D., & Fitzmaurice, G., (2011). Medusa: a proximity-aware multi-touch tabletop. Proc. UIST 2011 (pp. 337-346). New York, NY, USA: ACM-Press.
  2. Bradski, G., (2000). The OpenCV Library. Dr. Dobb's Journal of Software Tools.
  3. Burrus, N. (2011, June). Kinect RGB Demo v0.5.0. Retrieved from http://nicolas.burrus.name/index.php/ Research/KinectRgbDemoV5
  4. Dang, C. T., Straub, M., & André, E., (2009). Hand distinction for multi-touch tabletop interaction. Proc. ITS 2009 (pp. 101-108). New York, NY, USA: ACMPress.
  5. Dietz, P., & Leigh, D. (2001). DiamondTouch: a multiuser touch technology. Proc. UIST 2001 (pp. 219- 226). New York, NY, USA: ACM-Press.
  6. Dohse, K. C., Dohse, T., Still, J. D., & Parkhurst, D. J., (2008). Enhancing Multi-user Interaction with Multitouch Tabletop Displays Using Hand Tracking. Proc. Advances in Computer-Human Interaction 2008 (pp. 297-302). Washington, DC, USA: IEEE Computer Society.
  7. Ewerling, P., Kulik, A., & Froehlich, B., (2012). Finger and hand detection for multi-touch interfaces based on maximally stable extremal regions. Proc. ITS 2012 (pp. 173-182). New York, NY, USA: ACM-Press.
  8. Jung, H., Nebe, K., Klompmaker, F., & Fischer, H. (2011). Authentifizierte Eingaben auf MultitouchTischen. Mensch & Computer 2011 (pp. 305-308). München: Oldenbourg Wissenschaftsverlag GmbH.
  9. Kaltenbrunner, M., Bovermann, T., Bencina, R., & Costanza, E., (2005). TUIO - A Protocol for TableTop Tangible User Interfaces. Proc. of the 6th International Workshop on Gesture in HumanComputer Interaction and Simulation.
  10. Klompmaker, F., Nebe, K., & Fast, A., (2012). dSensingNI: a framework for advanced tangible interaction using a depth camera. Proc. of ACM TEI 2012 (pp. 217-224). New York, NY, USA: ACMPress.
  11. Marquardt, N., Kiemer, J., & Greenberg, S., (2010). What caused that touch?: expressive interaction with a surface through fiduciary-tagged gloves. Proc. ITS 2010 (pp. 139-142). New York, NY, USA: ACMPress.
  12. Martínez, R., Collins, A., Kay, J., & Yacef, K., (2011). Who did what? Who said that?: Collaid: an environment for capturing traces of collaborative learning at the tabletop. Proc. ITS 2011 (pp. 172-181). New York, NY, USA: ACM-Press.
  13. Morris, M. R., Huang, A., Paepcke, A., & Winograd, T., (2006). Cooperative gestures: multi-user gestural interactions for co-located groupware. Proc. CHI 2006 (pp. 1201-1210). New York, NY, USA: ACM-Press.
  14. Morris, M. R., Ryall, K., Shen, C., Forlines, C., & Vernier, F., (2004). Beyond "social protocols": multi-user coordination policies for co-located groupware. Proc. CSCW 2004 (pp. 262-265). New York, NY, USA: ACM-Press.
  15. Morris, R. M., Ryall, K., Shen, C., Forlines, C., & Vernier, F., (2004). Release, relocate, reorient, resize: fluid techniques for document sharing on multi-user interactive tables. CHI Extended Abstracts 2004 (pp. 1441-1444). New York, NY, USA: ACM-Press.
  16. Richter, S., Holz, C., & Baudisch, P. (2012). Bootstrapper: recognizing tabletop users by their shoes. Proc. CHI 2012 (pp. 1249-1252). New York, NY, USA: ACMPress.
  17. Roth, V., Schmidt, P., & Güldenring, B., (2010). The IR ring: authenticating users' touches on a multi-touch display. Proc. UIST 2010 (pp. 259-262). New York, NY, USA: ACM-Press.
  18. Scott, S. D., Sheelagh, M., Carpendale, T., & Inkpen, K. M., (2004). Territoriality in collaborative tabletop workspaces. Proc. CSCW 2004 (pp. 294-303). New York, NY, USA: ACM-Press.
  19. Shen, C., Vernier, F. D., Forlines, C., & Ringel, M., (2004). DiamondSpin: an extensible toolkit for around-the-table interaction. Proc. CHI 2004 (pp. 167- 174). New York, NY, USA: ACM-Press.
  20. Walther-Franks, B., Schwarten, L., Krause, M., Teichert, J., & Herrlich, M., (2008). User Detection for a Multitouch Table via Proximity Sensors. Proceedings of the IEEE Tabletops and Interactive Surfaces. IEEE Computer Society.
  21. Wilson, A. D., (2010). Using a depth camera as a touch sensor. Proc. ITS 2010 (pp. 69-72). New York, NY, USA: ACM-Press.
Download


Paper Citation


in Harvard Style

Schlattmann M., Yu Y., Gruendl N., Bogen M., Kulik A., d'Angelo D., Froehlich B. and Klein R. (2013). User Awareness for Collaborative Multi-touch Interaction . In Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2013) ISBN 978-989-8565-46-4, pages 359-366. DOI: 10.5220/0004210603590366


in Bibtex Style

@conference{grapp13,
author={Markus Schlattmann and Yuelong Yu and Nils Gruendl and Manfred Bogen and Alexander Kulik and David d'Angelo and Bernd Froehlich and Reinhard Klein},
title={User Awareness for Collaborative Multi-touch Interaction},
booktitle={Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2013)},
year={2013},
pages={359-366},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004210603590366},
isbn={978-989-8565-46-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2013)
TI - User Awareness for Collaborative Multi-touch Interaction
SN - 978-989-8565-46-4
AU - Schlattmann M.
AU - Yu Y.
AU - Gruendl N.
AU - Bogen M.
AU - Kulik A.
AU - d'Angelo D.
AU - Froehlich B.
AU - Klein R.
PY - 2013
SP - 359
EP - 366
DO - 10.5220/0004210603590366