ROBOTS, OBJECTS, HUMANS: TOWARDS SEAMLESS INTERACTION IN INTELLIGENT ENVIRONMENTS - Supporting Complex Cooperative Interactions between Humans and Technical Systems in Real World Scenarios through Cognitive Objects

Matthias Kranz, Andreas Möller, Luis Roalter

2011

Abstract

Future intelligent environments will be inhabited by humans, robots and ‘Smart Objects’ and allow for seamless interaction beyond the desktop. These environments therefore have to be adaptive, self-organizing, provide autonomous reasoning and integrate a variety of heterogenous hardware, objects, sensors and actuators – which goes far beyond merely interconnecting different kinds of technology. In light of the dawn of personal robotics, these environments should be equally usable and supportive for humans and robots. Manipulation tasks involving physical objects are at core of the interaction in these environments. This places novel challenges on the involved ‘Smart Objects’. We present an approach for supporting robotic systems in the interaction with physical objects while maintaining human usability and functionality by using so-called ‘Cognitive Objects’. We describe our infrastructure to support developing, simulating, testing and deploying of pervasive computing systems, using ROS (Robot Operating System) as middleware, and present several application scenarios. The scenarios are not limited to the robotics domain, but include location-aware services, intelligent environments and mobile interaction therein. Based on our experience, recommendations for the design of ‘Cognitive Objects’ (CO) and environments are given, to address the individual strengths of humans and machines and to foster new synergies in shared human-robot environments.

References

  1. Beigl, M. and Gellersen, H. (2003). Smart-its: An embedded platform for smart objects. In In Proc. Smart Objects Conference (SOC 2003, pages 15-17.
  2. Chapanis, A., Frick, F. C., Garner, W. R., Gebhard, J. W., Grether, W. F., Henneman, R. H., Kappauf, W. E., Newman, E. B., and Williams, A. C. J. (1951). Human engineering for an effective air-navigation and traffic control system. National Academy of Sciences Archives.
  3. Duchon, A. P., Warren, W. H., and Kaelbling, L. P. (1994). Ecological robotics. Adaptive Behavior, 6.
  4. Fitzpatrick, P., Metta, G., Natale, L., Rao, S., Sandini, G., and S, G. (2003). Learning about objects through action - initial steps towards artificial cognition. In In Proc. ICRA, pages 3140-3145.
  5. Holmquist, L., Gellersen, H., Kortuem, G., Antifakos, S., Michahelles, F., Schiele, B., Beigl, M., and Maze, R. (2004). Building intelligent environments with SmartIts. Computer Graphics and Applications, IEEE, 24(1):56-64.
  6. Johanson, B., Fox, A., and Winograd, T. (2002). The interactive workspaces project: experiences with ubiquitous computing rooms. Pervasive Computing, IEEE, 1(2):67-74.
  7. Kranz, M., Fischer, C., and Schmidt, A. (2010a). A comparative study of DECT and WLAN signals for indoor localization. In PerCom 2010, pages 235 -243. IEEE.
  8. Kranz, M., Holleis, P., and Schmidt, A. (2006). Ubiquitous Presence Systems. In SAC 7806: Proceedings of the 2006 ACM symposium on Applied computing, pages 1902-1909. ACM.
  9. Kranz, M., Holleis, P., and Schmidt, A. (2010b). Embedded Interaction: Interacting with the Internet of Things. IEEE Internet Computing, 14:46-53.
  10. Kranz, M., Linner, A., Ellmann, B., Bittner, A., Bock, T., and Roalter, L. (2010c). Robotic Service Cores for Ambient Assisted Living. Pervasive Health 2010.
  11. Kranz, M. and Schmidt, A. (2005). Prototyping Smart Objects for Ubiquitous Computing. In Workshop on Smart Object Systems, UbiComp.
  12. Kranz, M., Schmidt, A., Rusu, R., Maldonado, A., Beetz, M., Hornler, B., and Rigoll, G. (2007). Sensing Technologies and the Player-Middleware for ContextAwareness in Kitchen Environments. In Proc. of INSS, pages 179 -186.
  13. Kranz, M., Schmidt, D., Holleis, P., and Schmidt, A. (2005). A Display Cube as a Tangible User Interface. Adj. In Proc. of UbiComp 2005. Springer.
  14. Laerhoven, K. V., Schmidt, A., and Gellersen, H.-W. (2002). Pin&play: Networking objects through pins. In UbiComp 7802, pages 219-228. Springer-Verlag.
  15. Linner, T., Kranz, M., Roalter, L., and Bock, T. (2010). Compacted and industrially customizable ambient intelligent service units: Typology, examples and performance. In 2010 Sixth International Conference on Intelligent Environments, pages 295-300.
  16. Möller, A., Roalter, L., and Kranz, M. (2011). Cognitive Objects for Human-Computer Interaction and Human-Robot Interaction. In 6th ACM/IEEE International Conference on Human-Robot Interaction.
  17. Norman, D. A. (1990). The design of everyday things. Doubleday.
  18. Norman, D. A. (1993). Things that make us smart: defending human attributes in the age of the machine. Addison-Wesley Pub. Co.
  19. Norman, D. A. (2003). Emotional Design: Why We Love (or Hate) Everyday Things. Basic Books.
  20. Roalter, L., Kranz, M., and Möller, A. (2010). A middleware for intelligent environments and the internet of things. In Ubiquitous Intelligence and Computing, volume 6406 of Lecture Notes in Computer Science, pages 267-281. Springer Berlin / Heidelberg.
  21. ROS (2010). An open-source, meta-operating system for your robot, robot operating system middleware. http://www.ros.org.
  22. Rukzio, E., Leichtenstern, K., Callaghan, V., Holleis, P., Schmidt, A., and Chin, J. (2006). An experimental comparison of physical mobile interaction techniques: Touching, pointing and scanning. In Dourish, P. and Friday, A., editors, UbiComp 2006: Ubiquitous Computing, volume 4206 of Lecture Notes in Computer Science, pages 87-104. Springer Berlin / Heidelberg.
  23. Schmidt, A., Strohbach, M., van Laerhoven, K., Friday, A., and Gellersen, H.-W. (2002). Context acquisition based on load sensing. In Borriello, G. and Holmquist, L., editors, UbiComp 2002: Ubiquitous Computing, volume 2498 of Lecture Notes in Computer Science, pages 161-192. Springer Berlin / Heidelberg.
  24. Siio, I., Rowan, J., and Mynatt, E. (2003). Finding objects in "strata drawer". In CHI 7803: CHI 7803 extended abstracts on Human factors in computing systems, pages 982-983. ACM.
  25. Ullmer, B. and Ishii, H. (2000). Emerging Frameworks for Tangible User Interfaces. IBM Syst. J., 39(3-4):915- 931.
  26. Weiser, M. (1991). The Computer For The 21st Century. Scientific American, 265(3):66-75.
  27. Williams, B. C. and Nayak, P. P. (1996). Immobile Robots AI in the New Millennium. AI Magazine, 17(3):16- 35.
  28. Wimmer, R., Kranz, M., Boring, S., and Schmidt, A. (2007). Captable and capshelf - unobtrusive activity recognition using networked capacitive sensors. In Proc. Fourth International Conference on Networked Sensing Systems INSS 7807, pages 85-88.
  29. Wu, J., Pan, G., Zhang, D., Li, S., and Wu, Z. (2010). Magicphone: pointing & interacting. In Ubicomp 7810: Proceedings of the 12th ACM international conference adjunct papers on Ubiquitous computing, pages 451-452. ACM.
Download


Paper Citation


in Harvard Style

Kranz M., Möller A. and Roalter L. (2011). ROBOTS, OBJECTS, HUMANS: TOWARDS SEAMLESS INTERACTION IN INTELLIGENT ENVIRONMENTS - Supporting Complex Cooperative Interactions between Humans and Technical Systems in Real World Scenarios through Cognitive Objects . In Proceedings of the 1st International Conference on Pervasive and Embedded Computing and Communication Systems - Volume 1: PECCS, ISBN 978-989-8425-48-5, pages 163-172. DOI: 10.5220/0003323001630172


in Bibtex Style

@conference{peccs11,
author={Matthias Kranz and Andreas Möller and Luis Roalter},
title={ROBOTS, OBJECTS, HUMANS: TOWARDS SEAMLESS INTERACTION IN INTELLIGENT ENVIRONMENTS - Supporting Complex Cooperative Interactions between Humans and Technical Systems in Real World Scenarios through Cognitive Objects},
booktitle={Proceedings of the 1st International Conference on Pervasive and Embedded Computing and Communication Systems - Volume 1: PECCS,},
year={2011},
pages={163-172},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003323001630172},
isbn={978-989-8425-48-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 1st International Conference on Pervasive and Embedded Computing and Communication Systems - Volume 1: PECCS,
TI - ROBOTS, OBJECTS, HUMANS: TOWARDS SEAMLESS INTERACTION IN INTELLIGENT ENVIRONMENTS - Supporting Complex Cooperative Interactions between Humans and Technical Systems in Real World Scenarios through Cognitive Objects
SN - 978-989-8425-48-5
AU - Kranz M.
AU - Möller A.
AU - Roalter L.
PY - 2011
SP - 163
EP - 172
DO - 10.5220/0003323001630172