Improving User Experience via Motion Sensors in an Ambient Intelligence Scenario

Giuseppe Lo Re, Marco Morana, Marco Ortolani

2013

Abstract

Ambient Intelligence (AmI) is a new paradigm in Artificial Intelligence that aims at exploiting the information about the environment state in order to adapt it to the user preferences. AmI systems are usually based on several cheap and unobtrusive sensing devices that allow for continuous monitoring in different scenarios. In this work we present a gesture recognition module for the management of an office environment using a motion sensor device, namely Microsoft Kinect, as the primary interface between the user and the AmI system. The proposed gesture recognition method is based on both RGB and depth information for detecting the hand of the user and a fuzzy rule for determining the state of the detected hand. The shape of the hand is interpreted as one of the basic symbols of a grammar expressing a set of commands for the actuators of the AmI system. In order to maintain a high level of pervasiveness, the Kinect sensor is connected to a miniature computer capable of real-time processing.

References

  1. Aho, A., Lam, M., Sethi, R., and Ullman, J. (2007). Compilers: principles, techniques, and tools, volume 1009. Pearson/Addison Wesley.
  2. Alcalá, R., Casillas, J., Cordón, O., and Herrera, F. (2003). Linguistic modeling with weighted doubleconsequent fuzzy rules based on cooperative coevolutionary learning. Integr. Comput.-Aided Eng., 10(4):343-355.
  3. Borenstein, G. (2012). Making Things See: 3D Vision With Kinect, Processing, Arduino, and MakerBot. Make: Books. O'Reilly Media, Incorporated.
  4. Cho, J.-S. and Park, D.-J. (2000). Novel fuzzy logic control based on weighting of partially inconsistent rules using neural network. Journal of Intelligent Fuzzy Systems, 8(2):99-110.
  5. De Paola, A., Cascia, M., Lo Re, G., Morana, M., and Ortolani, M. (2012a). User detection through multisensor fusion in an ami scenario. In Information Fusion (FUSION), 2012 15th International Conference on, pages 2502 -2509.
  6. De Paola, A., Gaglio, S., Lo Re, G., and Ortolani, M. (2012b). Sensor9k: A testbed for designing and experimenting with WSN-based ambient intelligence applications. Pervasive and Mobile Computing. Elsevier, 8(3):448-466.
  7. Gulshan, V., Lempitsky, V., and Zisserman, A. (2011). Humanising grabcut: Learning to segment humans using the kinect. In Computer Vision Workshops (ICCV Workshops), 2011 IEEE International Conference on, pages 1127 -1133.
  8. Kean, S., Hall, J., and Perry, P. (2011). Meet the Kinect: An Introduction to Programming Natural User Interfaces. Apress, Berkely, CA, USA, 1st edition.
  9. Lai, K., Bo, L., Ren, X., and Fox, D. (2011). Sparse distance learning for object recognition combining rgb and depth information. In Robotics and Automation (ICRA), 2011 IEEE International Conference on, pages 4007 -4013.
  10. Morana, M., De Paola, A., Lo Re, G., and Ortolani, M. (2012). An Intelligent System for Energy Efficiency in a Complex of Buildings. In Proc. of the 2nd IFIP Conference on Sustainable Internet and ICT for Sustainability.
  11. Raheja, J., Chaudhary, A., and Singal, K. (2011). Tracking of fingertips and centers of palm using kinect. In Computational Intelligence, Modelling and Simulation (CIMSiM), 2011 Third International Conference on, pages 248 -252.
  12. Xia, L., Chen, C.-C., and Aggarwal, J. (2011). Human detection using depth information by kinect. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2011 IEEE Computer Society Conference on, pages 15 -22.
Download


Paper Citation


in Harvard Style

Lo Re G., Morana M. and Ortolani M. (2013). Improving User Experience via Motion Sensors in an Ambient Intelligence Scenario . In Proceedings of the 3rd International Conference on Pervasive Embedded Computing and Communication Systems - Volume 1: PECCS, ISBN 978-989-8565-43-3, pages 29-34. DOI: 10.5220/0004306000290034


in Bibtex Style

@conference{peccs13,
author={Giuseppe Lo Re and Marco Morana and Marco Ortolani},
title={Improving User Experience via Motion Sensors in an Ambient Intelligence Scenario},
booktitle={Proceedings of the 3rd International Conference on Pervasive Embedded Computing and Communication Systems - Volume 1: PECCS,},
year={2013},
pages={29-34},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004306000290034},
isbn={978-989-8565-43-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Pervasive Embedded Computing and Communication Systems - Volume 1: PECCS,
TI - Improving User Experience via Motion Sensors in an Ambient Intelligence Scenario
SN - 978-989-8565-43-3
AU - Lo Re G.
AU - Morana M.
AU - Ortolani M.
PY - 2013
SP - 29
EP - 34
DO - 10.5220/0004306000290034