USING DEFICITS OF CONVEXITY TO RECOGNIZE HAND GESTURES FROM SILHOUETTES

Ed Lawson, Zoran Duric

2006

Abstract

We describe a method of recognizing hand gestures from hand silhouettes. Given the silhouette of a hand, we compute its convex hull and extract the deficits of convexity corresponding to the differences between the hull and the silhouette. The deficits of convexity are normalized by rotating them around the edges shared with the hull. To learn a gesture, the deficits from a number of examples are extracted and normalized. The deficits are grouped by similarity which is measured by the relative overlap using k-means clustering. Each cluster is assigned a symbol and represented by a template. Gestures are represented by string of symbols corresponding to the nearest neighbors of the deficits. Distinct sequences of symbols corresponding to a given gesture are stored in a dictionary. Given an unknown gesture, its deficits of convexity are extracted and assigned the corresponding sequence of symbols. This sequence is compared with the dictionary of known gestures and assigned to the class to which the best matching string belongs. We used our method to design a gesture interface to control a web browser. We tested our method on five different subjects and achieved a recognition rate of 92% - 99%.

References

1. Oviatt, S. (2002). Designing the user interface for multimodal speech and pen-based gesture applications: State-of-the-art systems and future research direc-

Paper Citation

in Harvard Style

Lawson E. and Duric Z. (2006). USING DEFICITS OF CONVEXITY TO RECOGNIZE HAND GESTURES FROM SILHOUETTES . In Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, ISBN 972-8865-40-6, pages 123-128. DOI: 10.5220/0001376101230128

in Bibtex Style

@conference{visapp06,
author={Ed Lawson and Zoran Duric},
title={USING DEFICITS OF CONVEXITY TO RECOGNIZE HAND GESTURES FROM SILHOUETTES},
booktitle={Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,},
year={2006},
pages={123-128},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001376101230128},
isbn={972-8865-40-6},
}

in EndNote Style

TY - CONF
JO - Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,
TI - USING DEFICITS OF CONVEXITY TO RECOGNIZE HAND GESTURES FROM SILHOUETTES
SN - 972-8865-40-6
AU - Lawson E.
AU - Duric Z.
PY - 2006
SP - 123
EP - 128
DO - 10.5220/0001376101230128