POSE ESTIMATION USING STRUCTURED LIGHT AND HARMONIC SHAPE CONTEXTS

Thomas B. Moeslund, Jakob Kirkegaard

2006

Abstract

One of the remaining obstacles to a widespread introduction of industrial robots is their inability to deal with 3D objects in a bin that are not precisely positioned, i.e., the bin-picking problem. In this work we address the general bin-picking problem where a CAD model of the object to be picked is available beforehand. Structured light, in the form of Time Multiplexed Binary Stripes, is used together with a calibrated camera to obtain 3D data of the objects in the bin. The 3D data is then segmented into points of interest and for each a regional feature vector is extracted. The features are the Harmonic Shape Contexts. These are characterized by being rotational invariant and can in general model any free-form object. The Harmonic Shape Contexts are extracted from the 3D scene data and matched against similar features found in the CAD model. This allows for a pose estimation of the objects in the bin. Tests show the method to be capable of pose estimating partial-occluded objects, however, the method is also found to be sensitive to the resolution in the structured light system and to noise in the data.

References

  1. Balslev, I. and Eriksen, R. D. (2002). From belt picking to bin picking. Proceedings of SPIE - The International Society for Optical Engineering, 4902:616-623.
  2. Berger, M., Bachler, G., and Scherer, S. (2000). Vision Guided Bin Picking and Mounting in a Flexible Assembly Cell. In Proceedings of the 13th International Conference on Industrial & Engineering Applications of Artificial Intelligence & Expert Systems, IEA/AIE2000, pages 109-118, New Orleans, Louisiana, USA.
  3. Boughorbel, F., Zhang, Y., Kang, S., Chidambaram, U., Abidi, B., Koschan, A., and Abidi, M. (2003). Laser ranging and video imaging for bin picking. Assembly Automation, 23(1):53-59.
  4. Bronstein, A. M., Bronstein, M. M., Gordon, E., and Kimmel, R. (2003). High-resolution structured light range scanner with automatic calibration. Technical report, Technion - Israel Institute of Technology.
  5. Curless, B. (2000). Overview of active vision technologies. 3D Photography - Course Notes ACM Siggraph 7800.
  6. Frome, A., Huber, D., Kolluri, R., Bulow, T., and Malik, J. (2004). Recognizing objects in range data using regional point descriptors. In European Conference on Computer Vision (ECCV), pages 224-237, Prague, Czech Republic.
  7. Ghita, O. and Whelan, P. F. (2003). A bin picking system based on depth from defocus. Machine Vision and Applications, 13(4):234-244.
  8. Kazhdan, M., Funkhouser, T., and Rusinkiewicz, S. (2003). Rotation invariant spherical harmonic representation of 3d shape descriptors. In SGP 7803: Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing, pages 156-164, Sardinia, Italy.
  9. Kirkegaard, J. (2005). Pose Estimation of Randomly Organized Stator Housings using Structured Light and Harmonic Shape Contexts. Master's thesis, Lab. of Computer Vision and Media Technology, Aalborg University, Denmark.
  10. Moeslund, T. B. and Kirkegaard, J. (2005). Pose estimation of randomly organised stator housings with circular features. In Scandinavian Conference on Image Analysis, Joensuu, Finland.
  11. Posdamer, J. L. and Altschuler, M. D. (1982). Surface measurement by space-encoded projected beam systems. Computer Graphics and Image Processing, 18(1):1- 17.
  12. Saldner, H. (2003). Palletpicker-3d, the solution for picking of randomly placed parts. Assembly Automation, 23(1):29-31.
  13. Salvi, J., Pags, J., and Battle, J. (2004). Pattern codification strategies in structured light systems. Pattern Recognition, 37(4):827-849.
  14. Schraft, R. D. and Ledermann, T. (2003). Intelligent picking of chaotically stored objects. Assembly Automation, 23(1):38-42.
  15. Schwarte, R., Heinol, H., Buxbaum, B., Ringbeck, T., Xu, Z., and Hartmann, K. (1999). Principles of ThreeDimensional Imaging Techniques in ”Handbook of Computer Vision and Applications”, volume 1. The Academic Press, first edition.
  16. Torras, C. (1992). Computer Vision - Theory and Industrial Applications. Springer-Verlag, first edition.
  17. Trucco, E. and Verri, A. (1998). Introductory Techniques for 3D Computer Vision. Prentice Hall, first edition.
  18. Valkenburg, R. J. and McIvor, A. M. (1998). Accurate 3d measurement using a structured light system. Image and Vision Computing, 16(2):99-110.
  19. www.grundfos.com (2005).
Download


Paper Citation


in Harvard Style

B. Moeslund T. and Kirkegaard J. (2006). POSE ESTIMATION USING STRUCTURED LIGHT AND HARMONIC SHAPE CONTEXTS . In Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, ISBN 972-8865-40-6, pages 101-108. DOI: 10.5220/0001367201010108


in Bibtex Style

@conference{visapp06,
author={Thomas B. Moeslund and Jakob Kirkegaard},
title={POSE ESTIMATION USING STRUCTURED LIGHT AND HARMONIC SHAPE CONTEXTS},
booktitle={Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,},
year={2006},
pages={101-108},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001367201010108},
isbn={972-8865-40-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,
TI - POSE ESTIMATION USING STRUCTURED LIGHT AND HARMONIC SHAPE CONTEXTS
SN - 972-8865-40-6
AU - B. Moeslund T.
AU - Kirkegaard J.
PY - 2006
SP - 101
EP - 108
DO - 10.5220/0001367201010108