MULTI-RESOLUTION VIRTUAL PLANE BASED 3D RECONSTRUCTION USING INERTIAL-VISUAL DATA FUSION

Hadi Aliakbarpour, Jorge Dias

Abstract

In this paper a novel 3D volumetric reconstruction method, based on the fusion of inertial and visual information and applying a quadtree-based compression algorithm, has been proposed. A network of cameras is used to observe the scene. Then beside of each camera, a fusion-based virtual camera is defined. The transformations among the cameras have been estimated. Then a set of horizontal virtual planes have been passed through the volumetric scenes. The intersections of these virtual planes and the object within the scene, or in other words the virtual registration layers, have been obtained by using the concept of homography. Then quadtree-based decomposition has been applied to the registration layers and consequently the obtained layers (2D) are stacked to produce the 3D reconstruction of the object. The proposed method has the ability of adjusting the compactness or the resolution of the result which can be defined with respect to the application or the storage resources, specially when the intention is to keep the sequence of 3D models in a dynamic scene.

References

  1. Aliakbarpour, H. and Dias, J. (2010a). Human silhouette volume reconstruction using a gravity-based virtual camera network. In Proceedings of the 13th International Conference on Information Fusion, 26-29 July 2010 EICC Edinburgh, UK.
  2. Aliakbarpour, H. and Dias, J. (2010b). Imu-aided 3d reconstruction based on multiple virtual planes. In DICTA'10 (the Australian Pattern Recognition and Computer Vision Society Conference), IEEE Computer Society Press, 1-3 December 2010, Sydney, Australia.
  3. Bleser, Wohlleber, Becker, and Stricker. (2006). Fast and stable tracking for ar fusing video and inertial sensor data. pages 109-115. Short Papers Proceedings. Plzen: University of West Bohemia.
  4. Calbi, A., Regazzoni, C. S., and Marcenaro, L. (2006). Dynamic scene reconstruction for efficient remote surveillance. In IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS'06).
  5. Colleu, T., Morin, L., Labit, C., Pateux, S., and Balter, R. (2009). Compact quad-based representation for 3d video. In 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video, 2009, pages 1 -4.
  6. Dias, J., Lobo, J., and Almeida, L. A. (2002). Cooperation between visual and inertial information for 3d vision. In Proceedings of the 10th Mediterranean Conference on Control and Automation - MED2002 Lisbon, Portugal, July 9-12, 2002.
  7. Franco, J.-S. and Boyer, E. (2005). Fusion of multi-view silhouette cues using a space occupancy grid. In Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV05).
  8. Hartley, R. and Zisserman, A. (2003). Multiple View Geometry in Computer Vision. Cambridge University Press.
  9. Kampel, M., Tosovic, S., and Sablatnig, R. (2002). Octreebased fusion of shape from silhouette and shape from structured light. In 3D Data Processing Visualization and Transmission, 2002. Proceedings. First International Symposium on, IEEE.
  10. Khan, S. M., Yan, P., and Shah, M. (2007). A homographic framework for the fusion of multi-view silhouettes. In Computer Vision, 2007. ICCV 2007. IEEE 11th International Conference on.
  11. Lai, P.-L. and Yilmaz, A. (2008). Projective reconstruction of building shape from silhouette images acquired from uncalibrated cameras. In ISPRS Congress Beijing 2008, Proceedings of Commission III.
  12. Liu, S. and Cooper, D. (2010). Ray markov random fields for image-based 3d modeling: Model and efficient inference. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 1530 -1537.
  13. Lobo, J. and Dias, J. (2007). Relative pose calibration between visual and inertial sensors. International Journal of Robotics Research, Special Issue 2nd Workshop on Integration of Vision and Inertial Sensors, 26:561- 575.
  14. Michoud, B., Guillou, E., and Bouakaz, S. (2007). Real-time and markerless 3d human motion capture using multiple views. Human MotionUnderstanding, Modeling, Capture and Animation, Springer Berlin/Heidelberg., 4814/2007:88-103.
  15. Mirisola, L. G. B. and Dias, J. M. M. (2007). Exploiting inertial sensing in mosaicing and visual navigation. In In 6th IFAC Symposium on Inteligent Autonomous Vehicles (IAV07), Toulouse, France, Sep. 2007.
  16. Moon, H.-M. and Pan, S. B. (2010). A new human identification method for intelligent video surveillance system. In Computer Communications and Networks (ICCCN), 2010 Proceedings of 19th International Conference on., pages 1 -6.
  17. Ruwwe, C., Keck, B., Rusch, O., Zolzer, U., and Loison, X. (2008). Image registration by means of 3d octree correlation. In Multimedia Signal Processing, 2008 IEEE 10th Workshop on, pages 515 -519.
  18. Samet, H. (1981). Connected component labeling using quadtrees. J. ACM, 28(3):487-501.
  19. Song, W., Cai, S., Yang, B., Cui, W., and Wang, Y. (2009). A reduction method of three-dimensional point cloud. In Biomedical Engineering and Informatics, 2009. BMEI 7809. 2nd International Conference on, pages 1 -4.
  20. Wu, W. and Yang, J. (2009). Semi-automatically labeling objects in images. Image Processing, IEEE Transactions on, 18(6):1340 -1349.
  21. Zhang, Q.-B., Wang, H.-X., and Wei, S. (2003). A new algorithm for 3d projective reconstruction based on infinite homography. In Machine Learning and Cybernetics, 2003 International Conference on, IEEE.
Download


Paper Citation


in Harvard Style

Aliakbarpour H. and Dias J. (2011). MULTI-RESOLUTION VIRTUAL PLANE BASED 3D RECONSTRUCTION USING INERTIAL-VISUAL DATA FUSION . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2011) ISBN 978-989-8425-47-8, pages 112-118. DOI: 10.5220/0003317901120118


in Bibtex Style

@conference{visapp11,
author={Hadi Aliakbarpour and Jorge Dias},
title={MULTI-RESOLUTION VIRTUAL PLANE BASED 3D RECONSTRUCTION USING INERTIAL-VISUAL DATA FUSION},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2011)},
year={2011},
pages={112-118},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003317901120118},
isbn={978-989-8425-47-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2011)
TI - MULTI-RESOLUTION VIRTUAL PLANE BASED 3D RECONSTRUCTION USING INERTIAL-VISUAL DATA FUSION
SN - 978-989-8425-47-8
AU - Aliakbarpour H.
AU - Dias J.
PY - 2011
SP - 112
EP - 118
DO - 10.5220/0003317901120118