Solid Geometric Object Reconstruction from Single Line Drawing Image

Jinxin Zheng, Yongtao Wang, Zhi Tang

2015

Abstract

We present a robust method to reconstruct solid geometric object from single line drawing image taken from the geometric books. Unlike most of the existing methods which require perfect and complete sketches of the line drawings as the inputs, our method directly takes the line drawing images as the inputs and can well handle the incomplete sketches that are automatically produced by our sketch extraction algorithm. The proposed method consists of three major steps as follows: First, the sketch of the input line drawing (i.e., line segments and their intersections) is automatically extracted and further represented as an undirected graph. Second, candidate 3D models from the pre-built 3D model database are found by graph matching. Third, for each candidate 3D model, the model parameters, the rotation and the translation aligning the model with the sketch, are found by optimizing an objective function which is composed of the residuals between the vertices of the sketch and the 2D projections of the candidate model’s vertices, and an optimal reconstruction solution is further selected as the final result. Experimental results show that our method can effectively reconstruct the solid geometric object from single line drawing image.

References

  1. Brown, E. and Wang, P. S. (1996). Three-dimensional object recovery from two-dimensional images: a new approach. In Photonics East'96, pages 138-147. International Society for Optics and Photonics.
  2. Chen, Y., Liu, J., and Tang, X. (2007). A divide-andconquer approach to 3d object reconstruction from line drawings. In Computer Vision, 2007. ICCV 2007. IEEE 11th International Conference on, pages 1-8. IEEE.
  3. Cordella, L. P., Foggia, P., Sansone, C., and Vento, M. (2004). A (sub) graph isomorphism algorithm for matching large graphs. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 26(10):1367- 1372.
  4. Cordier, F., Seo, H., Melkemi, M., and Sapidis, N. S. (2013). Inferring mirror symmetric 3d shapes from sketches. Computer-Aided Design, 45(2):301-311.
  5. Hartigan, J. A. and Wong, M. A. (1979). Algorithm as 136: A k-means clustering algorithm. Applied statistics, pages 100-108.
  6. Leclerc, Y. G. and Fischler, M. A. (1992). An optimizationbased approach to the interpretation of single line drawings as 3d wire frames. International Journal of Computer Vision, 9(2):113-136.
  7. Lee, Y. T. and Fang, F. (2011). 3d reconstruction of polyhedral objects from single parallel projections using cubic corner. Computer-Aided Design, 43(8):1025- 1034.
  8. Lee, Y. T. and Fang, F. (2012). A new hybrid method for 3d object recovery from 2d drawings and its validation against the cubic corner method and the optimisation-based method. Computer-Aided Design, 44(11):1090-1102.
  9. Lipson, H. and Shpitalni, M. (1996). Optimization-based reconstruction of a 3d object from a single freehand line drawing. Computer-Aided Design, 28(8):651- 663.
  10. Liu, D., Wang, Y., Tang, Z., Li, L., and Gao, L. (2014). Automatic comic page image understanding based on edge segment analysis. In Proc. SPIE 9021, Document Recognition and Retrieval XXI, pages 90210J90210J-12.
  11. Liu, J., Cao, L., Li, Z., and Tang, X. (2008). Plane-based optimization for 3d object reconstruction from single line drawings. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 30(2):315-327.
  12. Liu, J., Chen, Y., and Tang, X. (2011). Decomposition of complex line drawings with hidden lines for 3d planarfaced manifold object reconstruction. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 33(1):3-15.
  13. Liu, J. and Lee, Y. T. (2001). Graph-based method for face identification from a single 2d line drawing. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 23(10):1106-1119.
  14. Liu, J., Lee, Y. T., and Cham, W.-K. (2002). Identifying faces in a 2d line drawing representing a manifold object. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 24(12):1579-1593.
  15. Liu, J. and Tang, X. (2005). Evolutionary search for faces from line drawings. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 27(6):861-872.
  16. Marill, T. (1991). Emulating the human interpretation of line-drawings as three-dimensional objects. International Journal of Computer Vision, 6(2):147-161.
  17. Otsu, N. (1975). A threshold selection method from graylevel histograms. Automatica, 11(285-296):23-27.
  18. Shoji, K., Kato, K., and Toyama, F. (2001). 3-d interpretation of single line drawings based on entropy minimization principle. In Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on, volume 2, pages II-90. IEEE.
  19. Shpitalni, M. and Lipson, H. (1996). Identification of faces in a 2d line drawing projection of a wireframe object. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 18(10):1000-1012.
  20. Tian, C., Masry, M., and Lipson, H. (2009). Physical sketching: Reconstruction and analysis of 3d objects from freehand sketches. Computer-Aided Design, 41(3):147-158.
  21. Xue, T., Liu, J., and Tang, X. (2010). Object cut: Complex 3d object reconstruction through line drawing separation. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 1149- 1156. IEEE.
  22. Xue, T., Liu, J., and Tang, X. (2012). Example-based 3d object reconstruction from line drawings. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 302-309. IEEE.
  23. Yang, L., Liu, J., and Tang, X. (2013). Complex 3d general object reconstruction from line drawings. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 1433-1440.
  24. Zou, C., Chen, S., Fu, H., and Liu, J. (2014a). Progressive 3d reconstruction of planar-faced manifold objects with drf-based line drawing decomposition. Visualization and Computer Graphics, IEEE Transactions on, PP(99):1-1.
  25. Zou, C., Yang, H., and Liu, J. (2014b). Separation of line drawings based on split faces for 3d object reconstruction. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 692-699.
Download


Paper Citation


in Harvard Style

Zheng J., Wang Y. and Tang Z. (2015). Solid Geometric Object Reconstruction from Single Line Drawing Image . In Proceedings of the 10th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2015) ISBN 978-989-758-087-1, pages 391-400. DOI: 10.5220/0005261203910400


in Bibtex Style

@conference{grapp15,
author={Jinxin Zheng and Yongtao Wang and Zhi Tang},
title={Solid Geometric Object Reconstruction from Single Line Drawing Image},
booktitle={Proceedings of the 10th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2015)},
year={2015},
pages={391-400},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005261203910400},
isbn={978-989-758-087-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2015)
TI - Solid Geometric Object Reconstruction from Single Line Drawing Image
SN - 978-989-758-087-1
AU - Zheng J.
AU - Wang Y.
AU - Tang Z.
PY - 2015
SP - 391
EP - 400
DO - 10.5220/0005261203910400