Two-stage Color Texture Synthesis using the Structure Tensor Field

Adib Akl, Charles Yaacoub, Marc Donias, Jean-Pierre Da Costa, Christian Germain

2015

Abstract

Since reproducing the realism of the physical word is a major goal for computer graphics, color texture synthesis is important for rendering synthetic images and animations. Most of the existing synthesis techniques provide impressive results in many cases, but fail in difficult situations with large patterns, or with long range directional variations. Based on a previously developed two-stage structure/texture synthesis algorithm where the structure tensor is used to represent the structure layer, an extension to color texture synthesis is proposed. Two different methods are used for the computation of the color structure tensor field. An acceleration method for the proposed algorithm is also presented. Results show that the proposed approach successfully synthesizes the output texture in many situations where traditional algorithms fail to reproduce the exemplar’s patterns and dynamics. These promising results pave the way towards 3D color textures synthesis showing multi-scale patterns.

References

  1. Bargteil, A. W., Sin, F., Michaels, J. E., Goktekin, T. G., O'Brien, J. F., 2006. "A Texture Synthesis Method for Liquid Animations," Proc. ACM SIGGRAPH/Eurographics Symposium on Computer Animation 2006.
  2. Yamauchi, H., Haber, J., Seidel, H-P., 2003. "Image restoration using multiresolution texture synthesis and image inpainting,” Proc. Int. Conf. Comput. Graph.
  3. Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C., 2000. “Image inpainting,” Proc. of the 27th annual conference on Computer graphics and interactive techniques, pp. 417-424.
  4. Winkenbach, G., Salesin, D. H., 1994. “Computergenerated pen-and-ink illustration,” Proc. of SIGGRAPH 94, pp. 91-100.
  5. Portilla, J., Simoncelli, E.P., 2000. "A Parametric Texture Model based on Joint Statistics of Complex Wavelet Coefficients," Int'l Journal of Computer Vision, vol.40(1), pp. 49-71.
  6. Wei, L.-Y., Levoy, M., 2000. "Fast texture synthesis using tree-structured vector quantization," Proc. of ACM SIGGRAPH 2000, pp. 479-488.
  7. Wei, L.-Y., Levoy, M., 2003. "Texture synthesis from multiple sources," Proc. of ACM SIGGRAPH Sketches & Application.
  8. Paget, R., Longstaff, I.D., 1998. "Texture synthesis via a non causal nonparametric multiscale markov random field," IEEE Trans. on Image Processing, vol. 7(6), pp. 925-931.
  9. Kwatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A., 2003. "Graphcut Textures: Image and Video Synthesis Using Graph Cuts," Proc. of ACM SIGGRAPH, pp. 277-286.
  10. Kopf, J., Fu, C.W., Cohen-Or, D., Deussenn, O., Lischinski, D., Wong, T. T. 2007. "Solid Texture Synthesis from 2D Exemplars," Proc. of ACM SIGGRAPH, vol. 26(3).
  11. Vanhoey, K., Sauvage, B., Larue, F., Dischler, J-M., 2013. “On-the-fly multi-scale infinite texturing from example,” ACM Trans. Graph, 32(6): 208.
  12. Efros, A., Freeman, W. T., 2001. “Image quilting for texture synthesis and transfer,” In SIGGRAPH: Proc. of the 28th annual conference on Computer graphics and interactive techniques, pp. 341-346.
  13. Han, J., Zhou, K., Wei, L.-Y., Gong, M., Bao, H., Zhang, X., Guo, B., 2006. “Fast example-based surface texture synthesis via discrete optimization,” Visual Computer, 22(9), pp. 918-925.
  14. Da Costa, J.-P., Germain, C., 2010. "Synthesis of solid textures based on a 2D example: application to the synthesis of 3D carbon structures observed by transmission electronic microscopy," Proc. of SPIE, Image Processing: Machine Vision Applications III, vol. 7538, pp. 10.
  15. Urs, R. D., 2013. "Non-parametric synthesis of volumetric textures from a 2D sample", PhD Thesis, Univ. Bordeaux I.
  16. Leyssale, J.-M., Da Costa, J.-P., Germain, C., Weisbecker, P., Vignoles, G., 2009. "An image guided atomistic reconstruction of pyrolytic carbons," App Phys Lett., vol. 95(23), pp. 231912.
  17. Leyssale, J.-M., Da Costa, J.-P. Germain, C., Weisbecker, P., Vignoles, G., 2012. "Structural features of pyrocarbon atomistic models constructed from transmission electron microscopy images," Carbon, vol. 50(12), pp. 4388-4400.
  18. Peyré, G., 2009. "Texture Synthesis with grouplets," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 32(4), pp. 733-746.
  19. Akl, A., Yaacoub, C., Donias, M., Da Costa, J.-P., Germain, C., 2014. “Structure Tensor Based Synthesis of Directional Textures for Virtual Material Design,” Proc of ICIP 2014.
  20. Toujas, V., Donias, M., Berthoumieu, Y., 2010. “Structure Tensor Field Regularization Based on Geometric Features,” Proc of EUSIPCO 2010.
  21. Zenzo, S. D., 1986. “A note on the gradient of a multiimage ,” Int'l J. Computer Vision, Graphics Image Process., vol. 33, pp. 116-125.
  22. Weijer, J., Gevers, T., 2004. “Tensor Based Feature Detection for Color Images,” 12th Color Imaging Conference: Color Science and Engineering Systems, Technologies, Applications, pp. 100-105.
  23. García, R., Deriche, R., Alberola-López, C., 2008. “Texture and color segmentation based on the combined use of the structure tensor and the image components,” Signal Processing, vol. 88, pp. 776-795.
  24. ITU-R Recommendation BT.601-7, “Studio encoding parameters of digital television for standard 4:3 and wide screen 16:9 aspect ratios,” ITU-R, Mar. 2011.
  25. Brodatz, P., 1966. A Photographic Album for Artists and Designers. Dover Ed., New York.
Download


Paper Citation


in Harvard Style

Akl A., Yaacoub C., Donias M., Da Costa J. and Germain C. (2015). Two-stage Color Texture Synthesis using the Structure Tensor Field . In Proceedings of the 10th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2015) ISBN 978-989-758-087-1, pages 182-188. DOI: 10.5220/0005358301820188


in Bibtex Style

@conference{grapp15,
author={Adib Akl and Charles Yaacoub and Marc Donias and Jean-Pierre Da Costa and Christian Germain},
title={Two-stage Color Texture Synthesis using the Structure Tensor Field},
booktitle={Proceedings of the 10th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2015)},
year={2015},
pages={182-188},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005358301820188},
isbn={978-989-758-087-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2015)
TI - Two-stage Color Texture Synthesis using the Structure Tensor Field
SN - 978-989-758-087-1
AU - Akl A.
AU - Yaacoub C.
AU - Donias M.
AU - Da Costa J.
AU - Germain C.
PY - 2015
SP - 182
EP - 188
DO - 10.5220/0005358301820188