MOTION MAP GENERATION FOR MAINTAINING THE TEMPORAL COHERENCE OF BRUSH STROKES

Youngsup Park, KyungHyun Yoon

Abstract

Painterly animation is a method that expresses images with a handpainted appearance from a video, and the most crucial element for it is the coherence between frames. A motion map generation is proposed in this paper as a resolution to the issue of maintaining the coherence in the brush strokes between the frames. A motion map refers to the range of motion calculated by their magnitudes and directions between the frames with the edge of the previous frame as a point of reference. The different methods of motion estimation used in this paper include the optical flow method and the block-based method, and the method that yielded the biggest PSNR using the motion information (the directions and magnitudes) acquired by various methods of motion estimation has been chosen as the final motion information to form a motion map. The created motion map determined the part of the frame that should be re-painted. In order to maintain the temporal coherence, the motion information was applied to only the strong edges that determine the directions of the brush strokes. Also, this paper sought to reduce the flickering phenomenon between the frames by using the multiple exposure method and the difference map created by the difference between images of the source and the canvas. Maintenance of the coherence in the direction of the brush strokes was also attempted by a local gradient interpolation in an attempt to maintain the structural coherence.

References

  1. Beier, T. and Neely, S. (1992). Feature based image metamorphosis. In SIGGRAPH'92, pages 35-42.
  2. Deng, Y., Kenney, C., Moore, M., and Manjunath, B. (1999a). Peer group filtering and perceptual color image quantization. In ISCAS'99, pages 21-24.
  3. Deng, Y., Manjunath, B., and Shin, H. (1999b). Color image segmentation. In CVPR'99, pages 2446-2451.
  4. Hays, J. and Essa, I. (2004). Image and video based painterly animation. In NPAR'2004, pages 113-120.
  5. Hertzmann, A. (1998). Painterly rendering with curved brush strokes of multiple sizes. In SIGGRAPH'98, pages 453-460.
  6. Hertzmann, A. and Perlin, K. (2000). Painterly rendering for video and interaction. In NPAR'2000, pages 7-12.
  7. Horn, B. and Schunck, B. (1981). Determining optical flow. In Artifitial Intelligence, pages 185-203.
  8. Koga, T., Iinuma, K., Hirano, A., Iijima, Y., and Ishiguro, T. (1981). Motion-compensated interframe coding for video. In NTC'81, pages 531-534.
  9. Laybourne, K. (1998). Animation Book. Three Reviers Press, 2nd edition.
  10. Litwinowicz, P. (1997). Processing images and video for an impressionist. In SIGGRAPH'97, pages 407-414.
  11. Lucas, B. and Kanade, T. (1981). An iterative image registration technique with an application to stereo vision. In DARPA Image Understanding Workshop, pages 121-130.
  12. Park, Y. and Yoon, K. (2004). Adaptive brush stroke generation for painterly rendering. In EG'04 - Short Presentations, pages 65-68.
  13. Tekalp, A. M. (1995). Digital Video Processing. PrenticeHall, 2nd edition.
Download


Paper Citation


in Harvard Style

Park Y. and Yoon K. (2006). MOTION MAP GENERATION FOR MAINTAINING THE TEMPORAL COHERENCE OF BRUSH STROKES . In Proceedings of the First International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, ISBN 972-8865-39-2, pages 158-167. DOI: 10.5220/0001354101580167


in Bibtex Style

@conference{grapp06,
author={Youngsup Park and KyungHyun Yoon},
title={MOTION MAP GENERATION FOR MAINTAINING THE TEMPORAL COHERENCE OF BRUSH STROKES},
booktitle={Proceedings of the First International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP,},
year={2006},
pages={158-167},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001354101580167},
isbn={972-8865-39-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the First International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP,
TI - MOTION MAP GENERATION FOR MAINTAINING THE TEMPORAL COHERENCE OF BRUSH STROKES
SN - 972-8865-39-2
AU - Park Y.
AU - Yoon K.
PY - 2006
SP - 158
EP - 167
DO - 10.5220/0001354101580167