A Novel Real-time Edge-Preserving Smoothing Filter

Simon Reich, Alexey Abramov, Jeremie Papon, Florentin Wörgötter, Babette Dellen


The segmentation of textured and noisy areas in images is a very challenging task due to the large variety of objects and materials in natural environments, which cannot be solved by a single similarity measure. In this paper, we address this problem by proposing a novel edge-preserving texture filter, which smudges the color values inside uniformly textured areas, thus making the processed image more workable for color-based image segmentation. Due to the highly parallel structure of the method, the implementation on a GPU runs in realtime, allowing us to process standard images within tens of milliseconds. By preprocessing images with this novel filter before applying a recent real-time color-based image segmentation method, we obtain significant improvements in performance for images from the Berkeley dataset, outperforming an alternative version using a standard bilateral filter for preprocessing. We further show that our combined approach leads to better segmentations in terms of a standard performance measure than graph-based and mean-shift segmentation for the Berkeley image dataset.


  1. Abramov, A. (2012). Compression of the visual data into symbol-like descriptors in terms of the cognitive real-time vision system. PhD thesis, Georg-AugustUniversität Göttingen.
  2. Abramov, A., Pauwels, K., Papon, J., Wörgötter, F., and Dellen, B. (2012). Real-time segmentation of stereo videos on a portable system with a mobile gpu. IEEE Transactions on Circuits and Systems for Video Technology.
  3. Cigla, C. and Aydin Alatan, A. (2008). Depth assisted object segmentation in multi-view video. In 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video, 2008, pages 185 -188.
  4. Comaniciu, D. and Meer, P. (2002). Mean shift: a robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(5):603 -619.
  5. Du, W., Tian, X., and Sun, Y. (2011). A dynamic threshold edge-preserving smoothing segmentation algorithm for anterior chamber oct images based on modified histogram. In 4th International Congress on Image and Signal Processing (CISP), volume 2, pages 1123 -1126.
  6. Durand, F. and Dorsey, J. (2002). Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph., 21(3):257-266.
  7. Elad, M. (2002). On the origin of the bilateral filter and ways to improve it. IEEE Transactions on Image Processing, 11(10):1141 - 1151.
  8. Farbman, Z., Fattal, R., Lischinski, D., and Szeliski, R. (2008). Edge-preserving decompositions for multiscale tone and detail manipulation. ACM Trans. Graph., 27(3):67:1-67:10.
  9. Farmer, M. and Jain, A. (2005). A wrapper-based approach to image segmentation and classification. IEEE Transactions on Image Processing, 14(12):2060 -2072.
  10. Farsiu, S., Elad, M., and Milanfar, P. (2006). Multiframe demosaicing and super-resolution of color images. IEEE Transactions on Image Processing, 15(1):141 -159.
  11. Felzenszwalb, P. and Huttenlocher, D. (2004). Efficient graph-based image segmentation. International Journal of Computer Vision, 59:167-181.
  12. Jiang, W., Baker, M. L., Wu, Q., Bajaj, C., and Chiu, W. (2003). Applications of a bilateral denoising filter in biological electron microscopy. Journal of Structural Biology, 144(1-2):114 - 122.
  13. Lev, A., Zucker, S. W., and Rosenfeld, A. (1977). Iterative enhancemnent of noisy images. IEEE Transactions on Systems, Man and Cybernetics, 7(6):435 -442.
  14. Martin, D., Fowlkes, C., and Malik, J. (2004). Learning to detect natural image boundaries using local brightness, color, and texture cues. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(5):530 -549.
  15. Martin, D., Fowlkes, C., Tal, D., and Malik, J. (2001). A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In Proc. 8th Int'l Conf. Computer Vision, volume 2, pages 416-423.
  16. Muneyasu, M., Maeda, T., Yako, T., and Hinamoto, T. (1995). A realization of edge-preserving smoothing filters using layered neural networks. In IEEE International Conference on Neural Networks, Proceedings., volume 4, pages 1903 -1906 vol.4.
  17. Paris, S. and Durand, F. (2007). A topological approach to hierarchical segmentation using mean shift. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1 -8.
  18. R., R. and W., S. (2003). Adaptive demosaicking. J. Electron. Imaging, 12(12):633.
  19. Sun, D., Roth, S., and Black, M. (2010). Secrets of optical flow estimation and their principles. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2432 -2439.
  20. Tomasi, C. and Manduchi, R. (1998). Bilateral filtering for gray and color images. In Sixth International Conference on Computer Vision, pages 839 -846.
  21. Xiao, J., Cheng, H., Sawhney, H., Rao, C., and Isnardi, M. (2006). Bilateral filtering-based optical flow estimation with occlusion detection. In Leonardis, A., Bischof, H., and Pinz, A., editors, Computer Vision - ECCV 2006, volume 3951 of Lecture Notes in Computer Science, pages 211-224. Springer Berlin / Heidelberg.
  22. Yang, Q., Wang, S., and Ahuja, N. (2010). Svm for edgepreserving filtering. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1775 - 1782.

Paper Citation

in Harvard Style

Reich S., Abramov A., Papon J., Wörgötter F. and Dellen B. (2013). A Novel Real-time Edge-Preserving Smoothing Filter . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013) ISBN 978-989-8565-47-1, pages 5-14. DOI: 10.5220/0004214300050014

in Bibtex Style

author={Simon Reich and Alexey Abramov and Jeremie Papon and Florentin Wörgötter and Babette Dellen},
title={A Novel Real-time Edge-Preserving Smoothing Filter},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013)},

in EndNote Style

JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013)
TI - A Novel Real-time Edge-Preserving Smoothing Filter
SN - 978-989-8565-47-1
AU - Reich S.
AU - Abramov A.
AU - Papon J.
AU - Wörgötter F.
AU - Dellen B.
PY - 2013
SP - 5
EP - 14
DO - 10.5220/0004214300050014