ARDO: AUTOMATIC REMOVAL OF DYNAMIC OBJECTS - Exclude Moving Objects Automatically from a Collection of Images using a Consumer Camera

Patrik Goorts, Philippe Bekaert

2012

Abstract

We present a novel method to remove tourists, cars and other moving objects from photos of monuments, buildings and other attractions. Typically, this is a manual process. Nevertheless, our method is fully automatic and requires neither image stabilization or advanced hardware during acquisition. The method requires a set of images taken from roughly the same location using any consumer photo or video camera and synthesizes the decluttered result using two phases. In the first phase, these images are aligned on to each other using image features and affine transformations. The second phase merges the images to the final result using a median-based per pixel filtering. The results are pleasant looking, even with moving clouds and trees, and outperforms other techniques considering quality and manual intervention.

References

  1. Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. (2004). Interactive digital photomontage. In SIGGraph-04, pages 294-302.
  2. Battiato, S., Gallo, G., Puglisi, G., and Scellato, S. (2007). Sift features tracking for video stabilization. In Image Analysis and Processing, 2007. ICIAP 2007. 14th International Conference on, pages 825-830. IEEE.
  3. Bertalmio, M., Sapiro, G., Caselles, V., and Ballester, C. (2000). Image inpainting. In Proceedings of the 27th annual conference on Computer graphics and interactive techniques, pages 417-424. ACM Press/AddisonWesley Publishing Co.
  4. Censi, A., Fusiello, A., and Roberto, V. (1999). Image stabilization by features tracking. In Image Analysis and Processing, 1999. Proceedings. International Conference on, pages 665-667. IEEE.
  5. Chang, J., Hu, W., Cheng, M., and Chang, B. (2002). Digital image translational and rotational motion stabilization using optical flow technique. Consumer Electronics, IEEE Transactions on, 48(1):108-115.
  6. Hartley, R. and Zisserman, A. (2000). Multiple view geometry, volume 6. Cambridge university press.
  7. Hoffman, M. (2010). Automatic tourist remover. http://www.tipsquirrel.com/index.php/2010/07/autom atic-tourist-remover/.
  8. Hu, R., Shi, R., Shen, I., and Chen, W. (2007). Video stabilization using scale-invariant features. In Information Visualization, 2007. IV'07. 11th International Conference, pages 871-877. IEEE.
  9. Kumar, S., Azartash, H., Biswas, M., and Nguyen, T. (2011). Real-time affine global motion estimation using phase correlation and its application for digital image stabilization. Image Processing, IEEE Transactions on, 99:1-1.
  10. Litvin, A., Konrad, J., and Karl, W. (2003). Probabilistic video stabilization using kalman filtering and mosaicking. In Proceedings of SPIE Conference on Electronic Imaging, pages 663-674. Citeseer.
  11. Lowe, D. G. (1999). Object recognition from local scaleinvariant features. In Computer Vision, 1999., volume 2, pages 1150-1157. Ieee.
  12. Pinto, B. and Anurenjan, P. (2011). Surf based robust video stabilization using kalman filter. In ICTT Electronics and Communication.
  13. Rousseeuw, P., Leroy, A., and Wiley, J. (1987). Robust regression and outlier detection, volume 3. Wiley Online Library.
  14. Snapmania (2011). Snapmania tourist remover. http://www.snapmania.com/info/en/trm/.
  15. Szeliski, R. (2006). Image alignment and stitching: A tutorial. Foundations and Trends in Computer Graphics and Vision, 2(1):1-104.
Download


Paper Citation


in Harvard Style

Goorts P. and Bekaert P. (2012). ARDO: AUTOMATIC REMOVAL OF DYNAMIC OBJECTS - Exclude Moving Objects Automatically from a Collection of Images using a Consumer Camera . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2012) ISBN 978-989-8565-03-7, pages 192-196. DOI: 10.5220/0003843001920196


in Bibtex Style

@conference{visapp12,
author={Patrik Goorts and Philippe Bekaert},
title={ARDO: AUTOMATIC REMOVAL OF DYNAMIC OBJECTS - Exclude Moving Objects Automatically from a Collection of Images using a Consumer Camera},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2012)},
year={2012},
pages={192-196},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003843001920196},
isbn={978-989-8565-03-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2012)
TI - ARDO: AUTOMATIC REMOVAL OF DYNAMIC OBJECTS - Exclude Moving Objects Automatically from a Collection of Images using a Consumer Camera
SN - 978-989-8565-03-7
AU - Goorts P.
AU - Bekaert P.
PY - 2012
SP - 192
EP - 196
DO - 10.5220/0003843001920196