PHOTO REPAIR AND 3D STRUCTURE FROM FLATBED SCANNERS

Ruggero Pintus, Thomas Malzbender, Oliver Wang, Ruth Bergman, Hila Nachlieli, Gitit Ruckenstein

2009

Abstract

We introduce a technique that allows 3D information to be captured from a conventional flatbed scanner. The technique requires no hardware modification and allows untrained users to easily capture 3D datasets. Once captured, these datasets can be used for interactive relighting and enhancement of surface detail on physical objects. We have also found that the method can be used to scan and repair damaged photographs. Since the only 3D structure on these photographs will typically be surface tears and creases, our method provides an accurate procedure for automatically detecting these flaws without any user intervention. Once detected, automatic techniques, such as infilling and texture synthesis, can be leveraged to seamlessly repair such damaged areas. We first present a method that is able to repair damaged photographs with minimal user interaction and then show how we can achieve similar results using a fully automatic process.

References

  1. Barsky, S., and Petrou, M. 2003. The 4-Source Photometric Stereo Technique for Three-Dimensional Surfaces in the Presence of Highlights and Shadows, IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 25, No. 10, pp. 1239-1252.
  2. Bergman, R., Maurer, R., Nachlieli, H., Ruckenstein, G., Chase, P., and Greig, D. 2007. Comprehensive Solutions for Automatic Removal of Dust and Scratches from Images, Journal of Electronic Imaging.
  3. Brown, B., Toler-Franklin, C., Nehad, D., Burns, M., Dobkin, D., Vlachopoulos, A., Doumas, C., Rusinkiewicz, S., Weyrich, T., “A System for HighVolume Acquisition and Matching of Fresco Fragments: Reassembling Theran Wall Paintings”, ACM Transactions on Graphics, Vol. 27, No. 3, pp.83:1-9, August 2008.
  4. Buades, A., Coll, B., and Morel, J. 2005. A Review of Image Denoising Algorithms, With a New One, Multiscale Modeling and Simulation (SIAM interdisciplinary journal), Vol 4 (2), pp. 490 - 530.
  5. Chantler, M., and Spense, A. 2004. Apparatus and Method for Obtaining Surface Texture Information, Patent GB 0424417.4.
  6. Efros, A., and Leung, T. 1999. Texture Synthesis by Nonparametric Sampling. In Proceedings of IEEE Internation Conference on Computer Vision, September.
  7. Fattal, R., Agrawala, M., and Rusinkiewicz, S. 2007. Multiscale Shape and Detail Enhancement from Multiple-light Image Collections, ACM Transactions on Graphics, 26 (3).
  8. Freeth, T., Bitsakis, Y., Moussas, X., Seiradakis, J., Tselikas, A., Mangou, H., Zafeiropoulou, M., Hadland, R., Bate, D., Ramsey, A., Allen, M., Crawley, A., Hockley, P., Malzbender, T., Gelb, D., Ambrisco, W., and Edmunds, M. 2006. Decoding the Ancient Greek Astronomical Calculator known as the Antikythera Mechanism, Nature, Vol. 444, Nov. 30, pp. 587 - 591.
  9. Gardner, A., Tchou, C., Hawkins, T., and Debevec, P. 2003 Linear Light Source Reflectometry, ACM Transactions on Graphics, Vol. 22, No. 3, pp. 749-758.
  10. Hammer, O., Bengston, S., Malzbender, T., and Gelb, D. 2002. Imaging Fossils Using Reflectance Transformation and Interactive Manipulation of Virtual Light Sources, Palaeontologia Electronica · August 23.
  11. Hastie, T., Tibshirani, R., and Friedman, J. 2001. The Elements of Statistical Learning - Data Mining, Inference, and Prediction. Springer-Velag.
  12. Hewlett-Packard G4050 Photo Scanner, 2007. www.hp.com.
  13. Horn, P. 1986. Robot Vision, MIT Press, ISBN 0-262- 08159-8.
  14. Klette, R., Schluns, K., and Koschan, A. 1998. Computer Vision: Three-Dimensional Data from Images, Springer -Verlag.
  15. Kschischang, F. R., Frey, B. J., and Loeliger, H. A. 2001. Factor Graphs and the Sum-Product Algorithm, IEEE Transaction on Information Theory, Vol. 47, No. 2.
  16. Malzbender, T., Gelb, D., and Wolters, H. 2001. Polynomial Texture Maps. In Proceedings of ACM Siggraph 2001, ACM Press / ACM SIGGRAPH, New York. E. Fiume, Ed., Computer Graphics Proceedings, Annual Conference Series, ACM, 519-528.
  17. Medioni, G., Lee,M., and Tang, C. 2000. A Computational Framework for Segmentation and Grouping, Elsevier.
  18. Onn, R., and Bruckstein, A. 1990 Integrability Disambiguates Surface Recovery in Two-Image Photometric Stereo, International Journal of Computer Vision, vol. 5, pp. 105-113.
  19. Petrovic, N., Cohen, I., Frey, B. J., Koetter, R., and Huang, T. S. 2001. Enforcing Integrability for Surface Reconstruction Algorithms Using Belief Propagation in Graphical Models, 2001 IEEE Conf. on Computer Vision and Pattern Recognition, vol. 1, pp. 743-748.
  20. Schubert, R. 2000. Using a Flatbed Scanner as a Stereoscopic Near-Field Camera, IEEE Computer Graphics and Applications, pp. 38-45.
  21. Toler-Franklin, C., Finkelstein, A., and Rusinkiewics, S. 2007. Illustration of Complex Real-World Objects using Images with Normals, International Symposium on Non-Photorealistic Animation and Rendering.
  22. Tu, P., and Mendonca, P. R. S., 2003. Surface Reconstruction via Helmholtz Reciprocity with a Single Image Pair, Proc. of 2003 IEEE Computer Society Conference on computer Vision and Pattern Recognition (CVPR'03), pp. 541-547.
  23. Yang, J., Ohnishi, N., and Sugie, N. 2003. Two Image Photometric Stero Method, Proc. SPIE, Intelligent Robots and Computer Vision XI, Vol. 1826, pp. 452- 463.
Download


Paper Citation


in Harvard Style

Pintus R., Malzbender T., Wang O., Bergman R., Nachlieli H. and Ruckenstein G. (2009). PHOTO REPAIR AND 3D STRUCTURE FROM FLATBED SCANNERS . In Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009) ISBN 978-989-8111-69-2, pages 40-50. DOI: 10.5220/0001789500400050


in Bibtex Style

@conference{visapp09,
author={Ruggero Pintus and Thomas Malzbender and Oliver Wang and Ruth Bergman and Hila Nachlieli and Gitit Ruckenstein},
title={PHOTO REPAIR AND 3D STRUCTURE FROM FLATBED SCANNERS },
booktitle={Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009)},
year={2009},
pages={40-50},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001789500400050},
isbn={978-989-8111-69-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009)
TI - PHOTO REPAIR AND 3D STRUCTURE FROM FLATBED SCANNERS
SN - 978-989-8111-69-2
AU - Pintus R.
AU - Malzbender T.
AU - Wang O.
AU - Bergman R.
AU - Nachlieli H.
AU - Ruckenstein G.
PY - 2009
SP - 40
EP - 50
DO - 10.5220/0001789500400050