Acquisition of Aerial Light Fields

Indrajit Kurmi, K. S. Venkatesh

2015

Abstract

Since its inception in computer graphics community light field has drawn a lot of attention and interest. By densly sampling the plenoptic function light fields present an alternative way to represent and produce a faithful reconstruction of 3D scenes. But acquisition of densely sampled light fields require camera arrays, robotic arms or newly developed plenoptic cameras. The light fields captured using the existential technologies are limited to scenes containing limited complexity. In this paper we propose to use unmanned aerial vehicle for acquisition of larger unstructured aerial light fields. We aim to capture light fields of larger objects and scenes which are not possible by traditional light field acquisition setup. We combine the data from IMU and state estimated using homography with a Kalman filter framework. Frames which gives a minimum error (approximation of free form camera surface to traditional parameterization) are selected as perspective images of light fields. Rendering algorithm is devised to support the unstructured camera surface and to avoid rebinning of image data.

References

  1. (1996). Setup used for light field rendering. http://graphics. stanford.edu/papers/light/gantry preview.jpg.
  2. (2002). The stanford spherical gantry. http://graphics. stanford.edu/projects/gantry.
  3. (2004). The stanford multi-camera array. http://graphics. stanford.edu/projects/array.
  4. Amidi, O. (1996). An Autonomous Vision-Guided Helicopter. PhD thesis, Citeseer.
  5. Camahort, E., Lerios, A., and Fussell, D. (1998). Uniformly sampled light fields. pages 117-130. Springer Verlag.
  6. Davis, A., Levoy, M., and Durand, F. (2012). Unstructured light fields. Comp. Graph. Forum, 31(2pt1):305-314.
  7. Diel, D. D., DeBitetto, P., and Teller, S. (2005). Epipolar constraints for vision-aided inertial navigation. In In EEE Workshop on Motion and Video Computing, pages 221-228.
  8. Dusha, D., Boles, W., and Walker, R. (2007). Attitude estimation for a fixed-wing aircraft using horizon detection and optical flow. In Digital Image Computing Techniques and Applications, 9th Biennial Conference of the Australian Pattern Recognition Society on, pages 485-492.
  9. Gortler, S. J., Grzeszczuk, R., Szeliski, R., and Cohen, M. F. (1996). The lumigraph. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 7896, pages 43-54, New York, NY, USA. ACM.
  10. Grabe, V., Blthoff, H. H., and Giordano, P. R. (2012). Onboard velocity estimation and closed-loop control of a quadrotor uav based on optical flow. In ICRA, pages 491-497. IEEE.
  11. Ihm, I., Park, S., and Lee, R. K. (1997). Rendering of spherical light fields. In Proceedings of the 5th Pacific Conference on Computer Graphics and Applications, PG 7897, pages 59-, Washington, DC, USA. IEEE Computer Society.
  12. Indrajit, K., Venkatesh, K., and Sumana, G. (2014). True zoom with cylindrical light feld system. In Chmielewski, L., Kozera, R., Shin, B.-S., and Wojciechowski, K., editors, Computer Vision and Graphics, volume 8671 of Lecture Notes in Computer Science, pages 278-285. Springer International Publishing.
  13. Laboratoire, N. F., Netter, T., and Franceschini, N. (2002). A Robotic Aircraft that Follows Terrain Using a Neuromorphic Eye Thomas Netter. In Conf. Intelligent Robots and System, volume 1, pages 129-134.
  14. Leabourne, K., Rock, S., Fleischer, S., and Burton, R. (1997). Station keeping of an rov using vision technology. In OCEANS 7897. MTS/IEEE Conference Proceedings, volume 1, pages 634-640 vol.1.
  15. Levoy, M. and Hanrahan, P. (1996). Light field rendering. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 7896, pages 31-42, New York, NY, USA. ACM.
  16. Lobo, J. and Dias, J. (1998). Integration of inertial information with vision. In Industrial Electronics Society, 1998. IECON 7898. Proceedings of the 24th Annual Conference of the IEEE, volume 3, pages 1263-1267 vol.3.
  17. Ma, Y., Kos?ecká, J., Soatto, S., and Sastry, S. (2001). An invitation to 3-d vision.
  18. Marks, R. L. (1995). Experiments in Visual Sensing for Automatic Control of an Underwater Robot. phd, Stanford University, Stanford, CA 94305. Also published as SUDAAR 681.
  19. Richmond, K. (2009). Real-time visual mosaicking and navigation on the seafloor. ProQuest.
  20. Roberts, J., Corke, P., and Buskey, G. (2003). Low-cost flight control system for a small autonomous helicopter. In Robotics and Automation, 2003. Proceedings. ICRA 7803. IEEE International Conference on, volume 1, pages 546-551 vol.1.
  21. Roumeliotis, S. I., Johnson, A. E., and Montgomery, J. F. (2002). Augmenting inertial navigation with imagebased motion estimation. In ICRA, pages 4326-4333. IEEE.
  22. Saripalli, S., Roberts, J. M., Corke, P. I., Buskey, G., and Sukhatme, G. (2003). A tale of two helicopters. In Intelligent Robots and Systems, 2003.(IROS 2003). Proceedings. 2003 IEEE/RSJ International Conference on, volume 1, pages 805-810. IEEE.
  23. Sinopoli, B., Micheli, M., Donato, G., and Koo, T. (2001). Vision based navigation for an unmanned aerial vehicle. In Robotics and Automation, 2001. Proceedings 2001 ICRA. IEEE International Conference on, volume 2, pages 1757-1764 vol.2.
  24. Soatto, S., Frezza, R., and Perona, P. (1996). Motion estimation via dynamic vision. Automatic Control, IEEE Transactions on, 41(3):393-413.
Download


Paper Citation


in Harvard Style

Kurmi I. and Venkatesh K. (2015). Acquisition of Aerial Light Fields . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-089-5, pages 272-277. DOI: 10.5220/0005362002720277


in Bibtex Style

@conference{visapp15,
author={Indrajit Kurmi and K. S. Venkatesh},
title={Acquisition of Aerial Light Fields},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={272-277},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005362002720277},
isbn={978-989-758-089-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)
TI - Acquisition of Aerial Light Fields
SN - 978-989-758-089-5
AU - Kurmi I.
AU - Venkatesh K.
PY - 2015
SP - 272
EP - 277
DO - 10.5220/0005362002720277