COVARIANCE BASED FISH TRACKING IN REAL-LIFE UNDERWATER ENVIRONMENT

Concetto Spampinato, Simone Palazzo, Daniela Giordano, Isaak Kavasidis, Fang-Pang Lin, Yun-Te Lin

2012

Abstract

In this paper we present a covariance based tracking algorithm for intelligent video analysis to assist marine biologists in understanding the complex marine ecosystem in the Ken-Ding sub-tropical coral reef in Taiwan by processing underwater real-time videos recorded in open ocean. One of the most important aspects of marine biology research is the investigation of fish trajectories to identify events of interest such as fish preying, mating, schooling, etc. This task, of course, requires a reliable tracking algorithm able to deal with 1) the difficulties of following fish that have multiple degrees of freedom and 2) the possible varying conditions of the underwater environment. To accommodate these needs, we have developed a tracking algorithm that exploits covariance representation to describe the object’s appearance and statistical information and also to join different types of features such as location, color intensities, derivatives, etc. The accuracy of the algorithm was evaluated by using hand-labeled ground truth data on 30000 frames belonging to ten different videos, achieving an average performance of about 94%, estimated using multiple ratios that provide indication on how good is a tracking algorithm both globally (e.g. counting objects in a fixed range of time) and locally (e.g. in distinguish occlusions among objects).

References

  1. Bashir, F. and Porikli, F. (2006). Performance Evaluation of Object Detection and Tracking Systems. In IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS2006).
  2. Bradski, G. R. (1998). Computer Vision Face Tracking For Use in a Perceptual User Interface. Intel Technology Journal, Q2.
  3. Brehmera, P., Chib, T. D., and Mouillotb, D. (2006). Amphidromous fish school migration revealed by combining fixed sonar monitoring (horizontal beaming) with fishing data. Journal of Experimental Marine Biology and Ecology, 334(1):139-150.
  4. Cannavò, F., Giordano, D., Nunnari, G., and Spampinato, C. (2006). Variational method for image denoising by distributed genetic algorithms on grid environment. In Proc. of WETICE-2006, pages 227 - 232.
  5. Comaniciu, D. and Meer, P. (2002). Mean Shift: A Robust Approach Toward Feature Space Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(5):603-619.
  6. Doucet, A., De Freitas, N., and Gordon, N., editors (2001). Sequential Monte Carlo methods in practice. Springer Verlag.
  7. Faro, A., Giordano, D., and Spampinato, C. (2008). Evaluation of the trac parameters in a metropolitan area by fusing visual perceptions and cnn processing of webcam images. IEEE Transactions on Neural Networks, 19(6):1108-1129.
  8. Faro, A., Giordano, D., and Spampinato, C. (2011). Integrating location tracking, traffic monitoring and semantics in a layered its architecture. IET Intelligent Transport Systems, 5(3):197-206.
  9. Forstner, W. and Moonen, B. (1999). A metric for covariance matrices. Technical report, Dept. of Geodesy and Geoinformatics, Stuttgart University.
  10. Gordon, N., Doucet, A., and Freitas, N. (1979). An algorithm for tracking multiple targets. IEEE Trans. Autom. Control, 24(6):843-854.
  11. Morais, E. F., Campos, M. F. M., Padua, F. L. C., and Carceroni, R. L. (2005). Particle filter-based predictive tracking for robust fish counting. Computer Graphics and Image Processing, Brazilian Symposium on, 0:367-374.
  12. Petrell, R., X.Shi, Ward, R., Naiberg, A., and Savage, C. (1997). Determining fish size and swimming speed in cages and tanks using simple video techniques. Aquacultural Engineering, 16(63-84).
  13. Porikli, F., Tuzel, O., and Meer, P. (2005). Covariance tracking using model update based on lie algebra. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition.
  14. Rouse, W. (2007). Marine biology research experiment: Population dynamics of barnacles in the intertidal zone.
  15. Spampinato, C. (2009). Adaptive objects tracking by using statistical features shape modeling and histogram analysis. In Seventh International Conference on Advances in Pattern Recognition, pages 270-273.
  16. Spampinato, C., Chen-Burger, Y.-H., Nadarajan, G., and Fisher, R. B. (2008). Detecting, tracking and counting fish in low quality unconstrained underwater videos. In VISAPP (2), pages 514-519.
  17. Spampinato, C., Giordano, D., Di Salvo, R., Chen-Burger, Y.-H. J., Fisher, R. B., and Nadarajan, G. (2010). Automatic fish classification for underwater species behavior understanding. In Proceedings of the ACM ARTEMIS 2010, pages 45-50, New York, NY, USA. ACM.
  18. Tuzel, O., Porikli, F., and Meer, P. (2006). Region covariance: A fast descriptor for detection and classification. Proc. 9th European Conf. on Computer Vision.
Download


Paper Citation


in Harvard Style

Spampinato C., Palazzo S., Giordano D., Kavasidis I., Lin F. and Lin Y. (2012). COVARIANCE BASED FISH TRACKING IN REAL-LIFE UNDERWATER ENVIRONMENT . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012) ISBN 978-989-8565-04-4, pages 409-414. DOI: 10.5220/0003866604090414


in Bibtex Style

@conference{visapp12,
author={Concetto Spampinato and Simone Palazzo and Daniela Giordano and Isaak Kavasidis and Fang-Pang Lin and Yun-Te Lin},
title={COVARIANCE BASED FISH TRACKING IN REAL-LIFE UNDERWATER ENVIRONMENT},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012)},
year={2012},
pages={409-414},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003866604090414},
isbn={978-989-8565-04-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012)
TI - COVARIANCE BASED FISH TRACKING IN REAL-LIFE UNDERWATER ENVIRONMENT
SN - 978-989-8565-04-4
AU - Spampinato C.
AU - Palazzo S.
AU - Giordano D.
AU - Kavasidis I.
AU - Lin F.
AU - Lin Y.
PY - 2012
SP - 409
EP - 414
DO - 10.5220/0003866604090414