A Single Performance Characteristic for the Evaluation of Seeker Tracking Algorithms

Leo Doktorski, Eckart Michaelsen, Endre Repasi

2013

Abstract

This paper presents a single numerical performance characteristic for the evaluation of seeker tracking algorithms. It concentrates on ship IR seeker tracking algorithms. Assessing the threat from guided missiles needs a sound evaluation of their performance. The main goal is to introduce a characteristic which is able to assess the threat for ships depending on various scenario pa-rameters. It is shown that for these applications such a single characteristic is sufficient. In order to achieve this seven popular tracking algorithms are used for this. Synthetic IR image sequences are generated to simulate a large set of attack approaches and assemble sufficient statistics on the behavior of the algorithms. The introduced characteristic can also be used for investigations on algorithms themselves, e.g. for sensitivity analyses and parameter optimization of a single algorithm, and for comparison of different algorithms.

References

  1. Anderson D. R., Moore J., Montgomery J., Chambliss M.: Infrared Seeker Performance Metrics. SBIR A02-158: Phase I SBIR, Final Report (2003) http://www.dtic.mil/cgibin/GetTRDoc?AD=ADA419746
  2. Bernardin K., Stiefelhagen R.: Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics. EURASIP J. on Image and Video Processing (2008)
  3. Edward K. K., Matthew P. D., Michael B. H.: An Information Theoretic Approach for Tracker Performance Evaluation. Computer Vision, 2009 IEEE 12th International Conference on 2009, (2009) 1523-1529
  4. Gerlach H.: Digitale Bildfolgenauswertung zum Wiederfinden von Objekten in natürlicher Umgebung. FGAN-FIM, Karlsruhe, Final Report (1979)
  5. Hudson R. D.: Infrared System Engineering. John Wiley & Sons, New York, (1969)
  6. de Jong W., Dam F. A., Kunz G. J., Schleijpen R. M. A.: IR Seeker Simulator and IR Scene Generation to Evaluate IR Decoy Effectiveness. Proc. SPIE 5615, (2004) 100-11
  7. de Jong W., van den Broek S. P., van der Nol R.: IR Seeker Simulator to Evaluate IR Decoy Effectiveness. Proc. SPIE 4718, (2002) 164-172
  8. Legault R.: Reticle and Image Analyses. Chap. 17 in The Infrared Handbook, W. L. Wolfe, G. J. Zissis, Eds., Office of Naval Research, Department of the Navy, Washington, DC (1989)
  9. Nasburg R. E.: Tracking and Control Systems. Chap. 5 in Electro-Optical Systems Design, Analysis, and Testing, M. C. Dudznik, Ed., Vol. 4, Infrared Information Analysis Center, Environmental Research Institute of Michigan, Ann Harbor, Michigan, USA (1993)
  10. Needham C.J., Boyle D.: Performance Evaluation Metrics and Statistics for Positional Tracker Evaluation. Proc. of the Computer Vision Systems: Third International Conference, ICVS 2003, 2626, Graz, Austria (2003) 278-289
  11. Lavailee P. D., Lightfoot J. A., Chambliss M. A., Kimbel C., Griffin J. R.: Methodology for Evaluating Autonomous IR Tracker Performance. 2002 Ground Targets Modeling and Validation Conference Houghton, MI, August 5-8, (2002)
  12. Schleijpen H. M. A.: Evaluation of Infrared-Signature Suppression of Ships. Proc. SPIE 2742, (1996) 245-254
  13. Schleijpen R. H. M. A.: Toolset for Evaluating Infrared Countermeasures and Signature Reduction for Ships. Proc. SPIE 7836, (2010)
  14. Schoemaker R., Schleijpen R.: Evaluation Tools for the Effectiveness of Infrared Countermeasures and Signature Reduction for Ships. Proc. SPIE 7662, (2010)
  15. Suzuki K.: Analysis of Rising-Sun Reticle. Opt. Eng. 18(3), (1979) 350-351
  16. Vaitekunas D. A.: IR Susceptibility of Naval Ships Using ShipIR/NTCS. Proc. SPIE 7662, (2010)
  17. Yujue L., Jinglong Y.: Performance Evaluation of Imaging Seeker Tracking Algorithm Based on Multi-Features. International Symposium on Photoelectronic Detection and Imaging 2011: Advances in Infrared Imaging and Applications. Proc. SPIE, 8193, (2011) 81932A-81932A-7
Download


Paper Citation


in Harvard Style

Doktorski L., Michaelsen E. and Repasi E. (2013). A Single Performance Characteristic for the Evaluation of Seeker Tracking Algorithms . In Proceedings of the 4th International Workshop on Image Mining. Theory and Applications - Volume 1: IMTA-4, (VISIGRAPP 2013) ISBN 978-989-8565-50-1, pages 3-13. DOI: 10.5220/0004391100030013


in Bibtex Style

@conference{imta-413,
author={Leo Doktorski and Eckart Michaelsen and Endre Repasi},
title={A Single Performance Characteristic for the Evaluation of Seeker Tracking Algorithms},
booktitle={Proceedings of the 4th International Workshop on Image Mining. Theory and Applications - Volume 1: IMTA-4, (VISIGRAPP 2013)},
year={2013},
pages={3-13},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004391100030013},
isbn={978-989-8565-50-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 4th International Workshop on Image Mining. Theory and Applications - Volume 1: IMTA-4, (VISIGRAPP 2013)
TI - A Single Performance Characteristic for the Evaluation of Seeker Tracking Algorithms
SN - 978-989-8565-50-1
AU - Doktorski L.
AU - Michaelsen E.
AU - Repasi E.
PY - 2013
SP - 3
EP - 13
DO - 10.5220/0004391100030013