Spotting Differences Among Observations

Marko Rak, Tim König, Klaus-Dietz Tönnies


Identifying differences among the sample distributions of different observations is an important issue in many fields ranging from medicine over biology and chemistry to physics. We address this issue, providing a general framework to detect difference spots of interest in feature space. Such spots occur not only at various locations, they may also come in various shapes and multiple sizes, even at the same location. We deal with these challenges in a scale-space detection framework based on the density function difference of the observations. Our framework is intended for semi-automatic processing, providing human-interpretable interest spots for further investigation of some kind, e.g., for generating hypotheses about the observations. Such interest spots carry valuable information, which we outline at a number of classification scenarios from UCI Machine Learning Repository; namely, classification of benign/malign breast cancer, genuine/forged money and normal/spondylolisthetic/disc-herniated vertebral columns. To this end, we establish a simple decision rule on top of our framework, which bases on the detected spots. Results indicate state-of-the-art classification performance, which underpins the importance of the information that is carried by these interest spots.


  1. Abbass, H. A. (2002). An evolutionary artificial neural networks approach for breast cancer diagnosis. Artificial Intelligence in Medicine, 25:265-281.
  2. Adal, K. M., Sidibe, D., Ali, S., Chaum, E., Karnowski, T. P., and Meriaudeau, F. (2014). Automated detection of microaneurysms using scale-adapted blob analysis and semi-supervised learning. Computer Methods and Programs in Biomedicine, 114:1-10.
  3. Babaud, J., Witkin, A. P., Baudin, M., and Duda, R. O. (1986). Uniqueness of the Gaussian kernel for scalespace filtering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 8:26-33.
  4. Berthonnaud, E., Dimnet, J., Roussouly, P., and Labelle, H. (2005). Analysis of the sagittal balance of the spine and pelvis using shape and orientation parameters. Journal of Spinal Disorders and Techniques, 18:40-47.
  5. Bretzner, L. and Lindeberg, T. (1998). Feature tracking with automatic selection of spatial scales. Computer Vision and Image Understanding, 71:385-392.
  6. Duong, T. and Hazelton, M. L. (2003). Plug-in bandwidth matrices for bivariate kernel density estimation. Journal of Nonparametric Statistics, 15:17-30.
  7. Duong, T. and Hazelton, M. L. (2005). Cross-validation bandwidth matrices for multivariate kernel density estimation. Scandinavian Journal of Statistics, 32:485- 506.
  8. Felzenszwalb, P. F., Girshick, R. B., McAllester, D., and Ramanan, D. (2010). Object detection with discriminatively trained part-based models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32:1627-1645.
  9. Glock, S., Gillich, E., Schaede, J., and Lohweg, V. (2009). Feature extraction algorithm for banknote textures based on incomplete shift invariant wavelet packet transform. In Proceedings of the Annual Pattern Recognition Symposium, volume 5748, pages 422- 431.
  10. Lakemond, R., Sridharan, S., and Fookes, C. (2012). Hessian-based affine adaptation of salient local image features. Journal of Mathematical Imaging and Vision, 44:150-167.
  11. Lindeberg, T. (1996). Edge detection and ridge detection with automatic scale selection. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 465-470.
  12. Lindeberg, T. (1998). Feature detection with automatic scale selection. International Journal of Computer Vision, 30:79-116.
  13. Lindeberg, T. and Garding, J. (1994). Shape-adapted smoothing in estimation of 3-d depth cues from affine distortions of local 2-d brightness structure. In Proceedings of the European Conference on Computer Vision, pages 389-400.
  14. Mikolajczyk, K. and Schmid, C. (2004). Scale & affine invariant interest point detectors. International Journal of Computer Vision, 60:63-86.
  15. Rocha Neto, A. R. and Barreto, G. A. (2009). On the application of ensembles of classifiers to the diagnosis of pathologies of the vertebral column: A comparative analysis. IEEE Latin America Transactions, 7:487- 496.
  16. Rocha Neto, A. R., Sousa, R., Barreto, G. A., and Cardoso, J. S. (2011). Diagnostic of pathology on the vertebral column with embedded reject option. In Pattern Recognition and Image Analysis, volume 6669, pages 588-595. Springer Berlin Heidelberg.
  17. Sain, S. R., Baggerly, K. A., and Scott, D. W. (1992). Crossvalidation of multivariate densities. Journal of the American Statistical Association, 89:807-817.
  18. Seyedhosseini, M., Kumar, R., Jurrus, E., Giuly, R., Ellisman, M., Pfister, H., and Tasdizen, T. (2011). Detection of neuron membranes in electron microscopy images using multi-scale context and Radon-like features. In Proceedings of the International Conference on Medical Image Computing and Computer-assisted Intervention, pages 670-677.
  19. Wand, M. P. and Jones, M. C. (1994). Multivariate plug-in bandwidth selection. Computational Statistics, 9:97- 116.
  20. Wolberg, W. and Mangasarian, O. (1990). Multisurface method of pattern separation for medical diagnosis applied to breast cytology. In Proceedings of the National Academy of Sciences, pages 9193-9196.
  21. Yi, C. and Tian, Y. (2011). Text string detection from natural scenes by structure-based partition and grouping. IEEE Transactions on Image Processing, 20:2594- 2605.
  22. Yuille, A. L. and Poggio, T. A. (1986). Scaling theorems for zero crossings. IEEE Transactions on Pattern Analysis and Machine Intelligence, 8:15-25.

Paper Citation

in Harvard Style

Rak M., König T. and Tönnies K. (2015). Spotting Differences Among Observations . In Proceedings of the International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-076-5, pages 5-13. DOI: 10.5220/0005165300050013

in Bibtex Style

author={Marko Rak and Tim König and Klaus-Dietz Tönnies},
title={Spotting Differences Among Observations},
booktitle={Proceedings of the International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},

in EndNote Style

JO - Proceedings of the International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Spotting Differences Among Observations
SN - 978-989-758-076-5
AU - Rak M.
AU - König T.
AU - Tönnies K.
PY - 2015
SP - 5
EP - 13
DO - 10.5220/0005165300050013