Dimensionality Reduction of Features using Multi Resolution Representation of Decomposed Images

Avi Bleiweiss

2014

Abstract

A common objective in multi class, image analysis is to reduce the dimensionality of input data, and capture the most discriminant features in the projected space. In this work, we investigate a system that first finds clusters of similar points in feature space, using a nearest neighbor, graph based decomposition algorithm. This process transforms the original image data on to a subspace of identical dimensionality, but at a much flatter, color gamut. The intermediate representation of the segmented image, follows an effective, local descriptor operator that yields a marked compact feature vector, compared to the one obtained from a descriptor, immediately succeeding the native image. For evaluation, we study a generalized, multi resolution representation of decomposed images, parameterized by a broad range of a decreasing number of clusters. We conduct experiments on both non and correlated image sets, expressed in raw feature vectors of one million elements each, and demonstrate robust accuracy in applying our features to a linear SVM classifier. Compared to state-of-the-art systems of identical goals, our method shows increased dimensionality reduction, at a consistent feature matching performance.

References

  1. Arya, S. and Mount, D. M. (1993). Approximate nearest neighbor queries in fixed dimensions. In ACM-SIAM Symposium on Discrete Algorithms, pages 271-280.
  2. Bellman, R. E. (1961). Adaptive Control Processes. Princeton University Press, Princeton, NJ.
  3. BSDS (2002). Berkeley Segmentation Dataset and Benchmark. http://www.eecs.berkeley.edu/Research/ Projects/CS/vision/bsds/.
  4. Burges, C. J. C. (2005). Geometric methods for feature extraction and dimensional reduction: A guided tour. In The Data Mining and Knowledge Discovery Handbook, pages 59-92. Springer.
  5. Cormen, T. H., Leiserson, C. H., Rivest, R. L., and Stein, C. (1990). Introduction to Algorithms. MIT Press/McGraw-Hill Book Company, Cambridge, MA.
  6. Dalal, N. and Triggs, B. (2005). Histograms of oriented gradients for human detection. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 886-893, San Diego, CA.
  7. Felzenszwalb, P. F., Girshick, R. B., McAllester, D., and Ramanan, D. (2010). Object detection with discriminatively trained part based models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(9):1627-1645.
  8. Felzenszwalb, P. F. and Huttenlocher, D. P. (2004). Efficient graph-based image segmentation. International Journal of Computer Vision, 59(2):167-181.
  9. GTFD (1999). Georgia Tech Face Database. www.anefian.com/research/face reco.htm.
  10. He, X. and Niyogi, P. (2003). Locality preserving projections. In Advances in Neural Information Processing Systems 16. MIT Press, Cambridge, MA.
  11. Joachims, T. (1999). Making large-scale SVM learning practical. In Advances in Kernel Methods: Support Vector Learning, pages 169-184. MIT Press, Cambridge, MA.
  12. Jolliffe, I. T. (1986). Principal Component Analysis. Springer, New York, NY.
  13. Ke, J. and Sukthankar, R. (2004). PCA-SIFT: A more distinctive representation for local image descriptors. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 506-513, Washington, DC.
  14. Kobayashi, T., Hidaka, A., and Kurita, T. (2007). Selection of histogram of oriented gradients features for pedestrian detection. In International Conference on Neural Information Processing (ICONIP), pages 598- 607, Kitakyushu, Japan.
  15. Lin, Y., Liu, T., and Fuh, C. (2011). Multi kernel learning for dimensionality reduction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(6):1147-1160.
  16. Mao, L. and Xie, M. (2012). Improving human detection operators by dimensionality reduction. Information Technology Journal, 11(12):1696-1704.
  17. Ravi Kanth, K. V., Agrawal, D., and Singh, A. (1998). Dimensionality reduction for similarity searching in dynamic databases. In International Conference on Management of Data (SIGMOD), pages 166-176, New York, NY.
  18. Salton, G., Wong, A., and Yang, C. S. (1975). A Vector Space Model for Automatic Indexing. Communications of the ACM, 18(11):613-620.
  19. Santle Camilus, K. and Govindan, V. K. (2012). A review on graph based segmentation. International Journal on Image, Graphics, and Signal Processing, 4(5):1- 13.
  20. Saul, L. K., Weinberger, K. Q., Ham, J. H., Sha, F., and Lee, D. D. (2006). Spectral methods for dimensionality reduction. In Semi-supervised Learning, pages 293-308. MIT Press, Cambridge, MA.
  21. Wang, Q. J. and Zhang, R. B. (2008). LPP-HOG: A new local image descriptor for fast human detection. In Knowledge Acquisition and Modeling Workshop (KAM), pages 640-643, Wuhan, China.
  22. Wold, H. (1975). Soft modeling by latent variables: the nonlinear iterative partial least squares approach. In Perspectives in Probability and Statistics. Academic Press Inc., London, England.
Download


Paper Citation


in Harvard Style

Bleiweiss A. (2014). Dimensionality Reduction of Features using Multi Resolution Representation of Decomposed Images . In Proceedings of the 3rd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-018-5, pages 316-324. DOI: 10.5220/0004917403160324


in Bibtex Style

@conference{icpram14,
author={Avi Bleiweiss},
title={Dimensionality Reduction of Features using Multi Resolution Representation of Decomposed Images},
booktitle={Proceedings of the 3rd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2014},
pages={316-324},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004917403160324},
isbn={978-989-758-018-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Dimensionality Reduction of Features using Multi Resolution Representation of Decomposed Images
SN - 978-989-758-018-5
AU - Bleiweiss A.
PY - 2014
SP - 316
EP - 324
DO - 10.5220/0004917403160324