Environment Recognition based on Images using Bag-of-Words

Taurius Petraitis, Rytis Maskeliūnas, Robertas Damaševičius, Dawid Połap, Marcin Woźniak, Marcin Gabryel

2017

Abstract

Object and scene recognition solutions have a wide application field from entertainment apps, and medical tools to security systems. In this paper, scene recognition methods and applications are analysed, and the Bag of Words (BoW), a local image feature based scene classification model is implemented. In the BoW model every picture is encoded by a bag of visual features, which shows the quantities of different visual features of an image, but disregards any spatial information. Five different feature detectors and two feature descriptors were analyzed and two best approaches were experimentally chosen as being most effective classifying images into eight outdoor categories: forced feature detection with a grid and description using SIFT descriptor, and feature detection with SURF and description with U-SURF. Support vector machines were used for classification. We also have found that for the task of scene recognition not just the distinct features which are found by common feature detectors are important, but also the features that are uninteresting for them. Indoor scenes were experimentally classified into five categories and worse results were achieved. This shows that indoor scene classification is a much harder task and a model which does not take into account any mid-level scene information like objects of the scene is not sufficient for the task. A computer application was written in order to demonstrate the algorithm, which allows training new classifiers with different parameters and using the trained classifiers to predict the classes of new images.

Paper Citation

in Harvard Style

Petraitis T., Maskeliūnas R., Damaševičius R., Połap D., Woźniak M. and Gabryel M. (2017). Environment Recognition based on Images using Bag-of-Words.In Proceedings of the 9th International Joint Conference on Computational Intelligence - Volume 1: IJCCI, ISBN 978-989-758-274-5, pages 166-176. DOI: 10.5220/0006585601660176

in Bibtex Style

@conference{ijcci17,
author={Taurius Petraitis and Rytis Maskeliūnas and Robertas Damaševičius and Dawid Połap and Marcin Woźniak and Marcin Gabryel},
title={Environment Recognition based on Images using Bag-of-Words},
booktitle={Proceedings of the 9th International Joint Conference on Computational Intelligence - Volume 1: IJCCI,},
year={2017},
pages={166-176},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006585601660176},
isbn={978-989-758-274-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 9th International Joint Conference on Computational Intelligence - Volume 1: IJCCI,
TI - Environment Recognition based on Images using Bag-of-Words
SN - 978-989-758-274-5
AU - Petraitis T.
AU - Maskeliūnas R.
AU - Damaševičius R.
AU - Połap D.
AU - Woźniak M.
AU - Gabryel M.
PY - 2017
SP - 166
EP - 176
DO - 10.5220/0006585601660176