A Binary Neural Network Framework for Attribute Selection and Prediction

Victoria J. Hodge, Tom Jackson, Jim Austin

2012

Abstract

In this paper, we introduce an implementation of the attribute selection algorithm, Correlation-based Feature Selection (CFS) integrated with our k-nearest neighbour (k-NN) framework. Binary neural networks underpin our k-NN and allow us to create a unified framework for attribute selection, prediction and classification. We apply the framework to a real world application of predicting bus journey times from traffic sensor data and show how attribute selection can both speed our k-NN and increase the prediction accuracy by removing noise and redundant attributes from the data.

References

  1. Austin, J., 1995. Distributed Associative Memories for High Speed Symbolic Reasoning. In IJCAI: Working Notes of Workshop on Connectionist-Symbolic Integration, pp. 87-93.
  2. Bishop, C., 1995. Neural networks for pattern recognition, Oxford University Press, Oxford, UK.
  3. Box, G., Jenkins, G., 1970. Time series analysis: Forecasting and control, San Francisco: Holden-Day.
  4. Cover T., Hart P, 1967. Nearest neighbor pattern classification. IEEE Transactions on Information Theory 13(1): 21-27.
  5. Engle, R., 1982. Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of UK Inflation. Econom., 50: 987-1008.
  6. Fayyad, U., Irani K., 1993. Multi-Interval Discretization of Continuous-Valued Attributes for Classification Learning. In Procs International Joint Conference on Artificial Intelligence, pp. 1022-1029.
  7. Guyon, I. et al., 2002. Gene selection for cancer classification using support vector machines. Mach. Learn., 46(1): 389-422
  8. Hall, M., 1998. Correlation-based Feature Subset Selection for Machine Learning. Ph.D. Thesis, University of Waikato, New Zealand.
  9. Hall, M., Smith, L., 1997. Feature subset selection: a correlation based filter approach. In, International Conference on Neural Information Processing and Intelligent Information Systems, pp. 855-858.
  10. Hodge, V., 2011. Outlier and Anomaly Detection: A Survey of Outlier and Anomaly Detection Methods. LAMBERT Academic Publishing, ISBN: 978-3-8465- 4822-6.
  11. Hodge, V., Austin, J., 2005. A Binary Neural k-Nearest Neighbour Technique. Knowl. Inf. Syst. (KAIS), 8(3): 276-292, Springer-Verlag London Ltd.
  12. Hodge, V. et al., 2004. A High Performance k-NN Approach Using Binary Neural Networks. Neural Netw., 17(3): 441-458, Elsevier Science.
  13. Hodge, V. et al., 2006. A Binary Neural Decision Table Classifier. NeuroComputing, 69(16-18): 1850-1859, Elsevier Science.
  14. Hodge, V. et al., 2011. Short-Term Traffic Prediction Using a Binary Neural Network. 43rd Annual UTSG Conference, Open University, UK, January 5-7.
  15. Jackson, T. et al., 2004. Distributed Health Monitoring for Aero-Engines on the Grid: DAME. In Procs of IEEE Aerospace, Montana, USA, March 6-13.
  16. Kohavi, R. John, G., 1997. Wrappers for Feature Subset Selection. In Artif. Intell. J., Special Issue on Relevance, 97(1-2): 273-324
  17. Krishnan, R. et al., 2010. On Identifying Spatial Traffic Patterns using Advanced Pattern Matching Techniques. In Procs of Transportation Research Board (TRB) 89th Annual Meeting, Washington, D.C.
  18. Labeeuw, W. et al., 2009. Prediction of Congested Traffic on the Critical Density Point Using Machine Learning and Decentralised Collaborating Cameras. Portuguese Conference on Artificial Intelligence, pp. 15-26.
  19. Liu, H., Setiono, R., 1995. Chi2: Feature selection and discretization of numeric attributes. In Procs IEEE 7th International Conference on Tools with Artificial Intelligence, pp. 338-391.
  20. Quinlan, J., 1986. Induction of Decision Trees. Mach, Learn., 1: 81-106.
  21. Vlahogianni, E. et al., 2005. Optimized and metaoptimized neural networks for short-term traffic flow prediction: A genetic approach, Transp. Res. Part C: Emerging Technologies, 13(3) (2005): 211-234.
  22. Weeks, M. et al., 2002. A Hardware Accelerated Novel IR System. In Procs 10th Euromicro Workshop (PDP2002), Gran Canaria, Jan. 9-11, 2002.
  23. Zhou, P. et al., 1999. High Performance k-NN Classifier Using a Binary Correlation Matrix Memory. In Procs Advances in Neural Information Processing Systems Vol. II, MIT Press, Cambridge, MA, USA, 713-719.
Download


Paper Citation


in Harvard Style

J. Hodge V., Jackson T. and Austin J. (2012). A Binary Neural Network Framework for Attribute Selection and Prediction . In Proceedings of the 4th International Joint Conference on Computational Intelligence - Volume 1: NCTA, (IJCCI 2012) ISBN 978-989-8565-33-4, pages 510-515. DOI: 10.5220/0004150705100515


in Bibtex Style

@conference{ncta12,
author={Victoria J. Hodge and Tom Jackson and Jim Austin},
title={A Binary Neural Network Framework for Attribute Selection and Prediction},
booktitle={Proceedings of the 4th International Joint Conference on Computational Intelligence - Volume 1: NCTA, (IJCCI 2012)},
year={2012},
pages={510-515},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004150705100515},
isbn={978-989-8565-33-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 4th International Joint Conference on Computational Intelligence - Volume 1: NCTA, (IJCCI 2012)
TI - A Binary Neural Network Framework for Attribute Selection and Prediction
SN - 978-989-8565-33-4
AU - J. Hodge V.
AU - Jackson T.
AU - Austin J.
PY - 2012
SP - 510
EP - 515
DO - 10.5220/0004150705100515