A Novel Approach to Neural Network Design for Natural Language Call Routing

Roman Sergienko, Oleg Akhtiamov, Eugene Semenkin, Alexander Schmitt

2015

Abstract

A novel approach to artificial neural network design using a combination of determined and stochastic optimization methods (the error backpropagation algorithm for weight optimization and the classical genetic algorithm for structure optimization) is described in this paper. The novel approach to GA-based structure optimization has a simplified solution representation that provides effective balance between the ANN structure representation flexibility and the problem dimensionality. The novel approach provides improvement of classification effectiveness in comparison with baseline approaches and requires less computational resource. Moreover, it has fewer parameters for tuning in comparison with the baseline ANN structure optimization approach. The novel approach is verified on the real problem of natural language call routing and shows effective results confirmed with statistical analysis.

References

  1. Bukhtoyarov, V. and Semenkina, O. 2010. Comprehensive evolutionary approach for neural network ensemble automatic design. In Evolutionary Computation (CEC), 2010 IEEE Congress on. IEEE.
  2. Bukhtoyarov, V., Semenkin E. and Sergienko, R. 2011. Evolutionary Approach for Automatic Design of Neural Networks Ensembles for Modeling and Time Series Forecasting. Proceedings of the IADIS International Conference Intelligent Systems and Agents: 93-96.
  3. Cohen, W. 1995. Fast Effective Rule Induction. Proceedings of the Twelfth International Conference on Machine Learning, Lake Tahoe, California.
  4. Debole, F. and Sebastiani, F. 2004. Supervised term weighting for automated text categorization. Text mining and its applications: 81-97. Springer Berlin Heidelberg.
  5. Gasanova, T., Sergienko, R., Semenkin, E., and Minker, W. 2014. Dimension Reduction with Coevolutionary Genetic Algorithm for Text Classification. Proceedings of the 11th International Conference on Informatics in Control, Automation and Robotics (ICINCO), Vol.1:215-222.
  6. Hecht-Nielsen, R. 1989. Theory of the backpropagation neural network. In Neural Networks, 1989. IJCNN., International Joint Conference on:593-605. IEEE.
  7. Ko, Y. 2012. A study of term weighting schemes using class information for text classification. Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval: 1029-1030. ACM.
  8. Lan, M., Tan, C. L., Su, J., and Lu, Y. 2009. Supervised and traditional term weighting methods for automatic text categorization. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 31(4):721-735.
  9. Salton, G. and Buckley, C. 1988. Term-weighting approaches in automatic text retrieval. Information processing & management, 24(5):513-523.
  10. Sebastiani, F. 2002. Machine learning in automated text categorization. ACM computing surveys (CSUR), 34(1):1-47.
  11. Shafait F., Reif M., Kofler C., and Breuel T. M. 2010. Pattern Recognition Engineering. RapidMiner Community Meeting and Conference, 9.
  12. Soucy P. and Mineau G. W. 2005. Beyond TFIDF Weighting for Text Categorization in the Vector Space Model. Proceedings of the 19th International Joint Conference on Artificial Intelligence (IJCAI 2005):1130-1135.
  13. Suhm B., Bers J., McCarthy D., Freeman B., Getty D., Godfrey K., and Peterson P.. 2002. A comparative study of speech in the call center: Natural language call routing vs. touch-tone menus. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems: 283-290. ACM.
  14. WARD SYSTEMS GROUP, INC. (1996) NeuroShell 2 User's Manual.
  15. Whitley, D., Starkweather, T., and Bogart, C. 1990. Genetic algorithms and neural networks: Optimizing connections and connectivity. Parallel computing, 14(3):347-361.
  16. Xu, H. and Li, C. 2007. A Novel term weighting scheme for automated text Categorization. Intelligent Systems Design and Applications, 2007. ISDA 2007. Seventh International Conference on: 759-764. IEEE.
  17. Yang, Y., and Pedersen, J. O. 1997. A comparative study on feature selection in text categorization. ICML, vol. 9:412-420.
Download


Paper Citation


in Harvard Style

Sergienko R., Akhtiamov O., Semenkin E. and Schmitt A. (2015). A Novel Approach to Neural Network Design for Natural Language Call Routing . In Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO, ISBN 978-989-758-122-9, pages 102-109. DOI: 10.5220/0005515401020109


in Bibtex Style

@conference{icinco15,
author={Roman Sergienko and Oleg Akhtiamov and Eugene Semenkin and Alexander Schmitt},
title={A Novel Approach to Neural Network Design for Natural Language Call Routing},
booktitle={Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,},
year={2015},
pages={102-109},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005515401020109},
isbn={978-989-758-122-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,
TI - A Novel Approach to Neural Network Design for Natural Language Call Routing
SN - 978-989-758-122-9
AU - Sergienko R.
AU - Akhtiamov O.
AU - Semenkin E.
AU - Schmitt A.
PY - 2015
SP - 102
EP - 109
DO - 10.5220/0005515401020109