that contain key interactions at a number of different
higher orders, the task of finding the significant coef-
ficients becomes a great problem. Work on heuristics
for finding the significant high order coefficients in
a sparse coefficient space is ongoing. One approach
is to build a probabilistic model of the importance of
different neurons and connection orders and sample
coefficients from that model. As more coefficients are
found, the quality of the model improves and allows
the faster discovery of others.
REFERENCES
Augasta, M. and Kathirvalavakumar, T. (2012). Rule ex-
traction from neural networks - a comparative study.
pages 404–408. cited By (since 1996)0.
Bartlett, E. B. (1994). Dynamic node architecture learning:
An information theoretic approach. Neural Networks,
7(1):129–140.
Baum, E. B. and Haussler, D. (1989). What size net gives
valid generalization? Neural Comput., 1(1):151–160.
Beauchamp, K. (1984). Applications of Walsh and Related
Functions. Academic Press, London.
Castillo, P. A., Carpio, J., Merelo, J., Prieto, A., Rivas, V.,
and Romero, G. (2000). Evolving multilayer percep-
trons.
Elman, J. L. (1990). Finding structure in time. Cognitive
Science, 14(2):179–211.
Gorman, R. P. and Sejnowski, T. J. (1988). Analysis of
hidden units in a layered network trained to classify
sonar targets. Neural Networks, 1(1):75–89.
Hruschka, E. R. and Ebecken, N. F. (2006). Extract-
ing rules from multilayer perceptrons in classification
problems: A clustering-based approach. Neurocom-
puting, 70(13):384 – 397. Neural Networks Selected
Papers from the 7th Brazilian Symposium on Neural
Networks (SBRN ’04) 7th Brazilian Symposium on
Neural Networks.
Jian-guo, W., Jian-hong, Y., Wen-xing, Z., and Jin-wu, X.
(2008). Rule extraction from artificial neural network
with optimized activation functions. In Intelligent Sys-
tem and Knowledge Engineering, 2008. ISKE 2008.
3rd International Conference on, volume 1, pages
873–879. IEEE.
Jivani, K., Ambasana, J., and Kanani, S. (2014). A sur-
vey on rule extraction approaches based techniques
for data classification using neural network. Interna-
tional Journal of Futuristic Trends in Engineering and
Technology, 1(1).
Kamimura, R. (1993). Principal hidden unit analysis with
minimum entropy method. In Gielen, S. and Kappen,
B., editors, ICANN 1993, pages 760–763. Springer
London.
Krogh, A. and Vedelsby, J. (1994). Neural network ensem-
bles, cross validation, and active learning. In NIPS,
pages 231–238.
Kulluk, S.,
¨
Ozbakir, L., and Baykaso
˘
glu, A. (2013). Fuzzy
difaconn-miner: A novel approach for fuzzy rule ex-
traction from neural networks. Expert Systems with
Applications, 40(3):938 – 946. FUZZYSS11: 2nd In-
ternational Fuzzy Systems Symposium 17-18 Novem-
ber 2011, Ankara, Turkey.
Rumelhart, D. E., Hinton, G. E., and Williams, R. J. (1986).
Parallel distributed processing: Explorations in the
microstructure of cognition, vol. 1. chapter Learning
Internal Representations by Error Propagation, pages
318–362. MIT Press, Cambridge, MA, USA.
Saad, E. and Wunsch II, D. (2007). Neural network explana-
tion using inversion. Neural Networks, 20(1):78–93.
cited By (since 1996)22.
Sanger, D. (1989). Contribution analysis: A technique for
assigning responsibilities to hidden units in connec-
tionist networks. Connection Science, 1(2):115–138.
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan,
D., Goodfellow, I. J., and Fergus, R. (2013). Intriguing
properties of neural networks. CoRR, abs/1312.6199.
Uphadyaya, B. and Eryurek, E. (1992). Application of neu-
ral networks for sensor validation and plant monitor-
ing. Neural Technology, (97):170–176.
Walsh, J. (1923). A closed set of normal orthogonal func-
tions. Amer. J. Math, 45:5–24.
Weigend, A. S., Huberman, B. A., and Rumelhart, D. E.
(1992). Predicting Sunspots and Exchange Rates with
Connectionist Networks. In Casdagli, M. and Eubank,
S., editors, Nonlinear modeling and forecasting, pages
395–432. Addison-Wesley.
Widrow, B. and Lehr, M. (1990). 30 years of adaptive neu-
ral networks: perceptron, madaline, and backpropaga-
tion. Proceedings of the IEEE, 78(9):1415–1442.
Yao, X. (1999). Evolving artificial neural networks. In Pro-
ceedings of the IEEE, volume 87, pages 1423–1447.
NCTA2014-InternationalConferenceonNeuralComputationTheoryandApplications
14