Authors:
Yasunobu Imamura
1
;
Naoya Higuchi
1
;
Takeshi Shinohara
1
;
Kouichi Hirata
1
and
Tetsuji Kuboyama
2
Affiliations:
1
Kyushu Institute of Technology, Kawazu 680-4, Iizuka 820-8502 and Japan
;
2
Gakushuin University, Mejiro 1-5-1, Toshima, Tokyo 171-8588 and Japan
Keyword(s):
Annealing by Increasing Resampling, Simulated Annealing, Logit, Probit, Meta-heuristics, Optimization.
Abstract:
Annealing by Increasing Resampling (AIR) is a stochastic hill-climbing optimization by resampling with increasing size for evaluating an objective function. In this paper, we introduce a unified view of the conventional Simulated Annealing (SA) and AIR. In this view, we generalize both SA and AIR to a stochastic hill-climbing for objective functions with stochastic fluctuations, i.e., logit and probit, respectively. Since the logit function is approximated by the probit function, we show that AIR is regarded as an approximation of SA. The experimental results on sparse pivot selection and annealing-based clustering also support that AIR is an approximation of SA. Moreover, when an objective function requires a large number of samples, AIR is much faster than SA without sacrificing the quality of the results.