often provide good solutions within a reasonable
time but not verify the quality of them. Among
heuristic methods one finds: Construction Methods
(CM), Limited Enumeration Methods (LEM),
Improvement Methods (IM), Tabu Search (TS),
Simulated Annealing (SA), Genetic Algorithms
(GA), Greedy Randomized Adaptive Search
Procedures (GRASP) and Ant Systems (AS). The
goal of this study is to compare how a set of
standard MINLP solvers perform, when the bilinear
QAP formulation is used.
The MINLP solvers are standard GAMS solvers
and uses the following solution techniques:
AlphaECP solves the problem by cutting plane
techniques; Bonmin (Basic Open-source Nonlinear
Mixed Integer programming) uses a simple branch
and bound algorithm and solves a Non-Linear
Programming (NLP) problem in each node;
DICOPT (Discrete and Continuous Optimizer) is an
outer-approximation method; SBB combines a
standard branch and bound method with some of the
NLP solvers in GAMS.
2 SETUP
The basic QAP formulation in (1-3) is modelled in
GAMS 23.6.2 and all solvers are used with default
parameter settings. We use here the following
abbreviations: ECP for AlphaECP, BON for Bonmin
and DOP for DICOPT. 50 problems from the QAP
library are solved: retrieved March 22nd, 2011, from
http://www.seas.upenn.edu/qaplib/. The problems
are selected from the QAP library (Hahn and Anjos,
2002) with the following criteria: 30 ≤ ≤ 90,
where is the size of the square matrices (×).
Thus, the selected set contains problems that are
very difficult to solve to proven optimality with
exact algorithms. Two problems, lipa90a and
lipa90b, with =90 are, however, not included in
the comparison because all solvers stopped within 4
minutes because of a system or memory limitation.
In the first test the solvers are set to solve 50
problems with a 1 hour time limit per problem per
starting point, hence the total solution time may raise
to 3 hours when the solvers are started from 3
random points. The second test batch consists of the
22 problems from the first set, which are the
problems where the global optimal solution is
known. In this test DICOPT is called with a 1 hour
time limit per problem per start point from 50
random points. The test computer is an Intel core i7
with 4 cores of 2,8GHz and 6GB of memory.
3 RESULTS
Table 1 shows how well, in general, the four solvers
solved the problems. Table item “Avg. % from best
solution” describes the average (avg.) deviation in
percentage from the best solutions known reported
in the QAPLIB (Hahn and Anjos, 2002), for the 13
problems where all the solvers found a solution.
Table item “Number of best solutions” denotes for
how many problems a solver found a better solution
than the other three solvers. Note that SBB found a
better solution than the three other solvers for 26
problems, but could not find any solution for 8
problems. Furthermore, it is worth noting the
exceptionally short solution time for DICOPT to
find good solutions.
Table 1: Overall performance of the 4 solvers.
ECP DOP SBB BON
Problems solved 50 50 42 13
Avg. solution time (min) 36 4 35 43
Avg. % from best solution 4.7 5.6 3.7 4.3
Number of best solutions 8 5 26 4
In Table 2 the problem size is included in the
name. The table reveals, for each solver, the best
solution when the solver is started from the 3
starting points. The star in Table 2 indicates that the
best known solution is a global optimal one. None of
the solvers are able to find exceptionally good
solutions compared to the other solvers. Table 3
reveals the improvement for DICOPT when the
solver is started from 50 random starting points
instead of 3. The standard deviation denotes the
standard deviation in the obtained value of the
objective function.
4 CONCLUSIONS
In this study 50 challenging problems from the
QAP-library were solved with some standard
MINLP solvers from GAMS. The compared solvers
were: AlphaECP, Bonmin, DICOPT and SBB.
AlphaECP found good solutions for all the
problems, but typically used the total solution time
available before termination. Bonmin found a
solution only for 13 problems, but 4 of them were
better than any of the other solvers. DICOPT solved
the problems significantly faster than the three other
solvers, but was unable to significantly improve the
solution quality when the solver was started from 50
random start points instead of 3.
SIMULTECH 2011 - 1st International Conference on Simulation and Modeling Methodologies, Technologies and
Applications
410