A HYPER-HEURISTIC FOR SCHEDULING INDEPENDENT JOBS IN COMPUTATIONAL GRIDS

Juan Antonio Gonzalez, Maria Serna, Fatos Xhafa

2007

Abstract

In this paper we present the design and implementation of an hyper-heuristic for efficiently scheduling independent jobs in Computational Grids. An efficient scheduling of jobs to Grid resources depends on many parameters, among others, the characteristics of the Grid infrastructure and job characteristics (such as computing capacity, consistency of computing, etc.). Existing ad hoc scheduling methods (batch and immediate mode) have shown their efficacy for certain types of Grids and job characteristics. However, as stand alone methods, they are not able to produce the best planning of jobs to resources for different types of Grid resources and job characteristics. In this work we have designed and implemented a hyper-heuristic that uses a set of ad hoc (immediate and batch mode) scheduling methods to provide the scheduling of jobs to Grid nodes according to the Grid and job characteristics. The hyper-heuristic is a high level algorithm, which examines the state and characteristics of the Grid system (jobs and resources), and selects and applies the ad hoc method that yields the best planning of jobs to Grid resources. The resulting hyper-heuristic based scheduler can be thus used to develop network-aware applications that need efficient planning of jobs to resources. The Hyper-heuristic has been tested and evaluated in a dynamic setting through a prototype of a Grid simulator. The experimental evaluation showed the usefulness of the hyper-heuristic in planning of jobs to resources as opposed to planning without knowledge of the Grid and jobs characteristics.

References

  1. Abraham, A., Buyya, R., and Nath, B. (2000). Nature's heuristics for scheduling jobs on computational grids. In The 8th IEEE International Conference on Advanced Computing and Communications, India.
  2. Braun, T., Siegel, H., Beck, N., Boloni, L., Maheswaran, M., Reuther, A., Robertson, J., Theys, M., and Yao, B. (2001). A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. Journal of Parallel and Distributed Computing, 61(6):810-837.
  3. Casanova, H. and Dongarra, J. (1998). Netsolve: Network enabled solvers. IEEE Computational Science and Engineering, 5(3):57-67.
  4. Foster, I. and Kesselman, C. (1998). The Grid - Blueprint for a New Computing Infrastructure. Morgan Pub.
  5. Foster, I., Kesselman, C., and Tuecke, S. (2001). The anatomy of the grid. International Journal of Supercomputer Applications, 15(3).
  6. Garey, M. and Johnson, D. (1979). Computers and Intractability - A Guide to the Theory of NPCompleteness. W.H. Freeman and Co.
  7. Linderoth, L. and Wright, S. (2003). Decomposition algorithms for stochastic programming on a computational grid. Computational Optimization and Applications, 24:207-250.
  8. Maheswaran, M., Ali, S., Siegel, H., Hensgen, D., and Freund, R. (1999). Dynamic mapping of a class of independent tasks onto heterogeneous computing systems. Journal of Parallel and Distributed Computing, 59(2):107-131.
  9. Phatanapherom, S. and Kachitvichyanukul, V. (2003). Fast simulation model for grid scheduling using hypersim. In Proceedings of the 2003 Winter Simulation Conference, New Orleans, USA.
  10. Wright, S. (2001). Solving optimization problems on computational grids. Optima, 65.
  11. Wu, M.-Y. and Shu, W. (2001). A high-performance mapping algorithm for heterogeneous computing systems. In Proceedings of the 15th International Parallel & Distributed Processing Symposium, page 74.
Download


Paper Citation


in Harvard Style

Antonio Gonzalez J., Serna M. and Xhafa F. (2007). A HYPER-HEURISTIC FOR SCHEDULING INDEPENDENT JOBS IN COMPUTATIONAL GRIDS . In Proceedings of the Second International Conference on Software and Data Technologies - Volume 1: ICSOFT, ISBN 978-989-8111-05-0, pages 128-135. DOI: 10.5220/0001328701280135


in Bibtex Style

@conference{icsoft07,
author={Juan Antonio Gonzalez and Maria Serna and Fatos Xhafa},
title={A HYPER-HEURISTIC FOR SCHEDULING INDEPENDENT JOBS IN COMPUTATIONAL GRIDS},
booktitle={Proceedings of the Second International Conference on Software and Data Technologies - Volume 1: ICSOFT,},
year={2007},
pages={128-135},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001328701280135},
isbn={978-989-8111-05-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Second International Conference on Software and Data Technologies - Volume 1: ICSOFT,
TI - A HYPER-HEURISTIC FOR SCHEDULING INDEPENDENT JOBS IN COMPUTATIONAL GRIDS
SN - 978-989-8111-05-0
AU - Antonio Gonzalez J.
AU - Serna M.
AU - Xhafa F.
PY - 2007
SP - 128
EP - 135
DO - 10.5220/0001328701280135