A PEER-TO-PEER SEARCH IN DATA GRIDS BASED ON ANT COLONY OPTIMIZATION

Uroš Jovanovič, Boštjan Slivnik

2006

Abstract

A method for (1) an efficient discovery of data in large distributed raw datasets and (2) collection of thus procured data is considered. It is a pure peer-to-peer method without any centralized control and is therefore primarily intended for a large-scale, dynamic (data)grid environments. It provides a simple but highly efficient mechanism for keeping the load it causes under control and proves especially usefull if data discovery and collection is to be performed simultaneoulsy with dataset generation. The method supports a user-specified extraction of structured metadata from raw datasets, and automatically performs aggregation of extracted metadata. It is based on the principle of ant colony optimization (ACO). The paper is focused on effective data aggregation and includes the detailed description of the modifications of the basic ACO algorithm that are needed for effective aggregation of the extracted data. Using a simulator, the method was vigorously tested on the wide set of different network topologies for different rates of data extraction and aggregation. Results of the most significant tests are included.

References

  1. Berman, F., Fox, G. C., and Hey, A. J. G. (2003). Grid Computing: Making the Global Infrastructure a Reality. John Wiley and Sons, Ltd., Chichester, England.
  2. Chervenak, A., Foster, I., Kesselman, C., Salisbury, C., and Tuecke, S. (1999). The data grid: Towards an architecture for the distributed management and analysis of large scientific datasets. Journal of Network and Computer Applications, 23:187-200.
  3. C?ibej, U., Slivnik, B., and Robic?, B. (2005). The complexity of static data replication in data grids. Parallel Computing, 31:900-912.
  4. Deneubourg, J. L., Goss, S., Franks, N., Sendova-Franks, A., Detrain, C., and Chretien, L. (1991). The dynamics of collective sorting: Robot-line ants and ant-like robots. In From Animals to Animats 1 (Proceeding of the First International Conference on Simulation of Adaptive Behavior), pages 356-365. The MIT Press, Boston, USA.
  5. Dorigo, M. and Stütlze, T. (2004). Ant Colony Optimization. The MIT Press, Boston, USA.
  6. gLite (2006). EGEE > gLite - Lightweight Middleware for Grid Computing. Retrieved April 28th, 2006, from http://glite.web.cern.ch/glite/.
  7. Globus (2006). The globus alliance. Retrieved April 28th, 2006, from http://www.globus.org/.
  8. Handl, J., Knowles, J., and Dorigo, M. (2006). Ant-based clustering and topographic mapping. Artificial Life, 12(1):35-62.
  9. Jovanovic?, U., Moc?nik, J., Novak, M., Pipan, G., and Slivnik, B. (2006). Using ant colony optimization for collaborative (re)search in data grids. In Proceedings of the Cracow Grid Workshop 7805, Cracow, Poland, pages 205-207.
Download


Paper Citation


in Harvard Style

Jovanovič U. and Slivnik B. (2006). A PEER-TO-PEER SEARCH IN DATA GRIDS BASED ON ANT COLONY OPTIMIZATION . In Proceedings of the First International Conference on Software and Data Technologies - Volume 1: ICSOFT, ISBN 978-972-8865-69-6, pages 363-366. DOI: 10.5220/0001319703630366


in Bibtex Style

@conference{icsoft06,
author={Uroš Jovanovič and Boštjan Slivnik},
title={A PEER-TO-PEER SEARCH IN DATA GRIDS BASED ON ANT COLONY OPTIMIZATION},
booktitle={Proceedings of the First International Conference on Software and Data Technologies - Volume 1: ICSOFT,},
year={2006},
pages={363-366},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001319703630366},
isbn={978-972-8865-69-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the First International Conference on Software and Data Technologies - Volume 1: ICSOFT,
TI - A PEER-TO-PEER SEARCH IN DATA GRIDS BASED ON ANT COLONY OPTIMIZATION
SN - 978-972-8865-69-6
AU - Jovanovič U.
AU - Slivnik B.
PY - 2006
SP - 363
EP - 366
DO - 10.5220/0001319703630366