A MAPREDUCE FRAMEWORK FOR CHANGE PROPAGATION IN GEOGRAPHIC DATABASES

Ferdinando Di Martino, Salvatore Sessa, Giuseppe Polese, Mario Vacca

2009

Abstract

Updating a schema is a very important activity which occurs naturally during the life cycle of database systems, due to different causes. A challenging problem arising when a schema evolves is the change propagation problem, i.e. the updating of the database ground instances to make them consistent with the evolved schema. Spatial datasets, a stored representation of geographical areas, are VLDBs and so the change propagation process, involving an enormous mass of data among geographical distributed nodes, is very expensive and call for efficient processing. Moreover, the problem of designing languages and tools for spatial data sets change propagation is relevant, for the shortage of tools for schema evolution, and, in particular, for the limitations of those for spatial data sets. In this paper, we take in account both efficiency and limitations and we propose an instance update language, based on the efficient and popular Map-Reduce Google programming paradigm, which allows to perform in a parallel way a wide category of schema changes. A system embodying the language has been implementing.

References

  1. Arctur, D. and Zeiler, M. (2004). Designing Geodatabases: Case Studies in GIS Data Modeling. ESRI Press, Redlands (CA).
  2. Balovnev, O. T., Breunig, M., Cremers, A. B., and Shumilov, S. S. (2000). Extending geotoolkit to access distributed spatial data and operations. In SSDBM, pages 259-261.
  3. Banerjee, J., Kim, W., Kim, H.-J., and Korth, H. F. (1987). Semantics and implementation of schema evolution in object-oriented databases. In Dayal, U. and Traiger, I. L., editors, SIGMOD Conference, pages 311-322. ACM Press.
  4. Bertino, E. (1992). A view mechanism for object-oriented databases. In Pirotte, A., Delobel, C., and Gottlob, G., editors, EDBT, volume 580 of Lecture Notes in Computer Science, pages 136-151. Springer.
  5. Brèche, P. (1996). Advanced principles for changing schemas of object databases. In Constantopoulos, P., Mylopoulos, J., and Vassiliou, Y., editors, CAiSE, volume 1080 of Lecture Notes in Computer Science, pages 476-495. Springer.
  6. chih Yang, H., Dasdan, A., Hsiao, R.-L., and Jr., D. S. P. (2007). Map-reduce-merge: simplified relational data processing on large clusters. In Chan, C. Y., Ooi, B. C., and Zhou, A., editors, SIGMOD Conference, pages 1029-1040. ACM.
  7. Chu, C.-T., Kim, S. K., Lin, Y.-A., Yu, Y., Bradski, G. R., Ng, A. Y., and Olukotun, K. (2006). Map-reduce for machine learning on multicore. In Schölkopf, B., Platt, J. C., and Hoffman, T., editors, NIPS, pages 281-288. MIT Press.
  8. Dean, J. and Ghemawat, S. (2004). Mapreduce: Simplified data processing on large clusters. In OSDI, pages 137- 150.
  9. Ferrandina, F., Meyer, T., Zicari, R., Ferran, G., and Madec, J. (1995). Schema and database evolution in the o2 object database system. In Dayal, U., Gray, P. M. D., and Nishio, S., editors, VLDB, pages 170-181. Morgan Kaufmann.
  10. Gorawski, M. and Malczok, R. (2003). Distributed spatial data warehouse. In Wyrzykowski, R., Dongarra, J., Paprzycki, M., and Wasniewski, J., editors, PPAM, volume 3019 of Lecture Notes in Computer Science, pages 676-681. Springer.
  11. Koufakou, A., Ortiz, E. G., Georgiopoulos, M., Anagnostopoulos, G. C., and Reynolds, K. M. (2007). A scalable and efficient outlier detection strategy for categorical data. In ICTAI (2), pages 210-217. IEEE Computer Society.
  12. Lagorce, J.-B., Stockus, A., and Waller, E. (1997). Objectoriented database evolution. In Afrati, F. N. and Kolaitis, P. G., editors, ICDT, volume 1186 of Lecture Notes in Computer Science, pages 379-393. Springer.
  13. Lerner, B. S. (2000). A model for compound type changes encountered in schema evolution. ACM Trans. Database Syst., 25(1):83-127.
  14. Malinowski, E. and Zimányi, E. (2006). Requirements specification and conceptual modeling for spatial data warehouses. In Meersman, R., Tari, Z., and Herrero, P., editors, OTM Workshops (2), volume 4278 of Lecture Notes in Computer Science, pages 1616-1625. Springer.
  15. Ozsu, M. T. (2003). Distributed database systems. In Encyclopedia of information systems, pages 673-682.
  16. Ram, S. and Shankaranarayanan, G. (2003). Research issues in database schema evolution: the road not taken. Univ. of Arizona, Working Paper #2003-15.
  17. Twumasi, B. O. (2002). Modelling spatial object behaviours in object-relational geodatabase. Int. Inst. for Geo-inf. Science and Earth Observ. (ITC), Master thesis.
  18. Yeung, A. K. W. and Hall, G. B. (2007). Spatial Database Systems: Design, Implementation and Project Management (GeoJournal Library). Springer-Verlag New York, Inc., Secaucus, NJ, USA.
  19. Yuhong, W. and Jun, C. (2007). Generic framework and key issues for updates propagation between heterogeneous spatial databases. In ISPRS Workshop on Updating Geo-spatial Databases with Imagery & The 5th ISPRS Workshop on DMGIS, pages 215-221.
  20. Zeiler, M. (1999). Modeling Our World: The ESRI Guide to Geodatabase Design. ESRI Press, Redlands (CA).
  21. Zicari, R. (1991). A framework for schema updates in an object-oriented database system. In ICDE, pages 2- 13. IEEE Computer Society.
Download


Paper Citation


in Harvard Style

Di Martino F., Sessa S., Polese G. and Vacca M. (2009). A MAPREDUCE FRAMEWORK FOR CHANGE PROPAGATION IN GEOGRAPHIC DATABASES . In Proceedings of the 11th International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-989-8111-84-5, pages 31-36. DOI: 10.5220/0001861300310036


in Bibtex Style

@conference{iceis09,
author={Ferdinando Di Martino and Salvatore Sessa and Giuseppe Polese and Mario Vacca},
title={A MAPREDUCE FRAMEWORK FOR CHANGE PROPAGATION IN GEOGRAPHIC DATABASES},
booktitle={Proceedings of the 11th International Conference on Enterprise Information Systems - Volume 1: ICEIS,},
year={2009},
pages={31-36},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001861300310036},
isbn={978-989-8111-84-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - A MAPREDUCE FRAMEWORK FOR CHANGE PROPAGATION IN GEOGRAPHIC DATABASES
SN - 978-989-8111-84-5
AU - Di Martino F.
AU - Sessa S.
AU - Polese G.
AU - Vacca M.
PY - 2009
SP - 31
EP - 36
DO - 10.5220/0001861300310036