HARVESTING AND AGGREGATION OF DIGITAL LIBRARIES USING THE OAI FRAMEWORK

Alon Kadury, Ariel J. Frank

Abstract

Digital Libraries (DLs) are an important tool for quality information retrieval over the Internet. However, with the information explosion on the Internet and the increase in the number of DLs, users might need to search several DLs before finding the relevant information looked for. Federated DLs (FDLs) and Harvested DLs (HDLs) can solve this problem. To overcome the lack of uniformity and interoperability problems between DLs and to develop standards that can ease the distribution of information between them, an initiative called OAI established the OAI-PMH (Open Archives Initiative Protocol for Metadata Harvesting) protocol. While this protocol enables the construction of FDLs, HDLs are hardly found. This paper presents the RIDDLE model for construction and aggregation of HDLs using the OAI-PMH protocol with some modifications. The use of RIDDLE can provide for high quality information retrieval from digital libraries on the Internet.

References

  1. Arms, W. Y. (2000). Digital Libraries. MIT Press, Cambridge.
  2. DC, Dublin Core Metadata for Resource Discovery. (1998, September). The Internet Engineering Task Force (IETF). RFC2413. Retrieved August 2006, from www.ietf.org/rfc/rfc2413.txt
  3. DCMI, DCMI Metadata Terms. (2005, June). Dublin Core Metadata Initiative. Retrieved August 2006, from dublincore.org/documents/dcmi-terms/
  4. DDC, Introduction to Dewey Decimal Classification. (2003). OCLC, Forest Press. Retrieved August 2006, www.oclc.org/dewey/versions/ddc22print/intro.pdf
  5. DDCServices, Dewey services. (2006). OCLC, Cataloging and Metadata. Retrieved October 2006, from www.oclc.org/dewey/
  6. Dushay, N., Hillmann, I. D. (2003, October). Analyzing Metadata for Effective Use and Re-use. Dublin Core Conference, Seattle.
  7. Hanani, U., Frank, A. J. (2000, July). Katsir: A Framework for Harvesting Digital Libraries on the Web. ECIS 8th European Conference on Information Systems, Vol. 1, 306-312, Vienna, Austria.
  8. Hanani, U., Frank, A. J. (2000, November). The Parallel Evolution of Search Engines and Digital Libraries: their Convergence to the Mega-Portal. ICDL'00, Kyoto International Conference on Digital Libraries: Research and Practice, Kyoto, Japan, 269-276.
  9. Kadury, A. (2006). Harvesting and Aggregation of Digital Libraries in the OAI framework. Master Thesis, Department of Computer Science, Bar-Ilan University.
  10. Lagoze, C., Krafft, D., Comwell, T., Dushay, N., Eckstrom, D., Sayloy, J. (2006, June). Metadata aggregation and "automated digital libraries": A retrospective on the NSDL experience. JCDL Joint Conference on Digital Libraries, North Carolina, USA, 230-239.
  11. OAI-PMH, The Open Archives Initiative Protocol for Metadata Harvesting, Protocol Version 2.0. (2002). Retrieved August 2006, from www.openarchives.org/OAI/openarchivesprotocol.html
  12. OAIGuide, Implementation Guidelines for the Open Archives Initiative Protocol for Metadata Harvesting. (2002), Open Archives Initiative. Retrieved August 2006, from www.openarchives.org/OAI/2.0/guidelines.html
  13. Sharon, T., Frank, A. J. (2000, August). Digital Libraries on the Internet. 66th IFLA Council and General Conference, Jerusalem, Israel, 13-18.
  14. Suleman, H., Fox, E. (2002). The Open Archives Initiative: Realizing Simple and Effective Digital Library Interoperability. Journal of Library Administration, Vol. 35, Issue 1, 125-145.
  15. Tennant, R. (2004, July). Metadata Bitter Harvest. Library Journal, Vol. 32. Retrieved August 2006, www.libraryjournal.com/article/ca43444322
  16. Van de Sompel, H., Lagoze, C. (2002). Notes from the Interoperability Front: A Progress Report on the Open Archives Initiative. ECDL 6th European Conference on Digital Libraries, 144-157.
  17. Yom Tov, N., Frank, A. J. (2006, October). Harnessing Search Engine Technologies to Increase Awareness and Discovery of Digital Libraries. 4th IEEE International Conference on Information Technology: Research and Education, Israel.
  18. Xiaoming, L. (2001, December). DP9 Service Providers for Web Crawlers. D-Lib Magazine, Vol. 7, No. 12. Retrieved October 2005, from www.dlib.org/dlib/december01/12inbrief.html
Download


Paper Citation


in Harvard Style

Kadury A. and J. Frank A. (2007). HARVESTING AND AGGREGATION OF DIGITAL LIBRARIES USING THE OAI FRAMEWORK . In Proceedings of the Third International Conference on Web Information Systems and Technologies - Volume 2: WEBIST, ISBN 978-972-8865-78-8, pages 441-446. DOI: 10.5220/0001284704410446


in Bibtex Style

@conference{webist07,
author={Alon Kadury and Ariel J. Frank},
title={HARVESTING AND AGGREGATION OF DIGITAL LIBRARIES USING THE OAI FRAMEWORK},
booktitle={Proceedings of the Third International Conference on Web Information Systems and Technologies - Volume 2: WEBIST,},
year={2007},
pages={441-446},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001284704410446},
isbn={978-972-8865-78-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Third International Conference on Web Information Systems and Technologies - Volume 2: WEBIST,
TI - HARVESTING AND AGGREGATION OF DIGITAL LIBRARIES USING THE OAI FRAMEWORK
SN - 978-972-8865-78-8
AU - Kadury A.
AU - J. Frank A.
PY - 2007
SP - 441
EP - 446
DO - 10.5220/0001284704410446