TURNING THE WEB INTO AN EFFECTIVE KNOWLEDGE REPOSITORY

Luís Veiga, Paulo Ferreira

Abstract

The weight of dynamically generated content versus static content has progressed enormously. Preserving accessibility to this type of content raises new issues. However, there are no large-scale mechanisms to enforce referential integrity in the WWW. We propose a system, comprised of a distributed web-proxy and cache architecture, to access and automatically manage web content, static and dynamically generated. It is combined with an implementation of a cyclic distributed garbage collection algorithm. It is scalable, correctly handles dynamic content, enforces referential integrity on the web, and is complete with regard to minimizing storage waste.

References

  1. Bergman, M. K. (2001). The deep web: Surfacing hidden value. The Journal of Electronic Publishing, 7(1).
  2. Bush, V. (1945). As we may think. The Atlantic Monthly, (July).
  3. Chiang, C.-Y., Liu, M. T., and Muller, M. E. (1999). Caching neighborhood protocol: a foundation for building dynamic web caching hierarchies with proxy servers. In International Conference on Parallel Processing.
  4. Creech, M. L. (1996). Author-oriented link management. In Fifth International WWW Conference, France.
  5. HostPulse (2002). Broken-link checker, www.hostpulse.com.
  6. Ingham, D., Caughey, S., and Little, M. (1996). Fixing the "Broken-Link" problem: the W3Objects approach. Computer Networks and ISDN Systems, 28(7- 11):1255-1268.
  7. Kappe, F. (1995). A Scalable Architecture for Maintaining Referential Integrity in Distributed Information Systems. Journal of Universal Computer Science, 1(2).
  8. Lamport, L. (1978). Time, clocks, and the ordering of events in a distributed system. Communications of the ACM, 21(7):558-565.
  9. Lawrence, S., Pennock, D. M., Flake, G. W., Krovetz, R., Coetzee, F. M., Glover, E., Nielsen, F. A., Kruger, A., and Giles, C. L. (2001). Persistence of web references in scienti c research. IEEE Computer, vol 34(2).
  10. LinkAlarm (1998). Linkalarm, http://www.linkalarm.com/.
  11. Moreau, L. and Gray, N. (1998). A community of agents maintaining link integrity in the world wide web. In Proceedings of the 3rd International Conference on the Practical Applications of Agents and Multi-Agent Systems (PAAM-98), London, UK.
  12. Nelson, T. H. (1972). As we will think. In On-line 72 Conference.
  13. O'Neill, E. T., Lavoie, B. F., and Bennett, R. (2003). Trends in the evolution of the public web 1998 - 2002. D-Lib Magazine, 9(4).
  14. Reich, V. and Rosenthal, D. (2001). Lockss: A permanent web publishing and access system. D-Lib M'zine, 7.
  15. Richer, N. and Shapiro, M. (2000). The memory behavior of the WWW, or the WWW considered as a persistent store. In POS 2000, pages 161-176.
  16. Shapiro, M., Dickman, P., and Plainfossé, D. (1992). Robust, dist. references and acyclic garbage collection. In Symp. on Principles of Dist. Computing, pages 135-146, Vancouver (Canada). ACM.
  17. Swaminathan, N. and Raghavan, S. (2000). Intelligent prefetch in www using client behavior characterization. In 8th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, pages 13-19.
  18. Veiga, L. and Ferreira, P. (2003). Complete distributed garbage collection, an experience with rotor. In IEE Research Journals - Software, number 150(5).
  19. XenuLink (1997). Linksleuth http://home.snafu.de/tilman/.
Download


Paper Citation


in Harvard Style

Veiga L. and Ferreira P. (2004). TURNING THE WEB INTO AN EFFECTIVE KNOWLEDGE REPOSITORY . In Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 4: ICEIS, ISBN 972-8865-00-7, pages 154-161. DOI: 10.5220/0002644401540161


in Bibtex Style

@conference{iceis04,
author={Luís Veiga and Paulo Ferreira},
title={TURNING THE WEB INTO AN EFFECTIVE KNOWLEDGE REPOSITORY},
booktitle={Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 4: ICEIS,},
year={2004},
pages={154-161},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002644401540161},
isbn={972-8865-00-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 4: ICEIS,
TI - TURNING THE WEB INTO AN EFFECTIVE KNOWLEDGE REPOSITORY
SN - 972-8865-00-7
AU - Veiga L.
AU - Ferreira P.
PY - 2004
SP - 154
EP - 161
DO - 10.5220/0002644401540161