A FRAMEWORK FOR ON-DEMAND INTEGRATION OF ENTERPRISE DATA SOURCES

Matti Heikkurinen, Tapio Niemi, Marko Niinimäki, Vesa Sivunen

2004

Abstract

Deploying a data warehouse system in a company is usually an expensive and risky investement. Constructing a data warehouse is a large project that can take very long time and a company cannot know in advance exactly what benefits a data warehouse will offer. Thus, in many cases, data warehousing projects have either been abandoned or been shown to be at least partial failures. We propose a new method by providing a platform to implement business intelligence systems on. The basic idea is to construct the analysis database (i.e. an OLAP cube) on demand and only include the data that is needed for the analysis at hand from the operational databases. In this way the data is always up-to-date, suitable for the current analysis, and some of the biggest risks associated with data warehouse systems can be avoided. In addition, external data can be included in the analysis. The computational costs related to the cube construction are likely to remain at acceptable level, since only the relevant part of the data for the current analysis is needed from operational databases. We outline the use of Grid techologies in the implementation to offer a cost-effective way to harness enough computing power used on parallel processing and sufficient security infrastructure (GSI). To deal with heterogenous data sources the XML language with XSL transformations is applied.

References

  1. Akinde, M., Bhlen, M., Johnson, T., and et al. (2003). Ef - cient OLAP query processing in distributed data warehouses. Information Systems, 28.
  2. Altova (2003). Altova corp. Available on: http://www.altova.com.
  3. Chaudhuri, S. and Dayal, U. (1997). An overview of data warehousing and OLAP technology. SIGMOD Rec., 26(1):65-74.
  4. European DataGrid (2002). European datagrid. Available on: http://www.eu-datagrid.org.
  5. Ewusi-Mensah, K. (1997). Critical issues in abandoned information systems development projects. Communications of the ACM, 9(40):74-80.
  6. Foster, I., Kesselman, C., and Tuecke, S. (2001). The anatomy of the Grid: Enabling scalable virtual organizations. International Journal of Supercomputer Applications, 15(3).
  7. Housley, R., Ford, W., Polk, W., and Solo, D. (1999). Rfc 2459, internet x.509 public key infrastructure certi cate and crl pro le. Available on http://www.ietf.org/rfc/rfc2459.txt.
  8. Karppinen, J., Niemi, T., and Niinimäki, M. (2003). Mobile analyzer - new concept for next generation of distributed computing. In CCGrid 2003. A poster.
  9. Mohania, M., Samtani, S., Roddick, J., and Kambayashi, Y. (1999). Advances and research directions in data warehousing technology. Australian Journal of Information Systems.
  10. Niemi, T., Niinimaki, M., Nummenmaa, J., and Thanisch, P. (2003a). Applying grid technologies to XML based OLAP cube constraction.
  11. Niemi, T., Niinimäki, M., and Sivunen, V. (2003b). Integrating distributed heterogeneous databases and distributed grid computing. In ICEIS 2003, volume 1, pages 96-103. ICEIS Press.
  12. Pedersen, D., Riis, K., and Pedersen, T. B. (2002). Query optimization for OLAP-XML federations. In DOLAP 2002, pages 57-64. ACM Press.
  13. Sypherlink, I. (2003). Data warehousing. Available on: http://www.sypherlink.com/ solutions/dataware.asp.
  14. The Globus project (2002). Commodity Grid Kits. Available on: http://www-unix.globus.org/cog/.
  15. World Wide Web Consortium (1999).
  16. transformations (XSLT). Available http://www.w3.org/TR/xslt.
Download


Paper Citation


in Harvard Style

Heikkurinen M., Niemi T., Niinimäki M. and Sivunen V. (2004). A FRAMEWORK FOR ON-DEMAND INTEGRATION OF ENTERPRISE DATA SOURCES . In Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 972-8865-00-7, pages 604-608. DOI: 10.5220/0002655806040608


in Bibtex Style

@conference{iceis04,
author={Matti Heikkurinen and Tapio Niemi and Marko Niinimäki and Vesa Sivunen},
title={A FRAMEWORK FOR ON-DEMAND INTEGRATION OF ENTERPRISE DATA SOURCES},
booktitle={Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 1: ICEIS,},
year={2004},
pages={604-608},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002655806040608},
isbn={972-8865-00-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - A FRAMEWORK FOR ON-DEMAND INTEGRATION OF ENTERPRISE DATA SOURCES
SN - 972-8865-00-7
AU - Heikkurinen M.
AU - Niemi T.
AU - Niinimäki M.
AU - Sivunen V.
PY - 2004
SP - 604
EP - 608
DO - 10.5220/0002655806040608