Towards a Comprehensive XML Benchamrk

Fatima Al-Sedairi, Mohammed Al-Badawi, Abdallah Al-Hamdani

2015

Abstract

XML benchmarks are tools used for measuring and evaluating the performance of new XML developments such as XML/RDBMS/OO mapping techniques and XML storages. With XML benchmarks, the evaluation process is done by executing predefined query-set over the benchmark's dataset members; where the performance of the new development is compared against the performance of some existing techniques. Yet, none of the existing XML benchmarks seems directly investigated the effect of sought data location on the query performance. This research is an attempt to investigate the rationale of adding the Data Dimension (DD) to the 3D~XBench features. To achieve this, a new set of queries was added to the query-set of the 3D~XBench to test the effect of changing the location of the sought records. The preliminarily experimental results have shown that the query execution time is also driven by the location of the sought data in the underlying XML database; and therefore, the Data Dimension can be added to the existing features of the 3D XML Benchmark.

References

  1. Afanasiev, L., Manolescu, I., and Michiels, P., 2005. MemBeR: A Micro-Benchmark Repository for XQuery. In Proceedings of 3rd International XML Database Symposium, LNCS. Springer-Verlag.
  2. Al-Badawi, M., North, S., and Eaglestone, B., 2010. The 3D XML Benchmark. In the proceedings of the WebIST'10, pp. 13-20, Valencia, Spain.
  3. Böhme, T. and Rahm, E., 2001. XMach-1: a Benchmark for XML Data Management. In Datenbank systeme in BuroTechnik und Wissenschaft, 9. GI-Fachtagung, pp.264-273, Springer-Verlag, London, UK.
  4. Bressan, S., Lee, M-L., Li, Y.G., Lacroix, Z. and Nambiar, U., 2003. The XOO7 benchmark. In Proceedings of VLDB 2002 Workshop EEXTT and CAiSE 2002 Workshop, pp.146-147, London, UK.
  5. Carey, M. J., Ling, L., Nicola, M., and Shao, L., 2011. Exrt: Towards a simple benchmark for xml readiness testing. In Performance Evaluation, Measurement and Characterization of Complex Systems, pp. 93-109. Springer Berlin Heidelberg.
  6. DBLP, 2014. The DBLP Website, Available at http://dblp.uni-trier.de/, [Accessed on 13/116/2014].
  7. Franceschet., M., 2005. XPathMark: an XPath benchmark for XMark generated data. International XML Database Symposium (XSYM).
  8. Florescu, D., and Kossmann, D., 1999. A Performance Evaluation of alternative Mapping Schemas for Storing XML Data in a Relational Database. INRIA Rocquencourt, France
  9. Gray J., 1993. The Benchmark Handbook for Database and Transaction Systems. Morgan Kaufmann, San Francisco, CA, USA, ISBN 1-55860-292-5.
  10. Jiang, H., Lu, H., Wang, W., and Yu, J., 2002. XParent: An Efficient RDBMS-Based XML Database System. International conference on Data Engineering, pages 1- 2, CA, USA.
  11. Mlynkova, I,. 2008. XML Benchmarking. IADIS International Conference Informatics, pages 59- 66.
  12. Nicola, M., Kogan, I., and Schiefer, B., 2007. An XML Transaction Processing Benchmark. In Proceedings of ACM SIGMOD international conference on Management of data (pp. 937-948).
  13. PennProj, 2014. The Penn Treebank Project. Available online at http://www.cis.upenn.edu/treebank/, [Accessed on: 13/11/2014].
  14. Roy, J., and Ramanujan, A., 2000. XML: data's universal language. IT Professional, 2(3), 32-36.
  15. Runapongsa, K., Patel, M., Jagadish, H., Chen, Y., and AlKhalifa, S., 2006. The Michigan Benchmark: Towards XML Query Performance Diagnostics. International Journal of Information systems, 31(2), pages 73-97.
  16. Sakr, S., 2010. Towards a comprehensive assessment for selectivity estimation approaches of XML queries. International Journal of Web Engineering and Technology, 6(1), 58-82.
  17. Schmidt, A., Waas, F., Kersten, M., Carey, D., Manolescu, I., and Busse. R., 2002. XMark: A Benchmark for XML Data Management. International conference on VLDB, Hong Kong, pages 1-12.
  18. Yao, B. B., Ozsu, M. T., and Khandelwal, N., 2004. XBench benchmark and performance testing of XML DBMSs. In IEEE Proceedings, 20th International Conference on Data Engineering (pp. 621-632).
  19. Zhang, X., Liu, K., Zou, L., Du, X., and Wang, S., 2011. Renda-RX: A Benchmark for Evaluating XMLRelational Database System. LNCS, Volume 6897, 2011, pp 578-589.
Download


Paper Citation


in Harvard Style

Al-Sedairi F., Al-Badawi M. and Al-Hamdani A. (2015). Towards a Comprehensive XML Benchamrk . In Proceedings of the 11th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST, ISBN 978-989-758-106-9, pages 112-117. DOI: 10.5220/0005474101120117


in Bibtex Style

@conference{webist15,
author={Fatima Al-Sedairi and Mohammed Al-Badawi and Abdallah Al-Hamdani},
title={Towards a Comprehensive XML Benchamrk},
booktitle={Proceedings of the 11th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,},
year={2015},
pages={112-117},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005474101120117},
isbn={978-989-758-106-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,
TI - Towards a Comprehensive XML Benchamrk
SN - 978-989-758-106-9
AU - Al-Sedairi F.
AU - Al-Badawi M.
AU - Al-Hamdani A.
PY - 2015
SP - 112
EP - 117
DO - 10.5220/0005474101120117