Benchmarking with TPC-H on Off-the-Shelf Hardware - An Experiments Report

Anna Thanopoulou, Paulo Carreira, Helena Galhardas

Abstract

Most medium-sized enterprises run their databases on inexpensive off-the-shelf hardware; still, they need quick answers to complex queries, like ad-hoc Decision Support System (DSS) ones. Thus, it is important that the chosen database system and its tuning be optimal for the specific database size and design. Such choice can be made in-house, based on tests with academic database benchmarks. This paper focuses on the TPC-H database benchmark that aims at measuring the performance of ad-hoc DSS queries. Since official TPC-H results feature large databases and run on high-end hardware, we attempt to assess whether the test is meaningfully downscalable and can be performed on off-the-shelf hardware. We present the benchmark and the steps that a non-expert must take to run the tests. In addition, we report our own benchmark tests, comparing an open-source and a commercial database server running on off-the-shelf hardware when varying parameters that affect the performance of DSS queries.

References

  1. Guehis, S., Goasdoue-Thion, V., and Rigaux, P. (2009). Speeding-up data-driven applications with program summaries. In IDEAS'09, 2009 Int'l Database Engineering and Applications Symposium. ACM Press.
  2. Oracle (2006). Conducting a data warehouse benchmark.
  3. Scalzo, B. (2007). Top 10 Benchmarking Misconceptions. Quest Software, 121007 edition.
  4. Somogyi, S., Wenisch, T., Ailamaki, A., and Falsa, B. (2009). Spatio-temporal memory streaming. In ISCA'09, 36th Annual Int'l Symposium on Computer Architecture. ACM Press.
Download


Paper Citation


in Harvard Style

Thanopoulou A., Carreira P. and Galhardas H. (2012). Benchmarking with TPC-H on Off-the-Shelf Hardware - An Experiments Report . In Proceedings of the 14th International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-989-8565-10-5, pages 205-208. DOI: 10.5220/0004004402050208


in Bibtex Style

@conference{iceis12,
author={Anna Thanopoulou and Paulo Carreira and Helena Galhardas},
title={Benchmarking with TPC-H on Off-the-Shelf Hardware - An Experiments Report},
booktitle={Proceedings of the 14th International Conference on Enterprise Information Systems - Volume 1: ICEIS,},
year={2012},
pages={205-208},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004004402050208},
isbn={978-989-8565-10-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 14th International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - Benchmarking with TPC-H on Off-the-Shelf Hardware - An Experiments Report
SN - 978-989-8565-10-5
AU - Thanopoulou A.
AU - Carreira P.
AU - Galhardas H.
PY - 2012
SP - 205
EP - 208
DO - 10.5220/0004004402050208