Application-Mimes - An Approach for Quantitative Comparison of SQL - and NoSQL-databases

Martin Kammerer, Jens Nimis

Abstract

Due to the rise of NoSQL systems over the last years, the world of commercially applicable database systems has become much larger and heterogeneous than it was ever before. But the opportunities that are associated with the upcoming systems have also introduced a new decision problem that occurs in the information system design process. Once, benchmarking has helped to identify the proper database product among the de facto standard SQL systems. Nowadays, functional and non-functional properties of database systems and their implication on application development are so divergent that not all systems that come into account for realisation of a specific application can be covered by the same benchmark. In this paper we present an approach for experimental comparative information system evaluation that allows for well-grounded selection among diverging database systems. It is based on the concept of so-called application-mimes, i.e. functionally restricted implementations that focus exclusively on the information systems’ interaction with data management and try to mimic the target systems behaviour in this respect as realistic as possible.

References

  1. Bernstein, Ph. A., Das, S., 2013. Rethinking eventual consistency. In SIGMOD 7813, ACM SIGMOD International Conference on Management of Data. ACM.
  2. Cooper, B.F., Silberstein, A., Tam, E., Ramakrishnan, R., Sears, R., et al, 2010. Benchmarking cloud serving systems with YCSB. In: SoCC'10, 1st ACM symposium on Cloud computing, ACM.
  3. DeWitt, D.J., 1993. The Wisconsin Benchmark: Past, present and future. In J. Gray, editor, The Benchmark Handbook. Morgan Kaufmann.
  4. Doppelhammer, J., Höppler, Th., Kemper, A., Kossmann. D., 1997. Database performance in the real world: TPC-D and SAP R/3. In SIGMOD 7897, ACM SIGMOD international conference on Management of data, ACM.
  5. Erinle, B., 2013. Performance Testing with JMeter 2.9, Packt Publishing, Birmingham
  6. Haerder, Th., Reuter, A., 1983. Principles of transactionoriented database recovery. ACM Comput. Surv. 15, 4, ACM.
  7. Hecht, R., Jablonski, S., 2011. NoSQL evaluation: A use case oriented survey. In CSC'11, Int'l Conference on Cloud and Service Computing, IEEE.
  8. Mohan, C., 2013. History repeats itself: sensible and NonsenSQL aspects of the NoSQL hoopla. In EDBT 7813, 16th International Conference on Extending Database Technology. ACM.
  9. Object Management Group, 2013. UML Resource Page http://www.uml.org (last visited: 2013-09-17)
  10. Redmond, E., Wilson, J.R., 2012. Seven databases in seven weeks: a guide to modern databases and the NoSQL movement. Pragmatic Bookshelf, Dallas.
  11. Robinson, I., Webber, J., Eifrem, E., 2013. Graph Databases. O'Reilly, Sebastopol.
  12. Schwartz, B., Zaitsev, P., Tkachenko, V., 2012. MySQL High Performance. O'Reilly, Sebastopol.
  13. Stonebraker, M., 2012. New opportunities for New SQL. Commun. ACM 55, 11. ACM.
  14. Terry, D.B., Demers, A.J., Petersen, K., Spreitzer, M.J., Theimer, M.M., Welch, B.B., 1994. Session guarantees for weakly consistent replicated data. In PDIS'94, 3rd Int'l Conference on Parallel and Distributed Information Systems, IEEE.
  15. Thanopoulou, A., Carreira, P., Galhardas, H., 2012. Benchmarking with TPC-H on Off-the-Shelf Hardware: An Experiments Report. In ICEIS'2012, 14th Int'l Conference on Enterprise Information Systems, SCITEPRESS.
  16. Transaction Processing Performance Council, 2013. About TPC. http://www.tpc.org/information/about/ abouttpc.asp (last visited: 2013-09-16)
  17. Transaction Processing Performance Council, 2013b. Introduction to TPC-C. http://www.tpc.org/tpcc/ default.asp (last visited: 2013-09-16)
Download


Paper Citation


in Harvard Style

Kammerer M. and Nimis J. (2014). Application-Mimes - An Approach for Quantitative Comparison of SQL - and NoSQL-databases . In Proceedings of the 16th International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-989-758-027-7, pages 256-263. DOI: 10.5220/0004896702560263


in Bibtex Style

@conference{iceis14,
author={Martin Kammerer and Jens Nimis},
title={Application-Mimes - An Approach for Quantitative Comparison of SQL - and NoSQL-databases},
booktitle={Proceedings of the 16th International Conference on Enterprise Information Systems - Volume 1: ICEIS,},
year={2014},
pages={256-263},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004896702560263},
isbn={978-989-758-027-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 16th International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - Application-Mimes - An Approach for Quantitative Comparison of SQL - and NoSQL-databases
SN - 978-989-758-027-7
AU - Kammerer M.
AU - Nimis J.
PY - 2014
SP - 256
EP - 263
DO - 10.5220/0004896702560263