Authors:
Dirk Habich
;
Till Kolditz
;
Juliana Hildebrandt
and
Wolfgang Lehner
Affiliation:
Database Systems Group, Technische Universität Dresden and Germany
Keyword(s):
In-Memory, Database Systems, Error Detection, Error Correction, AN Encoding.
Related
Ontology
Subjects/Areas/Topics:
Data Engineering
;
Database Architecture and Performance
;
Databases and Data Security
;
Query Processing and Optimization
Abstract:
The key objective of database systems is to reliably manage data, whereby high query throughput and low query latency are core requirements. To satisfy these requirements, database systems constantly adapt to novel hardware features. Although it has been intensively studied and commonly accepted that hardware error rates in terms of bit flips increase dramatically with the decrease of the underlying chip structures, most database system research activities neglected this fact, leaving error (bit flip) detection as well as correction to the underlying hardware. Especially for memory, silent data corruption (SDC) as a result of transient bit flips leading to faulty data is mainly detected and corrected at the DRAM and memory-controller layer. However, since future hardware becomes less reliable and error detection as well as correction by hardware becomes more expensive, this free ride will come to an end in the near future. To further provide a reliable data management, an emerging re
search direction will be employing specific and tailored protection techniques at the database system level. Following that, we are currently developing and implementing an adopted system design for state-of-the-art in-memory column stores. In this position paper, we summarize our vision, the current state and outline future work of our research.
(More)