An Efficient Hash Function Construction for Sparse Data

Nir Soffer, Erez Waisbard

2024

Abstract

Verifying the integrity of files during transfer is a fundamental operation critical to ensuring data reliability and security. This is accomplished by computing and comparing a hash value generated from the file’s contents by both the sender and the receiver. This process becomes prohibitively slow when dealing with large files, even in scenarios involving sparse disk images where significant portions of the file may be unallocated. We introduce blkhash, the first hash construction tailored specifically for optimizing hash computation performance in sparse disk images. Our approach addresses the inefficiencies inherent in traditional hashing algorithms by significantly reducing the computational overhead associated with unallocated areas within the file. Moreover, blkhash implements a parallel computation strategy that leverages multiple cores, further enhancing efficiency and scalability. We have implemented the blkhash construction and conducted extensive performance evaluations to assess its efficacy. Our results demonstrate remarkable improvements in hash computation speed, outperforming state-of-the-art hash functions by up to four orders of magnitude. This substantial acceleration in hash computation offers immense potential for use cases requiring rapid verification of large virtual disk images, particularly in virtualization and software-defined storage.

Paper Citation

in Harvard Style

Soffer N. and Waisbard E. (2024). An Efficient Hash Function Construction for Sparse Data. In Proceedings of the 21st International Conference on Security and Cryptography - Volume 1: SECRYPT; ISBN 978-989-758-709-2, SciTePress, pages 698-703. DOI: 10.5220/0012764500003767

in Bibtex Style

@conference{secrypt24,
author={Nir Soffer and Erez Waisbard},
title={An Efficient Hash Function Construction for Sparse Data},
booktitle={Proceedings of the 21st International Conference on Security and Cryptography - Volume 1: SECRYPT},
year={2024},
pages={698-703},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012764500003767},
isbn={978-989-758-709-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 21st International Conference on Security and Cryptography - Volume 1: SECRYPT
TI - An Efficient Hash Function Construction for Sparse Data
SN - 978-989-758-709-2
AU - Soffer N.
AU - Waisbard E.
PY - 2024
SP - 698
EP - 703
DO - 10.5220/0012764500003767
PB - SciTePress