GPU Acceleration of PySpark using RAPIDS AI

Abdallah Aguerzame, Benoit Pelletier, François Waeselynck

Abstract

RAPIDS AI is a promising open source project for accelerating Python end to end data science workloads. Our quest is to be able to integrate RAPIDS AI capabilities within PySpark and offload PySpark intensive tasks to GPUs to gain in performance.

Download


Paper Citation


in Harvard Style

Aguerzame A., Pelletier B. and Waeselynck F. (2019). GPU Acceleration of PySpark using RAPIDS AI.In Proceedings of the 8th International Conference on Data Science, Technology and Applications - Volume 1: ADITCA, ISBN 978-989-758-377-3, pages 437-442. DOI: 10.5220/0008191404370442


in Bibtex Style

@conference{aditca19,
author={Abdallah Aguerzame and Benoit Pelletier and François Waeselynck},
title={GPU Acceleration of PySpark using RAPIDS AI},
booktitle={Proceedings of the 8th International Conference on Data Science, Technology and Applications - Volume 1: ADITCA,},
year={2019},
pages={437-442},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008191404370442},
isbn={978-989-758-377-3},
}


in EndNote Style

TY - CONF

JO - Proceedings of the 8th International Conference on Data Science, Technology and Applications - Volume 1: ADITCA,
TI - GPU Acceleration of PySpark using RAPIDS AI
SN - 978-989-758-377-3
AU - Aguerzame A.
AU - Pelletier B.
AU - Waeselynck F.
PY - 2019
SP - 437
EP - 442
DO - 10.5220/0008191404370442