Reducing Data Transfer in Parallel Processing of SQL Window Functions

Fábio Coelho, José Pereira, Ricardo Vilaça, Rui Oliveira

2016

Abstract

Window functions are a sub-class of analytical operators that allow data to be handled in a derived view of a given relation, while taking into account their neighboring tuples. We propose a technique that can be used in the parallel execution of this operator when data is naturally partitioned. The proposed method benefits the cases where the required partitioning is not the natural partitioning employed. Preliminary evaluation shows that we are able to limit data transfer among parallel workers to 14% of the registered transfer when using a naive approach.

References

  1. (2015). Reactive programming for java. https://git hub.com/ReactiveX/RxJava.
  2. Cao, Y., Chan, C.-Y., Li, J., and Tan, K.-L. (2012). Optimization of analytic window functions. Proceedings of the VLDB Endowment,5(11):1244- 1255
  3. Council, T. P. P. (2010). TPC Benchmark C.
  4. Navathe, S., Ceri, S., Wiederhold, G., and Dou, J. (1984). Vertical partitioning algorithms for database design. ACM Transactions on Database Systems (TODS), 9(4):680-710.
  5. Poosala, V., Haas, P. J., Ioannidis, Y. E., and Shekita, E. J. (1996). Improved histograms for selectiv256 128
  6. sw 64
  7. roe 32
  8. lp 16
  9. tuK 84 2 1 ity estimation of range predicates. In ACM SIGMOD Record, volume 25, pages 294-305. ACM.
  10. Sadalage, P. J. and Fowler, M. (2012). NoSQL distilled: a brief guide to the emerging world of polyglot persistence. Pearson Education.
  11. Zuzarte, C., Pirahesh, H., Ma, W., Cheng, Q., Liu, L., and Wong, K. (2003). Winmagic: Subquery elimination using window aggregation. In Proceedings of the 2003 ACM SIGMOD international conference on Management of data, pages 652-656. ACM.
Download


Paper Citation


in Harvard Style

Coelho F., Pereira J., Vilaça R. and Oliveira R. (2016). Reducing Data Transfer in Parallel Processing of SQL Window Functions . In Proceedings of the 6th International Conference on Cloud Computing and Services Science - Volume 1: DataDiversityConvergence, (CLOSER 2016) ISBN 978-989-758-182-3, pages 343-347. DOI: 10.5220/0005923603430347


in Bibtex Style

@conference{datadiversityconvergence16,
author={Fábio Coelho and José Pereira and Ricardo Vilaça and Rui Oliveira},
title={Reducing Data Transfer in Parallel Processing of SQL Window Functions},
booktitle={Proceedings of the 6th International Conference on Cloud Computing and Services Science - Volume 1: DataDiversityConvergence, (CLOSER 2016)},
year={2016},
pages={343-347},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005923603430347},
isbn={978-989-758-182-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 6th International Conference on Cloud Computing and Services Science - Volume 1: DataDiversityConvergence, (CLOSER 2016)
TI - Reducing Data Transfer in Parallel Processing of SQL Window Functions
SN - 978-989-758-182-3
AU - Coelho F.
AU - Pereira J.
AU - Vilaça R.
AU - Oliveira R.
PY - 2016
SP - 343
EP - 347
DO - 10.5220/0005923603430347