Design of an RDMA Communication Middleware for Asynchronous Shuffling in Analytical Processing

Rui C. Gonçalves; José Pereira; Ricardo Jimenez-Peris

Research.Publish.Connect.

*Please fill out at least one Field. *Value must be an number!

Title:
ISBN:
Year:
Acronym:
Subject:

Advanced Search Proceedings Search

If you're looking for an exact phrase use quotation marks on text fields.

*Please fill out at least one Field.

Title:
Author:
Affiliation:
Subject:

Advanced Search Papers Search

If you're looking for an exact phrase use quotation marks on text fields.

*Please fill out at least one Field.

Name:
Affiliation:
Country:
Conference:
Subject:

Advanced Search Authors Search

If you're looking for an exact phrase use quotation marks on text fields.

*Please fill out at least one Field.

Name:
Country:
Subject:

Advanced Search Affiliations Search

If you're looking for an exact phrase use quotation marks on text fields.

Proceedings

Proceedings Search *Please fill out at least one Field. *Value must be an number!

Title:
ISBN:
Year:
Acronym:
Subject:

Advanced Search Proceedings Search

If you're looking for an exact phrase use quotation marks on text fields.

Papers

Papers Search *Please fill out at least one Field.

Title:
Author:
Affiliation:
Subject:

Advanced Search Papers Search

If you're looking for an exact phrase use quotation marks on text fields.

Authors

Authors Search *Please fill out at least one Field.

Name:
Affiliation:
Country:
Conference:
Subject:

Advanced Search Authors Search

If you're looking for an exact phrase use quotation marks on text fields.

Advanced Search

Paper

Design of an RDMA Communication Middleware for Asynchronous Shuffling in Analytical Processing

In Proceedings of the 6th International Conference on Cloud Computing and Services Science - Volume 1: DataDiversityConvergence, 348-351, 2016 , Rome, Italy

Authors: Rui C. Gonçalves ¹ ; José Pereira ¹ and Ricardo Jimenez-Peris ²

Affiliations: ¹ INESC TEC & U. Minho, Portugal ; ² LeanXcale, Spain

Keyword(s): Shuffling, Analytical Processing, Middleware, RDMA.

Abstract: A key component in a distributed parallel analytical processing engine is shuffling, the distribution of data to multiple nodes such that the computation can be done in parallel. In this paper we describe the initial design of a communication middleware to support asynchronous shuffling of data among multiple processes on a distributed memory environment. The proposed middleware relies on RDMA (Remote Direct Memory Access) operations to transfer data, and provides basic operations to send and queue data on remote machines, and to retrieve this queued data. Preliminary results show that the RDMA-based middleware can provide a 75% reduction on communication costs, when compared with a traditional sockets implementation.

CC BY-NC-ND 4.0

Guest: Register as new SciTePress user now for free.

SciTePress user: please login.

My Papers

You are not signed in, therefore limits apply to your IP address 3.145.95.184

In the current month:

Recent papers: 100 available of 100 total

2⁺ years older papers: 200 available of 200 total

Paper citation in several formats:

Gonçalves, R. ; Pereira, J. and Jimenez-Peris, R. (2016). Design of an RDMA Communication Middleware for Asynchronous Shuffling in Analytical Processing. In Proceedings of the 6th International Conference on Cloud Computing and Services Science (CLOSER 2016) - Volume 1: DataDiversityConvergence; ISBN 978-989-758-182-3; ISSN 2184-5042, SciTePress, pages 348-351. DOI: 10.5220/0005923703480351

@conference{datadiversityconvergence16,
author={Rui C. Gon\c{c}alves and José Pereira and Ricardo Jimenez{-}Peris},
title={Design of an RDMA Communication Middleware for Asynchronous Shuffling in Analytical Processing},
booktitle={Proceedings of the 6th International Conference on Cloud Computing and Services Science (CLOSER 2016) - Volume 1: DataDiversityConvergence},
year={2016},
pages={348-351},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005923703480351},
isbn={978-989-758-182-3},
issn={2184-5042},
}

TY - CONF

JO - Proceedings of the 6th International Conference on Cloud Computing and Services Science (CLOSER 2016) - Volume 1: DataDiversityConvergence
TI - Design of an RDMA Communication Middleware for Asynchronous Shuffling in Analytical Processing
SN - 978-989-758-182-3
IS - 2184-5042
AU - Gonçalves, R.
AU - Pereira, J.
AU - Jimenez-Peris, R.
PY - 2016
SP - 348
EP - 351
DO - 10.5220/0005923703480351
PB - SciTePress