Fault-Tolerant Scheduling for Scientific Workflow with Task Replication Method in Cloud

Zhongjin Li, Jiacheng Yu, Haiyang Hu, Jie Chen, Hua Hu, Jidong Ge, Victor Chang

2018

Abstract

Cloud computing has become a revolutionary paradigm by provisioning on-demand and low cost computing resources for customers. As a result, scientific workflow, which is the big data application, is increasingly prone to adopt cloud computing platforms. However, internal failure (host fault) is inevitable in such large distributed computing environment. It is also well studied that cloud data center will experience malicious attacks frequently. Hence, external failure (failure by malicious attack) should also be considered when scheduling scientific workflows. In this paper, a fault-tolerant scheduling (FTS) algorithm is proposed for scientific workflow in cloud computing environment, the aim of which is to minimize the workflow cost with the deadline constraint even in the presence of various failures. The FTS algorithm is based on tasks replication method which is one of the widely used fault tolerant mechanisms. The experimental results in terms of real-world scientific workflow applications demonstrate the effectiveness and practicality of our proposed algorithm.

Paper Citation

in Harvard Style

Li Z., Yu J., Hu H., Chen J., Hu H., Ge J. and Chang V. (2018). Fault-Tolerant Scheduling for Scientific Workflow with Task Replication Method in Cloud.In Proceedings of the 3rd International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS, ISBN 978-989-758-296-7, pages 95-104. DOI: 10.5220/0006687300950104

in Bibtex Style

@conference{iotbds18,
author={Zhongjin Li and Jiacheng Yu and Haiyang Hu and Jie Chen and Hua Hu and Jidong Ge and Victor Chang},
title={Fault-Tolerant Scheduling for Scientific Workflow with Task Replication Method in Cloud},
booktitle={Proceedings of the 3rd International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS,},
year={2018},
pages={95-104},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006687300950104},
isbn={978-989-758-296-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 3rd International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS,
TI - Fault-Tolerant Scheduling for Scientific Workflow with Task Replication Method in Cloud
SN - 978-989-758-296-7
AU - Li Z.
AU - Yu J.
AU - Hu H.
AU - Chen J.
AU - Hu H.
AU - Ge J.
AU - Chang V.
PY - 2018
SP - 95
EP - 104
DO - 10.5220/0006687300950104