Executing Bag of Distributed Tasks on Virtually Unlimited Cloud Resources

Long Thai, Blesson Varghese, Adam Barker

2015

Abstract

Bag-of-Distributed-Tasks (BoDT) application is the collection of identical and independent tasks each of which requires a piece of input data located around the world. As a result, Cloud computing offers an effective way to execute BoT application as it not only consists of multiple geographically distributed data centres but also allows a user to pay for what is actually used. In this paper, BoDT on the Cloud using virtually unlimited cloud resources is investigated. To this end, a heuristic algorithm is proposed to find an execution plan that takes budget constraints into account. Compared with other approaches, for the same given budget, the proposed algorithm is able to reduce the overall execution time up to 50%.

References

  1. Chun, B., Culler, D., Roscoe, T., Bavier, A., Peterson, L., Wawrzoniak, M., and Bowman, M. (2003). Planetlab: an overlay testbed for broad-coverage services. SIGCOMM Comput. Commun. Rev., 33(3):3-12.
  2. Kaya, K. and Aykanat, C. (2006). Iterative-improvementbased heuristics for adaptive scheduling of tasks sharing files on heterogeneous master-slave environments. Parallel and Distributed Systems, IEEE Transactions on, 17(8):883-896.
  3. Luckeneder, M. and Barker, A. (2013). Location, location, location: Data-intensive distributed computing in the cloud. In In Proceedings of IEEE CloudCom 2013, pages 647-653.
  4. Mao, M., Li, J., and Humphrey, M. (2010). Cloud autoscaling with deadline and budget constraints. In Grid Computing (GRID), 2010 11th IEEE/ACM International Conference on, pages 41-48.
  5. Oprescu, A. and Kielmann, T. (2010). Bag-of-tasks scheduling under budget constraints. In Cloud Computing Technology and Science (CloudCom), 2010 IEEE Second International Conference on, pages 351-359.
  6. Ranganathan, K. and Foster, I. (2002). Decoupling computation and data scheduling in distributed data-intensive applications. In Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing, HPDC 7802, pages 352-, Washington, DC, USA. IEEE Computer Society.
  7. Ryden, M., Oh, K., Chandra, A., and Weissman, J. B. (2014). Nebula: Distributed edge cloud for data intensive computing.
  8. Thai, L., Barker, A., Varghese, B., Akgun, O., and Miguel, I. (2014a). Optimal deployment of geographically distributed workflow engines on the cloud. In 6th IEEE International Conference on Cloud Computing Technology and Science (CloudCom 2014).
  9. Thai, L., Varghese, B., and Barker, A. (2014b). Executing bag of distributed tasks on the cloud: Investigating the trade-offs between performance and cost. In Cloud Computing Technology and Science (CloudCom), 2014 IEEE 6th International Conference on, pages 400-407.
  10. Venugopal, S. and Buyya, R. (2005). A deadline and budget constrained scheduling algorithm for escience applications on data grids. In in Proc. of 6th International Conference on Algorithms and Architectures for Parallel Processing (ICA3PP-2005, pages 60-72. Springer-Verlag.
Download


Paper Citation


in Harvard Style

Thai L., Varghese B. and Barker A. (2015). Executing Bag of Distributed Tasks on Virtually Unlimited Cloud Resources . In Proceedings of the 5th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-104-5, pages 373-380. DOI: 10.5220/0005403303730380


in Bibtex Style

@conference{closer15,
author={Long Thai and Blesson Varghese and Adam Barker},
title={Executing Bag of Distributed Tasks on Virtually Unlimited Cloud Resources},
booktitle={Proceedings of the 5th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2015},
pages={373-380},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005403303730380},
isbn={978-989-758-104-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - Executing Bag of Distributed Tasks on Virtually Unlimited Cloud Resources
SN - 978-989-758-104-5
AU - Thai L.
AU - Varghese B.
AU - Barker A.
PY - 2015
SP - 373
EP - 380
DO - 10.5220/0005403303730380