Optimizing the Stretch for Virtual Screening Application on Pilot-agent Platforms on Grid/Cloud by using Multi-level Queue-based Scheduling

T. Q. Bui, E. Medernach, V. Breton, H. Q. Nguyen

2014

Abstract

Virtual screening has proven very effective on grid infrastructures. We focus on finding platform scheduling policy for pilot-agent platform shared by many virtual screening users. They need a suitable scheduling algorithm at platform level to ensure a certain fairness between users. Optimal criterion used in our research is the stretch, a measure for user experience on the platform. From our latest research (Quang et al., 2013), simulation result and experimentation on real pilot agent platform showed that SPT policy is the best policy in 4 different existing scheduling policies (FIFO, SPT, LPT and Round Robin) for optimizing the stretch. However, research on real grid workload (Medernach, 2005) showed that there are two types of grid user: normal users who submit frequently little jobs to grid and data challenge users who submit occasionally large number of jobs to grid. And SPT policy, in particularly, is not appropriate for data challenge user because they have to wait always normal user. In this paper, we proposed a new policy named SPT-SPT which uses multi-level queue scheduling technique for scheduling in a pilot agent platform. In SPT-SPT policy, the administrator creates two separate user groups in the platform: Normal group and Data Challenge group. Each group has their own task queue in the platform and SPT policy is applied on it. A parameter p (p ϵ [0,1]), the probability that task queue is chosen to send pilot agent their task, is assigned to one task queue and 1-p for the other one. This policy improves user experience for Data Challenge group and do not impact very much for Normal group.

References

  1. Azmi, B., 2011. Performance Comparison of Priority Rule Scheduling Algorithms Using Different Inter Arrival Time Jobs in Grid Environment. International Journal of Grid and Distributed Computing, 4(3), pp.61-70.
  2. Berman, F. et al., 1996. Application-level scheduling on distributed heterogeneous networks. In Supercomputing, 1996. Proceedings of the 1996 ACM/IEEE Conference on. p. 39.
  3. Fifield, T. et al., 2011. Integration of cloud, grid and local cluster resources with DIRAC. Journal of Physics: Conference Series, 331(6), p.062009.
  4. Van Herwijnen, E. et al., 2003. Dirac-distributed infrastructure with remote agent control. In Conference for Computing in High-Energy and Nuclear Physics (CHEP 03).
  5. Jacq, N. et al., 2008. Grid-enabled virtual screening against malaria. Journal of Grid Computing, 6(1), pp.29-43.
  6. Jacq, N. et al., 2006. Large scale in silico screening on grid infrastructures. arXiv preprint cs/0611084. Available at: http://arxiv.org/abs/cs/0611084 [Accessed December 31, 2013].
  7. Jiang, C. et al., 2007. A survey of job scheduling in grids. In Advances in Data and Web Management. Springer, pp. 419-427.
  8. Kasam, V. et al., 2009. WISDOM-II: screening against multiple targets implicated in malaria using computational grid infrastructures. Malaria journal, 8, p.88.
  9. Legrand, A., Su, A. & Vivien, F., 2006. Minimizing the stretch when scheduling flows of biological requests. Proceedings of the eighteenth annual ACM symposium on Parallelism in algorithms and architectures, pp.103-112.
  10. Li, W., Tordsson, J. & Elmroth, E., 2011. Modeling for dynamic cloud scheduling via migration of virtual machines. In Cloud Computing Technology and Science (CloudCom), 2011 IEEE Third International Conference on. pp. 163-171.
  11. Luckow, A., Lacinski, L. & Jha, S., 2010. SAGA BigJob: An extensible and interoperable pilot-job abstraction for distributed applications and systems. In Cluster, Cloud and Grid Computing (CCGrid), 2010 10th IEEE/ACM International Conference on. pp. 135-144.
  12. Marrow, P. et al., 2003. DIET-a scalable, robust and adaptable multi-agent platform for information management. BT technology journal, 21(4), pp.130- 137.
  13. Maruthanayagam, D., 2010. Grid scheduling algorithms: A survey. International Journal of Current Research, 11(2), pp.228-235.
  14. Medernach, E., 2005. Workload analysis of a cluster in a grid environment. Job scheduling strategies for parallel processing, (June).
  15. Moscicki, J.T., 2003. Distributed analysis environment for HEP and interdisciplinary applications. Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, 502(2), pp.426-429.
  16. Muthukrishnan, S. et al., 1999. Online scheduling to minimize average stretch. In Foundations of Computer Science, 1999. 40th Annual Symposium on. pp. 433- 443.
  17. Pandey, S. et al., 2010. A particle swarm optimizationbased heuristic for scheduling workflow applications in cloud computing environments. In Advanced Information Networking and Applications (AINA), 2010 24th IEEE International Conference on. pp. 400-407.
  18. Quang, B.T. et al., 2013. Stretch optimization for virtual screening on multi-user pilot-agent platforms on grid/cloud. In Proceedings of the Fourth Symposium on Information and Communication Technology. pp. 301-310.
  19. Schmidt, G., 2000. Scheduling with limited machine availability. European Journal of Operational Research, 121(1), pp.1-15.
Download


Paper Citation


in Harvard Style

Bui T., Medernach E., Breton V. and Nguyen H. (2014). Optimizing the Stretch for Virtual Screening Application on Pilot-agent Platforms on Grid/Cloud by using Multi-level Queue-based Scheduling . In Proceedings of the 4th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-019-2, pages 199-204. DOI: 10.5220/0004962801990204


in Bibtex Style

@conference{closer14,
author={T. Q. Bui and E. Medernach and V. Breton and H. Q. Nguyen},
title={Optimizing the Stretch for Virtual Screening Application on Pilot-agent Platforms on Grid/Cloud by using Multi-level Queue-based Scheduling},
booktitle={Proceedings of the 4th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2014},
pages={199-204},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004962801990204},
isbn={978-989-758-019-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 4th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - Optimizing the Stretch for Virtual Screening Application on Pilot-agent Platforms on Grid/Cloud by using Multi-level Queue-based Scheduling
SN - 978-989-758-019-2
AU - Bui T.
AU - Medernach E.
AU - Breton V.
AU - Nguyen H.
PY - 2014
SP - 199
EP - 204
DO - 10.5220/0004962801990204