Optimal Static Bidding Strategy for Running Jobs with Hard Deadline Constraints on Spot Instances

Kai-Siang Wang, Cheng-Han Hsieh, Jerry Chou

2023

Abstract

Spot-instances(SI) is an auction-based pricing scheme used by cloud providers. It allows users to place bids for spare computing instances and rent them at a substantially lower price compared to the fixed on-demand price. This inexpensive computational power is at the cost of availability, because a spot instance can be revoked whenever the spot market price exceeds the bid. Therefore, SI has become an attractive option for applications without requiring real-time availability constraints, such as the batch jobs in different application domains, including big data analytics, scientific computing, and deep learning. For batch jobs, service interruptions and execution delays can be tolerated as long as their service quality is gauged by an execution deadline. Hence, this paper aims to develop a static bidding strategy for minimizing the monetary cost of a batch job with hard deadline constraints. We formulate the problem as a Markov chain process and use Dynamic Programming to find the optimal bid in polynomial time. Experiments conducted on real workloads from Amazon Spot Instance historical prices show that our proposed strategy successfully outperformed two state-of-art dynamic bidding strategies (Amazing, DBA), and several deadline agnostic static bidding strategies with lower cost.

Paper Citation

in Harvard Style

Wang K., Hsieh C. and Chou J. (2023). Optimal Static Bidding Strategy for Running Jobs with Hard Deadline Constraints on Spot Instances. In Proceedings of the 13th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-650-7, SciTePress, pages 123-130. DOI: 10.5220/0011645400003488

in Bibtex Style

@conference{closer23,
author={Kai-Siang Wang and Cheng-Han Hsieh and Jerry Chou},
title={Optimal Static Bidding Strategy for Running Jobs with Hard Deadline Constraints on Spot Instances},
booktitle={Proceedings of the 13th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2023},
pages={123-130},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011645400003488},
isbn={978-989-758-650-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - Optimal Static Bidding Strategy for Running Jobs with Hard Deadline Constraints on Spot Instances
SN - 978-989-758-650-7
AU - Wang K.
AU - Hsieh C.
AU - Chou J.
PY - 2023
SP - 123
EP - 130
DO - 10.5220/0011645400003488
PB - SciTePress