A/B Testing Adaptations based on Possibilistic Reward Methods for Checkout Processes: A Numerical Analysis

Miguel Martín, Antonio Jiménez-Martín, Alfonso Mateos

2020

Abstract

A/B Testing can be used in digital contexts to optimize the e-commerce purchasing process so as to reduce customer effort during online purchasing and assure that the largest possible number of customers place their order. In this paper we focus on the checkout process. Most of the companies are very interested in agilice this process in order to reduce the customer abandon rate during the purchase sequence and to increase the customer satisfaction. In this paper, we use an adaptation of A/B testing based on multi-armed bandit algorithms, which also includes the definition of alternative stopping criteria. In real contexts, where the family to which the reward distribution belongs is unknown, the possibilistic reward (PR) methods become a powerful alternative. In PR methods, the probability distribution of the expected rewards is approximately modeled and only the minimum and maximum reward bounds have to be known. A comparative numerical analysis based on the simulation of real checkout process scenarios is used to analyze the performance of the proposed A/B testing adaptations in non-Bernoulli environments. The conclusion is that the PR3 method can be efficiently used in such environments in combination with the PR3-based stopping criteria.

Paper Citation

in Harvard Style

Martín M., Jiménez-Martín A. and Mateos A. (2020). A/B Testing Adaptations based on Possibilistic Reward Methods for Checkout Processes: A Numerical Analysis. In Proceedings of the 9th International Conference on Operations Research and Enterprise Systems - Volume 1: ICORES, ISBN 978-989-758-396-4, pages 278-285. DOI: 10.5220/0009356902780285

in Bibtex Style

@conference{icores20,
author={Miguel Martín and Antonio Jiménez-Martín and Alfonso Mateos},
title={A/B Testing Adaptations based on Possibilistic Reward Methods for Checkout Processes: A Numerical Analysis},
booktitle={Proceedings of the 9th International Conference on Operations Research and Enterprise Systems - Volume 1: ICORES,},
year={2020},
pages={278-285},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009356902780285},
isbn={978-989-758-396-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 9th International Conference on Operations Research and Enterprise Systems - Volume 1: ICORES,
TI - A/B Testing Adaptations based on Possibilistic Reward Methods for Checkout Processes: A Numerical Analysis
SN - 978-989-758-396-4
AU - Martín M.
AU - Jiménez-Martín A.
AU - Mateos A.
PY - 2020
SP - 278
EP - 285
DO - 10.5220/0009356902780285