Chinthalapati, V.L.R., Yadati, N. and Karumanchi, R. (2006) Learning Dynamic Prices in Multi-Seller Electronic Retail Markets with Price Sensitive Customers, Stochastic Demands, and Inventory Replenishment. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 36 (1). pp. 92-106. ISSN 1094-6977 (doi:https://doi.org/10.1109/TSMCC.2005.860578)

Full text not available from this repository.

Abstract

In this paper, we use reinforcement learning (RL) as a tool to study price dynamics in an electronic retail market consisting of two competing sellers and price sensitive and lead time sensitive customers. Sellers, offering identical products, compete on price to satisfy stochastically arriving demands (customers) and follow standard inventory control and replenishment policies to manage their inventories. In such a generalized setting, RL techniques have not been applied before. We consider two representative cases: (1) no information case, where none of the sellers has any information about customer queue levels, inventory levels, or prices at the competitors; and (2) partial information case, where every seller has information about the customer queue levels and inventory levels of the competitors. Sellers employ automated pricing agents or pricebots, which use RLbased pricing algorithms to reset the prices at random intervals based on factors such as number of back orders, inventory levels, and replenishment lead times, with the objective of maximizing discounted cumulative profit. In the no information case, we show that a seller who uses Q-learning outperforms a seller who uses derivative following (DF). In the partial information case, we model the problem as a Markovian game and use actor-critic based RL to learn dynamic prices. We believe our approach to solving these problems is a new promising way of setting dynamic prices in multi-seller environments with stochastic demands, price sensitive customers, and inventory replenishments.

Item Type:	Article
Additional Information:	[1] INSPEC Accession Number: 8818633 [2] Copyright: © 2006 IEEE
Uncontrolled Keywords:	Online retail markets, dynamic pricing, inventory replenishments, price sensitive customers, stochastic demands, multi-agent learning, reinforcement learning , Markovian game.
Subjects:	H Social Sciences > H Social Sciences (General) H Social Sciences > HF Commerce H Social Sciences > HF Commerce > HF5601 Accounting H Social Sciences > HG Finance
Faculty / School / Research Centre / Research Group:	Faculty of Business Faculty of Business > Department of Accounting & Finance
Related URLs:	Publisher
Last Modified:	14 Oct 2016 09:32
URI:	http://gala.gre.ac.uk/id/eprint/13363

Actions (login required)

View Item