English
Related papers

Related papers: Reinforcement Mechanism Design for e-commerce

200 papers

Sponsored search in E-commerce platforms such as Amazon, Taobao and Tmall provides sellers an effective way to reach potential buyers with most relevant purpose. In this paper, we study the auction mechanism optimization problem in…

Computer Science and Game Theory · Computer Science 2018-08-02 Gang Bai , Zhihui Xie , Liang Wang

We consider a meal delivery service fulfilling dynamic customer requests given a set of couriers over the course of a day. A courier's duty is to pick-up an order from a restaurant and deliver it to a customer. We model this service as a…

Machine Learning · Computer Science 2022-03-01 Hadi Jahanshahi , Aysun Bozanta , Mucahit Cevik , Eray Mert Kavuk , Ayşe Tosun , Sibel B. Sonuc , Bilgin Kosucu , Ayşe Başar

Embodied agents, such as robots and virtual characters, must continuously select actions to execute tasks effectively, solving complex sequential decision-making problems. Given the difficulty of designing such controllers manually,…

Robotics · Computer Science 2026-05-18 Pedro Santana

Reinforcement learning (RL) has proven to be well-performed and general-purpose in the inventory control (IC). However, further improvement of RL algorithms in the IC domain is impeded due to two limitations of online experience. First,…

Machine Learning · Computer Science 2025-02-18 Zifan Liu , Xinran Li , Shibo Chen , Gen Li , Jiashuo Jiang , Jun Zhang

The online 3D bin packing problem is important in logistics, warehousing and intelligent manufacturing, with solutions shifting to deep reinforcement learning (DRL) which faces challenges like low sample efficiency. This paper proposes a…

Robotics · Computer Science 2026-04-14 Jie Han , Tong Li , Qingyang Xu , Yong Song , Bao Pang , Xianfeng Yuan

In e-commerce websites like Taobao, brand is playing a more important role in influencing users' decision of click/purchase, partly because users are now attaching more importance to the quality of products and brand is an indicator of…

Information Retrieval · Computer Science 2018-08-14 Yu Zhu , Junxiong Zhu , Jie Hou , Yongliang Li , Beidou Wang , Ziyu Guan , Deng Cai

We propose a general and model-free approach for Reinforcement Learning (RL) on real robotics with sparse rewards. We build upon the Deep Deterministic Policy Gradient (DDPG) algorithm to use demonstrations. Both demonstrations and actual…

We develop a portfolio allocation framework that leverages deep learning techniques to address challenges arising from high-dimensional, non-stationary, and low-signal-to-noise market information. Our approach includes a dynamic embedding…

Portfolio Management · Quantitative Finance 2025-01-31 Jinghai He , Cheng Hua , Chunyang Zhou , Zeyu Zheng

The E-commerce platform has become the principal battleground where people search, browse and pay for whatever they want. Critical as is to improve the online shopping experience for customers and merchants, how to find a proper approach…

Machine Learning · Computer Science 2020-08-06 Jingxing Jiang , Zhubin Wang , Fei Fang , Binqiang Zhao

The problem of how to take the right actions to make profits in sequential process continues to be difficult due to the quick dynamics and a significant amount of uncertainty in many application scenarios. In such complicated environments,…

Machine Learning · Computer Science 2023-10-03 Zhendong Shi , Xiaoli Wei , Ercan E. Kuruoglu

We investigate how reinforcement learning can be used to train level-designing agents. This represents a new approach to procedural content generation in games, where level design is framed as a game, and the content generator itself is…

Machine Learning · Computer Science 2020-08-14 Ahmed Khalifa , Philip Bontrager , Sam Earle , Julian Togelius

The development of open benchmarking platforms could greatly accelerate the adoption of AI agents in retail. This paper presents comprehensive simulations of customer shopping behaviors for the purpose of benchmarking reinforcement learning…

Artificial Intelligence · Computer Science 2024-05-20 Yu Xia , Sriram Narayanamoorthy , Zhengyuan Zhou , Joshua Mabry

Large scale eCommerce platforms such as eBay carry a wide variety of inventory and provide several buying choices to online shoppers. It is critical for eCommerce search engines to showcase in the top results the variety and selection of…

Information Retrieval · Computer Science 2020-10-29 Shubhangi Tandon , Saratchandra Indrakanti , Amit Jaiswal , Svetlana Strunjas , Manojkumar Rangasamy Kannadasan

Nowadays, a significant share of the Business-to-Consumer sector is based on online platforms like Amazon and Alibaba and uses Artificial Intelligence for pricing strategies. This has sparked debate on whether pricing algorithms may tacitly…

General Economics · Economics 2024-06-05 Shidi Deng , Maximilian Schiffer , Martin Bichler

As the largest e-commerce platform, Taobao helps advertisers reach billions of search queries each day via sponsored search, which has also contributed considerable revenue to the platform. An efficient bidding strategy to cater to diverse…

Computer Science and Game Theory · Computer Science 2019-03-12 Hao Liu , Qinyu Cao , Xinru Liao , Guang Qiu , Sheng Li , Jiming Chen

Incrementality, which is used to measure the causal effect of showing an ad to a potential customer (e.g. a user in an internet platform) versus not, is a central object for advertisers in online advertising platforms. This paper…

Machine Learning · Computer Science 2023-01-18 Ashwinkumar Badanidiyuru , Zhe Feng , Tianxi Li , Haifeng Xu

Deep reinforcement learning has proven remarkably useful in training agents from unstructured data. However, the opacity of the produced agents makes it difficult to ensure that they adhere to various requirements posed by human engineers.…

Machine Learning · Computer Science 2022-02-10 Raz Yerushalmi , Guy Amir , Achiya Elyasaf , David Harel , Guy Katz , Assaf Marron

Query-product relevance prediction is fundamental to e-commerce search and has become even more critical in the era of AI-powered shopping, where semantic understanding and complex reasoning directly shape the user experience and business…

Information Retrieval · Computer Science 2026-01-27 Jianhui Yang , Yiming Jin , Pengkun Jiao , Chenhe Dong , Zerui Huang , Shaowei Yao , Xiaojiang Zhou , Dan Ou , Haihong Tang

Revenue-optimal auction design is a challenging problem with significant theoretical and practical implications. Sequential auction mechanisms, known for their simplicity and strong strategyproofness guarantees, are often limited by…

Computer Science and Game Theory · Computer Science 2024-07-12 Sai Srivatsa Ravindranath , Zhe Feng , Di Wang , Manzil Zaheer , Aranyak Mehta , David C. Parkes

We test the performance of deep deterministic policy gradient (DDPG), a deep reinforcement learning algorithm, able to handle continuous state and action spaces, to learn Nash equilibria in a setting where firms compete in prices. These…

Computer Science and Game Theory · Computer Science 2025-09-30 Christoph Graf , Viktor Zobernig , Johannes Schmidt , Claude Klöckl