English
Related papers

Related papers: Multinomial Logit Contextual Bandits: Provable Opt…

200 papers

We study the multinomial logit (MNL) contextual bandit problem for sequential assortment selection. Although most existing research assumes utility functions to be linear in item features, this linearity assumption restricts the modeling of…

Machine Learning · Computer Science 2026-01-13 Taehyun Hwang , Dahngoon Kim , Min-hwan Oh

In this paper, we study the contextual multinomial logit (MNL) bandit problem in which a learning agent sequentially selects an assortment based on contextual information, and user feedback follows an MNL choice model. There has been a…

Machine Learning · Statistics 2025-10-17 Joongkyu Lee , Min-hwan Oh

In this paper, we consider the contextual variant of the MNL-Bandit problem. More specifically, we consider a dynamic set optimization problem, where a decision-maker offers a subset (assortment) of products to a consumer and observes the…

Machine Learning · Computer Science 2024-04-16 Priyank Agrawal , Theja Tulabandhula , Vashist Avadhanula

In this short note we consider a dynamic assortment planning problem under the capacitated multinomial logit (MNL) bandit model. We prove a tight lower bound on the accumulated regret that matches existing regret upper bounds for all…

Machine Learning · Statistics 2018-10-01 Xi Chen , Yining Wang

We study the multinomial logit (MNL) bandit problem, where at each time step, the seller offers an assortment of size at most $K$ from a pool of $N$ items, and the buyer purchases an item from the assortment according to a MNL choice model.…

Machine Learning · Computer Science 2020-11-20 Jiaqi Yang

Contextual multinomial logit (MNL) bandits capture many real-world assortment recommendation problems such as online retailing/advertising. However, prior work has only considered (generalized) linear value functions, which greatly limits…

Machine Learning · Computer Science 2024-02-20 Mengxiao Zhang , Haipeng Luo

Multinomial logit bandit is a sequential subset selection problem which arises in many applications. In each round, the player selects a $K$-cardinality subset from $N$ candidate items, and receives a reward which is governed by a {\it…

Machine Learning · Computer Science 2019-03-05 Mingdong Ou , Nan Li , Shenghuo Zhu , Rong Jin

Optimizing the assortment of products to display to customers is a key to increasing revenue for both offline and online retailers. To trade-off between exploring customers' preference and exploiting customers' choices learned from data, in…

Machine Learning · Computer Science 2022-04-25 Hongbin Zhang , Yu Yang , Feng Wu , Qixin Zhang

Out of the rich family of generalized linear bandits, perhaps the most well studied ones are logisitc bandits that are used in problems with binary rewards: for instance, when the learner/agent tries to maximize the profit over a user that…

Machine Learning · Computer Science 2021-03-23 Sanae Amani , Christos Thrampoulidis

Contextual bandits are widely used in Internet services from news recommendation to advertising, and to Web search. Generalized linear models (logistical regression in particular) have demonstrated stronger performance than linear models in…

Machine Learning · Computer Science 2017-06-20 Lihong Li , Yu Lu , Dengyong Zhou

We introduce the problem of model selection for contextual bandits, where a learner must adapt to the complexity of the optimal policy while balancing exploration and exploitation. Our main result is a new model selection guarantee for…

Machine Learning · Computer Science 2019-11-15 Dylan J. Foster , Akshay Krishnamurthy , Haipeng Luo

With the growing demand for personalized assortment recommendations, concerns over data privacy have intensified, highlighting the urgent need for effective privacy-preserving strategies. This paper presents a novel framework for…

Machine Learning · Statistics 2024-10-31 Young Hyun Cho , Will Wei Sun

Learning the optimal ordering of content is an important challenge in website design. The learning to rank (LTR) framework models this problem as a sequential problem of selecting lists of content and observing where users decide to click.…

Machine Learning · Computer Science 2023-05-12 James A. Grant , David S. Leslie

We consider dynamic multi-product pricing and assortment problems under an unknown demand over T periods, where in each period, the seller decides on the price for each product or the assortment of products to offer to a customer who…

Machine Learning · Computer Science 2022-11-15 Vineet Goyal , Noemie Perivier

We consider a sequential subset selection problem under parameter uncertainty, where at each time step, the decision maker selects a subset of cardinality $K$ from $N$ possible items (arms), and observes a (bandit) feedback in the form of…

Machine Learning · Computer Science 2019-01-07 Shipra Agrawal , Vashist Avadhanula , Vineet Goyal , Assaf Zeevi

We consider the problem of contextual bandits and imitation learning, where the learner lacks direct knowledge of the executed action's reward. Instead, the learner can actively query an expert at each round to compare two actions and…

Machine Learning · Computer Science 2023-07-25 Ayush Sekhari , Karthik Sridharan , Wen Sun , Runzhe Wu

We present an efficient algorithm for linear contextual bandits with adversarial losses and stochastic action sets. Our approach reduces this setting to misspecification-robust adversarial linear bandits with fixed action sets. Without…

Machine Learning · Computer Science 2025-12-16 Tim van Erven , Jack Mayo , Julia Olkhovskaya , Chen-Yu Wei

We study the dynamic assortment planning problem, where for each arriving customer, the seller offers an assortment of substitutable products and customer makes the purchase among offered products according to an uncapacitated multinomial…

Machine Learning · Statistics 2019-02-11 Xi Chen , Yining Wang , Yuan Zhou

We study the Logistic Contextual Slate Bandit problem, where, at each round, an agent selects a slate of $N$ items from an exponentially large set (of size $2^{\Omega(N)}$) of candidate slates provided by the environment. A single binary…

Machine Learning · Computer Science 2026-05-13 Tanmay Goyal , Gaurav Sinha

We consider a dynamic assortment selection problem where a seller has a fixed inventory of $N$ substitutable products and faces an unknown demand that arrives sequentially over $T$ periods. In each period, the seller needs to decide on the…

Machine Learning · Computer Science 2024-01-25 Abdellah Aznag , Vineet Goyal , Noemie Perivier
‹ Prev 1 2 3 10 Next ›