中文
相关论文

相关论文: Learning-Augmented Algorithms for MTS with Bandit …

200 篇论文

Unlike classical control theory, such as Linear Quadratic Control (LQC), real-world control problems are highly complex. These problems often involve adversarial perturbations, bandit feedback models, and non-quadratic, adversarially chosen…

机器学习 · 计算机科学 2024-10-03 Y. Jennifer Sun , Zhou Lu

In this paper, we consider the contextual variant of the MNL-Bandit problem. More specifically, we consider a dynamic set optimization problem, where a decision-maker offers a subset (assortment) of products to a consumer and observes the…

机器学习 · 计算机科学 2024-04-16 Priyank Agrawal , Theja Tulabandhula , Vashist Avadhanula

This paper studies bandit convex optimization with constraints, where the learner aims to generate a sequence of decisions under partial information of loss functions such that the cumulative loss is reduced as well as the cumulative…

机器学习 · 计算机科学 2023-10-18 Yasunari Hikima

We consider a combinatorial multi-armed bandit problem for maximum value reward function under maximum value and index feedback. This is a new feedback structure that lies in between commonly studied semi-bandit and full-bandit feedback…

机器学习 · 计算机科学 2023-05-26 Yiliu Wang , Wei Chen , Milan Vojnović

We propose an algorithm for stochastic and adversarial multiarmed bandits with switching costs, where the algorithm pays a price $\lambda$ every time it switches the arm being played. Our algorithm is based on adaptation of the Tsallis-INF…

机器学习 · 计算机科学 2021-02-22 Chloé Rouyer , Yevgeny Seldin , Nicolò Cesa-Bianchi

We study an online learning problem with long-term budget constraints in the adversarial setting. In this problem, at each round $t$, the learner selects an action from a convex decision set, after which the adversary reveals a cost…

机器学习 · 计算机科学 2025-08-26 Dhruv Sarkar , Samrat Mukhopadhyay , Abhishek Sinha

We study a variation of the classical multi-armed bandits problem. In this problem, the learner has to make a sequence of decisions, picking from a fixed set of choices. In each round, she receives as feedback only the loss incurred from…

机器学习 · 计算机科学 2017-09-18 Paresh Nakhe , Rebecca Reiffenhäuser

We study a generalization of the problem of online learning in adversarial linear contextual bandits by incorporating loss functions that belong to a reproducing kernel Hilbert space, which allows for a more flexible modeling of complex…

机器学习 · 统计学 2023-10-04 Gergely Neu , Julia Olkhovskaya , Sattar Vakili

The stochastic multi-armed bandit problem is a well-known model for studying the exploration-exploitation trade-off. It has significant possible applications in adaptive clinical trials, which allow for dynamic changes in the treatment…

机器学习 · 计算机科学 2019-06-11 Hossein Aboutalebi , Doina Precup , Tibor Schuster

In this paper, we consider a best action identification problem in the stochastic linear bandit setup with a fixed confident constraint. In the considered best action identification problem, instead of minimizing the accumulative regret as…

机器学习 · 计算机科学 2018-12-04 Jun Geng , Lifeng Lai

Efficient exploration in bandits is a fundamental online learning problem. We propose a variant of Thompson sampling that learns to explore better as it interacts with bandit instances drawn from an unknown prior. The algorithm meta-learns…

We consider the regret minimization task in a dueling bandits problem with context information. In every round of the sequential decision problem, the learner makes a context-dependent selection of two choice alternatives (arms) to be…

机器学习 · 计算机科学 2022-10-14 Viktor Bengs , Aadirupa Saha , Eyke Hüllermeier

Building on the framework introduced by Xu and Raginksy [1] for supervised learning problems, we study the best achievable performance for model-based Bayesian reinforcement learning problems. With this purpose, we define minimum Bayesian…

机器学习 · 计算机科学 2022-07-19 Amaury Gouverneur , Borja Rodríguez-Gálvez , Tobias J. Oechtering , Mikael Skoglund

The dueling bandit is a learning framework wherein the feedback information in the learning process is restricted to a noisy comparison between a pair of actions. In this research, we address a dueling bandit problem based on a cost…

机器学习 · 统计学 2017-12-13 Wataru Kumagai

We study the adversarial bandit problem against arbitrary strategies, where the difficulty is captured by an unknown parameter $S$, which is the number of switches in the best arm in hindsight. To handle this problem, we adopt the…

机器学习 · 计算机科学 2025-11-26 Jung-hun Kim , Se-Young Yun

In this paper we consider the adversarial contextual bandit problem in metric spaces. The paper "Nearest neighbour with bandit feedback" tackled this problem but when there are many contexts near the decision boundary of the comparator…

机器学习 · 计算机科学 2023-12-18 Stephen Pasteris , Chris Hicks , Vasilios Mavroudis

We propose a simple model selection approach for algorithms in stochastic bandit and reinforcement learning problems. As opposed to prior work that (implicitly) assumes knowledge of the optimal regret, we only require that each base…

机器学习 · 计算机科学 2020-12-25 Aldo Pacchiano , Christoph Dann , Claudio Gentile , Peter Bartlett

We discuss multi-task online learning when a decision maker has to deal simultaneously with M tasks. The tasks are related, which is modeled by imposing that the M-tuple of actions taken by the decision maker needs to satisfy certain…

机器学习 · 统计学 2009-03-27 Gabor Lugosi , Omiros Papaspiliopoulos , Gilles Stoltz

Recommender systems are a ubiquitous feature of online platforms. Increasingly, they are explicitly tasked with increasing users' long-term satisfaction. In this context, we study a content exploration task, which we formalize as a…

机器学习 · 计算机科学 2023-07-21 Thomas M. McDonald , Lucas Maystre , Mounia Lalmas , Daniel Russo , Kamil Ciosek

Policy gradients-based reinforcement learning has proven to be a promising approach for directly optimizing non-differentiable evaluation metrics for language generation tasks. However, optimizing for a specific metric reward leads to…

计算与语言 · 计算机科学 2020-11-17 Ramakanth Pasunuru , Han Guo , Mohit Bansal