English
Related papers

Related papers: Exploration via linearly perturbed loss minimisati…

200 papers

Stochastic linear bandits are a natural and well-studied model for structured exploration/exploitation problems and are widely used in applications such as online marketing and recommendation. One of the main challenges faced by…

We investigate the non-stationary stochastic linear bandit problem where the reward distribution evolves each round. Existing algorithms characterize the non-stationarity by the total variation budget $B_K$, which is the summation of the…

Machine Learning · Computer Science 2024-03-19 Zhiyong Wang , Jize Xie , Yi Chen , John C. S. Lui , Dongruo Zhou

Adversarial training has been proposed to protect machine learning models against adversarial attacks. This paper focuses on adversarial training under $\ell_\infty$-perturbation, which has recently attracted much research attention. The…

Statistics Theory · Mathematics 2025-03-04 Yiling Xie , Xiaoming Huo

This paper introduces a simple efficient learning algorithms for general sequential decision making. The algorithm combines Optimism for exploration with Maximum Likelihood Estimation for model estimation, which is thus named OMLE. We prove…

Machine Learning · Computer Science 2022-11-24 Qinghua Liu , Praneeth Netrapalli , Csaba Szepesvári , Chi Jin

Bugs in popular distributed protocol implementations have been the source of many downtimes in popular internet services. We describe a randomized testing approach for distributed protocol implementations based on reinforcement learning.…

Software Engineering · Computer Science 2024-09-05 Andrea Borgarelli , Constantin Enea , Rupak Majumdar , Srinidhi Nagendra

Learning complex robot behaviors through interaction requires structured exploration. Planning should target interactions with the potential to optimize long-term performance, while only reducing uncertainty where conducive to this…

Machine Learning · Computer Science 2021-12-14 Tim Seyde , Wilko Schwarting , Sertac Karaman , Daniela Rus

We study a multi-objective pure exploration problem in a multi-armed bandit model. Each arm is associated to an unknown multi-variate distribution and the goal is to identify the distributions whose mean is not uniformly worse than that of…

Machine Learning · Statistics 2025-01-15 Cyrille Kone , Emilie Kaufmann , Laura Richert

We consider Bayesian optimization using Gaussian Process models, also referred to as kernel-based bandit optimization. We study the methodology of exploring the domain using random samples drawn from a distribution. We show that this random…

Machine Learning · Computer Science 2024-02-05 Sudeep Salgia , Sattar Vakili , Qing Zhao

We propose an evolution strategies-based algorithm for estimating gradients in unrolled computation graphs, called ES-Single. Similarly to the recently-proposed Persistent Evolution Strategies (PES), ES-Single is unbiased, and overcomes…

Machine Learning · Computer Science 2023-04-24 Paul Vicol , Zico Kolter , Kevin Swersky

We introduce the E$^4$ algorithm for the batched linear bandit problem, incorporating an Explore-Estimate-Eliminate-Exploit framework. With a proper choice of exploration rate, we prove E$^4$ achieves the finite-time minimax optimal regret…

Machine Learning · Computer Science 2024-06-07 Xuanfei Ren , Tianyuan Jin , Pan Xu

We study the problem of optimal portfolio selection under stochastic volatility within a continuous time reinforcement learning framework with portfolio constraints. Exploration is modeled through entropy-regularized relaxed controls, where…

Mathematical Finance · Quantitative Finance 2026-04-27 Thai Nguyen , Pertiny Nkuize

Adaptive decision-making in biological and artificial intelligence requires balancing the exploitation of known outcomes with the exploration of uncertain alternatives. Although prior work suggests that uncertainty generally promotes…

Artificial Intelligence · Computer Science 2026-05-20 Payam Piray

We study the linear bandit problem under limited adaptivity, known as the batched linear bandit. While existing approaches can achieve near-optimal regret in theory, they are often computationally prohibitive or underperform in practice. We…

Machine Learning · Statistics 2025-08-12 Sanghoon Yu , Min-hwan Oh

We introduce a novel online learning framework that unifies and generalizes pre-established models, such as delayed and corrupted feedback, to encompass adversarial environments where action feedback evolves over time. In this setting, the…

Machine Learning · Computer Science 2024-05-28 Yogev Bar-On , Yishay Mansour

Reinforcement learning with human feedback (RLHF), which learns a reward model from human preference data and then optimizes a policy to favor preferred responses, has emerged as a central paradigm for aligning large language models (LLMs)…

Machine Learning · Statistics 2025-09-29 Gen Li , Yuling Yan

We introduce the model selection problem in pure exploration linear bandits, where the learner needs to adapt to the instance-dependent complexity measure of the smallest hypothesis class containing the true model. We design algorithms in…

Machine Learning · Statistics 2022-03-18 Yinglun Zhu , Julian Katz-Samuels , Robert Nowak

Contextual bandits can solve a huge range of real-world problems. However, current popular algorithms to solve them either rely on linear models, or unreliable uncertainty estimation in non-linear models, which are required to deal with the…

Machine Learning · Computer Science 2023-02-01 Adam Elwood , Marco Leonardi , Ashraf Mohamed , Alessandro Rozza

Safe reinforcement learning is extremely challenging--not only must the agent explore an unknown environment, it must do so while ensuring no safety constraint violations. We formulate this safe reinforcement learning (RL) problem using the…

Machine Learning · Computer Science 2022-10-19 Archana Bura , Aria HasanzadeZonuzy , Dileep Kalathil , Srinivas Shakkottai , Jean-Francois Chamberland

We study "incentivized exploration" (IE) in social learning problems where the principal (a recommendation algorithm) can leverage information asymmetry to incentivize sequentially-arriving agents to take exploratory actions. We identify…

Machine Learning · Computer Science 2024-02-22 Anand Kalvit , Aleksandrs Slivkins , Yonatan Gur

Bandit and reinforcement learning (RL) problems can often be framed as optimization problems where the goal is to maximize average performance while having access only to stochastic estimates of the true gradient. Traditionally, stochastic…

Machine Learning · Computer Science 2021-02-22 Wesley Chung , Valentin Thomas , Marlos C. Machado , Nicolas Le Roux