English
Related papers

Related papers: Combinatorial Pure Exploration with Bottleneck Rew…

200 papers

Model monitoring is a critical component of the machine learning lifecycle, safeguarding against undetected drops in the model's performance after deployment. Traditionally, performance monitoring has required access to ground truth labels,…

Machine Learning · Computer Science 2026-03-10 Juhani Kivimäki , Jakub Białek , Wojtek Kuberski , Jukka K. Nurminen

We consider a combinatorial multi-armed bandit problem for maximum value reward function under maximum value and index feedback. This is a new feedback structure that lies in between commonly studied semi-bandit and full-bandit feedback…

Machine Learning · Computer Science 2023-05-26 Yiliu Wang , Wei Chen , Milan Vojnović

In this paper, we investigate the problem of offline Preference-based Reinforcement Learning (PbRL) with human feedback where feedback is available in the form of preference between trajectory pairs rather than explicit rewards. Our…

Machine Learning · Computer Science 2023-10-03 Wenhao Zhan , Masatoshi Uehara , Nathan Kallus , Jason D. Lee , Wen Sun

Motivated by applications, we consider here new operator theoretic approaches to Conditional mean embeddings (CME). Our present results combine a spectral analysis-based optimization scheme with the use of kernels, stochastic processes, and…

Machine Learning · Computer Science 2023-05-16 Palle E. T. Jorgensen , Myung-Sin Song , James Tian

We consider the best-arm identification problem in multi-armed bandits, which focuses purely on exploration. A player is given a fixed budget to explore a finite set of arms, and the rewards of each arm are drawn independently from a fixed,…

Machine Learning · Statistics 2017-08-02 Shahin Shahrampour , Mohammad Noshad , Vahid Tarokh

Reinforcement Learning (RL) has emerged as a powerful tool for neural combinatorial optimization, enabling models to learn heuristics that solve complex problems without requiring expert knowledge. Despite significant progress, existing RL…

Machine Learning · Computer Science 2025-05-14 Mingjun Pan , Guanquan Lin , You-Wei Luo , Bin Zhu , Zhien Dai , Lijun Sun , Chun Yuan

Safety and stability are two critical concerns in pursuit-evasion (PE) problems in an obstacle-rich environment. Most existing works combine control barrier functions (CBFs) and reinforcement learning (RL) to provide an efficient and safe…

Systems and Control · Electrical Eng. & Systems 2025-07-29 Xinyang Wang , Hongwei Zhang , Jun Xu , Shimin Wang , Martin Guay

The restless bandit problem is one of the most well-studied generalizations of the celebrated stochastic multi-armed bandit problem in decision theory. In its ultimate generality, the restless bandit problem is known to be PSPACE-Hard to…

Data Structures and Algorithms · Computer Science 2009-02-03 Sudipto Guha , Kamesh Munagala , Peng Shi

This paper addresses continuous-time reinforcement learning (CTRL) where the system dynamics are governed by an unknown stochastic differential equation, and only discrete-time observations are available. Existing approaches face…

Optimization and Control · Mathematics 2025-10-14 Yuhua Zhu , Yuming Zhang , Haoyu Zhang

Combinatorial optimization algorithms for graph problems are usually designed afresh for each new problem with careful attention by an expert to the problem structure. In this work, we develop a new framework to solve any combinatorial…

This paper presents a framework to tackle constrained combinatorial optimization problems using deep Reinforcement Learning (RL). To this end, we extend the Neural Combinatorial Optimization (NCO) theory in order to deal with constraints in…

Machine Learning · Computer Science 2020-06-23 Ruben Solozabal , Josu Ceberio , Martin Takáč

Efficient exploration remains a central challenge in reinforcement learning, serving as a useful pretraining objective for data collection, particularly when an external reward function is unavailable. A principled formulation of the…

Machine Learning · Computer Science 2026-03-16 Jacob Adamczyk , Adam Kamoski , Rahul V. Kulkarni

An automatic machine learning (AutoML) task is to select the best algorithm and its hyper-parameters simultaneously. Previously, the hyper-parameters of all algorithms are joint as a single search space, which is not only huge but also…

Machine Learning · Computer Science 2019-06-03 Yi-Qi Hu , Yang Yu , Jun-Da Liao

Byte-Pair Encoding (BPE) is a popular algorithm used for tokenizing data in NLP, despite being devised initially as a compression method. BPE appears to be a greedy algorithm at face value, but the underlying optimization problem that BPE…

Computation and Language · Computer Science 2024-09-04 Vilém Zouhar , Clara Meister , Juan Luis Gastaldi , Li Du , Tim Vieira , Mrinmaya Sachan , Ryan Cotterell

In this paper, we consider the low rank structure of the reward sequence of the pure exploration problems. Firstly, we propose the separated setting in pure exploration problem, where the exploration strategy cannot receive the feedback of…

Machine Learning · Computer Science 2023-06-29 Yaxiong Liu , Atsuyoshi Nakamura , Kohei Hatano , Eiji Takimoto

The performance of acquisition functions for Bayesian optimisation to locate the global optimum of continuous functions is investigated in terms of the Pareto front between exploration and exploitation. We show that Expected Improvement…

Machine Learning · Computer Science 2021-04-29 George De Ath , Richard M. Everson , Alma A. M. Rahat , Jonathan E. Fieldsend

We propose a novel technique for analyzing adaptive sampling called the {\em Simulator}. Our approach differs from the existing methods by considering not how much information could be gathered by any fixed sampling strategy, but how…

Machine Learning · Computer Science 2023-04-25 Max Simchowitz , Kevin Jamieson , Benjamin Recht

We consider a novel multi-armed bandit framework where the rewards obtained by pulling the arms are functions of a common latent random variable. The correlation between arms due to the common random source can be used to design a…

Machine Learning · Statistics 2019-01-31 Samarth Gupta , Gauri Joshi , Osman Yağan

We consider a continuous-time multi-arm bandit problem (CTMAB), where the learner can sample arms any number of times in a given interval and obtain a random reward from each sample, however, increasing the frequency of sampling incurs an…

Machine Learning · Computer Science 2023-04-20 Rahul Vaze , Manjesh K. Hanawal

We study the task of bandit learning, also known as best-arm identification, under the assumption that the true reward function f belongs to a known, but arbitrary, function class F. We seek a general theory of bandit learnability, akin to…

Machine Learning · Computer Science 2025-06-18 Nataly Brukhim , Aldo Pacchiano , Miroslav Dudik , Robert Schapire