English
Related papers

Related papers: BandMaxSAT: A Local Search MaxSAT Solver with Mult…

200 papers

We study a multi-objective multi-armed bandit problem in a dynamic environment. The problem portrays a decision-maker that sequentially selects an arm from a given set. If selected, each action produces a reward vector, where every element…

Machine Learning · Computer Science 2023-02-14 Amir Rezaei Balef , Setareh Maghsudi

Tree-form sequential decision making (TFSDM) extends classical one-shot decision making by modeling tree-form interactions between an agent and a potentially adversarial environment. It captures the online decision-making problems that each…

Computer Science and Game Theory · Computer Science 2021-03-09 Gabriele Farina , Robin Schmucker , Tuomas Sandholm

Kinodynamic motion planners allow robots to perform complex manipulation tasks under dynamics constraints or with black-box models. However, they struggle to find high-quality solutions, especially when a steering function is unavailable.…

Robotics · Computer Science 2023-08-29 Marco Faroni , Dmitry Berenson

Combinatorial bandits with semi-bandit feedback generalize multi-armed bandits, where the agent chooses sets of arms and observes a noisy reward for each arm contained in the chosen set. The action set satisfies a given structure such as…

Machine Learning · Statistics 2021-01-22 Marc Jourdan , Mojmír Mutný , Johannes Kirschner , Andreas Krause

We consider the question introduced by \cite{Mason2020} of identifying all the $\varepsilon$-optimal arms in a finite stochastic multi-armed bandit with Gaussian rewards. We give two lower bounds on the sample complexity of any algorithm…

Machine Learning · Statistics 2022-04-07 Aymen Al Marjani , Tomáš Kocák , Aurélien Garivier

Local search has recently been applied to SMT problems over various arithmetic theories. Among these, nonlinear real arithmetic poses special challenges due to its uncountable solution space and potential need to solve higher-degree…

Symbolic Computation · Computer Science 2023-11-27 Zhonghan Wang , Bohua Zhan , Bohan Li , Shaowei Cai

The multi-armed bandit (MAB) problem is an active learning framework that aims to select the best among a set of actions by sequentially observing rewards. Recently, it has become popular for a number of applications over wireless networks,…

Machine Learning · Computer Science 2021-11-12 Osama A. Hanna , Lin F. Yang , Christina Fragouli

Submodular optimization with bandit feedback has recently been studied in a variety of contexts. In a number of real-world applications such as diversified recommender systems and data summarization, the submodular function exhibits…

Machine Learning · Computer Science 2024-07-04 Wenjing Chen , Victoria G. Crawford

We consider a multi-armed bandit problem in a setting where each arm produces a noisy reward realization which depends on an observable random covariate. As opposed to the traditional static multi-armed bandit problem, this setting allows…

Statistics Theory · Mathematics 2013-05-27 Vianney Perchet , Philippe Rigollet

Classification bandits are multi-armed bandit problems whose task is to classify a given set of arms into either positive or negative class depending on whether the rate of the arms with the expected reward of at least h is not less than w…

Various approaches have emerged for multi-armed bandits in distributed systems. The multiplayer dueling bandit problem, common in scenarios with only preference-based information like human feedback, introduces challenges related to…

Machine Learning · Computer Science 2025-04-24 Or Raveh , Junya Honda , Masashi Sugiyama

In this paper, we explore the use of multi-armed bandit online learning techniques to solve distributed resource selection problems. As an example, we focus on the problem of network selection. Mobile devices often have several wireless…

Computer Science and Game Theory · Computer Science 2018-05-15 Anuja Meetoo Appavoo , Seth Gilbert , Kian-Lee Tan

We formulate a multi-armed bandit (MAB) approach to choosing expert policies online in Markov decision processes (MDPs). Given a set of expert policies trained on a state and action space, the goal is to maximize the cumulative reward of…

Systems and Control · Computer Science 2017-07-19 Eric Mazumdar , Roy Dong , Vicenç Rúbies Royo , Claire Tomlin , S. Shankar Sastry

Stochastic local search (SLS) algorithms have exhibited great effectiveness in finding models of random instances of the Boolean satisfiability problem (SAT). As one of the most widely known and used SLS algorithm, WalkSAT plays a key role…

Artificial Intelligence · Computer Science 2015-12-07 Sixue Liu

Anytime multi-agent path finding (MAPF) is a promising approach to scalable path optimization in large-scale multi-agent systems. State-of-the-art anytime MAPF is based on Large Neighborhood Search (LNS), where a fast initial solution is…

Artificial Intelligence · Computer Science 2024-01-02 Thomy Phan , Taoan Huang , Bistra Dilkina , Sven Koenig

Most recent MaxSAT algorithms rely on a succession of calls to a SAT solver in order to find an optimal solution. In particular, several algorithms take advantage of the ability of SAT solvers to identify unsatisfiable subformulas. Usually,…

Artificial Intelligence · Computer Science 2015-05-12 Miguel Neves , Ruben Martins , Mikoláš Janota , Inês Lynce , Vasco Manquinho

Long-context modeling is critical for a wide range of real-world tasks, including long-context question answering, summarization, and complex reasoning tasks. Recent studies have explored fine-tuning Large Language Models (LLMs) with…

Computation and Language · Computer Science 2026-04-10 Shaohua Duan , Pengcheng Huang , Xinze Li , Zhenghao Liu , Xiaoyuan Yi , Yukun Yan , Shuo Wang , Yu Gu , Ge Yu , Maosong Sun

In the maximum satisfiability problem (MAX-SAT) we are given a propositional formula in conjunctive normal form and have to find an assignment that satisfies as many clauses as possible. We study the parallel parameterized complexity of…

Computational Complexity · Computer Science 2022-06-06 Max Bannach , Malte Skambath , Till Tantau

We study the real-valued combinatorial pure exploration of the multi-armed bandit in the fixed-budget setting. We first introduce the Combinatorial Successive Asign (CSA) algorithm, which is the first algorithm that can identify the best…

Machine Learning · Computer Science 2023-11-16 Shintaro Nakamura , Masashi Sugiyama

Stochastic multi-armed bandits form a class of online learning problems that have important applications in online recommendation systems, adaptive medical treatment, and many others. Even though potential attacks against these learning…

Machine Learning · Computer Science 2019-05-17 Fang Liu , Ness Shroff