中文
相关论文

相关论文: PAC-Bayesian Analysis of the Exploration-Exploitat…

200 篇论文

We introduce Parameterized Exploration (PE), a simple family of methods for model-based tuning of the exploration schedule in sequential decision problems. Unlike common heuristics for exploration, our method accounts for the time horizon…

机器学习 · 计算机科学 2019-07-16 Jesse Clifton , Lili Wu , Eric Laber

The exploration-exploitation trade-off is central to the description of adaptive behaviour in fields ranging from machine learning, to biology, to economics. While many approaches have been taken, one approach to solving this trade-off has…

机器学习 · 计算机科学 2021-11-29 Beren Millidge , Anil Seth , Christopher Buckley

We propose a new PAC-Bayesian bound and a way of constructing a hypothesis space, so that the bound is convex in the posterior distribution and also convex in a trade-off parameter between empirical performance of the posterior distribution…

机器学习 · 计算机科学 2017-08-25 Niklas Thiemann , Christian Igel , Olivier Wintenberger , Yevgeny Seldin

This paper is devoted to the bipartite ranking problem, a classical statistical learning task, in a high dimensional setting. We propose a scoring and ranking strategy based on the PAC-Bayesian approach. We consider nonlinear additive…

机器学习 · 统计学 2019-05-20 Benjamin Guedj , Sylvain Robbiano

We propose a novel Bayesian model selection technique on linear mixed-effects models to compare multiple treatments with a control. A fully Bayesian approach is implemented to estimate the marginal inclusion probabilities that provide a…

应用统计 · 统计学 2015-09-28 Lei Gong , James M. Flegal , Stephen R. Spindler , Patricia L. Mote

We use the PAC-Bayesian theory for the setting of learning-to-optimize. To the best of our knowledge, we present the first framework to learn optimization algorithms with provable generalization guarantees (PAC-Bayesian bounds) and explicit…

机器学习 · 计算机科学 2025-02-26 Michael Sucker , Jalal Fadili , Peter Ochs

An autonomous experimentation platform in manufacturing is supposedly capable of conducting a sequential search for finding suitable manufacturing conditions by itself or even for discovering new materials with minimal human intervention.…

机器学习 · 计算机科学 2024-10-03 Imtiaz Ahmed , Satish Bukkapatnam , Bhaskar Botcha , Yu Ding

The inherent trade-off in on-line learning is between exploration and exploitation. A good balance between these two (conflicting) goals can achieve a better long-term performance. Can we define an optimal balance? We propose to study this…

信息论 · 计算机科学 2024-11-06 Ram Zamir , Kenneth Rose

Preference-based many-objective optimization faces two obstacles: an expanding space of trade-offs and heterogeneous, context-dependent human value structures. Towards this, we propose a Bayesian framework that learns a small set of latent…

机器学习 · 计算机科学 2026-03-31 Manisha Dubey , Sebastiaan De Peuter , Wanrong Wang , Samuel Kaski

Recent advances in the binary classification setting by Hanneke [2016b] and Larsen [2023] have resulted in optimal PAC learners. These learners leverage, respectively, a clever deterministic subsampling scheme and the classic heuristic of…

机器学习 · 计算机科学 2025-02-10 Mikael Møller Høgsgaard

The combination of the Bayesian game and learning has a rich history, with the idea of controlling a single agent in a system composed of multiple agents with unknown behaviors given a set of types, each specifying a possible behavior for…

机器学习 · 计算机科学 2024-11-21 Tongxin Li , Tinashe Handina , Shaolei Ren , Adam Wierman

The optimization of expensive-to-evaluate black-box functions over combinatorial structures is an ubiquitous task in machine learning, engineering and the natural sciences. The combinatorial explosion of the search space and costly…

机器学习 · 统计学 2018-10-11 Ricardo Baptista , Matthias Poloczek

Integrative analyses based on statistically relevant associations between genomics and a wealth of intermediary phenotypes (such as imaging) provide vital insights into their clinical relevance in terms of the disease mechanisms. Estimates…

Multi-armed bandit problems are the most basic examples of sequential decision problems with an exploration-exploitation trade-off. This is the balance between staying with the option that gave highest payoffs in the past and exploring new…

机器学习 · 计算机科学 2012-11-06 Sébastien Bubeck , Nicolò Cesa-Bianchi

Several methods of preference modeling, ranking, voting and multi-criteria decision making include pairwise comparisons. It is usually simpler to compare two objects at a time, furthermore, some relations (e.g., the outcome of sports…

Randomized controlled experiments assess new policy impacts on performance metrics to inform launch decisions. Traditional approaches evaluate metrics independently despite correlations, and mixed results (e.g., positive revenue impact,…

应用统计 · 统计学 2026-01-29 Hoiyi Ng , Guido Imbens

We propose a MAP Bayesian approach to perform and evaluate a co-clustering of mixed-type data tables. The proposed model infers an optimal segmentation of all variables then performs a co-clustering by minimizing a Bayesian model selection…

机器学习 · 统计学 2019-02-07 Aichetou Bouchareb , Marc Boullé , Fabrice Rossi , Fabrice Clérot

Optimization of accelerator performance parameters is limited by numerous trade-offs and finding the appropriate balance between optimization goals for an unknown system is challenging to achieve. Here we show that multi-objective Bayesian…

加速器物理 · 物理学 2023-03-29 F. Irshad , C. Eberle , F. M. Foerster , K. v. Grafenstein , F. Haberstroh , E. Travac , N. Weisse , S. Karsch , A. Döpp

We advance the study of incentivized bandit exploration, in which arm choices are viewed as recommendations and are required to be Bayesian incentive compatible. Recent work has shown under certain independence assumptions that after…

计算机科学与博弈论 · 计算机科学 2024-09-25 Mark Sellke

Preferential Bayesian optimization allows optimization of objectives that are either expensive or difficult to measure directly, by relying on a minimal number of comparative evaluations done by a human expert. Generating candidate…