中文
相关论文

相关论文: PAC-Bayesian Analysis of the Exploration-Exploitat…

200 篇论文

The exploration-exploitation dilemma has been an intriguing and unsolved problem within the framework of reinforcement learning. "Optimism in the face of uncertainty" and model building play central roles in advanced exploration methods.…

人工智能 · 计算机科学 2008-10-21 István Szita , András Lőrincz

Ecologists increasingly rely on Bayesian methods to fit capture-recapture models. Capture-recapture models are used to estimate abundance while accounting for imperfect detectability in individual-level data. A variety of implementations…

统计方法学 · 统计学 2023-02-01 Mevin B Hooten , Michael R Schwob , Devin S Johnson , Jacob S. Ivan

This paper proposes a new randomized strategy for adaptive MCMC using Bayesian optimization. This approach applies to non-differentiable objective functions and trades off exploration and exploitation to reduce the number of potentially…

统计计算 · 统计学 2011-11-01 Nimalan Mahendran , Ziyu Wang , Firas Hamze , Nando de Freitas

Bayesian decision analysis is a useful method for risk management decisions, but is limited in its ability to consider severe uncertainty in knowledge, and value ambiguity in management objectives. We study the use of robust Bayesian…

应用统计 · 统计学 2022-07-15 Ullrika Sahlin , Matthias C. M. Troffaes , Lennart Edsman

Mutual independence is a key concept in statistics that characterizes the structural relationships between variables. Existing methods to investigate mutual independence rely on the definition of two competing models, one being nested into…

机器学习 · 统计学 2023-08-09 Guillaume Marrelec , Alain Giron

The predominance of machine learning models in many spheres of human activity has led to a growing demand for their transparency. The transparency of models makes it possible to discern some factors, such as security or non-discrimination.…

机器学习 · 计算机科学 2026-01-16 Niffa Cheick Oumar Diaby , Thierry Duchesne , Mario Marchand

Qualitative probabilistic reasoning in a Bayesian network often reveals tradeoffs: relationships that are ambiguous due to competing qualitative influences. We present two techniques that combine qualitative and numeric probabilistic…

人工智能 · 计算机科学 2013-02-01 Chao-Lin Liu , Michael P. Wellman

Bayesian optimization is a sample-efficient approach to global optimization that relies on theoretically motivated value heuristics (acquisition functions) to guide its search process. Fully maximizing acquisition functions produces the…

机器学习 · 统计学 2018-12-04 James T. Wilson , Frank Hutter , Marc Peter Deisenroth

Probabilistic generative modeling of data distributions can potentially exploit hidden information which is useful for discriminative classification. This observation has motivated the development of approaches that couple generative and…

机器学习 · 计算机科学 2012-04-17 Xiong Li , Tai Sing Lee , Yuncai Liu

Sample-efficient exploration is crucial not only for discovering rewarding experiences but also for adapting to environment changes in a task-agnostic fashion. A principled treatment of the problem of optimal input synthesis for system…

机器学习 · 计算机科学 2019-10-10 Matthias Schultheis , Boris Belousov , Hany Abdulsamad , Jan Peters

Our comment on Garc\'ia-Donato et al. (2025). "Model uncertainty and missing data: An objective Bayesian perspective" explores a further extension of the proposed methodology. Specifically, we consider the sequential setting where…

统计方法学 · 统计学 2025-10-01 Sebastian Arnold , Alexander Ly

In certain complex optimization tasks, it becomes necessary to use multiple measures to characterize the performance of different algorithms. This paper presents a method that combines ordinal effect sizes with Pareto dominance to analyze…

神经与进化计算 · 计算机科学 2018-06-08 Eivind Samuelsen , Kyrre Glette

In this paper, we present refined probabilistic bounds on empirical reward estimates for off-policy learning in bandit problems. We build on the PAC-Bayesian bounds from Seldin et al. (2010) and improve on their results using a new…

机器学习 · 统计学 2025-02-18 Amaury Gouverneur , Tobias J. Oechtering , Mikael Skoglund

We introduce and study a unified Bayesian framework for extended feature allocations which flexibly captures interactions -- such as repulsion or attraction -- among features and their associated weights. We provide a complete Bayesian…

统计理论 · 数学 2025-03-04 Mario Beraha , Federico Camerlenghi , Lorenzo Ghilotti

Comparing competing mathematical models of complex natural processes is a shared goal among many branches of science. The Bayesian probabilistic framework offers a principled way to perform model comparison and extract useful metrics for…

Recent discussion in the public sphere about algorithmic classification has involved tension between competing notions of what it means for a probabilistic classification to be fair to different groups. We formalize three fairness…

机器学习 · 计算机科学 2016-11-18 Jon Kleinberg , Sendhil Mullainathan , Manish Raghavan

We study the problem of causal discovery through targeted interventions. Starting from few observational measurements, we follow a Bayesian active learning approach to perform those experiments which, in expectation with respect to the…

机器学习 · 统计学 2019-10-10 Julius von Kügelgen , Paul K Rubenstein , Bernhard Schölkopf , Adrian Weller

The PAC-Bayesian approach is a powerful set of techniques to derive non- asymptotic risk bounds for random estimators. The corresponding optimal distribution of estimators, usually called the Gibbs posterior, is unfortunately intractable.…

机器学习 · 统计学 2015-06-16 Pierre Alquier , James Ridgway , Nicolas Chopin

We propose a simple yet effective solution to tackle the often-competing goals of fairness and utility in classification tasks. While fairness ensures that the model's predictions are unbiased and do not discriminate against any particular…

机器学习 · 计算机科学 2023-08-16 Anique Tahir , Lu Cheng , Huan Liu

Machine learning models are deployed as a central component in decision making and policy operations with direct impact on individuals' lives. In order to act ethically and comply with government regulations, these models need to make fair…

机器学习 · 计算机科学 2023-11-28 Bogdan Ficiu , Neil D. Lawrence , Andrei Paleyes