中文
相关论文

相关论文: PAC-Bayesian Analysis of the Exploration-Exploitat…

200 篇论文

The bias-variance trade-off is a well-known problem in machine learning that only gets more pronounced the less available data there is. In active learning, where labeled data is scarce or difficult to obtain, neglecting this trade-off can…

PAC-Bayes learning is a comprehensive setting for (i) studying the generalisation ability of learning algorithms and (ii) deriving new learning algorithms by optimising a generalisation bound. However, optimising generalisation bounds might…

机器学习 · 统计学 2024-11-27 Antoine Picard-Weibel , Roman Moscoviz , Benjamin Guedj

Count outcomes in longitudinal studies are frequent in clinical and engineering studies. In frequentist and Bayesian statistical analysis, methods such as Mixed linear models allow the variability or correlation within individuals to be…

统计方法学 · 统计学 2024-07-15 Alejandra Estefanía Patiño Hoyos , Johnatan Cardona Jiménez

Boltzmann exploration is a classic strategy for sequential decision-making under uncertainty, and is one of the most standard tools in Reinforcement Learning (RL). Despite its widespread use, there is virtually no theoretical understanding…

机器学习 · 计算机科学 2017-11-08 Nicolò Cesa-Bianchi , Claudio Gentile , Gábor Lugosi , Gergely Neu

We present a comprehensive study of multilayer neural networks with binary activation, relying on the PAC-Bayesian theory. Our contributions are twofold: (i) we develop an end-to-end framework to train a binary activated deep neural…

机器学习 · 计算机科学 2020-02-05 Gaël Letarte , Pascal Germain , Benjamin Guedj , François Laviolette

We consider an agent who is involved in a Markov decision process and receives a vector of outcomes every round. Her objective is to maximize a global concave reward function on the average vectorial outcome. The problem models applications…

机器学习 · 计算机科学 2019-05-17 Wang Chi Cheung

Bayesian optimization (BO) has become a powerful tool for solving simulation-based engineering optimization problems thanks to its ability to integrate physical and mathematical understandings, consider uncertainty, and address the…

机器学习 · 计算机科学 2024-11-01 Bach Do , Taiwo Adebiyi , Ruda Zhang

While statisticians are well-accustomed to performing exploratory analysis in the modeling stage of an analysis, the notion of conducting preliminary general-purpose exploratory analysis in the Monte Carlo stage (or more generally, the…

统计计算 · 统计学 2012-06-15 Luke Bornn , Pierre Jacob , Pierre Del Moral , Arnaud Doucet

This paper introduces a general Bayesian non- parametric latent feature model suitable to per- form automatic exploratory analysis of heterogeneous datasets, where the attributes describing each object can be either discrete, continuous or…

机器学习 · 统计学 2017-07-27 Isabel Valera , Melanie F. Pradier , Zoubin Ghahramani

Patient-level health economic data collected alongside clinical trials are an important component of the process of technology appraisal, with a view to informing resource allocation decisions. For end of life treatments, such as cancer…

应用统计 · 统计学 2020-11-24 Andrea Gabrio

Missing time-series data is a prevalent problem in many prescriptive analytics models in operations management, healthcare and finance. Imputation methods for time-series data are usually applied to the full panel data with the purpose of…

统计方法学 · 统计学 2023-04-13 Jose Blanchet , Fernando Hernandez , Viet Anh Nguyen , Markus Pelger , Xuhui Zhang

Reliability assessment of engineering systems often requires repeated evaluations of limit-state functions that may rely on computationally expensive high-fidelity models, rendering direct sampling-based reliability analysis impractical. An…

计算工程、金融与科学 · 计算机科学 2026-05-13 Jonathan A. Moran , Pablo G. Morato

PAC-Bayes learning is an established framework to both assess the generalisation ability of learning algorithms, and design new learning algorithm by exploiting generalisation bounds as training objectives. Most of the exisiting bounds…

机器学习 · 统计学 2023-05-31 Maxime Haddouche , Benjamin Guedj

Exciting contemporary machine learning problems have recently been phrased in the classic formalism of tree search -- most famously, the game of Go. Interestingly, the state-space underlying these sequential decision-making problems often…

机器学习 · 计算机科学 2021-06-17 Julia Grosse , Cheng Zhang , Philipp Hennig

We present a novel preference learning framework to capture participant preferences efficiently within limited interaction rounds. It involves three main contributions. First, we develop a variational Bayesian approach to infer the…

机器学习 · 计算机科学 2025-03-20 Yan Wang , Jiapeng Liu , Milosz Kadziński , Xiuwu Liao

We present a unified framework for deriving PAC-Bayesian generalization bounds. Unlike most previous literature on this topic, our bounds are anytime-valid (i.e., time-uniform), meaning that they hold at all stopping times, not only for a…

机器学习 · 统计学 2024-01-04 Ben Chugg , Hongjian Wang , Aaditya Ramdas

We describe a method for Bayesian optimization by which one may incorporate data from multiple systems whose quantitative interrelationships are unknown a priori. All general (nonreal-valued) features of the systems are associated with…

机器学习 · 计算机科学 2020-01-06 Steven Atkinson , Sayan Ghosh , Natarajan Chennimalai-Kumar , Genghis Khan , Liping Wang

The evaluation of fairness models in Machine Learning involves complex challenges, such as defining appropriate metrics, balancing trade-offs between utility and fairness, and there are still gaps in this stage. This work presents a novel…

机器学习 · 计算机科学 2026-03-03 Gökhan Özbulak , Oscar Jimenez-del-Toro , Maíra Fatoretto , Lilian Berton , André Anjos

When utilising PAC-Bayes theory for risk certification, it is usually necessary to estimate and bound the Gibbs risk of the PAC-Bayes posterior. Many works in the literature employ a method for this which requires a large number of passes…

机器学习 · 计算机科学 2022-10-21 Felix Biggs

Equipping artificial agents with useful exploration mechanisms remains a challenge to this day. Humans, on the other hand, seem to manage the trade-off between exploration and exploitation effortlessly. In the present article, we put…

机器学习 · 计算机科学 2022-11-15 Marcel Binz , Eric Schulz