中文
相关论文

相关论文: Robust Bayesian Optimization with Student-t Likeli…

200 篇论文

We propose a general solution to the problem of robust Bayesian inference in complex settings where outliers may be present. In practice, the automation of robust Bayesian analyses is important in the many applications involving large and…

统计方法学 · 统计学 2022-04-15 Jeremie Houssineau , David J. Nott

This study investigates the application of Bayesian Optimization (BO) for the hyperparameter tuning of neural networks, specifically targeting the enhancement of Convolutional Neural Networks (CNN) for image classification tasks. Bayesian…

机器学习 · 计算机科学 2024-10-30 Gabriele Onorato

Bayesian optimization is a powerful tool for fine-tuning the hyper-parameters of a wide variety of machine learning models. The success of machine learning has led practitioners in diverse real-world settings to learn classifiers for…

机器学习 · 统计学 2015-02-24 Matt J. Kusner , Jacob R. Gardner , Roman Garnett , Kilian Q. Weinberger

We propose a generative model for robust tensor factorization in the presence of both missing data and outliers. The objective is to explicitly infer the underlying low-CP-rank tensor capturing the global information and a sparse tensor…

计算机视觉与模式识别 · 计算机科学 2016-06-21 Qibin Zhao , Guoxu Zhou , Liqing Zhang , Andrzej Cichocki , Shun-ichi Amari

Gaussian processes (GPs) are non-parametric probabilistic regression models that are popular due to their flexibility, data efficiency, and well-calibrated uncertainty estimates. However, standard GP models assume homoskedastic Gaussian…

机器学习 · 计算机科学 2025-01-08 Sebastian Ament , Elizabeth Santorella , David Eriksson , Ben Letham , Maximilian Balandat , Eytan Bakshy

We consider the problem of optimizing expensive black-box functions over high-dimensional combinatorial spaces which arises in many science, engineering, and ML applications. We use Bayesian Optimization (BO) and propose a novel surrogate…

A Gaussian measurement error assumption, i.e., an assumption that the data are observed up to Gaussian noise, can bias any parameter estimation in the presence of outliers. A heavy tailed error assumption based on Student's t distribution…

统计方法学 · 统计学 2018-11-30 Hyungsuk Tak , Justin A. Ellis , Sujit K. Ghosh

Many engineering problems involve the optimization of computationally expensive models for which derivative information is not readily available. The Bayesian optimization (BO) framework is a particularly promising approach for solving…

最优化与控制 · 数学 2022-02-10 Joel A. Paulson , Congwen Lu

Bayesian optimization (BO) is a powerful framework for optimizing expensive black-box objectives, yet extending it to graph-structured domains remains challenging due to the discrete and combinatorial nature of graphs. Existing approaches…

机器学习 · 计算机科学 2025-11-12 Shu Hong , Yongsheng Mei , Mahdi Imani , Tian Lan

Robust training of machine learning models in the presence of outliers has garnered attention across various domains. The use of robust losses is a popular approach and is known to mitigate the impact of outliers. We bring to light two…

机器学习 · 计算机科学 2025-01-03 Rajat Talak , Charis Georgiou , Jingnan Shi , Luca Carlone

Bayesian Student-$t$ linear regression is a common robust alternative to the normal model, but its theoretical properties are not well understood. We aim to fill some gaps by providing analyses in two different asymptotic scenarios. The…

统计理论 · 数学 2023-02-08 Philippe Gagnon , Yoshiko Hayashi

Bayesian Optimization (BO) is used to find the global optima of black box functions. In this work, we propose a practical BO method of function compositions where the form of the composition is known but the constituent functions are…

机器学习 · 计算机科学 2023-05-02 Kunal Jain , Prabuchandran K. J. , Tejas Bodas

We propose to use Bayesian optimization (BO) to improve the efficiency of the design selection process in clinical trials. BO is a method to optimize expensive black-box functions, by using a regression as a surrogate to guide the search.…

统计方法学 · 统计学 2021-05-20 Jakob Richter , Tim Friede , Jörg Rahnenführer

Distributional shifts pose a significant challenge to achieving robustness in contemporary machine learning. To overcome this challenge, robust satisficing (RS) seeks a robust solution to an unspecified distributional shift while achieving…

机器学习 · 计算机科学 2023-08-17 Artun Saday , Yaşar Cahit Yıldırım , Cem Tekin

The optimization of expensive black-box functions is ubiquitous in science and engineering. A common solution to this problem is Bayesian optimization (BO), which is generally comprised of two components: (i) a surrogate model and (ii) an…

The task of robust linear estimation in the presence of outliers is of particular importance in signal processing, statistics and machine learning. Although the problem has been stated a few decades ago and solved using classical…

信息论 · 计算机科学 2023-07-19 George Papageorgiou , Pantelis Bouboulis , Sergios Theodoridis , Kostantinos Themelis

Bayesian optimization (BO) algorithms form a class of surrogate-based heuristics, aimed at efficiently computing high-quality solutions for numerical black-box optimization problems. The BO pipeline is highly modular, with different design…

机器学习 · 计算机科学 2022-11-18 Carolin Benjamins , Anja Jankovic , Elena Raponi , Koen van der Blom , Marius Lindauer , Carola Doerr

Bayesian Optimization (BO) is a widely used approach for blackbox optimization that leverages a Gaussian process (GP) model and an acquisition function to guide future sampling. While effective in low-dimensional settings, BO faces…

机器学习 · 计算机科学 2025-11-26 Pavankumar Koratikere , Leifur Leifsson

Bayesian optimization (BO) is a global optimization strategy designed to find the minimum of an expensive black-box function, typically defined on a compact subset of $\mathcal{R}^d$, by using a Gaussian process (GP) as a surrogate model…

机器学习 · 统计学 2018-09-24 Eero Siivola , Aki Vehtari , Jarno Vanhatalo , Javier González , Michael Riis Andersen

This study introduces an outlier-robust model for analyzing hierarchically structured bounded count data within a Bayesian framework, utilizing a logistic regression approach implemented in JAGS. Our model incorporates a t-distributed…

统计方法学 · 统计学 2026-02-17 Divan A. Burger , Sean van der Merwe , Emmanuel Lesaffre