中文
相关论文

相关论文: Theory of Optimal Bayesian Feature Filtering

200 篇论文

We present Neural Bayesian Filtering (NBF), an algorithm for maintaining distributions over hidden states, called beliefs, in partially observable systems. NBF is trained to find a good latent representation of the beliefs induced by a…

A Bayesian filtering algorithm is developed for a class of state-space systems that can be modelled via Gaussian mixtures. In general, the exact solution to this filtering problem involves an exponential growth in the number of mixture…

机器学习 · 统计学 2023-07-03 Adrian G. Wills , Johannes Hendriks , Christopher Renton , Brett Ninness

In this work we propose a framework to address the issue of state dependent nonlinear equality-constrained state estimation using Bayesian filtering. This framework is constructed specifically for a linear approximation of Bayesian…

最优化与控制 · 数学 2020-03-16 Niladri Das , Raktim Bhattacharya

We derive ensembles of decision trees through a nonparametric Bayesian model, allowing us to view random forests as samples from a posterior distribution. This insight provides large gains in interpretability, and motivates a class of…

应用统计 · 统计学 2015-05-19 Matt Taddy , Chun-Sheng Chen , Jun Yu , Mitch Wyle

The performance of many machine learning models depends on their hyper-parameter settings. Bayesian Optimization has become a successful tool for hyper-parameter optimization of machine learning algorithms, which aims to identify optimal…

机器学习 · 计算机科学 2020-08-04 Lidan Wang , Franck Dernoncourt , Trung Bui

A novel tool, based on Bayesian filtering framework and expectation maximization algorithm, is numerically and experimentally demonstrated for accurate frequency comb noise characterization. The tool is statistically optimum in a…

信号处理 · 电气工程与系统科学 2019-04-29 Giovanni Brajato , Lars Lundberg , Victor Torres-Company , Darko Zibar

We investigate feature selection problem for generic machine learning models. We introduce a novel framework that selects features considering the outcomes of the model. Our framework introduces a novel feature masking approach to eliminate…

机器学习 · 计算机科学 2024-12-10 Mehmet E. Lorasdagi , Mehmet Y. Turali , Suleyman S. Kozat

Bayesian optimal experimental design (OED) seeks to conduct the most informative experiment under budget constraints to update the prior knowledge of a system to its posterior from the experimental data in a Bayesian framework. Such…

机器学习 · 计算机科学 2024-02-29 Rafael Orozco , Felix J. Herrmann , Peng Chen

In a typical supervised machine learning setting, the predictions on all test instances are based on a common subset of features discovered during model training. However, using a different subset of features that is most informative for…

机器学习 · 计算机科学 2021-06-10 Yasitha Warahena Liyanage , Daphney-Stavroula Zois , Charalampos Chelmis

Early phase, personalized dose-finding trials for combination therapies seek to identify patient-specific optimal biological dose (OBD) combinations, which are defined as safe dose combinations which maximize therapeutic benefit for a…

统计方法学 · 统计学 2024-04-18 James Willard , Shirin Golchi , Erica EM Moodie

First Order Bayesian Optimization (FOBO) is a sample efficient sequential approach to find the global maxima of an expensive-to-evaluate black-box objective function by suitably querying for the function and its gradient evaluations. Such…

机器学习 · 计算机科学 2023-06-21 Utkarsh Prakash , Aryan Chollera , Kushagra Khatwani , Prabuchandran K. J. , Tejas Bodas

Bayesian optimization (BO) is an effective approach to optimize expensive black-box functions, that seeks to trade-off between exploitation (selecting parameters where the maximum is likely) and exploration (selecting parameters where we…

机器学习 · 统计学 2021-10-19 Tristan Fauvel , Matthew Chalk

We consider Bayesian optimization of objective functions of the form $\rho[ F(x, W) ]$, where $F$ is a black-box expensive-to-evaluate function and $\rho$ denotes either the VaR or CVaR risk measure, computed with respect to the randomness…

机器学习 · 统计学 2020-11-05 Sait Cakmak , Raul Astudillo , Peter Frazier , Enlu Zhou

Bayesian Optimisation (BO) methods seek to find global optima of objective functions which are only available as a black-box or are expensive to evaluate. Such methods construct a surrogate model for the objective function, quantifying the…

机器学习 · 统计学 2023-01-10 Enrico Crovini , Simon L. Cotter , Konstantinos Zygalakis , Andrew B. Duncan

Performing optimal Bayesian design for discriminating between competing models is computationally intensive as it involves estimating posterior model probabilities for thousands of simulated datasets. This issue is compounded further when…

统计方法学 · 统计学 2022-04-07 Markus Hainy , David J. Price , Olivier Restif , Christopher Drovandi

Bayesian optimization offers a flexible framework to optimize an objective function that is expensive to be evaluated. A Bayesian optimizer iteratively queries the function values on its carefully selected points. Subsequently, it makes a…

机器学习 · 计算机科学 2019-06-25 Yang Li , Yaqiang Yao

Online selection of dynamic features has attracted intensive interest in recent years. However, existing online feature selection methods evaluate features individually and ignore the underlying structure of feature stream. For instance, in…

计算机视觉与模式识别 · 计算机科学 2016-08-23 Jing Wang , Meng Wang , Peipei Li , Luoqi Liu , Zhongqiu Zhao , Xuegang Hu , Xindong Wu

Feature selection is an important task in many problems occurring in pattern recognition, bioinformatics, machine learning and data mining applications. The feature selection approach enables us to reduce the computation burden and the…

机器学习 · 计算机科学 2016-08-30 Hadi Zare , Mojtaba Niazi

Bayesian optimisation is a powerful tool to solve expensive black-box problems, but fails when the stationary assumption made on the objective function is strongly violated, which is the case in particular for ill-conditioned or…

机器学习 · 统计学 2019-12-06 Victor Picheny , Sattar Vakili , Artem Artemev

This paper is concerned with sequential state filtering in the presence of nonlinearity, non-Gaussianity and model uncertainty. For this problem, the Bayesian model averaged particle filter (BMAPF) is perhaps one of the most efficient…

统计计算 · 统计学 2020-01-28 Bin Liu