English
Related papers

Related papers: Theory of Optimal Bayesian Feature Filtering

200 papers

Our paper deals with inferring simulator-based statistical models given some observed data. A simulator-based model is a parametrized mechanism which specifies how data are generated. It is thus also referred to as generative model. We…

Machine Learning · Statistics 2016-01-01 Michael U. Gutmann , Jukka Corander

Bayesian optimization is a data-efficient technique that has been shown to be extremely powerful to optimize expensive, black-box, and possibly noisy objective functions. Many applications involve optimizing probabilities and mixtures which…

Machine Learning · Computer Science 2026-03-11 Federico Pavesi , Antonio Candelieri , Noémie Jaquier

We present the Bayesian consensus filter (BCF) for tracking a moving target using a networked group of sensing agents and achieving consensus on the best estimate of the probability distributions of the target's states. Our BCF framework…

Optimization and Control · Mathematics 2016-10-14 Saptarshi Bandyopadhyay , Soon-Jo Chung

Bayesian optimisation has proven to be a powerful tool for expensive global black-box optimisation problems. In this paper, we propose new Bayesian optimisation variants of the popular Knowledge Gradient acquisition functions for problems…

Machine Learning · Computer Science 2025-12-22 Xietao Wang Lin , Juan Ungredda , Max Butler , James Town , Alma Rahat , Hemant Singh , Juergen Branke

Achieving the Bayes optimal binary classification rule subject to group fairness constraints is known to be reducible, in some cases, to learning a group-wise thresholding rule over the Bayes regressor. In this paper, we extend this result…

Machine Learning · Computer Science 2020-06-01 Ibrahim Alabdulmohsin

Finding a globally optimal Bayesian Network using exhaustive search is a problem with super-exponential complexity, which severely restricts the number of variables that it can work for. We implement a dynamic programming based algorithm…

Artificial Intelligence · Computer Science 2022-07-19 Nand Sharma , Joshua Millstein

In this work we introduce a new framework for multi-objective Bayesian optimisation where the multi-objective functions can only be accessed via choice judgements, such as ``I pick options A,B,C among this set of five options A,B,C,D,E''.…

Machine Learning · Statistics 2021-10-18 Alessio Benavoli , Dario Azzimonti , Dario Piga

We demonstrate and explicate Bayesian methods for fitting the parameters that encode the impact of short-distance physics on observables in effective field theories (EFTs). We use Bayes' theorem together with the principle of maximum…

High Energy Physics - Phenomenology · Physics 2009-08-14 Matthias R. Schindler , Daniel R. Phillips

In this paper, we aim to develop a unified view of causal and non-causal feature selection methods. The unified view will fill in the gap in the research of the relation between the two types of methods. Based on the Bayesian network…

Artificial Intelligence · Computer Science 2018-12-18 Kui Yu , Lin Liu , Jiuyong Li

While precise data observation is essential for the learning processes of predictive models, it can be challenging owing to factors such as insufficient observation accuracy, high collection costs, and privacy constraints. In this paper, we…

Machine Learning · Computer Science 2024-09-18 Kosuke Sugiyama , Masato Uchida

M\"ossbauer spectroscopy, which provides knowledge related to electronic states in materials, has been applied to various fields such as condensed matter physics and material sciences. In conventional spectral analyses based on least-square…

Computational Physics · Physics 2022-05-20 Ryota Moriguchi , Satoshi Tsutsui , Shun Katakami , Kenji Nagata , Masaichiro Mizumaki , Masato Okada

Band selection, by choosing a set of representative bands in hyperspectral image (HSI), is an effective method to reduce the redundant information without compromising the original contents. Recently, various unsupervised band selection…

Image and Video Processing · Electrical Eng. & Systems 2019-05-01 Qi Wang , Fahong Zhang , Xuelong Li

Directed evolution is a versatile technique in protein engineering that mimics the process of natural selection by iteratively alternating between mutagenesis and screening in order to search for sequences that optimize a given property of…

Biomolecules · Quantitative Biology 2024-05-02 Lixue Cheng , Ziyi Yang , Changyu Hsieh , Benben Liao , Shengyu Zhang

Most feature detectors such as edge detectors or circle finders are statistical, in the sense that they decide at each point in an image about the presence of a feature, this paper describes the use of Bayesian feature detectors.

Computer Vision and Pattern Recognition · Computer Science 2013-04-15 David Sher

We introduce a flexible, scalable Bayesian inference framework for nonlinear dynamical systems characterised by distinct and hierarchical variability at the individual, group, and population levels. Our model class is a generalisation of…

Machine Learning · Statistics 2019-10-03 Geoffrey Roeder , Paul K. Grant , Andrew Phillips , Neil Dalchau , Edward Meeds

The multivariate normal linear model is one of the most widely employed models for statistical inference in applied research. Special cases include (multivariate) t testing, (M)AN(C)OVA, (multivariate) multiple regression, and repeated…

Methodology · Statistics 2021-03-15 J. Mulder , H. Hoijtink , X. Gu

Click-through prediction (CTR) models transform features into latent vectors and enumerate possible feature interactions to improve performance based on the input feature set. Therefore, when selecting an optimal feature set, we should…

Information Retrieval · Computer Science 2024-03-27 Fuyuan Lyu , Xing Tang , Dugang Liu , Liang Chen , Xiuqiang He , Xue Liu

Feature selection is a process of choosing a subset of relevant features so that the quality of prediction models can be improved. An extensive body of work exists on information-theoretic feature selection, based on maximizing Mutual…

Machine Learning · Computer Science 2016-12-05 Jilin Wu , Soumyajit Gupta , Chandrajit Bajaj

Objective prior distributions represent an important tool that allows one to have the advantages of using the Bayesian framework even when information about the parameters of a model is not available. The usual objective approaches work off…

Methodology · Statistics 2018-09-25 Fabrizio Leisen , Cristiano Villa , Stephen G. Walker

Conventional Bayesian optimal experimental design seeks to maximize the expected information gain (EIG) on model parameters. However, the end goal of the experiment often is not to learn the model parameters, but to predict downstream…

Computation · Statistics 2024-08-20 Atlanta Chakraborty , Xun Huan , Tommie Catanach