English
Related papers

Related papers: Nonparametric learning from Bayesian models with r…

200 papers

Most applications of machine learning to classification assume a closed set of balanced classes. This is at odds with the real world, where class occurrence statistics often follow a long-tailed power-law distribution and it is unlikely…

Machine Learning · Computer Science 2023-11-27 Jake C. Snell , Gianluca Bencomo , Thomas L. Griffiths

A fully Bayesian approach is proposed for ultrahigh-dimensional nonparametric additive models in which the number of additive components may be larger than the sample size, though ideally the true model is believed to include only a small…

Methodology · Statistics 2013-09-24 Zuofeng Shang , Ping Li

Gaussian graphical models provide a powerful framework to reveal the conditional dependency structure between multivariate variables. The process of uncovering the conditional dependency network is known as structure learning. Bayesian…

Methodology · Statistics 2024-07-30 Lucas Vogels , Reza Mohammadi , Marit Schoonhoven , S. Ilker Birbil

Modeling structure in complex networks using Bayesian non-parametrics makes it possible to specify flexible model structures and infer the adequate model complexity from the observed data. This paper provides a gentle introduction to…

Machine Learning · Statistics 2013-12-23 Mikkel N. Schmidt , Morten Mørup

Non-exhaustive learning (NEL) is an emerging machine-learning paradigm designed to confront the challenge of non-stationary environments characterized by anon-exhaustive training sets lacking full information about the available…

Machine Learning · Computer Science 2019-08-27 Yicheng Cheng , Bartek Rajwa , Murat Dundar

Bayesian active learning relies on the precise quantification of predictive uncertainty to explore unknown function landscapes. While Gaussian process surrogates are the standard for such tasks, an underappreciated fact is that their…

Machine Learning · Computer Science 2026-02-03 Sanna Jarl , Maria Bånkestad , Jonathan J. S. Scragg , Jens Sjölund

We derive ensembles of decision trees through a nonparametric Bayesian model, allowing us to view random forests as samples from a posterior distribution. This insight provides large gains in interpretability, and motivates a class of…

Applications · Statistics 2015-05-19 Matt Taddy , Chun-Sheng Chen , Jun Yu , Mitch Wyle

We introduce a class of neural networks derived from probabilistic models in the form of Bayesian networks. By imposing additional assumptions about the nature of the probabilistic models represented in the networks, we derive neural…

Disordered Systems and Neural Networks · Physics 2010-04-30 Michael J. Barber , John W. Clark

We consider the problem of estimating the expected value of information (the knowledge gradient) for Bayesian learning problems where the belief model is nonlinear in the parameters. Our goal is to maximize some metric, while simultaneously…

Machine Learning · Statistics 2016-11-23 Xinyu He , Warren B. Powell

In a meta-analysis, it is important to specify a model that adequately describes the effect-size distribution of the underlying population of studies. The conventional normal fixed-effect and normal random-effects models assume a normal…

Methodology · Statistics 2013-10-21 George Karabatsos , Elizabeth Talbott , Stephen G. Walker

Statistical inference with nonresponse is quite challenging, especially when the response mechanism is nonignorable. In this case, the validity of statistical inference depends on untestable correct specification of the response model. To…

Methodology · Statistics 2021-01-15 Shonosuke Sugasawa , Kosuke Morikawa , Keisuke Takahata

We present a novel approach for training deep neural networks in a Bayesian way. Classical, i.e. non-Bayesian, deep learning has two major drawbacks both originating from the fact that network parameters are considered to be deterministic.…

Machine Learning · Statistics 2019-03-11 Konstantin Posch , Jan Steinbrener , Jürgen Pilz

Recent advances in the field of meta-learning have tackled domains consisting of large numbers of small ("few-shot") supervised learning tasks. Meta-learning algorithms must be able to rapidly adapt to any individual few-shot task, fitting…

Machine Learning · Computer Science 2021-10-22 Vivek Myers , Nikhil Sardana

Obtaining labeled data for machine learning tasks can be prohibitively expensive. Active learning mitigates this issue by exploring the unlabeled data space and prioritizing the selection of data that can best improve the model performance.…

Machine Learning · Computer Science 2021-04-21 Vineeth Rakesh , Swayambhoo Jain

A general Bayesian framework for model selection on random network models regarding their features is considered. The goal is to develop a principle Bayesian model selection approach to compare different fittable, not necessarily nested,…

Methodology · Statistics 2020-04-30 Papamichalis Marios

We present a Bayesian nonparametric system reliability model which scales well and provides a great deal of flexibility in modeling. The Bayesian approach naturally handles the disparate amounts of component and subsystem data that may…

Methodology · Statistics 2022-03-22 Richard L. Warr , Jeremy M. Meyer , Jackson T. Curtis

Non-Bayesian social learning theory provides a framework for distributed inference of a group of agents interacting over a social network by sequentially communicating and updating beliefs about the unknown state of the world through…

Methodology · Statistics 2019-10-25 James Z. Hare , Cesar Uribe , Lance Kaplan , Ali Jadbabaie

Transfer learning is a machine learning paradigm where knowledge from one problem is utilized to solve a new but related problem. While conceivable that knowledge from one task could be useful for solving a related task, if not executed…

Machine Learning · Computer Science 2021-10-01 Xuetong Wu , Jonathan H. Manton , Uwe Aickelin , Jingge Zhu

The Bayesian Lasso is constructed in the linear regression framework and applies the Gibbs sampling to estimate the regression parameters. This paper develops a new sparse learning model, named the Bayesian Lasso Sparse (BLS) model, that…

Machine Learning · Statistics 2022-07-15 Ingvild M. Helgøy , Yushu Li

A Bayesian non-parametric framework for studying time-to-event data is proposed, where the prior distribution is allowed to depend on an additional random source, and may update with the sample size. Such scenarios are natural, for…

Methodology · Statistics 2025-05-06 Martin Bladt , Jorge González Cázares