English
Related papers

Related papers: Bayesian Nonlinear Support Vector Machines for Big…

200 papers

Distributed inference/estimation in Bayesian framework in the context of sensor networks has recently received much attention due to its broad applicability. The variational Bayesian (VB) algorithm is a technique for approximating…

Machine Learning · Statistics 2020-11-30 Junhao Hua , Chunguang Li

We use Bayesian model selection paradigms, such as group least absolute shrinkage and selection operator priors, to facilitate generalized additive model selection. Our approach allows for the effects of continuous predictors to be…

Methodology · Statistics 2023-09-29 Virginia X. He , Matt P. Wand

Linear mixed effects models are widely used in statistical modelling. We consider a mixed effects model with Bayesian variable selection in the random effects using spike-and-slab priors and developed a variational Bayes inference scheme…

Methodology · Statistics 2024-08-15 M-Z. Spyropoulou , J. Hopker , J. E. Griffin

Bayesian neural networks (BNNs) augment deep networks with uncertainty quantification by Bayesian treatment of the network weights. However, such models face the challenge of Bayesian inference in a high-dimensional and usually…

Machine Learning · Computer Science 2021-03-30 Zhijie Deng , Yucen Luo , Jun Zhu , Bo Zhang

Active learning methods for neural networks are usually based on greedy criteria which ultimately give a single new design point for the evaluation. Such an approach requires either some heuristics to sample a batch of design points at one…

Machine Learning · Computer Science 2020-01-28 Evgenii Tsymbalov , Sergei Makarychev , Alexander Shapeev , Maxim Panov

We introduce implicit Bayesian neural networks, a simple and scalable approach for uncertainty representation in deep learning. Standard Bayesian approach to deep learning requires the impractical inference of the posterior distribution…

Machine Learning · Statistics 2020-10-27 Trung Trinh , Samuel Kaski , Markus Heinonen

Solving different types of optimization models (including parameters fitting) for support vector machines on large-scale training data is often an expensive computational task. This paper proposes a multilevel algorithmic framework that…

Machine Learning · Statistics 2014-10-14 Talayeh Razzaghi , Ilya Safro

We show how to use a variational approximation to the logistic function to perform approximate inference in Bayesian networks containing discrete nodes with continuous parents. Essentially, we convert the logistic function to a Gaussian,…

Artificial Intelligence · Computer Science 2013-01-30 Kevin Murphy

Varying coefficient models are popular for estimating nonlinear regression functions in functional data models. Their Bayesian variants have received limited attention in large data applications, primarily due to prohibitively slow…

Machine Learning · Statistics 2025-06-03 Rajarshi Guhaniyogi , Laura Baracaldo , Sudipto Banerjee

In this article, we primarily propose a novel Bayesian characterization of stationary and nonstationary stochastic processes. In practice, this theory aims to distinguish between global stationarity and nonstationarity for both parametric…

Statistics Theory · Mathematics 2020-05-04 Sucharita Roy , Sourabh Bhattacharya

How can we perform efficient inference and learning in directed probabilistic models, in the presence of continuous latent variables with intractable posterior distributions, and large datasets? We introduce a stochastic variational…

Machine Learning · Statistics 2022-12-13 Diederik P Kingma , Max Welling

Variational inference methods have been shown to lead to significant improvements in the computational efficiency of approximate Bayesian inference in mixed multinomial logit models when compared to standard Markov-chain Monte Carlo (MCMC)…

Computation · Statistics 2020-04-14 Filipe Rodrigues

Spike-and-slab and horseshoe regression are arguably the most popular Bayesian variable selection approaches for linear regression models. However, their performance can deteriorate if outliers and heteroskedasticity are present in the…

Methodology · Statistics 2022-10-20 Alberto Cabezas , Marco Battiston , Christopher Nemeth

There has been considerable recent interest in Bayesian modeling of high-dimensional networks via latent space approaches. When the number of nodes increases, estimation based on Markov Chain Monte Carlo can be extremely slow and show poor…

Computation · Statistics 2022-05-30 Emanuele Aliverti , Massimiliano Russo

Understanding how stochastic gene expression is regulated in biological systems using snapshots of single-cell transcripts requires state-of-the-art methods of computational analysis and statistical inference. A Bayesian approach to…

Quantitative Methods · Quantitative Biology 2018-12-10 Yen Ting Lin , Nicolas E. Buchler

We propose a Bayesian variable selection method in the framework of modal regression for heavy-tailed responses. An efficient expectation-maximization algorithm is employed to expedite parameter estimation. A test statistic is constructed…

Methodology · Statistics 2025-10-29 Jiasong Duan , Hongmei Zhang , Xianzheng Huang

In recent years dynamical modelling has been provided with a range of breakthrough methods to perform exact Bayesian inference. However it is often computationally unfeasible to apply exact statistical methodologies in the context of large…

Computation · Statistics 2014-12-24 Umberto Picchini , Julie Lyng Forman

Parameter identification and comparison of dynamical systems is a challenging task in many fields. Bayesian approaches based on Gaussian process regression over time-series data have been successfully applied to infer the parameters of a…

Machine Learning · Statistics 2019-03-04 Philippe Wenk , Alkis Gotovos , Stefan Bauer , Nico Gorbach , Andreas Krause , Joachim M. Buhmann

This paper proposes a Vector Autoregression augmented with nonlinear factors that are modeled nonparametrically using regression trees. There are four main advantages of our model. First, modeling potential nonlinearities nonparametrically…

Econometrics · Economics 2025-08-20 Todd Clark , Florian Huber , Gary Koop

A mean field variational Bayes approach to support vector machines (SVMs) using the latent variable representation on Polson & Scott (2012) is presented. This representation allows circumvention of many of the shortcomings associated with…

Methodology · Statistics 2013-05-14 Jan Luts , John T. Ormerod