English
Related papers

Related papers: Mean field variational Bayesian inference for supp…

200 papers

We propose a scalable variational Bayes method for statistical inference for a single or low-dimensional subset of the coordinates of a high-dimensional parameter in sparse linear regression. Our approach relies on assigning a mean-field…

Machine Learning · Statistics 2025-08-12 Ismaël Castillo , Alice L'Huillier , Kolyan Ray , Luke Travis

The support vector machine (SVM) and minimum Euclidean norm least squares regression are two fundamentally different approaches to fitting linear models, but they have recently been connected in models for very high-dimensional data through…

Machine Learning · Computer Science 2021-10-28 Navid Ardeshir , Clayton Sanford , Daniel Hsu

In this paper we consider the simulation-based Bayesian analysis of stochastic volatility in mean (SVM) models. Extending the highly efficient Markov chain Monte Carlo mixture sampler for the SV model proposed in Kim et al. (1998) and Omori…

Econometrics · Economics 2024-11-21 Daichi Hiraki , Siddhartha Chib , Yasuhiro Omori

There has been an intense development on the estimation of a sparse regression coefficient vector in statistics, machine learning and related fields. In this paper, we focus on the Bayesian approach to this problem, where sparsity is…

Computation · Statistics 2016-02-25 Xichen Huang , Jin Wang , Feng Liang

Sparse Bayesian learning is a state-of-the-art supervised learning algorithm that can choose a subset of relevant samples from the input data and make reliable probabilistic predictions. However, in the presence of high-dimensional data…

Machine Learning · Computer Science 2020-01-10 Bingbing Jiang , Chang Li , Maarten de Rijke , Xin Yao , Huanhuan Chen

Support vector machines represent a promising development in machine learning research that is not widely used within the remote sensing community. This paper reports the results of Multispectral(Landsat-7 ETM+) and Hyperspectral DAIS)data…

Neural and Evolutionary Computing · Computer Science 2009-11-13 Mahesh Pal , Paul M. Mather

In this article, a large dimensional performance analysis of kernel least squares support vector machines (LS-SVMs) is provided under the assumption of a two-class Gaussian mixture model for the input data. Building upon recent advances in…

Machine Learning · Statistics 2021-03-18 Zhenyu Liao , Romain Couillet

We present a variational method for online state estimation and parameter learning in state-space models (SSMs), a ubiquitous class of latent variable models for sequential data. As per standard batch variational techniques, we use…

Machine Learning · Statistics 2022-06-16 Andrew Campbell , Yuyang Shi , Tom Rainforth , Arnaud Doucet

We present a scalable approach to performing approximate fully Bayesian inference in generic state space models. The proposed method is an alternative to particle MCMC that provides fully Bayesian inference of both the dynamic latent states…

Machine Learning · Statistics 2019-02-13 Marcel Hirt , Petros Dellaportas

Variational Bayes (VB) is a popular scalable alternative to Markov chain Monte Carlo for Bayesian inference. We study a mean-field spike and slab VB approximation of widely used Bayesian model selection priors in sparse high-dimensional…

Machine Learning · Statistics 2021-09-07 Kolyan Ray , Botond Szabo , Gabriel Clara

Bayesian models provide a framework for probabilistic modelling of complex datasets. However, many of such models are computationally demanding especially in the presence of large datasets. On the other hand, in sensor network applications,…

Machine Learning · Computer Science 2015-07-06 Behnam Babagholami-Mohamadabadi , Sejong Yoon , Vladimir Pavlovic

Support Vector Machine (SVM) is a powerful tool in binary classification, known to attain excellent misclassification rates. On the other hand, many realworld classification problems, such as those found in medical diagnosis, churn or fraud…

Machine Learning · Statistics 2023-12-25 Sandra Benítez-Peña , Rafael Blanquero , Emilio Carrizosa , Pepa Ramírez-Cobo

We use Bayesian model selection paradigms, such as group least absolute shrinkage and selection operator priors, to facilitate generalized additive model selection. Our approach allows for the effects of continuous predictors to be…

Methodology · Statistics 2023-09-29 Virginia X. He , Matt P. Wand

Support Vector Machines (SVMs) with various kernels have played dominant role in machine learning for many years, finding numerous applications. Although they have many attractive features interpretation of their solutions is quite…

Machine Learning · Computer Science 2019-01-29 Tomasz Maszczyk , Włodzisław Duch

Mean-field Variational Bayes (MFVB) is an approximate Bayesian posterior inference technique that is increasingly popular due to its fast runtimes on large-scale datasets. However, even when MFVB provides accurate posterior means for…

Methodology · Statistics 2018-10-18 Ryan Giordano , Tamara Broderick , Michael I. Jordan

Support vector machines (SVMs) are widely used machine learning models (e.g., in remote sensing), with formulations for both classification and regression tasks. In the last years, with the advent of working quantum annealers, hybrid SVM…

Emerging Technologies · Computer Science 2024-11-05 Enrico Zardini , Amer Delilbasic , Enrico Blanzieri , Gabriele Cavallaro , Davide Pastorello

Mean-Field is an efficient way to approximate a posterior distribution in complex graphical models and constitutes the most popular class of Bayesian variational approximation methods. In most applications, the mean field distribution…

Machine Learning · Computer Science 2015-02-23 Pierre Baqué , Jean-Hubert Hours , François Fleuret , Pascal Fua

Variational Bayes (VB) has been used to facilitate the calculation of the posterior distribution in the context of Bayesian inference of the parameters of nonlinear models from data. Previously an analytical formulation of VB has been…

Signal Processing · Electrical Eng. & Systems 2020-07-06 Michael A. Chappell , Martin S. Craig , Mark W. Woolrich

We address the problem of model selection for Support Vector Machine (SVM) classification. For fixed functional form of the kernel, model selection amounts to tuning kernel parameters and the slack penalty coefficient $C$. We begin by…

Disordered Systems and Neural Networks · Physics 2007-05-23 Carl Gold , Peter Sollich

Objective: Brain networks have gained increasing recognition as potential biomarkers in mental health studies, but there are limited approaches that can leverage complex brain networks for accurate classification. Our goal is to develop a…

Methodology · Statistics 2022-05-25 Jin Ming , Suprateek Kundu