English
Related papers

Related papers: Bayesian Semi-structured Subspace Inference

200 papers

A powerful and flexible approach to structured prediction consists in embedding the structured objects to be predicted into a feature space of possibly infinite dimension by means of output kernels, and then, solving a regression problem in…

Machine Learning · Statistics 2020-11-03 Luc Brogat-Motte , Alessandro Rudi , Céline Brouard , Juho Rousu , Florence d'Alché-Buc

The features in high dimensional biomedical prediction problems are often well described with lower dimensional manifolds. An example is genes that are organised in smaller functional networks. The outcome can then be described with the…

The remarkable generalization performance of large-scale models has been challenging the conventional wisdom of the statistical learning theory. Although recent theoretical studies have shed light on this behavior in linear models and…

Machine Learning · Statistics 2024-06-18 Tomoya Wakayama

We introduce a new Bayesian multi-class support vector machine by formulating a pseudo-likelihood for a multi-class hinge loss in the form of a location-scale mixture of Gaussians. We derive a variational-inference-based training objective…

Machine Learning · Computer Science 2018-06-08 Martin Wistuba , Ambrish Rawat

This paper presents a new Bayesian model and algorithm for nonlinear unmixing of hyperspectral images. The model proposed represents the pixel reflectances as linear combinations of the endmembers, corrupted by nonlinear (with respect to…

Methodology · Statistics 2015-10-06 Yoann Altmann , Marcelo Pereyra , Stephen McLaughlin

Social and economic studies are often implemented as complex survey designs. For example, multistage, unequal probability sampling designs utilized by federal statistical agencies are typically constructed to maximize the efficiency of the…

Methodology · Statistics 2020-06-09 Matthew R. Williams , Terrance D. Savitsky

The spatial linear mixed model (SLMM) consists of fixed and spatial random effects that may be linearly dependent. Partially motivated as a means to address potential issues with confounding, the Restricted spatial regression (RSR) model…

Methodology · Statistics 2026-03-24 Jonathan R. Bradley

Reliable predictive uncertainty estimation plays an important role in enabling the deployment of neural networks to safety-critical settings. A popular approach for estimating the predictive uncertainty of neural networks is to define a…

Machine Learning · Statistics 2023-12-29 Tim G. J. Rudner , Zonghao Chen , Yee Whye Teh , Yarin Gal

Constructing good representations is critical for learning complex tasks in a sample efficient manner. In the context of meta-learning, representations can be constructed from common patterns of previously seen tasks so that a future task…

Machine Learning · Computer Science 2021-03-02 Halil Ibrahim Gulluk , Yue Sun , Samet Oymak , Maryam Fazel

This paper proposes a new approach to address the problem of unmeasured confounding in spatial designs. Spatial confounding occurs when some confounding variables are unobserved and not included in the model, leading to distorted…

Methodology · Statistics 2025-03-05 Carlo Zaccardi , Pasquale Valentini , Luigi Ippoliti , Alexandra M. Schmidt

Modeling uncertainty in deep neural networks, despite recent important advances, is still an open problem. Bayesian neural networks are a powerful solution, where the prior over network weights is a design choice, often a normal…

Machine Learning · Statistics 2019-10-29 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Gal Novik

The declining response rates in probability surveys along with the widespread availability of unstructured data has led to growing research into non-probability samples. Existing robust approaches are not well-developed for non-Gaussian…

Methodology · Statistics 2022-03-29 Ali Rafei , Michael R. Elliott , Carol A. C. Flannagan

Penalized likelihood and quasi-likelihood methods dominate inference in high-dimensional linear mixed-effects models. Sampling-based Bayesian inference is less explored due to the computational bottlenecks introduced by the random effects…

Methodology · Statistics 2025-07-24 Sreya Sarkar , Kshitij Khare , Sanvesh Srivastava

We present a flexible Bayesian semiparametric mixed model for longitudinal data analysis in the presence of potentially high-dimensional categorical covariates. Building on a novel hidden Markov tensor decomposition technique, our proposed…

Methodology · Statistics 2022-08-05 Giorgio Paulon , Peter Müller , Abhra Sarkar

A fully Bayesian approach is proposed for ultrahigh-dimensional nonparametric additive models in which the number of additive components may be larger than the sample size, though ideally the true model is believed to include only a small…

Methodology · Statistics 2013-09-24 Zuofeng Shang , Ping Li

State-of-the-art neural network-based methods for learning summary statistics have delivered promising results for simulation-based likelihood-free parameter inference. Existing approaches require density estimation as a post-processing…

For stochastic models with intractable likelihood functions, approximate Bayesian computation offers a way of approximating the true posterior through repeated comparisons of observations with simulated model outputs in terms of a small set…

Machine Learning · Computer Science 2022-05-24 Carlo Albert , Simone Ulzega , Firat Ozdemir , Fernando Perez-Cruz , Antonietta Mira

Data transformations are essential for broad applicability of parametric regression models. However, for Bayesian analysis, joint inference of the transformation and model parameters typically involves restrictive parametric transformations…

Methodology · Statistics 2024-08-29 Daniel R. Kowal , Bohan Wu

Functional mixed models are widely useful for regression analysis with dependent functional data, including longitudinal functional data with scalar predictors. However, existing algorithms for Bayesian inference with these models only…

Methodology · Statistics 2023-06-14 Thomas Y. Sun , Daniel R. Kowal

This paper reviews recent developments in statistical structure learning; namely, Bayesian model reduction. Bayesian model reduction is a method for rapidly computing the evidence and parameters of probabilistic models that differ only in…

Methodology · Statistics 2019-10-15 Karl Friston , Thomas Parr , Peter Zeidman