English
Related papers

Related papers: Bayesian Sparse Factor Analysis with Kernelized Ob…

200 papers

Bayesian change-point detection, together with latent variable models, allows to perform segmentation over high-dimensional time-series. We assume that change-points lie on a lower-dimensional manifold where we aim to infer subsets of…

Machine Learning · Statistics 2020-11-04 Lorena Romero-Medrano , Pablo Moreno-Muñoz , Antonio Artés-Rodríguez

Undertaking causal inference with observational data is incredibly useful across a wide range of tasks including the development of medical treatments, advertisements and marketing, and policy making. There are two significant challenges…

Machine Learning · Statistics 2022-01-19 Matthew James Vowels , Necati Cihan Camgoz , Richard Bowden

Biological systems commonly exhibit complex spatiotemporal patterns whose underlying generative mechanisms pose a significant analytical challenge. Traditional approaches to spatiodynamic inference rely on dimensionality reduction through…

Quantitative Methods · Quantitative Biology 2025-08-01 Jun Won Park , Kangyu Zhao , Sanket Rane

In order to better understand feature learning in neural networks, we propose a framework for understanding linear models in tangent feature space where the features are allowed to be transformed during training. We consider linear…

Machine Learning · Computer Science 2024-02-22 Daniel LeJeune , Sina Alemohammad

A sensitivity analysis in an observational study assesses the robustness of significant findings to unmeasured confounding. While sensitivity analyses in matched observational studies have been well addressed when there is a single outcome…

Methodology · Statistics 2015-11-05 Colin B. Fogarty , Dylan S. Small

We undertake Bayesian learning of the high-dimensional functional relationship between a system parameter vector and an observable, that is in general tensor-valued. The ultimate aim is Bayesian inverse prediction of the system parameters,…

Methodology · Statistics 2018-04-17 Kangrui Wang , Dalia Chakrabarty

Many computer vision and medical imaging problems are faced with learning from large-scale datasets, with millions of observations and features. In this paper we propose a novel efficient learning scheme that tightens a sparsity constraint…

Machine Learning · Statistics 2017-02-07 Adrian Barbu , Yiyuan She , Liangjing Ding , Gary Gramajo

Kernel density estimation is a widely used nonparametric approach to estimate an unknown distribution. Recent work in Bayesian predictive inference has considered stochastic processes formed by specifying the predictive distribution for the…

Methodology · Statistics 2026-05-15 Torey Hilbert

We propose a Bayesian neural network-based continual learning algorithm using Variational Inference, aiming to overcome several drawbacks of existing methods. Specifically, in continual learning scenarios, storing network parameters at each…

Machine Learning · Computer Science 2024-11-22 Sanchar Palit , Biplab Banerjee , Subhasis Chaudhuri

We propose a methodology for modeling and comparing probability distributions within a Bayesian nonparametric framework. Building on dependent normalized random measures, we consider a prior distribution for a collection of discrete random…

Methodology · Statistics 2022-06-01 Mario Beraha , Jim E. Griffin

A multivariate quantile regression model with a factor structure is proposed to study data with many responses of interest. The factor structure is allowed to vary with the quantile levels, which makes our framework more flexible than the…

Methodology · Statistics 2020-01-22 Shih-Kang Chao , Wolfgang Karl Härdle , Ming Yuan

We study the problem nonparametric classification with repeated observations. Let $\bX$ be the $d$ dimensional feature vector and let $Y$ denote the label taking values in $\{1,\dots ,M\}$. In contrast to usual setup with large sample size…

Information Theory · Computer Science 2023-07-20 Hüseyin Afşer , László Györfi , Harro Walk

Feature learning in neural networks is crucial for their expressive power and inductive biases, motivating various theoretical approaches. Some approaches describe network behavior after training through a change in kernel scale from…

Disordered Systems and Neural Networks · Physics 2025-05-29 Noa Rubin , Kirsten Fischer , Javed Lindner , David Dahmen , Inbar Seroussi , Zohar Ringel , Michael Krämer , Moritz Helias

For supervised and unsupervised learning, positive definite kernels allow to use large and potentially infinite dimensional feature spaces with a computational cost that only depends on the number of observations. This is usually done…

Machine Learning · Computer Science 2008-09-10 Francis Bach

In many domains such as healthcare or finance, data often come in different assays or measurement modalities, with features in each assay having a common theme. Simply concatenating these assays together and performing prediction can be…

Methodology · Statistics 2018-07-17 J. Kenneth Tay , Robert Tibshirani

A multimodal system with Poisson, Gaussian, and multinomial observations is considered. A generative graphical model that combines multiple modalities through common factor loadings is proposed. In this model, latent factors are like…

Applications · Statistics 2015-08-04 Yasin Yilmaz , Alfred O. Hero

In this paper, we address the challenge of performing counterfactual inference with observational data via Bayesian nonparametric regression adjustment, with a focus on high-dimensional settings featuring multiple actions and multiple…

Machine Learning · Computer Science 2022-11-22 Alberto Caron , Gianluca Baio , Ioanna Manolopoulou

Bayesian optimisation is an adaptive sampling strategy for constructing a Gaussian process surrogate to efficiently search for the global minimum of a black-box computational model. Gaussian processes have limited applicability in…

Applications · Statistics 2025-12-04 Thomas A. Archbold , Ieva Kazlauskaite , Fehmi Cirak

Recent progress in variational inference has paid much attention to the flexibility of variational posteriors. One promising direction is to use implicit distributions, i.e., distributions without tractable densities as the variational…

Machine Learning · Statistics 2018-02-26 Jiaxin Shi , Shengyang Sun , Jun Zhu

Multivariate spatially-oriented data sets are prevalent in the environmental and physical sciences. Scientists seek to jointly model multiple variables, each indexed by a spatial location, to capture any underlying spatial association for…

Methodology · Statistics 2021-08-19 Lu Zhang , Sudipto Banerjee