English
Related papers

Related papers: Efficient Bayesian Nonparametric Modelling of Stru…

200 papers

Gaussian process regression is widely used because of its ability to provide well-calibrated uncertainty estimates and handle small or sparse datasets. However, it struggles with high-dimensional data. One possible way to scale this…

Machine Learning · Statistics 2024-02-02 Bernardo Fichera , Viacheslav Borovitskiy , Andreas Krause , Aude Billard

Deep directed generative models have attracted much attention recently due to their generative modeling nature and powerful data representation ability. In this paper, we review different structures of deep directed generative models and…

Machine Learning · Computer Science 2017-10-16 Siqi Nie , Meng Zheng , Qiang Ji

Gaussian process regression is a frequently used statistical method for flexible yet fully probabilistic non-linear regression modeling. A common obstacle is its computational complexity which scales poorly with the number of observations.…

Methodology · Statistics 2026-03-10 Adam Gorm Hoffmann , Claus Thorn Ekstrøm , Andreas Kryger Jensen

Unlike the classical linear model, nonlinear generative models have been addressed sparsely in the literature of statistical learning. This work aims to bringing attention to these models and their secrecy potential. To this end, we invoke…

Information Theory · Computer Science 2022-07-15 Ali Bereyhi , Bruno Loureiro , Florent Krzakala , Ralf R. Müller , Hermann Schulz-Baldes

The Bayesian two-step change point detection method is popular for the Hawkes process due to its simplicity and intuitiveness. However, the non-conjugacy between the point process likelihood and the prior requires most existing Bayesian…

Machine Learning · Statistics 2024-10-16 Zeyue Zhang , Xiaoling Lu , Feng Zhou

We develop a Bayesian non-parametric framework based on multi-task Gaussian processes, appropriate for temporal shrinkage. We focus on a particular class of dynamic hierarchical models to obtain evidence-based knowledge of infectious…

Sparse Gaussian Processes are a key component of high-throughput Bayesian optimisation (BO) loops -- an increasingly common setting where evaluation budgets are large and highly parallelised. By using representative subsets of the available…

Machine Learning · Computer Science 2022-07-14 Henry B. Moss , Sebastian W. Ober , Victor Picheny

While existing mathematical descriptions can accurately account for phenomena at microscopic scales (e.g. molecular dynamics), these are often high-dimensional, stochastic and their applicability over macroscopic time scales of physical…

Machine Learning · Statistics 2016-09-08 P. S. Koutsourelakis , Elias Bilionis

We consider a prior for nonparametric Bayesian estimation which uses finite random series with a random number of terms. The prior is constructed through distributions on the number of basis functions and the associated coefficients. We…

Statistics Theory · Mathematics 2015-02-10 Weining Shen , Subhashis Ghosal

Friction modeling has always been a challenging problem due to the complexity of real physical systems. Although a few state-of-the-art structured data-driven methods show their efficiency in nonlinear system modeling, deterministic…

Systems and Control · Electrical Eng. & Systems 2024-05-28 Rui Dai , Giulio Evangelisti , Sandra Hirche

Gaussian processes are Bayesian non-parametric models used in many areas. In this work, we propose a Non-stationary Heteroscedastic Gaussian process model which can be learned with gradient-based techniques. We demonstrate the…

Machine Learning · Computer Science 2022-12-26 Zeel B Patel , Nipun Batra , Kevin Murphy

Despite much research targeted at enabling conventional machine learning models to continually learn tasks and data distributions sequentially without forgetting the knowledge acquired, little effort has been devoted to account for more…

Machine Learning · Computer Science 2021-06-11 Sandra Servia-Rodriguez , Cecilia Mascolo , Young D. Kwon

Thanks to technological advances leading to near-continuous time observations, emerging multivariate point process data offer new opportunities for causal discovery. However, a key obstacle in achieving this goal is that many relevant…

Machine Learning · Statistics 2021-12-15 Xu Wang , Ali Shojaie

This paper introduces a quasi-Bayesian method that integrates frequentist nonparametric estimation with Bayesian inference in a two-stage process. Applied to an endogenous discrete choice model, the approach first uses kernel or sieve…

Econometrics · Economics 2025-05-20 Ruixuan Liu , Zhengfei Yu

Functional data are defined as realizations of random functions (mostly smooth functions) varying over a continuum, which are usually collected with measurement errors on discretized grids. In order to accurately smooth noisy functional…

Methodology · Statistics 2016-12-13 Jingjing Yang , Dennis D. Cox , Jong Soo Lee , Peng Ren , Taeryon Choi

We derive a novel generative model from iterative Gaussian posterior inference. By treating the generated sample as an unknown variable, we can formulate the sampling process in the language of Bayesian probability. Our model uses a…

Machine Learning · Computer Science 2026-01-28 Marten Lienen , Marcel Kollovieh , Stephan Günnemann

Copulas allow to learn marginal distributions separately from the multivariate dependence structure (copula) that links them together into a density function. Vine factorizations ease the learning of high-dimensional copulas by constructing…

Methodology · Statistics 2013-02-19 David Lopez-Paz , José Miguel Hernández-Lobato , Zoubin Ghahramani

We consider the situation where a temporal process is composed of contiguous segments with differing slopes and replicated noise-corrupted time series measurements are observed. The unknown mean of the data generating process is modelled as…

Factor analysis models are widely utilized in social and behavioral sciences, such as psychology, education, and marketing, to measure unobservable latent traits. In this article, we introduce a nonlinear structured latent factor analysis…

Methodology · Statistics 2025-01-07 Yimang Zhang , Xiaorui Wang , Jian Qing Shi

Networks play a central role in modern data analysis, enabling us to reason about systems by studying the relationships between their parts. Most often in network analysis, the edges are given. However, in many systems it is difficult or…

Machine Learning · Statistics 2014-02-06 Scott W. Linderman , Ryan P. Adams