English
Related papers

Related papers: Degenerate Gaussian factors for probabilistic infe…

200 papers

We introduce a new interpretation of sparse variational approximations for Gaussian processes using inducing points, which can lead to more scalable algorithms than previous methods. It is based on decomposing a Gaussian process as a sum of…

Machine Learning · Statistics 2024-02-27 Jiaxin Shi , Michalis K. Titsias , Andriy Mnih

We consider the problem of estimating a rank-one matrix in Gaussian noise under a probabilistic model for the left and right factors of the matrix. The probabilistic model can impose constraints on the factors including sparsity and…

Information Theory · Computer Science 2015-09-16 Alyson K. Fletcher , Sundeep Rangan

We present a new probabilistic modelling framework based on the recent notion of normal factor graph (NFG). We show that the proposed NFG models and their transformations unify some existing models such as factor graphs, convolutional…

Information Theory · Computer Science 2012-09-17 Ali Al-Bashabsheh , Yongyi Mao

Factor analysis is a flexible technique for assessment of multivariate dependence and codependence. Besides being an exploratory tool used to reduce the dimensionality of multivariate data, it allows estimation of common factors that often…

Methodology · Statistics 2020-02-19 Kelly C. M. Gonçalves , Afonso C. B. Silva

Graphical models describe associations between variables through the notion of conditional independence. Gaussian graphical models are a widely used class of such models where the relationships are formalized by non-null entries of the…

Methodology · Statistics 2023-08-08 Sagnik Bhadury , Riten Mitra , Jeremy T. Gaskins

Lifted probabilistic inference exploits symmetries in probabilistic graphical models to allow for tractable probabilistic inference with respect to domain sizes. To exploit symmetries in, e.g., factor graphs, it is crucial to identify…

Artificial Intelligence · Computer Science 2024-07-24 Malte Luttermann , Johann Machemer , Marcel Gehrke

We extend Gaussian networks - directed acyclic graphs that encode probabilistic relationships between variables - to its vector form. Vector Gaussian continuous networks consist of composite nodes representing multivariates, that take…

Artificial Intelligence · Computer Science 2013-02-18 Satnam Alag , Alice M. Agogino

Causal disentanglement aims to learn about latent causal factors behind data, holding the promise to augment existing representation learning methods in terms of interpretability and extrapolation. Recent advances establish identifiability…

Machine Learning · Computer Science 2024-12-25 Ryan Welch , Jiaqi Zhang , Caroline Uhler

Boolean matrix factorisation aims to decompose a binary data matrix into an approximate Boolean product of two low rank, binary matrices: one containing meaningful patterns, the other quantifying how the observations can be expressed as a…

Machine Learning · Statistics 2017-02-28 Tammo Rukat , Chris C. Holmes , Michalis K. Titsias , Christopher Yau

We consider a modification of the covariance function in Gaussian processes to correctly account for known linear constraints. By modelling the target function as a transformation of an underlying function, the constraints are explicitly…

Machine Learning · Statistics 2017-09-20 Carl Jidling , Niklas Wahlström , Adrian Wills , Thomas B. Schön

This work considers estimation and forecasting in a multivariate, possibly high-dimensional count time series model constructed from a transformation of a latent Gaussian dynamic factor series. The estimation of the latent model parameters…

Methodology · Statistics 2025-04-07 Younghoon Kim , Marie-Christine Düker , Zachary F. Fisher , Vladas Pipiras

Factor analysis aims to determine latent factors, or traits, which summarize a given data set. Inter-battery factor analysis extends this notion to multiple views of the data. In this paper we show how a nonlinear, nonparametric version of…

Machine Learning · Statistics 2016-04-19 Andreas Damianou , Neil D. Lawrence , Carl Henrik Ek

We propose a dynamic factor model (DFM) where the latent factors are linked to observed variables with unknown and potentially nonlinear functions. The key novelty and source of flexibility of our approach is a nonparametric observation…

Econometrics · Economics 2025-09-08 Tony Chernis , Niko Hauzenberger , Haroon Mumtaz , Michael Pfarrhofer

We use the periodicity properties of generalized Gauss sums to factor numbers. Moreover, we derive rules for finding the factors and illustrate this factorization scheme for various examples. This algorithm relies solely on interference and…

Quantum Physics · Physics 2012-10-25 S. Wölk , W. Merkel , W. P. Schleich , I. Sh. Averbukh , B. Girard

Factor models are widely used for dimension reduction in the analysis of multivariate data. This is achieved through decomposition of a p x p covariance matrix into the sum of two components. Through a latent factor representation, they can…

Methodology · Statistics 2024-07-01 Sarah Elizabeth Heaps , Ian Hyla Jermyn

We develop an automated variational method for inference in models with Gaussian process (GP) priors and general likelihoods. The method supports multiple outputs and multiple latent functions and does not require detailed knowledge of the…

Machine Learning · Statistics 2018-11-06 Edwin V. Bonilla , Karl Krauth , Amir Dezfouli

We propose a general formalism of iterated random functions with semigroup property, under which exact and approximate Bayesian posterior updates can be viewed as specific instances. A convergence theory for iterated random functions is…

Machine Learning · Statistics 2013-11-05 Arash A. Amini , XuanLong Nguyen

Gaussian process regression networks (GPRN) are powerful Bayesian models for multi-output regression, but their inference is intractable. To address this issue, existing methods use a fully factorized structure (or a mixture of such…

Machine Learning · Computer Science 2020-05-19 Shibo Li , Wei Xing , Mike Kirby , Shandian Zhe

We construct a family of random matrix models for the q-deformed Gaussian random variables G_\mu=a_\mu+a^\star_\mu where the annihilation operators a_\mu and creation operators a^\star_\nu fulfil the q-deformed commutation relation a_\mu…

Probability · Mathematics 2009-10-31 Piotr Sniady

Despite major methodological developments, Bayesian inference for Gaussian graphical models remains challenging in high dimension due to the tremendous size of the model space. This article proposes a method to infer the marginal and…

Methodology · Statistics 2018-04-10 Gwenaël G. R. Leday , Sylvia Richardson