English
Related papers

Related papers: Efficient recursive algorithms for functionals bas…

200 papers

Tensor regression has attracted significant attention in statistical research. This study tackles the challenge of handling covariates with smooth varying structures. We introduce a novel framework, termed functional tensor regression,…

Methodology · Statistics 2025-06-12 Tongyu Li , Fang Yao , Anru R. Zhang

Recently developed techniques have made it possible to quickly learn accurate probability density functions from data in low-dimensional continuous space. In particular, mixtures of Gaussians can be fitted to data very quickly using an…

Machine Learning · Computer Science 2013-01-18 Scott Davies , Andrew Moore

With the significant advancement in quantum computation in the past couple of decades, the exploration of machine-learning subroutines using quantum strategies has become increasingly popular. Gaussian process regression is a widely used…

Quantum Physics · Physics 2018-03-07 Siddhartha Das , George Siopsis , Christian Weedbrook

An exciting branch of machine learning research focuses on methods for learning, optimizing, and integrating unknown functions that are difficult or costly to evaluate. A popular Bayesian approach to this problem uses a Gaussian process…

Machine Learning · Statistics 2018-04-02 Anqi Wu , Mikio C. Aoi , Jonathan W. Pillow

It is now known that an extended Gaussian process model equipped with rescaling can adapt to different smoothness levels of a function valued parameter in many nonparametric Bayesian analyses, offering a posterior convergence rate that is…

Statistics Theory · Mathematics 2011-12-06 Surya T. Tokdar

In Gaussian graphical models, the likelihood equations must typically be solved iteratively. We investigate two algorithms: A version of iterative proportional scaling which avoids inversion of large matrices, and an algorithm based on…

Computation · Statistics 2023-12-12 Søren Højsgaard , Steffen Lauritzen

We develop Bayesian models for density regression with emphasis on discrete outcomes. The problem of density regression is approached by considering methods for multivariate density estimation of mixed scale variables, and obtaining…

Methodology · Statistics 2019-08-14 Georgios Papageorgiou

We consider graphical models based on a recursive system of linear structural equations. This implies that there is an ordering, $\sigma$, of the variables such that each observed variable $Y_v$ is a linear function of a variable specific…

Methodology · Statistics 2019-06-28 Y. Samuel Wang , Mathias Drton

Representations of multivariate functions with low-dimensional functions that depend on subsets of original coordinates (corresponding of different orders of coupling) are useful in quantum dynamics and other applications, especially where…

Machine Learning · Computer Science 2024-06-26 Sergei Manzhos , Manabu Ihara

High order cumulant tensors carry information about statistics of non-normally distributed multivariate data. In this work we present a new efficient algorithm for calculation of cumulants of arbitrary order in a sliding window for data…

Data Structures and Algorithms · Computer Science 2022-10-06 Krzysztof Domino , Piotr Gawron

We propose practical deep Gaussian process models on Riemannian manifolds, similar in spirit to residual neural networks. With manifold-to-manifold hidden layers and an arbitrary last layer, they can model manifold- and scalar-valued…

Machine Learning · Statistics 2025-03-03 Kacper Wyrwal , Andreas Krause , Viacheslav Borovitskiy

Gaussian smoothing (GS) is a derivative-free optimization (DFO) algorithm that estimates the gradient of an objective using perturbations of the current parameters sampled from a standard normal distribution. We generalize it to sampling…

Machine Learning · Computer Science 2022-11-29 Katelyn Gao , Ozan Sener

We reconsider a nonparametric density model based on Gaussian processes. By augmenting the model with latent P\'olya--Gamma random variables and a latent marked Poisson process we obtain a new likelihood which is conjugate to the model's…

Machine Learning · Statistics 2018-05-30 Christian Donner , Manfred Opper

The paper contains results in three areas: First we present a general estimate for tail probabilities of Gaussian quadratic forms with known expectation and variance. Thereafter we analyze the distribution of norms of complex Gaussian…

Probability · Mathematics 2019-03-20 Georg Berschneider , Björn Böttcher

Variational approximation methods have proven to be useful for scaling Bayesian computations to large data sets and highly parametrized models. Applying variational methods involves solving an optimization problem, and recent research in…

Methodology · Statistics 2017-01-13 Victor M. -H. Ong , David J. Nott , Michael S. Smith

We consider a general class of regression models with normally distributed covariates, and the associated nonconvex problem of fitting these models from data. We develop a general recipe for analyzing the convergence of iterative algorithms…

Optimization and Control · Mathematics 2021-09-22 Kabir Aladin Chandrasekher , Ashwin Pananjady , Christos Thrampoulidis

Gaussian processes are a widely embraced technique for regression and classification due to their good prediction accuracy, analytical tractability and built-in capabilities for uncertainty quantification. However, they suffer from the…

Optimization and Control · Mathematics 2024-02-07 Mickael Binois , Victor Picheny

The aim of this paper is to develop novel quantum algorithms for Gaussian process quadrature methods. Gaussian process quadratures are numerical integration methods where Gaussian processes are used as functional priors for the integrands…

Computation · Statistics 2025-02-21 Cristian A. Galvis-Florez , Ahmad Farooq , Simo Särkkä

We introduce a variational Bayesian neural network where the parameters are governed via a probability distribution on random matrices. Specifically, we employ a matrix variate Gaussian \cite{gupta1999matrix} parameter posterior…

Machine Learning · Statistics 2016-06-24 Christos Louizos , Max Welling

We develop Gaussian approximations for high-dimensional vectors formed by second-order $U$- and $V$-statistics whose kernels depend on sample size under independent but not identically distributed (i.n.i.d.) sampling. Our results hold…

Statistics Theory · Mathematics 2026-05-26 Shunsuke Imai