English
Related papers

Related papers: Estimation of Low-Rank Covariance Function

200 papers

Standard sparse pseudo-input approximations to the Gaussian process (GP) cannot handle complex functions well. Sparse spectrum alternatives attempt to answer this but are known to over-fit. We suggest the use of variational inference for…

Machine Learning · Statistics 2015-03-23 Yarin Gal , Richard Turner

Positive semi-definite matrices commonly occur as normal matrices of least squares problems in statistics or as kernel matrices in machine learning and approximation theory. They are typically large and dense. Thus algorithms to solve…

Numerical Analysis · Mathematics 2020-12-01 Markus Hegland , Frank deHoog

We propose a method for variable selection in the intensity function of spatial point processes that combines sparsity-promoting estimation with noise-robust model selection. As high-resolution spatial data becomes increasingly available…

Methodology · Statistics 2025-10-30 Dominik Sturm , Ivo F. Sbalzarini

Reliable state estimation depends on accurately modeled noise covariances, which are difficult to determine in practice. This paper formulates the noise covariance estimation as a bilevel optimization problem that factorizes the joint…

Systems and Control · Electrical Eng. & Systems 2025-12-08 Haoying Li , Yifan Peng , Yuchi Wu , Junfeng Wu

This paper aims at achieving a simultaneously sparse and low-rank estimator from the semidefinite population covariance matrices. We first benefit from a convex optimization which develops $l_1$-norm penalty to encourage the sparsity and…

Statistics Theory · Mathematics 2014-08-08 Shenglong Zhou , Naihua Xiu , Ziyan Luo , Lingchen Kong

This paper tackles the problem of robust covariance matrix estimation when the data is incomplete. Classical statistical estimation methodologies are usually built upon the Gaussian assumption, whereas existing robust estimation ones assume…

Approximating a function $f(x)$ on $[-1,1]$ based on $N+1$ samples is a classical problem in numerical analysis. If the samples come with heteroskedastic noise depending on $x$ of variance $\sigma(x)^2$, an $O(N\log N)$ algorithm for this…

Numerical Analysis · Mathematics 2025-08-13 Yuji Nakatsukasa , Yifu Zhang

Gaussian process regression is a powerful method for predicting states based on given data. It has been successfully applied for probabilistic predictions of structural systems to quantify, for example, the crack growth in mechanical…

Machine Learning · Statistics 2022-06-20 Simon Pfingstl , Markus Zimmermann

A new image denoising algorithm to deal with the additive Gaussian white noise model is given. Like the non-local means method, the filter is based on the weighted average of the observations in a neighborhood, with weights depending on the…

Other Statistics · Statistics 2011-11-04 Qiyu Jin , Ion Grama , Quansheng Liu

This paper presents a sequential randomized lowrank matrix factorization approach for incrementally predicting values of an unknown function at test points using the Gaussian Processes framework. It is well-known that in the Gaussian…

Machine Learning · Computer Science 2017-11-21 Shaunak D. Bopardikar , George S. Eskander Ekladious

This paper investigates the signal detection problem in colored Gaussian noise with an unknown covariance matrix. To be specific, we consider a sample deficient scenario in which the number of signal bearing samples ($n$) is strictly…

Signal Processing · Electrical Eng. & Systems 2024-04-26 Prathapasinghe Dharmawansa , Saman Atapattu , Jamie Evans , Kandeepan Sithamparanathan

This note investigates invariance principles for sums of N(nt) iid radom variables, where n is an integer, t is a positive real number and N(u) is a stochastic process with nonnegative integer values. We show that the sequence of sums of…

Probability · Mathematics 2016-10-11 Gane Samb Lo

In large-scale systems, complex internal relationships are often present. Such interconnected systems can be effectively described by low rank stochastic processes. When identifying a predictive model of low rank processes from sampling…

Machine Learning · Computer Science 2025-01-17 Wenqi Cao , Aming Li

In this paper, we propose a novel approach to fit a functional linear regression in which both the response and the predictor are functions of a common variable such as time. We consider the case that the response and the predictor…

Methodology · Statistics 2017-11-15 Behdad Mostafaiy , MohammadReza FaridRohani , Shojaeddin Chenouri

This paper tackles the problem of jointly estimating the noise covariance matrix alongside states (parameters such as poses and points) from measurements corrupted by Gaussian noise and, if available, prior information. In such settings,…

Robotics · Computer Science 2025-08-13 Kasra Khosoussi , Iman Shames

In the multivariate regression, also referred to as multi-task learning in machine learning, the goal is to recover a vector-valued function based on noisy observations. The vector-valued function is often assumed to be of low rank.…

Statistics Theory · Mathematics 2020-05-05 Wenjia Wang , Yi-Hui Zhou

Stochastic models in biomolecular contexts can have a state-dependent process noise covariance. The choice of the process noise covariance is an important parameter in the design of a Kalman Filter for state estimation and the theoretical…

Systems and Control · Electrical Eng. & Systems 2025-08-05 Krishan Kumar Gola , Shaunak Sen

This paper consists of two parts. In the first part, we focus on the average of a functional over shifted Gaussian homogeneous noise and as the averaging domain covers the whole space, we establish a Breuer-Major type Gaussian fluctuation…

Probability · Mathematics 2020-04-29 David Nualart , Guangqu Zheng

Assuming that a stochastic process $X=(X_t)_{t\geq 0}$ is a sum of a compound Poisson process $Y=(Y_t)_{t\geq 0}$ with known intensity $\lambda$ and unknown jump size density $f,$ and an independent Brownian motion $Z=(Z_t)_{t\geq 0},$ we…

Statistics Theory · Mathematics 2007-11-06 Shota Gugushvili

We investigate unbiased high-dimensional mean estimators in differential privacy. We consider differentially private mechanisms whose expected output equals the mean of the input dataset, for every dataset drawn from a fixed bounded…

Statistics Theory · Mathematics 2023-12-22 Aleksandar Nikolov , Haohua Tang