English
Related papers

Related papers: Efficient covariance estimation for asynchronous n…

200 papers

According to recent findings [1,2], empirical covariance matrices deduced from financial return series contain such a high amount of noise that, apart from a few large eigenvalues and the corresponding eigenvectors, their structure can…

Statistical Mechanics · Physics 2009-11-07 Szilard Pafka , Imre Kondor

This paper develops an empirical balancing approach for the estimation of treatment effects under two-sided noncompliance using a binary conditionally independent instrumental variable. The method weighs both treatment and outcome…

Econometrics · Economics 2020-07-10 Phillip Heiler

We propose a method of data quantization of finite discrete-time signals which optimizes the error estimate of low frequency Haar coefficients. We also discuss the error/noise bounds of this quantization in the Fourier space. Our result…

Signal Processing · Electrical Eng. & Systems 2021-01-12 Shu Nakamura

Computing accurate estimates of the Fourier transform of analog signals from discrete data points is important in many fields of science and engineering. The conventional approach of performing the discrete Fourier transform of the data…

Machine Learning · Statistics 2017-12-08 Luca Ambrogioni , Eric Maris

Smoothing of noisy sample covariances is an important component in functional data analysis. We propose a novel covariance smoothing method based on penalized splines and associated software. The proposed method is a bivariate spline…

Methodology · Statistics 2017-04-07 Luo Xiao , Cai Li , William Checkley , Ciprian M. Crainiceanu

This paper considers a noisy data structure recovery problem. The goal is to investigate the following question: Given a noisy observation of a permuted data set, according to which permutation was the original data sorted? The focus is on…

Information Theory · Computer Science 2020-11-24 Minoh Jeong , Alex Dytso , Martina Cardone , H. Vincent Poor

The multivariate linear regression model with shuffled data and additive Gaussian noise arises in various correspondence estimation and matching problems. Focusing on the denoising aspect of this problem, we provide a characterization the…

Machine Learning · Statistics 2017-04-26 Ashwin Pananjady , Martin J. Wainwright , Thomas A. Courtade

Combining tensor network techniques with quantum autoregressive moving average models, we quantify the effects of time-correlated noise on quantum algorithms and predict their performance at scale. As a paradigmatic test case, we examine…

Quantum Physics · Physics 2026-03-06 Amit Jamadagni , Gregory Quiroz , Eugene Dumitrescu

We propose a fast bivariate smoothing approach for symmetric surfaces that has a wide range of applications. We show how it can be applied to estimate the covariance function in longitudinal data as well as multiple additive covariances in…

Computation · Statistics 2016-09-23 Jona Cederbaum , Fabian Scheipl , Sonja Greven

We present a method for analyzing the phase noise of oscillators based on feedback driven high quality factor resonators. Our approach is to derive the phase drift of the oscillator by projecting the stochastic oscillator dynamics onto a…

Pattern Formation and Solitons · Physics 2015-10-28 Eyal Kenig , M. C. Cross

We study the dynamics of dephasing in a quantum two-level system by modeling both 1/f and high-frequency noise by random telegraph processes. Our approach is based on a so-called spin-fluctuator model in which a noisy environment is modeled…

Quantum Physics · Physics 2014-12-01 Alexander I. Nesterov , Gennady P. Berman

Motivated by the need for efficient estimation of conditional expectations, we consider a least-squares function approximation problem with heavily polluted data. Existing methods that are effective in the small-noise regime are suboptimal…

Machine Learning · Statistics 2026-05-26 Ben Adcock , Bernhard Hientzsch , Akil Narayan , Yiming Xu

Reliable state estimation hinges on accurate specification of sensor noise covariances, which weigh heterogeneous measurements. In practice, these covariances are difficult to identify due to environmental variability, front-end…

Robotics · Computer Science 2025-12-18 Haoying Li , Yifan Peng , Xinghan Li , Junfeng Wu

This paper introduces a consistent estimator and rate of convergence for the precision matrix of asset returns in large portfolios using a non-linear factor model within the deep learning framework. Our estimator remains valid even in low…

Machine Learning · Statistics 2023-08-30 Mehmet Caner , Maurizio Daniele

In this paper, we develop a novel high-dimensional coefficient estimation procedure based on high-frequency data. Unlike usual high-dimensional regression procedures such as LASSO, we additionally handle the heavy-tailedness of…

Methodology · Statistics 2025-10-22 Minseok Shin , Donggyu Kim

We consider the problem of estimating a signal from noisy circularly-translated versions of itself, called multireference alignment (MRA). One natural approach to MRA could be to estimate the shifts of the observations first, and infer the…

Information Theory · Computer Science 2018-02-14 Tamir Bendory , Nicolas Boumal , Chao Ma , Zhizhen Zhao , Amit Singer

For nonparametric regression with one-sided errors and a boundary curve model for Poisson point processes we consider the problem of efficient estimation for linear functionals. The minimax optimal rate is obtained by an unbiased estimation…

Statistics Theory · Mathematics 2015-09-25 Markus Reiß , Leonie Selk

We propose an algorithm for optimizations in which the gradients contain stochastic noise. This arises, for example, in structural optimizations when computations of forces and stresses rely on methods involving Monte Carlo sampling, such…

Materials Science · Physics 2022-11-30 Siyuan Chen , Shiwei Zhang

The computational cost for inference and prediction of statistical models based on Gaussian processes with Mat\'ern covariance functions scales cubicly with the number of observations, limiting their applicability to large data sets. The…

Statistics Theory · Mathematics 2025-03-04 David Bolin , Vaibhav Mehandiratta , Alexandre B. Simas

We present an optimization-based method for the joint estimation of system parameters and noise covariances of linear time-variant systems. Given measured data, this method maximizes the likelihood of the parameters. We solve the…

Optimization and Control · Mathematics 2023-03-21 Léo Simpson , Andrea Ghezzi , Jonas Asprion , Moritz Diehl