English
Related papers

Related papers: Feasibility study on the least square method for f…

200 papers

This paper considers least-square based estimation of the amplitude and square amplitude of a quantized sine wave, done by considering random initial record phase. Using amplitude- and frequency-domain modeling techniques, it is shown that…

Signal Processing · Electrical Eng. & Systems 2018-04-23 Paolo Carbone , Johan Schoukens

In constrained stochastic optimization, one naturally expects that imposing a stricter feasible set does not increase the statistical risk of an estimator defined by projection onto that set. In this paper, we show that this intuition can…

Statistics Theory · Mathematics 2026-01-23 Omar Al-Ghattas

We compare a recently proposed multivariate spline based on mixed partial derivatives with two other standard splines for the scattered data smoothing problem. The splines are defined as the minimiser of a penalised least squares…

Numerical Analysis · Mathematics 2020-03-04 Elizabeth Harris , Bishnu Lamichhane , Quoc Thong Le Gia

We consider estimation models of the form $Y=X^*+N$, where $X^*$ is some $m$-dimensional signal we wish to recover, and $N$ is symmetrically distributed noise that may be unbounded in all but a small $\alpha$ fraction of the entries. We…

Machine Learning · Computer Science 2022-11-15 Tommaso d'Orsi , Rajai Nasser , Gleb Novikov , David Steurer

Studying the properties of stochastic noise to optimize complex non-convex functions has been an active area of research in the field of machine learning. Prior work has shown that the noise of stochastic gradient descent improves…

Optimization and Control · Mathematics 2022-09-20 Aurelien Lucchi , Frank Proske , Antonio Orvieto , Francis Bach , Hans Kersting

This paper aims at distributed algorithms for solving a system of linear algebraic equations. Different from most existing formulations for this problem, we assume that the local data at each node is not accurately measured but subject to…

Optimization and Control · Mathematics 2023-05-10 Yutao Tang , Yicheng Zhang , Ruonan Li , Xinghu Wang

We consider a nonlinear filtering problem of multiscale non-Gaussian signal processes and observation processes with jumps. Firstly, we prove that the dimension for the signal system can be reduced by a homogenized approach. Secondly,…

Probability · Mathematics 2019-10-21 Huijie Qiao

Recent studies indicate that the noise characteristics of phasor measurement units (PMUs) can be more accurately described by non-Gaussian distributions. Consequently, estimation techniques based on Gaussian noise assumptions may produce…

Signal Processing · Electrical Eng. & Systems 2024-04-26 Anushka Sharma , Antos Cheeramban Varghese , Anamitra Pal

In existing distributed stochastic optimization studies, it is usually assumed that the gradient noise has a bounded variance. However, recent research shows that the heavy-tailed noise, which allows an unbounded variance, is closer to…

Optimization and Control · Mathematics 2025-05-15 Jun Hu , Chao Sun , Bo Chen , Jianzheng Wang , Zheming Wang

We find analytical solution of pair of stochastic equations with arbitrary forces and multiplicative L\'evy noises in a steady-state nonequilibrium case. This solution shows that L\'evy flights suppress always a quasi-periodical motion…

Statistical Mechanics · Physics 2010-01-04 A. I. Olemskoi , S. S. Borysov , I. A. Shuda

The least-squares estimator has achieved considerable success in learning linear dynamical systems from a single trajectory of length $T$. While it attains an optimal error of $\mathcal{O}(1/\sqrt{T})$ under independent zero-mean noise, it…

Optimization and Control · Mathematics 2026-02-23 Jihun Kim , Javad Lavaei

For a wide class of stochastic athermal systems, we derive Langevin-like equations driven by non-Gaussian noise, starting from master equations and developing a new asymptotic expansion. We found an explicit condition whereby the…

Statistical Mechanics · Physics 2015-03-10 Kiyoshi Kanazawa , Tomohiko G. Sano , Takahiro Sagawa , Hisao Hayakawa

Non-Gaussian impulsive noise (IN) with memory exists in many practical applications. When it is mixed with white Gaussian noise (WGN), the resultant mixed noise will be bursty. The performance of communication systems will degrade…

Signal Processing · Electrical Eng. & Systems 2024-02-12 Tianfu Qi , Jun Wang

It is now known that an extended Gaussian process model equipped with rescaling can adapt to different smoothness levels of a function valued parameter in many nonparametric Bayesian analyses, offering a posterior convergence rate that is…

Statistics Theory · Mathematics 2011-12-06 Surya T. Tokdar

We study nonasymptotic minimax estimation of the linear functional $L(\theta)=\eta^\top \theta$ for a high-dimensional $s$-sparse mean vector with an arbitrary loading vector $\eta$. For symmetric noise with exponentially decaying tails, we…

Statistics Theory · Mathematics 2026-04-29 Jie Xie , Dongming Huang

Suppose that $\mathbf{y}=\lvert A\mathbf{x_0}\rvert+\eta$ where $\mathbf{x_0} \in \mathbb{R}^d$ is the target signal and $\eta\in \mathbb{R}^m$ is a noise vector. The aim of phase retrieval is to estimate $\mathbf{x_0}$ from $\mathbf{y}$. A…

Information Theory · Computer Science 2019-04-23 Meng Huang , Zhiqiang Xu

In this paper, we investigate Gaussian process modeling with input location error, where the inputs are corrupted by noise. Here, the best linear unbiased predictor for two cases is considered, according to whether there is noise at the…

Statistics Theory · Mathematics 2021-03-02 Wenjia Wang , Xiaowei Yue , Benjamin Haaland , C. F. Jeff Wu

A standard approach to analysis of noise-induced effects in stochastic dynamics assumes a Gaussian character of the noise term describing interaction of the analyzed system with its complex surroundings. An additional assumption about the…

Statistical Mechanics · Physics 2009-05-06 Bartlomiej Dybiec , Ewa Gudowska-Nowak

We analyze the convergence of a nonlocal gradient descent method for minimizing a class of high-dimensional non-convex functions, where a directional Gaussian smoothing (DGS) is proposed to define the nonlocal gradient (also referred to as…

Optimization and Control · Mathematics 2023-02-14 Hoang Tran , Qiang Du , Guannan Zhang

This paper studies the minimum mean squared error (MMSE) of estimating $\mathbf{X} \in \mathbb{R}^d$ from the noisy observation $\mathbf{Y} \in \mathbb{R}^k$, under the assumption that the noise (i.e., $\mathbf{Y}|\mathbf{X}$) is a member…

Information Theory · Computer Science 2022-05-13 Ian Zieder , Alex Dytso , Martina Cardone