English
Related papers

Related papers: Hutch++ and XTrace to Improve Stochastic Trace Est…

200 papers

Low-rank matrix estimation under heavy-tailed noise is challenging, both computationally and statistically. Convex approaches have been proven statistically optimal but suffer from high computational costs, especially since robust loss…

Statistics Theory · Mathematics 2023-05-12 Yinan Shen , Jingyang Li , Jian-Feng Cai , Dong Xia

Some data analysis problems require the computation of (regularised) inverse traces, i.e. quantities of the form $\Tr (q \bI + \bL)^{-1}$. For large matrices, direct methods are unfeasible and one must resort to approximations, for example…

In this work, we consider the problem of multi-pitch estimation, i.e., identifying super-imposed truncated harmonic series from noisy measurements. We phrase this as recovering a harmonically-structured measure on the unit circle, where the…

Signal Processing · Electrical Eng. & Systems 2025-08-05 Anton Björkman , Filip Elvander

In lattice QCD the calculation of disconnected quark loops from the trace of the inverse quark matrix has large noise variance. A multilevel Monte Carlo method is proposed for this problem that uses different degree polynomials on a…

High Energy Physics - Lattice · Physics 2024-02-02 Paul Lashomb , Ronald B. Morgan , Travis Whyte , Walter Wilcox

We consider an evolution operator for a discrete Langevin equation with a strongly hyperbolic classical dynamics and Gaussian noise. Using an integral representation of the evolution operator we investigate the high order corrections to the…

Chaotic Dynamics · Physics 2016-09-07 Gergely Palla , Gabor Vattay , Andre Voros

We present an encoding technique that reduces the effects of noise on quantum spin systems whose operation is driven by Hamiltonian evolution. This technique is widely applicable, being most relevant to the scenarios where there are…

Quantum Physics · Physics 2022-03-28 Catherine Keele , Alastair Kay

Stochastic noise estimator method is a powerful tool to calculate the disconnected insertion involving quark loops. We study the variance reduction technique with unbiased subtraction. We use the complex $Z_2$ noise to calculate the quark…

High Energy Physics - Lattice · Physics 2009-11-07 Nilmani Mathur , Shao-Jing Dong

We present a method for subtracting point sources from interferometric radio images via forward modeling of the instrument response and involving an algebraic nonlinear minimization. The method is applied to simulated maps of the Murchison…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-20 G. Bernardi , D. A. Mitchell , S. M. Ord , L. J. Greenhill , B. Pindor , R. B. Wayth , J. S. B. Wyithe

We present a new method for reducing the stochastic noise of all-to-all propagators based on stopping the inversion of the propagator before convergence. The method is easy to implement, unbiased and independent of the quark action.…

High Energy Physics - Lattice · Physics 2010-01-18 S. Collins , G. Bali , A. Schäfer

Using quasi-Newton methods in stochastic optimization is not a trivial task given the difficulty of extracting curvature information from the noisy gradients. Moreover, pre-conditioning noisy gradient observations tend to amplify the noise.…

Optimization and Control · Mathematics 2024-04-02 Andre Carlon , Luis Espath , Raul Tempone

In this paper, we develop a novel regularization method for deep neural networks by penalizing the trace of Hessian. This regularizer is motivated by a recent guarantee bound of the generalization error. We explain its benefits in finding…

Machine Learning · Computer Science 2023-02-23 Yucong Liu , Shixing Yu , Tong Lin

Ultrasound images formed by delay-and-sum beamforming are plagued by artifacts that only clear up after compounding many transmissions. Some prior works pose imaging as an inverse problem. This approach can yield high image quality with few…

Signal Processing · Electrical Eng. & Systems 2024-07-03 Vincent van de Schaft , Oisín Nolan , Ruud J. G. van Sloun

We propose some new mixed finite element methods for the time dependent stochastic Stokes equations with multiplicative noise, which use the Helmholtz decomposition of the driving multiplicative noise. It is known [16] that the pressure…

Numerical Analysis · Mathematics 2020-06-09 Xiaobing Feng , Andreas Prohl , Liet Vo

In this paper, we propose a new way to obtain optimal convergence rates for smooth stochastic (strong) convex optimization tasks. Our approach is based on results for optimization tasks where gradients have nonrandom noise. In contrast to…

Optimization and Control · Mathematics 2020-04-16 Darina Dvinskikh , Alexander Tyurin , Alexander Gasnikov , Sergey Omelchenko

Atmospheric lidar observations provide a unique capability to directly observe the vertical column of cloud and aerosol scattering properties. Detector and solar background noise, however, hinder the ability of lidar systems to provide…

Optimization and Control · Mathematics 2016-06-21 Willem J. Marais , Robert E. Holz , Yu Hen Hu , Ralph E. Kuehn , Edwin E. Eloranta , Rebecca M. Willett

We propose a stochastic variance-reduced cubic regularized Newton method for non-convex optimization. At the core of our algorithm is a novel semi-stochastic gradient along with a semi-stochastic Hessian, which are specifically designed for…

Machine Learning · Computer Science 2018-02-14 Dongruo Zhou , Pan Xu , Quanquan Gu

The scalability of continuous normalizing flows (CNFs) for unbiased Boltzmann sampling remains limited in high-dimensional systems due to the cost of Jacobian-determinant evaluation, which requires $D$ backpropagation passes through the…

Machine Learning · Computer Science 2026-01-30 Xin Peng , Ang Gao

This paper develops negative curvature methods for continuous nonlinear unconstrained optimization in stochastic settings, in which function, gradient, and Hessian information is available only through probabilistic oracles, i.e., oracles…

Optimization and Control · Mathematics 2026-03-05 Albert S. Berahas , Raghu Bollapragada , Wanping Dong

We propose improved estimators to compute the reweighting factors which are needed for lattice QCD calculations that rely on twisted-mass reweighting for the light quark contribution and the Rational Hybrid Monte Carlo (RHMC) algorithm for…

High Energy Physics - Lattice · Physics 2024-03-19 Simon Kuberski

Glitches are transitory noise artifacts that degrade the detection sensitivity and accuracy of interferometric observatories such as LIGO and Virgo in gravitational wave astronomy. Reliable glitch subtraction techniques are essential for…

General Relativity and Quantum Cosmology · Physics 2024-06-04 Mohammad Abu Thaher Chowdhury