English
Related papers

Related papers: Early stopping for statistical inverse problems vi…

200 papers

We show that given an estimate $\widehat{A}$ that is close to a general high-rank positive semi-definite (PSD) matrix $A$ in spectral norm (i.e., $\|\widehat{A}-A\|_2 \leq \delta$), the simple truncated SVD of $\widehat{A}$ produces a…

Machine Learning · Statistics 2017-11-07 Simon S. Du , Yining Wang , Aarti Singh

In this work we investigate the practicality of stochastic gradient descent and recently introduced variants with variance-reduction techniques in imaging inverse problems. Such algorithms have been shown in the machine learning literature…

Optimization and Control · Mathematics 2021-01-26 Junqi Tang , Karen Egiazarian , Mohammad Golbabaee , Mike Davies

Computing eigenvalue decomposition (EVD) of a given linear operator, or finding its leading eigenvalues and eigenfunctions, is a fundamental task in many machine learning and scientific computing problems. For high-dimensional eigenvalue…

Machine Learning · Computer Science 2024-08-22 J. Jon Ryu , Xiangxiang Xu , H. S. Melihcan Erol , Yuheng Bu , Lizhong Zheng , Gregory W. Wornell

Singular value decomposition (SVD) is one of the most popular compression methods that approximate a target matrix with smaller matrices. However, standard SVD treats the parameters within the matrix with equal importance, which is a simple…

Computation and Language · Computer Science 2022-12-19 Ting Hua , Yen-Chang Hsu , Felicity Wang , Qian Lou , Yilin Shen , Hongxia Jin

Modern data analysis increasingly requires identifying shared latent structure across multiple high-dimensional datasets. A commonly used model assumes that the data matrices are noisy observations of low-rank matrices with a shared…

Machine Learning · Statistics 2025-07-31 Tavor Z. Baharav , Phillip B. Nicol , Rafael A. Irizarry , Rong Ma

The power of randomized algorithms in numerical methods have led to fast solutions which use the Singular Value Decomposition (SVD) as a core routine. However, given the large data size of modern and the modest runtime of SVD, most…

Machine Learning · Computer Science 2018-12-20 Hui Han Chin , Paul Pu Liang

We propose a new least-squares Monte Carlo algorithm for the approximation of conditional expectations in the presence of stochastic derivative weights. The algorithm can serve as a building block for solving dynamic programming equations,…

Statistics Theory · Mathematics 2020-10-02 Christian Bender , Nikolaus Schweizer

Gradient based optimization methods are the established state-of-the-art paradigm to study strongly entangled quantum systems in two dimensions with Projected Entangled Pair States. However, the key ingredient, the gradient itself, has…

Quantum Physics · Physics 2025-04-15 Anna Francuz , Norbert Schuch , Bram Vanhecke

In a Big Data setting computing the dominant SVD factors is restrictive due to the main memory requirements. Recently introduced streaming Randomized SVD schemes work under the restrictive assumption that the singular value spectrum of the…

Numerical Analysis · Mathematics 2021-03-22 Gurpreet Singh , Soumyajit Gupta , Matthew Lease , Clint Dawson

As in standard linear regression, in truncated linear regression, we are given access to observations $(A_i, y_i)_i$ whose dependent variable equals $y_i= A_i^{\rm T} \cdot x^* + \eta_i$, where $x^*$ is some fixed unknown vector of interest…

Machine Learning · Computer Science 2020-07-30 Constantinos Daskalakis , Dhruv Rohatgi , Manolis Zampetakis

This paper introduces a statistical treatment of inverse problems constrained by models with stochastic terms. The solution of the forward problem is given by a distribution represented numerically by an ensemble of simulations. The goal is…

Optimization and Control · Mathematics 2019-04-17 Emil M. Constantinescu , Noemi Petra , Julie Bessac , Cosmin G. Petra

Stochastic variance-reduced gradient (SVRG) is an optimization method originally designed for tackling machine learning problems with a finite sum structure. SVRG was later shown to work for policy evaluation, a problem in reinforcement…

Machine Learning · Computer Science 2020-06-22 Zilun Peng , Ahmed Touati , Pascal Vincent , Doina Precup

Aiming to provide a faster and convenient truncated SVD algorithm for large sparse matrices from real applications (i.e. for computing a few of largest singular values and the corresponding singular vectors), a dynamically shifted power…

Mathematical Software · Computer Science 2024-04-16 Xu Feng , Wenjian Yu , Yuyang Xie , Jie Tang

Given multiple time series data, how can we efficiently find latent patterns in an arbitrary time range? Singular value decomposition (SVD) is a crucial tool to discover hidden factors in multiple time series data, and has been used in many…

Numerical Analysis · Computer Science 2018-12-21 Jun-Gi Jang , Dongjin Choi , Jinhong Jung , U Kang

Singular Spectrum Analysis (SSA) or Singular Value Decomposition (SVD) are often used to de-noise univariate time series or to study their spectral profile. Both techniques rely on the eigendecomposition of the cor- relation matrix…

Signal Processing · Electrical Eng. & Systems 2018-07-30 A. M. Tomé , D. Malafaia , A. R. Teixeira , E. W. Lang

This paper presents the modal truncation and singular value decomposition (SVD) technique as two main algorithms for dynamic model reduction of the power system. The significance and accuracy of the proposed methods are investigated with…

Systems and Control · Electrical Eng. & Systems 2020-04-17 Mohammad Khatibi , Fatemeh Rahmani , Tanushree Agarwal

We consider estimators obtained by iterates of the conjugate gradient (CG) algorithm applied to the normal equation of prototypical statistical inverse problems. Stopping the CG algorithm early induces regularisation, and optimal…

Statistics Theory · Mathematics 2024-12-23 Laura Hucker , Markus Reiß

In this paper, we study reflected backward stochastic difference equations (RBSDEs for short) with finitely many states in discrete time. The general existence and uniqueness result, as well as comparison theorems for the solutions, are…

Probability · Mathematics 2013-07-03 Lifen An , Samuel N. Cohen , Shaolin Ji

Many large-scale stochastic optimization algorithms involve repeated solutions of linear systems or evaluations of log-determinants. In these regimes, computing exact solutions is often unnecessary; it is more computationally efficient to…

Numerical Analysis · Mathematics 2026-02-24 Tianshi Xu , Difeng Cai , Hua Huang , Edmond Chow , Yuanzhe Xi

Low-rank regularization-based deep unrolling networks have achieved remarkable success in various inverse imaging problems (IIPs). However, the singular value decomposition (SVD) is non-differentiable when duplicated singular values occur,…

Numerical Analysis · Mathematics 2024-11-22 Yinghao Zhang , Yue Hu