English
Related papers

Related papers: Noisy Accelerated Power Method for Eigenproblems w…

200 papers

A recently discovered universal rank-based matrix method to extract trends from noisy time series is described in [1] but the formula for the output matrix elements, implemented there as an open-access supplement MATLAB computer code, is…

Data Analysis, Statistics and Probability · Physics 2020-06-24 D. J. Kestner , G. R. Ierley , A. B. Kostinski

Robust matrix completion aims to recover a low-rank matrix from a subset of noisy entries perturbed by complex noises, where traditional methods for matrix completion may perform poorly due to utilizing $l_2$ error norm in optimization. In…

Information Theory · Computer Science 2020-02-19 Yicong He , Fei Wang , Yingsong Li , Jing Qin , Badong Chen

This paper considers the problem of minimizing the sum of a smooth function and the Schatten-$p$ norm of the matrix. Our contribution involves proposing accelerated iteratively reweighted nuclear norm methods designed for solving the…

Optimization and Control · Mathematics 2024-06-27 Hao Wang , Ye Wang , Xiangyu Yang

The fast marching algorithm, and its variants, solves numerically the generalized eikonal equation associated to an underlying riemannian metric. A major challenge for these algorithms is the non-isotropy of the riemannian metric.…

Numerical Analysis · Mathematics 2012-05-25 J. -M. Mirebeau

Computation of (approximate) polynomials common factors is an important problem in several fields of science, like control theory and signal processing. While the problem has been widely studied for scalar polynomials, the scientific…

Numerical Analysis · Mathematics 2021-06-02 A. Fazzi , N. Guglielmi , I. Markovsky

We investigate the oblique Lanczos method recently put forward in arXiv:2406.20009 for analysing Euclidean correlators in lattice field theories and show that it is analytically equivalent to the well known Prony Generalised Eigenvalue…

High Energy Physics - Lattice · Physics 2025-03-03 Johann Ostmeyer , Aniket Sen , Carsten Urbach

A new numerical algorithm for solving the symmetric eigenvalue problem is presented. The technique deviates fundamentally from the traditional Krylov subspace iteration based techniques (Arnoldi and Lanczos algorithms) or other…

Computational Engineering, Finance, and Science · Computer Science 2009-11-13 Eric Polizzi

This work proposes an accelerated first-order algorithm we call the Robust Momentum Method for optimizing smooth strongly convex functions. The algorithm has a single scalar parameter that can be tuned to trade off robustness to gradient…

Optimization and Control · Mathematics 2018-02-27 Saman Cyrus , Bin Hu , Bryan Van Scoy , Laurent Lessard

Pairwise comparison matrices are frequently applied in multi-criteria decision making. A weight vector is called efficient if no other weight vector is at least as good in approximating the elements of the pairwise comparison matrix, and…

Optimization and Control · Mathematics 2017-10-03 Sándor Bozóki , János Fülöp

This paper deals with speeding up the convergence of a class of two-step iterative methods for solving linear systems of equations. To implement the acceleration technique, the residual norm associated with computed approximations for each…

Numerical Analysis · Mathematics 2024-04-24 Fatemeh P. A. Beik , Michele Benzi , Mehdi Najafi-Kalyani

We propose a relax-and-round approach combined with a greedy search strategy for performing complex lattice basis reduction. Taking an optimization perspective, we introduce a relaxed version of the problem that, while still nonconvex, has…

Signal Processing · Electrical Eng. & Systems 2018-08-16 Marius Arvinte , Ahmed H. Tewfik

We develop a fast and robust algorithm for solving large scale convex composite optimization models with an emphasis on the $\ell_1$-regularized least squares regression (Lasso) problems. Despite the fact that there exist a large number of…

Optimization and Control · Mathematics 2017-05-04 Xudong Li , Defeng Sun , Kim-Chuan Toh

In this paper we provide nearly linear time algorithms for several problems closely associated with the classic Perron-Frobenius theorem, including computing Perron vectors, i.e. entrywise non-negative eigenvectors of non-negative matrices,…

Data Structures and Algorithms · Computer Science 2018-10-05 AmirMahdi Ahmadinejad , Arun Jambulapati , Amin Saberi , Aaron Sidford

This work addresses the issue of large covariance matrix estimation in high-dimensional statistical analysis. Recently, improved iterative algorithms with positive-definite guarantee have been developed. However, these algorithms cannot be…

Information Theory · Computer Science 2016-07-29 Fei Wen , Yuan Yang , Peilin Liu , Robert C. Qiu

We introduce the concept of mode-k generalized eigenvalues and eigenvectors of a tensor and prove some properties of such eigenpairs. In particular, we derive an upper bound for the number of equivalence classes of generalized tensor…

Numerical Analysis · Mathematics 2016-01-15 Liping Chen , Lixing Han , Liangmin Zhou

Leading eigenvalue problems for large scale matrices arise in many applications. Coordinate-wise descent methods are considered in this work for such problems based on a reformulation of the leading eigenvalue problem as a non-convex…

Numerical Analysis · Mathematics 2020-02-25 Yingzhou Li , Jianfeng Lu , Zhe Wang

We consider ``one-at-a-time'' coordinate-wise descent algorithms for a class of convex optimization problems. An algorithm of this kind has been proposed for the $L_1$-penalized regression (lasso) in the literature, but it seems to have…

Computation · Statistics 2007-12-18 Jerome Friedman , Trevor Hastie , Holger Höfling , Robert Tibshirani

This paper introduces a novel anomaly detection framework that combines the robust statistical principles of density-estimation-based anomaly detection methods with the representation-learning capabilities of deep learning models. The…

Machine Learning · Computer Science 2024-08-15 Joseph Gallego-Mejia , Oscar Bustos-Brinez , Fabio A. González

We consider global efficiency of algorithms for minimizing a sum of a convex function and a composition of a Lipschitz convex function with a smooth map. The basic algorithm we rely on is the prox-linear method, which in each iteration…

Optimization and Control · Mathematics 2017-08-16 Dmitriy Drusvyatskiy , Courtney Paquette

We consider the problem of estimation of a low-rank matrix from a limited number of noisy rank-one projections. In particular, we propose two fast, non-convex \emph{proper} algorithms for matrix recovery and support them with rigorous…

Machine Learning · Statistics 2017-05-23 Mohammadreza Soltani , Chinmay Hegde