English
Related papers

Related papers: A globally convergent matricial algorithm for mult…

200 papers

In this technical note, we deal with a spectrum approximation problem arising in THREE-like multivariate spectral estimation approaches. The solution to the problem minimizes a suitable divergence index with respect to an a priori spectral…

Optimization and Control · Mathematics 2014-06-27 Mattia Zorzi

In this paper, we present a sharp analysis for a class of alternating projected gradient descent algorithms which are used to solve the covariate adjusted precision matrix estimation problem in the high-dimensional setting. We demonstrate…

Information Theory · Computer Science 2022-01-13 Xiao Lv , Wei Cui , Yulong Liu

In this paper, we propose a globally convergent method for solving constrained nonlinear systems. The method combines an efficient Newton conditional gradient method with a derivative-free and nonmonotone linesearch strategy. The global…

Optimization and Control · Mathematics 2018-06-06 M. L. N. Gonçalves , F. R. Oliveira

In this paper, an efficient modified Newton type algorithm is proposed for nonlinear unconstrianed optimization problems. The modified Hessian is a convex combination of the identity matrix (for steepest descent algorithm) and the Hessian…

Optimization and Control · Mathematics 2015-10-09 Yaguang Yang

We consider the problem of estimating the spectral norm of a matrix using only matrix-vector products. We propose a new Counterbalance estimator that provides upper bounds on the norm and derive probabilistic guarantees on its…

Numerical Analysis · Mathematics 2025-06-19 Alexey Naumov , Maxim Rakhuba , Denis Ryapolov , Sergey Samsonov

We describe a novel algorithm for solving general parametric (nonlinear) eigenvalue problems. Our method has two steps: first, high-accuracy solutions of non-parametric versions of the problem are gathered at some values of the parameters;…

Numerical Analysis · Mathematics 2024-10-14 Davide Pradovera , Alessandro Borghi

In this paper, we investigate the matrix estimation problem in the multi-response regression model with measurement errors. A nonconvex error-corrected estimator based on a combination of the amended loss function and the nuclear norm…

Statistics Theory · Mathematics 2022-09-19 Xin Li , Dongya Wu

We consider the problem of parameter estimation in a high-dimensional generalized linear model. Spectral methods obtained via the principal eigenvector of a suitable data-dependent matrix provide a simple yet surprisingly effective…

Statistics Theory · Mathematics 2025-07-11 Yihan Zhang , Hong Chang Ji , Ramji Venkataramanan , Marco Mondelli

We propose a learning-based approach for estimating the spectrum of a multisinusoidal signal from a finite number of samples. A neural-network is trained to approximate the spectra of such signals on simulated data. The proposed methodology…

Machine Learning · Computer Science 2019-06-03 Gautier Izacard , Brett Bernstein , Carlos Fernandez-Granda

We present new algorithms for $M$-estimators of multivariate scatter and location and for symmetrized $M$-estimators of multivariate scatter. The new algorithms are considerably faster than currently used fixed-point and related algorithms.…

Computation · Statistics 2015-12-10 Lutz Duembgen , Klaus Nordhausen , Heike Schuhmacher

In this paper, multi-snapshot Newtonized orthogonal matching pursuit (MNOMP) algorithm is proposed to deal with the line spectrum estimation with multiple measurement vectors (MMVs). MNOMP has the low computation complexity and…

Information Theory · Computer Science 2019-05-09 Jiang Zhu , Lin Han , Rick S. Blum , Zhiwei Xu

We address the subset selection problem for matrices, where the goal is to select a subset of $k$ columns from a "short-and-fat" matrix $X \in \mathbb{R}^{m \times n}$, such that the pseudoinverse of the sampled submatrix has as small…

Numerical Analysis · Mathematics 2025-07-29 Ivan Kozyrev , Alexander Osinsky

The problem of minimizing a sum of local convex objective functions over a networked system captures many important applications and has received much attention in the distributed optimization field. Most of existing work focuses on…

Optimization and Control · Mathematics 2019-01-09 Fatemeh Mansoori , Ermin Wei

Many machine learning models involve solving optimization problems. Thus, it is important to deal with a large-scale optimization problem in big data applications. Recently, subsampled Newton methods have emerged to attract much attention…

Numerical Analysis · Computer Science 2020-03-24 Haishan Ye , Luo Luo , Zhihua Zhang

We present a quantum algorithm for estimating the matrix determinant based on quantum spectral sampling. The algorithm estimates the logarithm of the determinant of an $n \times n$ positive sparse matrix to an accuracy $\epsilon$ in time…

Quantum Physics · Physics 2025-05-02 Vittorio Giovannetti , Seth Lloyd , Lorenzo Maccone

We derive, similar to Lau and Riha, a matrix formulation of a general best approximation theorem of Singer for the special case of spectral approximations of a given matrix from a given subspace. Using our matrix formulation we describe the…

Numerical Analysis · Mathematics 2025-06-12 Vance Faber , Jörg Liesen , Petr Tichý

We consider the convergence of iterative solvers for problems of nonlinear magnetostatics. Using the equivalence to an underlying minimization problem, we can establish global linear convergence of a large class of methods, including the…

Numerical Analysis · Mathematics 2024-03-28 Herbert Egger , Felix Engertsberger , Bogdan Radu

A general class of Newton algorithms on Gra{\ss}mann and Lagrange-Gra{\ss}mann manifolds is introduced, that depends on an arbitrary pair of local coordinates. Local quadratic convergence of the algorithm is shown under a suitable condition…

Optimization and Control · Mathematics 2011-11-10 Uwe Helmke , Knut Hüper , Jochen Trumpf

The task of approximating a function of d variables from its evaluations at a given number of points is ubiquitous in numerical analysis and engineering applications. When d is large, this task is challenged by the so-called curse of…

Numerical Analysis · Mathematics 2016-12-21 Albert Cohen , Giovanni Migliorati

Spectral analysis plays a crucial role in high-dimensional statistics, where determining the asymptotic distribution of various spectral statistics remains a challenging task. Due to the difficulties of deriving the analytic form, recent…

Statistics Theory · Mathematics 2025-04-02 Guoyu Zhang , Dandan Jiang , Fang Yao