English
Related papers

Related papers: EPIC: a provable accelerated Eigensolver based on …

200 papers

In this work, an efficient approximation scheme has been proposed for getting accurate approximate solution of nonlinear partial differential equations with constant or variable coefficients satisfying initial conditions in a series of…

Analysis of PDEs · Mathematics 2020-09-04 Prakash Kumar Das , M. M. Panja

Riemannian convex optimization and minimax optimization have recently drawn considerable attention. Their appeal lies in their capacity to adeptly manage the non-convexity of the objective function as well as constraints inherent in the…

Optimization and Control · Mathematics 2024-06-04 Zihao Hu , Guanghui Wang , Xi Wang , Andre Wibisono , Jacob Abernethy , Molei Tao

Non-convex gradient descent is a common approach for estimating a low-rank $n\times n$ ground truth matrix from noisy measurements, because it has per-iteration costs as low as $O(n)$ time, and is in theory capable of converging to a…

Optimization and Control · Mathematics 2024-02-29 Gavin Zhang , Hong-Ming Chiu , Richard Y. Zhang

A novel orthogonalization-free method together with two specific algorithms are proposed to solve extreme eigenvalue problems. On top of gradient-based algorithms, the proposed algorithms modify the multi-column gradient such that earlier…

Numerical Analysis · Mathematics 2021-10-15 Weiguo Gao , Yingzhou Li , Bichen Lu

Conditional gradients constitute a class of projection-free first-order algorithms for smooth convex optimization. As such, they are frequently used in solving smooth convex optimization problems over polytopes, for which the computational…

Optimization and Control · Mathematics 2019-10-14 Jelena Diakonikolas , Alejandro Carderera , Sebastian Pokutta

We study random points on the real line generated by the eigenvalues in unitary invariant random matrix ensembles or by more general repulsive particle systems. As the number of points tends to infinity, we prove convergence of the…

Probability · Mathematics 2015-11-11 Kristina Schubert , Martin Venker

We consider the minimization or maximization of the $J$th largest eigenvalue of an analytic and Hermitian matrix-valued function, and build on Mengi et al. (2014, SIAM J. Matrix Anal. Appl., 35, 699-724). This work addresses the setting…

Numerical Analysis · Mathematics 2017-06-19 Fatih Kangal , Karl Meerbergen , Emre Mengi , Wim Michiels

The solution of (generalized) eigenvalue problems for symmetric or Hermitian matrices is a common subtask of many numerical calculations in electronic structure theory or materials science. Solving the eigenvalue problem can easily amount…

Mathematical Software · Computer Science 2020-01-08 P. Kus , A. Marek , S. S. Koecher , H. -H. Kowalski , C. Carbogno , Ch. Scheurer , K. Reuter , M. Scheffler , H. Lederer

In this work, we use the monolithic convex limiting (MCL) methodology to enforce relevant inequality constraints in implicit finite element discretizations of the compressible Euler equations. In this context, preservation of invariant…

Numerical Analysis · Mathematics 2024-11-12 Paul Moujaes , Dmitri Kuzmin

In this paper, we propose a new algorithm to speed-up the convergence of accelerated proximal gradient (APG) methods. In order to minimize a convex function $f(\mathbf{x})$, our algorithm introduces a simple line search step after each…

Machine Learning · Statistics 2014-06-19 Ziming Zhang , Venkatesh Saligrama

In this paper, we propose new proximal Newton-type methods for convex optimization problems in composite form. The applications include model predictive control (MPC) and embedded MPC. Our new methods are computationally attractive since…

Optimization and Control · Mathematics 2020-07-21 Ilan Adler , Zhiyue Tom Hu , Tianyi Lin

In the last decade matrix polynomials have been investigated with the primary focus on adequate linearizations and good scaling techniques for computing their eigenvalues and eigenvectors. In this article we propose a new method for…

Numerical Analysis · Mathematics 2017-06-19 Jared Aurentz , Thomas Mach , Leonardo Robol , Raf Vandebril , David S. Watkins

In this work, we consider symmetric positive definite pencils depending on two parameters. That is, we are concerned with the generalized eigenvalue problem $A(x)-\lambda B(x)$, where $A$ and $B$ are symmetric matrix valued functions in…

Numerical Analysis · Mathematics 2024-02-13 Luca Dieci , Alessandra Papini , Alessandro Pugliese

In this paper, we propose a speed-up approach for subclass discriminant analysis and formulate a novel efficient multi-view solution to it. The speed-up approach is developed based on graph embedding and spectral regression approaches that…

Machine Learning · Computer Science 2020-10-13 Kateryna Chumachenko , Jenni Raitoharju , Alexandros Iosifidis , Moncef Gabbouj

The problem of low-tubal-rank tensor estimation is a fundamental task with wide applications across high-dimensional signal processing, machine learning, and image science. Traditional approaches tackle such a problem by performing tensor…

Machine Learning · Computer Science 2025-12-24 Zhiyu Liu , Zhi Han , Yandong Tang , Jun Fan , Yao Wang

We present two approximate versions of the proximal subgradient method for minimizing the sum of two convex functions (not necessarily differentiable). The algorithms involve, at each iteration, inexact evaluations of the proximal operator…

Optimization and Control · Mathematics 2019-07-12 Reinier Díaz Millán , Majela Pentón Machado

This paper solves a new class of optimization problems under uncertainty, called Probable Event Constrained Optimization (PECO), which optimizes an objective function of decision variables and subjects to a set of Probable Event Constraints…

Optimization and Control · Mathematics 2025-03-07 Qifeng Li

In this paper, we propose some accelerated methods for solving optimization problems under the condition of relatively smooth and relatively Lipschitz continuous functions with an inexact oracle. We consider the problem of minimizing the…

Optimization and Control · Mathematics 2024-11-27 O. S. Savchuk , M. S. Alkousa , A. S. Shushko , A. A. Vyguzov , F. S. Stonyakin , D. A. Pasechnyuk , A. V. Gasnikov

We propose a new concept of a relatively inexact stochastic subgradient and present novel first-order methods that can use such objects to approximately solve convex optimization problems in relative scale. An important example where…

Optimization and Control · Mathematics 2023-05-30 Yurii Nesterov , Anton Rodomanov

We propose a rational QZ method for the solution of the dense, unsymmetric generalized eigenvalue problem. This generalization of the classical QZ method operates implicitly on a Hessenberg, Hessenberg pencil instead of on a Hessenberg,…

Numerical Analysis · Mathematics 2020-05-20 Daan Camps , Karl Meerbergen , Raf Vandebril