English
Related papers

Related papers: Fastest quotient iteration with variational princi…

200 papers

A type of adaptive finite element method for the eigenvalue problems is proposed based on the multilevel correction scheme. In this method, adaptive finite element method to solve eigenvalue problems involves solving associated boundary…

Numerical Analysis · Mathematics 2012-01-12 Hehu Xie

Generalized eigenvalue problems (GEPs) find applications in various fields of science and engineering. For example, principal component analysis, Fisher's discriminant analysis, and canonical correlation analysis are specific instances of…

Machine Learning · Computer Science 2024-11-05 Zhaoqiang Liu , Wen Li , Junren Chen

We present an efficient method for preparing the initial state required by the eigenvalue approximation quantum algorithm of Abrams and Lloyd. Our method can be applied when solving continuous Hermitian eigenproblems, e.g., the Schroedinger…

Quantum Physics · Physics 2009-11-10 Peter Jaksch , Anargyros Papageorgiou

Bilevel optimization aims to optimize an outer objective function that depends on the solution to an inner optimization problem. It is routinely used in Machine Learning, notably for hyperparameter tuning. The conventional method to compute…

Machine Learning · Computer Science 2024-02-27 Zhenzhang Ye , Gabriel Peyré , Daniel Cremers , Pierre Ablin

For a singular oscillator, the Schrodinger equation is obtained an equation of eigenvalues, and the dependence of energy on the self-adjoint extension parameter is established. It is shown that the self-adjoint extension violates the…

Quantum Physics · Physics 2024-06-21 Anzor Khelashvili , Teimuraz Nadareishvili

The ParaDiag family of algorithms solves differential equations by using preconditioners that can be inverted in parallel through diagonalization. In the context of optimal control of linear parabolic PDEs, the state-of-the-art ParaDiag…

Numerical Analysis · Mathematics 2024-03-15 Arne Bouillon , Giovanni Samaey , Karl Meerbergen

In this paper, we study an adaptive finite element method for multiple eigenvalue problems of a class of second order elliptic equations. By using some eigenspace approximation technology and its crucial property which is also presented in…

Numerical Analysis · Mathematics 2013-09-18 Xiaoying Dai , Lianhua He , Aihui Zhou

Successive quadratic approximations, or second-order proximal methods, are useful for minimizing functions that are a sum of a smooth part and a convex, possibly nonsmooth part that promotes regularization. Most analyses of iteration…

Optimization and Control · Mathematics 2019-01-25 Ching-pei Lee , Stephen J. Wright

The paper suggests a preconditioning type method for fast solving of elliptic equations with oscillating quasiperiodic coefficients $A_\epsilon$ specified by the small parameter $\epsilon>0$. We use an iteration method generated by an…

Numerical Analysis · Mathematics 2015-10-02 Boris N. Khoromskij , Sergey I. Repin

Quantization is a fundamental optimization for many machine-learning use cases, including compressing gradients, model weights and activations, and datasets. The most accurate form of quantization is \emph{adaptive}, where the error is…

Machine Learning · Computer Science 2025-08-01 Ran Ben-Basat , Yaniv Ben-Itzhak , Michael Mitzenmacher , Shay Vargaftik

The method of self-similar factor approximants is shown to be very convenient for solving different evolution equations and boundary-value problems typical of physical applications. The method is general and simple, being a straightforward…

Mathematical Physics · Physics 2009-11-13 E. P. Yukalova , V. I. Yukalov , S. Gluzman

Dynamic optimization is currently limited by sensitivity computations that require information from full forward and adjoint wave fields. Since the forward and adjoint solutions are computed in opposing time directions, the forward solution…

Computational Engineering, Finance, and Science · Computer Science 2025-09-22 Leon Herrmann , Tim Bürchner , László Kudela , Stefan Kollmannsberger

For large-scale eigenvalue problems requiring many mutually orthogonal eigenvectors, traditional numerical methods suffer substantial computational and communication costs with limited parallel scalability, primarily due to explicit…

Numerical Analysis · Mathematics 2026-01-12 Shengyue Wang , Aihui Zhou

We introduce a novel eigenvalue algorithm for near-diagonal matrices inspired by Rayleigh-Schr\"odinger perturbation theory and termed Iterative Perturbative Theory (IPT). Contrary to standard eigenvalue algorithms, which are either…

Numerical Analysis · Mathematics 2022-11-18 Maseim Kenmoe , Ronald Kriemann , Matteo Smerlak , Anton S. Zadorin

We discuss the close connection between eigenvalue computation and optimization using the Newton method and subspace methods. From the connection we derive a new class of Newton updates. The new update formulation is similar to the…

Numerical Analysis · Mathematics 2025-10-20 Yunkai Zhou

In this article we study the estimation of bifurcation coefficients in nonlinear branching problems by means of Rayleigh-Ritz approximation to the eigenvectors of the corresponding linearized problem. It is essential that the approximations…

Spectral Theory · Mathematics 2009-03-05 W. M. Greenlee , L. Hermi

We describe a strategy for solving nonlinear eigenproblems numerically. Our approach is based on the approximation of a vector-valued function, defined as solution of a non-homogeneous version of the eigenproblem. This approximation step is…

Numerical Analysis · Mathematics 2023-12-06 Davide Pradovera

Derivative-based algorithms are ubiquitous in statistics, machine learning, and applied mathematics. Automatic differentiation offers an algorithmic way to efficiently evaluate these derivatives from computer programs that execute relevant…

Computation · Statistics 2022-03-01 Charles C. Margossian , Michael Betancourt

We propose, analyze, and test a proximal-gradient method for solving regularized optimization problems with general constraints. The method employs a decomposition strategy to compute trial steps and uses a merit function to determine step…

Optimization and Control · Mathematics 2026-01-16 Frank E. Curtis , Xiaoyi Qu , Daniel P. Robinson

It is shown how to compute quotients efficiently in non-commutative univariate polynomial rings. This extends earlier work where efficient generic quotients were studied with a primary focus on commutative domains. Fast algorithms are given…

Symbolic Computation · Computer Science 2023-06-29 Stephen M. Watt