English
Related papers

Related papers: Fastest quotient iteration with variational princi…

200 papers

Algorithms often carry out equally many computations for "easy" and "hard" problem instances. In particular, algorithms for finding nearest neighbors typically have the same running time regardless of the particular problem instance. In…

Data Structures and Algorithms · Computer Science 2020-03-25 Daniel LeJeune , Richard G. Baraniuk , Reinhard Heckel

The purpose of this study is to show some mathematical aspects of the adjoint method that is a numerical method for the Cauchy problem, an inverse boundary value problem. The adjoint method is an iterative method based on the variational…

Numerical Analysis · Mathematics 2009-04-16 Takemi Shigeta

In general, standard necessary optimality conditions cannot be formulated in a straightforward manner for semi-smooth shape optimization problems. In this paper, we consider shape optimization problems constrained by variational…

Optimization and Control · Mathematics 2020-12-17 Daniel Luft , Volker H. Schulz , Kathrin Welker

With the recent emergence of mixed precision hardware, there has been a renewed interest in its use for solving numerical linear algebra problems fast and accurately. The solution of total least squares problems, i.e., solving $\min_{E,r}…

Numerical Analysis · Mathematics 2023-09-14 Eda Oktay , Erin Carson

We derive and implement a second-order adjoint method to compute exact gradients and Hessians for a prototypical quantum optimal control problem, that of solving for the minimal energy applied electric field that drives a molecule from a…

Quantum Physics · Physics 2025-05-02 Harish S. Bhat

Neural differential equations may be trained by backpropagating gradients via the adjoint method, which is another differential equation typically solved using an adaptive-step-size numerical differential equation solver. A proposed step is…

Machine Learning · Computer Science 2021-05-11 Patrick Kidger , Ricky T. Q. Chen , Terry Lyons

Variational principles are proved for self-adjoint operator functions arising from variational evolution equations of the form \[ \langle\ddot{z}(t),y \rangle + \mathfrak{d}[\dot{z} (t), y] + \mathfrak{a}_0 [z(t),y] = 0. \] Here…

Functional Analysis · Mathematics 2017-03-27 Birgit Jacob , Matthias Langer , Carsten Trunk

A rational approximation by a ratio of polynomial functions is a flexible alternative to polynomial approximation. In particular, rational functions exhibit accurate estimations to nonsmooth and non- Lipschitz functions, where polynomial…

Optimization and Control · Mathematics 2020-02-27 V. Peiris , N. Sharon , N. Sukhorukova J. Ugon

Models with a large number of latent variables are often used to fully utilize the information in big or complex data. However, they can be difficult to estimate using standard approaches, and variational inference methods are a popular…

Methodology · Statistics 2021-04-20 Rubén Loaiza-Maya , Michael Stanley Smith , David J. Nott , Peter J. Danaher

We explore the applicability of quantum annealing to the approximation task of curve fitting. To this end, we consider a function that shall approximate a given set of data points and is written as a finite linear combination of…

Optimization and Control · Mathematics 2026-02-27 Philipp Isserstedt , Daniel Jaroszewski , Wolfgang Mergenthaler , Felix Paul , Bastian Harrach

Determining the number of common factors is an important and practical topic in high dimensional factor models. The existing literatures are mainly based on the eigenvalues of the covariance matrix. Due to the incomparability of the…

Methodology · Statistics 2019-09-25 Jianqing Fan , Jianhua Guo , Shurong Zheng

This paper is concerned with the convergence analysis of an extended variation of the locally optimal preconditioned conjugate gradient method (LOBPCG) for the extreme eigenvalue of a Hermitian matrix polynomial which admits some extended…

Numerical Analysis · Mathematics 2023-03-03 Peter Benner , Xin Liang

The semivarying coefficient models are widely used in the application of finance, economics, medical science and many other areas. The functional coefficients are commonly estimated by local smoothing methods, e.g. local linear estimator.…

Methodology · Statistics 2020-01-01 Heng Peng , Chuanlong Xie , Jingxin Zhao

An efficient algorithm for computing eigenvectors of a matrix of integers by exact computation is proposed. The components of calculated eigenvectors are expressed as polynomials in the eigenvalue to which the eigenvector is associated, as…

Numerical Analysis · Mathematics 2019-02-19 Shinichi Tajima , Katsuyoshi Ohara , Akira Terui

Algorithmic differentiation (AD) has become increasingly capable and straightforward to use. However, AD is inefficient when applied directly to solvers, a feature of most engineering analyses. We can leverage implicit differentiation to…

Optimization and Control · Mathematics 2023-06-28 Andrew Ning , Taylor McDonnell

We consider the problem of calculating learning curves (i.e., average generalization performance) of Gaussian processes used for regression. On the basis of a simple expression for the generalization error, in terms of the eigenvalue…

Disordered Systems and Neural Networks · Physics 2007-05-23 Peter Sollich , Anason Halees

We describe an algorithm that, given any full-rank matrix A having fewer rows than columns, can rapidly compute the orthogonal projection of any vector onto the null space of A, as well as the orthogonal projection onto the row space of A,…

Numerical Analysis · Computer Science 2011-05-26 Vladimir Rokhlin , Mark Tygert

Standard perturbation theory of eigenvalue problems consists of obtaining approximations of eigenmodes in the neighborhood of an operator where the corresponding eigenmode is known. Nevertheless, if the corresponding eigenmodes of several…

Mathematical Physics · Physics 2025-07-29 Geneviève Dusson , Louis Garrigue , Benjamin Stamm

In this paper, we first establish the convergence criteria of the residual iteration method for solving quadratic eigenvalue problem- s. We analyze the impact of shift point and the subspace expansion on the convergence of this method. In…

Numerical Analysis · Mathematics 2017-01-12 Liu Yang , Yuquan Sun , Fanghui Gong

An approach is developed for constructing simple analytical formulae accurately approximating solutions to eigenvalue problems of quantum mechanics. This approach is based on self-similar approximation theory. In order to derive…

Condensed Matter · Physics 2009-10-31 V. I. Yukalov , E. P. Yukalova , S. Gluzman