English
Related papers

Related papers: Disguised and new Quasi-Newton methods for nonline…

200 papers

Equivariant deep learning architectures exploit symmetries in learning problems to improve the sample efficiency of neural-network-based models and their ability to generalise. However, when modelling real-world data, learning problems are…

Machine Learning · Statistics 2024-11-12 Matthew Ashman , Cristiana Diaconu , Adrian Weller , Wessel Bruinsma , Richard E. Turner

Newton method is one of the most powerful methods for finding solutions of nonlinear equations and for proving their existence. In its "pure" form it has fast convergence near the solution, but small convergence domain. On the other hand…

Optimization and Control · Mathematics 2019-08-27 Boris Polyak , Andrey Tremba

We develop a computationally efficient algorithm for the automatic regularization of nonlinear inverse problems based on the discrepancy principle. We formulate the problem as an equality constrained optimization problem, where the…

Numerical Analysis · Mathematics 2021-09-03 Jeffrey Cornelis , Wim Vanroose

This paper deals with approximate solutions of a nonsmooth semi-infinite programming with multiple interval-valued objective functions. We first introduce four types of approximate quasi Pareto solutions of the considered problem by…

Optimization and Control · Mathematics 2022-01-25 Nguyen Huy Hung , Hoang Ngoc Tuan , Nguyen Van Tuyen

The partial Schur factorization can be used to represent several eigenpairs of a matrix in a numerically robust way. Different adaptions of the Arnoldi method are often used to compute partial Schur factorizations. We propose here a…

Numerical Analysis · Mathematics 2012-02-16 Elias Jarlebring , Karl Meerbergen , Wim Michiels

Machine learning (ML) problems are often posed as highly nonlinear and nonconvex unconstrained optimization problems. Methods for solving ML problems based on stochastic gradient descent are easily scaled for very large problems but may…

Numerical Analysis · Mathematics 2019-05-24 Jennifer B. Erway , Joshua Griffin , Roummel F. Marcia , Riadh Omheni

We introduce the primal-dual quasi-Newton (PD-QN) method as an approximated second order method for solving decentralized optimization problems. The PD-QN method performs quasi-Newton updates on both the primal and dual variables of the…

Optimization and Control · Mathematics 2020-01-08 Mark Eisen , Aryan Mokhtari , Alejandro Ribeiro

This paper proposed a new explicit nonlinear dimensionality reduction using neural networks for image retrieval tasks. We first proposed a Quasi-curvature Locally Linear Embedding (QLLE) for training set. QLLE guarantees the linear…

Computer Vision and Pattern Recognition · Computer Science 2017-03-14 Shenglan Liu , Jun Wu , Lin Feng , Feilong Wang

This work discusses the Improved Matrix Method and Weighted Residual Method for studying the quasinormal modes (QNMs) of black holes. In the first method, by utilizing Jordan decomposition, the improved matrix method avoids the calculation…

General Relativity and Quantum Cosmology · Physics 2025-07-09 Kai Lin

In this paper, we propose an inexact proximal Newton-type method for nonconvex composite problems. We establish the global convergence rate of the order $\mathcal{O}(k^{-1/2})$ in terms of the minimal norm of the KKT residual mapping and…

Optimization and Control · Mathematics 2024-12-26 Hong Zhu

The affine inverse eigenvalue problem consists of identifying a real symmetric matrix with a prescribed set of eigenvalues in an affine space. Due to its ubiquity in applications, various instances of the problem have been widely studied in…

Optimization and Control · Mathematics 2019-11-07 Utkan Candogan , Yong Sheng Soh , Venkat Chandrasekaran

In this paper we make a subtle use of tools from operator theory and the Schauder fixed-point theorem to establish the existence of pseudo-almost automorphic solutions to some classes of nonautonomous integro-differential equations with…

Analysis of PDEs · Mathematics 2014-02-25 Toka Diagana

We consider the numerical solution of Hamilton-Jacobi-Bellman equations arising in stochastic control theory. We introduce a class of monotone approximation schemes relying on monotone interpolation. These schemes converge under very weak…

Numerical Analysis · Mathematics 2014-05-26 Kristian Debrabant , Espen R. Jakobsen

For large-scale eigenvalue problems requiring many mutually orthogonal eigenvectors, traditional numerical methods suffer substantial computational and communication costs with limited parallel scalability, primarily due to explicit…

Numerical Analysis · Mathematics 2026-01-12 Shengyue Wang , Aihui Zhou

We introduce an inertial quasi-Newton Forward-Backward Splitting Algorithm to solve a class of monotone inclusion problems. While the inertial step is computationally cheap, in general, the bottleneck is the evaluation of the resolvent…

Optimization and Control · Mathematics 2024-03-18 Shida Wang , Jalal Fadili , Peter Ochs

Numerical solution of nonlinear eigenvalue problems (NEPs) is frequently encountered in computational science and engineering. The applicability of most existing methods is limited by matrix structures, property of eigen-solutions, size of…

Numerical Analysis · Mathematics 2016-05-26 Jinyou Xiao , Chuanzeng Zhang , Tsung-Ming Huang , Tetsuya Sakurai

Hidden Markov Models (HMM) model a sequence of observations that are dependent on a hidden (or latent) state that follow a Markov chain. These models are widely used in diverse fields including ecology, speech recognition, and…

Optimization and Control · Mathematics 2024-09-05 Sidonie Foulon , Thérèse Truong , Anne-Louise Leutenegger , Hervé Perdry

In this paper we show uniqueness of the conductivity for the quasilinear Calder\'on's inverse problem. The nonlinear conductivity depends, in a nonlinear fashion, of the potential itself and its gradient. Under some structural assumptions…

Analysis of PDEs · Mathematics 2018-06-26 Claudio Muñoz , Gunther Uhlmann

Quasi-Newton (QN) methods provide an efficient alternative to second-order methods for minimizing smooth unconstrained problems. While QN methods generally compose a Hessian estimate based on one secant interpolation per iteration,…

Optimization and Control · Mathematics 2025-04-11 Mokhwa Lee , Yifan Sun

The purpose of this work is to investigate root finding problems defined on (quasi-)metric spaces, and ranging in Euclidean spaces. The motivation for this line of inquiry stems from recent models in biology and phylogenetics, where…

Optimization and Control · Mathematics 2025-10-28 Titus Pinta