English
Related papers

Related papers: Limited-memory BFGS Systems with Diagonal Updates

200 papers

Quasi-Newton methods are ubiquitous in deterministic local search due to their efficiency and low computational cost. This class of methods uses the history of gradient evaluations to approximate second-order derivatives. However, only…

Optimization and Control · Mathematics 2025-11-24 André Carlon , Luis Espath , Raúl Tempone

The main goal of this paper is to propose a new quaternion total variation regularization model for solving linear ill-posed quaternion inverse problems, which arise from three-dimensional signal filtering or color image processing. The…

Numerical Analysis · Mathematics 2024-08-07 Xuan Liu , Zhigang Jia , Xiaoqing Jin

We propose a GPU-based iterative method for accelerated elastodynamic simulation with the log-barrier-based contact model. While Newton's method is a conventional choice for solving the interior-point system, the presence of ill-conditioned…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-14 Dewen Guo , Minchen Li , Yin Yang , Guoping Wang , Sheng Li

Deep learning algorithms often require solving a highly non-linear and nonconvex unconstrained optimization problem. Methods for solving optimization problems in large-scale machine learning, such as deep learning and deep reinforcement…

Machine Learning · Computer Science 2019-09-06 Jacob Rafati , Roummel F. Marcia

L-BFGS is a hill climbing method that is guarantied to converge only for convex problems. In computer graphics, it is often used as a black box solver for a more general class of non linear problems, including problems having many local…

Graphics · Computer Science 2015-08-13 Nicolas Ray , Dmitry Sokolov

The quaternion biconjugate gradient (QBiCG) method, as a novel variant of quaternion Lanczos-type methods for solving the non-Hermitian quaternion linear systems, does not yield a minimization property. This means that the method possesses…

Numerical Analysis · Mathematics 2024-02-07 Tao Li , Qing-Wen Wang , Xin-Fang Zhang

Numerous applications, such as Krylov subspace solvers, make extensive use of the block classical Gram-Schmidt (BCGS) algorithm and its reorthogonalized variants for orthogonalizing a set of vectors. For large-scale problems in distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-30 Erin Carson , Yuxin Ma

First-order methods have been popularly used for solving large-scale problems. However, many existing works only consider unconstrained problems or those with simple constraint. In this paper, we develop two first-order methods for…

Optimization and Control · Mathematics 2017-11-23 Yangyang Xu

We use the circle method to count the number of integer solutions to systems of bihomogeneous equations of bidegree $(1,1)$ and $(2,1)$ of bounded height in lopsided boxes. Previously, adjusting Birch's techniques to the bihomogeneous…

Number Theory · Mathematics 2023-05-29 Leonhard Hochfilzer

We consider an on-line system identification setting, in which new data become available at given time steps. In order to meet real-time estimation requirements, we propose a tailored Bayesian system identification procedure, in which the…

Systems and Control · Computer Science 2016-01-19 Diego Romeres , Giulia Prando , Gianluigi Pillonetto , Alessandro Chiuso

MARTY is a C++ computer algebra system specialized for High Energy Physics that can calculate amplitudes, squared amplitudes and Wilson coefficients in a large variety of beyond the Standard Model scenarios up to the one-loop order. It is…

High Energy Physics - Phenomenology · Physics 2021-02-24 G. Uhlrich , F. Mahmoudi , A. Arbey

Lagrangian multiforms provide a variational framework for describing integrable hierarchies. This thesis presents two approaches for systematically constructing Lagrangian one-forms, which cover the case of finite-dimensional integrable…

Mathematical Physics · Physics 2026-02-13 Anup Anand Singh

We present an entirely new geometric and probabilistic approach to synchronization of correspondences across multiple sets of objects or images. In particular, we present two algorithms: (1) Birkhoff-Riemannian L-BFGS for optimizing the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Tolga Birdal , Umut Şimşekli

In the context of the minimal SO(5) linear {\sigma}-model, a complete renormalizable Lagrangian -including gauge bosons and fermions- is considered, with the symmetry softly broken to SO(4). The scalar sector describes both the electroweak…

High Energy Physics - Phenomenology · Physics 2016-06-29 Ferruccio Feruglio , Belen Gavela , Kirill Kanshin , Pedro Accioly Nogueira Machado , Stefano Rigolin , Sara Saa

The information bottleneck (IB) problem tackles the issue of obtaining relevant compressed representations $T$ of some random variable $X$ for the task of predicting $Y$. It is defined as a constrained optimization problem which maximizes…

Machine Learning · Statistics 2020-02-19 Borja Rodríguez-Gálvez , Ragnar Thobaben , Mikael Skoglund

In this paper, we consider the linear programming (LP) formulation for deep reinforcement learning. The number of the constraints depends on the size of state and action spaces, which makes the problem intractable in large or continuous…

Optimization and Control · Mathematics 2021-05-21 Yongfeng Li , Mingming Zhao , Weijie Chen , Zaiwen Wen

Working in the Palatini formalism, we describe a procedure for constructing degenerate solutions of general relativity on 4-manifold M from certain solutions of 2-dimensional BF theory on any framed surface Sigma embedded in M. In these…

General Relativity and Quantum Cosmology · Physics 2009-10-30 John C. Baez

Solving multihomogeneous systems, as a wide range of structured algebraic systems occurring frequently in practical problems, is of first importance. Experimentally, solving these systems with Gr\"obner bases algorithms seems to be easier…

Symbolic Computation · Computer Science 2010-02-24 Jean-Charles Faugère , Mohab Safey El Din , Pierre-Jean Spaenlehauer

The presented previously indirect optimization method (IOM) developed within biochemical systems theory (BST) provides a versatile and mathematically tractable optimization strategy for biochemical systems. However, due to the local…

Quantitative Methods · Quantitative Biology 2007-06-13 Gongxian Xu , Cheng Shao , Zhilong Xiu

The BFGS quasi-Newton methodology, popular for smooth minimization, has also proved surprisingly effective in nonsmooth optimization. Through a variety of simple examples and computational experiments, we explore how the BFGS matrix update…

Optimization and Control · Mathematics 2018-02-20 Jiayi Guo , Adrian S. Lewis