English
Related papers

Related papers: Accelerating MPGP-type Methods Through Preconditio…

200 papers

Composite optimization problems involve minimizing the composition of a smooth map with a convex function. Such objectives arise in numerous data science and signal processing applications, including phase retrieval, blind deconvolution,…

Optimization and Control · Mathematics 2025-10-06 Mateo Díaz , Liwei Jiang , Abdel Ghani Labassi

In the beginning stage, face verification is done using easy method of geometric algorithm models, but the verification route has now developed into a scientific progress of complicated geometric representation and identical procedure. In…

Computer Vision and Pattern Recognition · Computer Science 2014-03-24 V. Karthikeyan , K. Vijayalakshmi , P. Jeyakumar

A class of preconditioners is introduced to enhance geometry optimisation and transition state search of molecular systems. We start from the Hessian of molecular mechanical terms, decompose it and retain only its positive definite part to…

Chemical Physics · Physics 2018-04-06 Letif Mones , Gabor Csanyi , Christoph Ortner

In the preprocessing model for uncertain data we are given a set of regions R which model the uncertainty associated with an unknown set of points P. In this model there are two phases: a preprocessing phase, in which we have access only to…

Computational Geometry · Computer Science 2021-01-18 Ivor van der Hoog , Irina Kostitsyna , Maarten Löffler , Bettina Speckmann

We present a method for improving the speed of geometry relaxation by using a harmonic approximation for the interaction potential between nearest neighbor atoms to construct an initial Hessian estimate. The model is quite robust, and…

Computational Physics · Physics 2007-12-12 J. M. Rondinelli , B. Deng , L. D. Marks

Preconditioning is widely used in machine learning to accelerate convergence on the empirical risk, yet its role on the expected risk remains underexplored. In this work, we investigate how preconditioning affects feature learning and…

Machine Learning · Computer Science 2025-10-01 Kotaro Yoshida , Atsushi Nitanda

In this paper we propose an efficiently preconditioned Newton method for the computation of the leftmost eigenpairs of large and sparse symmetric positive definite matrices. A sequence of preconditioners based on the BFGS update formula is…

Numerical Analysis · Mathematics 2013-12-06 Luca Bergamaschi , Angeles Martinez

In this report, we present a versatile and efficient preconditioned Anderson acceleration (PAA) method for fixed-point iterations. The proposed framework offers flexibility in balancing convergence rates (linear, super-linear, or quadratic)…

Numerical Analysis · Mathematics 2023-10-09 Kewang Chen , Ye Ji , Matthias Möller , Cornelis Vuik

We investigate iterative methods with randomized preconditioners for solving overdetermined least-squares problems, where the preconditioners are based on a random embedding of the data matrix. We consider two distinct approaches: the…

Numerical Analysis · Mathematics 2021-04-15 Jonathan Lacotte , Mert Pilanci

We consider a convex minimization problem for which the objective is the sum of a homogeneous polynomial of degree four and a linear term. Such task arises as a subproblem in algorithms for quadratic inverse problems with a…

Optimization and Control · Mathematics 2024-04-24 Radu-Alexandru Dragomir , Yurii Nesterov

We propose a novel preconditioned inexact primal-dual interior point method for constrained convex quadratic programming problems. The algorithm we describe invokes the preconditioned conjugate gradient method on a new reduced Schur…

Numerical Analysis · Mathematics 2021-12-28 Samah Karim , Edgar Solomonik

We address the slow convergence and poor stability of quasi-newton sequential quadratic programming (SQP) methods that is observed when solving experimental design problems, in particular when they are large. Our findings suggest that this…

Optimization and Control · Mathematics 2011-08-09 M. S. Mommer , A. Sommer , J. P. Schlöder , H. G. Bock

The eXtended Finite Element Method (XFEM) is an approach for solving problems with non-smooth solutions. In the XFEM, the approximate solution is locally enriched to capture discontinuities without requiring a mesh which conforms to the…

Numerical Analysis · Mathematics 2013-12-23 Christapher Lang , David Makhija , Alireza Doostan , Kurt Maute

Kernel Ridge Regression (KRR) is a simple yet powerful technique for non-parametric regression whose computation amounts to solving a linear system. This system is usually dense and highly ill-conditioned. In addition, the dimensions of the…

Numerical Analysis · Computer Science 2017-07-18 Haim Avron , Kenneth L. Clarkson , David P. Woodruff

We describe how the low-rank structure in an SDP can be exploited to reduce the per-iteration cost of a convex primal-dual interior-point method down to $O(n^{3})$ time and $O(n^{2})$ memory, even at very high accuracies. A traditional…

Optimization and Control · Mathematics 2024-12-04 Hong-Ming Chiu , Richard Y. Zhang

Polynomial preconditioning is an important tool in solving large linear systems and eigenvalue problems. A polynomial from GMRES can be used to precondition restarted GMRES and restarted Arnoldi. Here we give methods for indefinite matrices…

Numerical Analysis · Mathematics 2025-10-17 Hayden Henson , Ronald B. Morgan

We are given a set of jobs, each one specified by its release date, its deadline and its processing volume (work), and a single (or a set of) speed-scalable processor(s). We adopt the standard model in speed-scaling in which if a processor…

Data Structures and Algorithms · Computer Science 2012-11-26 Evripidis Bampis , Giorgio Lucarelli , Ioannis Nemparis

Despite hundreds of papers on preconditioned linear systems of equations, there remains a significant lack of comprehensive performance benchmarks comparing various preconditioners for solving symmetric positive definite (SPD) systems. In…

Numerical Analysis · Mathematics 2025-05-28 Marc A. Tunnell , David F. Gleich

Recently, several authors have suggested the use of first order methods, such as fast dual ascent and the alternating direction method of multipliers, for embedded model predictive control. The main reason is that they can be implemented…

Optimization and Control · Mathematics 2014-04-08 Pontus Giselsson

We study classical deadline-based preemptive scheduling of tasks in a computing environment equipped with both dynamic speed scaling and sleep state capabilities: Each task is specified by a release time, a deadline and a processing volume,…

Data Structures and Algorithms · Computer Science 2014-07-04 Antonios Antoniadis , Chien-Chung Huang , Sebastian Ott