English
Related papers

Related papers: An Efficient Multilevel Preconditioned Nonlinear C…

200 papers

An estimation of the sky signal from streams of Time Ordered Data (TOD) acquired by Cosmic Microwave Background (\cmb) experiments is one of the most important steps in the context of \cmb data analysis referred to as the map-making…

Cosmology and Nongalactic Astrophysics · Physics 2018-10-17 Giuseppe Puglisi , Davide Poletti , Giulio Fabbian , Carlo Baccigalupi , Luca Heltai , Radek Stompor

Gaussian process hyperparameter optimization requires linear solves with, and log-determinants of, large kernel matrices. Iterative numerical techniques are becoming popular to scale to larger datasets, relying on the conjugate gradient…

Machine Learning · Computer Science 2022-06-22 Jonathan Wenger , Geoff Pleiss , Philipp Hennig , John P. Cunningham , Jacob R. Gardner

In this paper, we propose a modified nonlinear conjugate gradient (NCG) method for functions with a non-Lipschitz continuous gradient. First, we present a new formula for the conjugate coefficient \beta_k in NCG, conducting a search…

Numerical Analysis · Mathematics 2022-04-19 Bingjie Li , Tianhao Ni , Zhenyue Zhang

In this paper, we propose a new estimation methodology based on a projected non-linear conjugate gradient (PNCG) algorithm with an efficient line search technique. We develop a general PNCG algorithm for a survival model incorporating a…

Statistics Theory · Mathematics 2020-07-07 Suvra Pal , Souvik Roy

Incremental Potential Contact (IPC) enables robust, contact-rich simulation by casting elasticity and contact as a single energy minimization problem, but high-performance IPC pipelines are typically built from specialized kernels and…

Graphics · Computer Science 2026-05-25 Xuan Tang , Kemeng Huang , Gilbert Bernstein , Minchen LI , Tzumao Li

We present a quasi-static finite element simulator for human face animation. We model the face as an actuated soft body, which can be efficiently simulated using Projective Dynamics (PD). We adopt Incremental Potential Contact (IPC) to…

Graphics · Computer Science 2023-12-07 Bo Li , Lingchen Yang , Barbara Solenthaler

In this paper we consider a nonconvex unconstrained optimization problem minimizing a twice differentiable objective function with H\"older continuous Hessian. Specifically, we first propose a Newton-conjugate gradient (Newton-CG) method…

Optimization and Control · Mathematics 2025-04-15 Chuan He , Heng Huang , Zhaosong Lu

Consider composite nonconvex optimization problems where the objective function consists of a smooth nonconvex term (with Lipschitz-continuous gradient) and a convex (possibly nonsmooth) term. Existing parameter-free methods for such…

Optimization and Control · Mathematics 2025-10-08 Zilong Ye , Shiqian Ma , Junfeng Yang , Danqing Zhou

The Pairwise Conditional Gradients (PCG) algorithm is a powerful extension of the Frank-Wolfe algorithm leading to particularly sparse solutions, which makes PCG very appealing for problems such as sparse signal recovery, sparse regression,…

Optimization and Control · Mathematics 2022-02-09 Kazuma Tsuji , Ken'ichiro Tanaka , Sebastian Pokutta

This paper investigates one possible solution to the problem of self-interference cancellation (SIC) arising in the design of in-band full-duplex (IBFD) communication systems. Self-interference cancellation is performed in the digital…

Optimization and Control · Mathematics 2026-03-20 Alexander Degtyarev , Sergei Bakhurin , Nikita Yudin

Despite hundreds of papers on preconditioned linear systems of equations, there remains a significant lack of comprehensive performance benchmarks comparing various preconditioners for solving symmetric positive definite (SPD) systems. In…

Numerical Analysis · Mathematics 2025-05-28 Marc A. Tunnell , David F. Gleich

The conjugate gradient solver (CG) is a prevalent method for solving symmetric and positive definite linear systems Ax=b, where effective preconditioners are crucial for fast convergence. Traditional preconditioners rely on prescribed…

Machine Learning · Computer Science 2025-11-03 Zherui Yang , Zhehao Li , Kangbo Lyu , Yixuan Li , Tao Du , Ligang Liu

We numerically analyze the possibility of turning off post-smoothing (relaxation) in geometric multigrid when used as a preconditioner in conjugate gradient linear and eigenvalue solvers for the 3D Laplacian. The geometric Semicoarsening…

Numerical Analysis · Computer Science 2015-06-09 Henricus Bouwmeester , Andrew Dougherty , Andrew V. Knyazev

Newton's Method is widely used to find the solution of complex non-linear simulation problems in Computer Graphics. To guarantee a descent direction, it is common practice to clamp the negative eigenvalues of each element Hessian prior to…

Graphics · Computer Science 2026-05-26 José Antonio Fernández-Fernández , Fabian Löschner , Jan Bender

In this paper we are interested in the solution of Compressed Sensing (CS) problems where the signals to be recovered are sparse in coherent and redundant dictionaries. CS problems of this type are convex with non-smooth and non-separable…

Optimization and Control · Mathematics 2014-06-02 Ioannis Dassios , Kimon Fountoulakis , Jacek Gondzio

This paper presents performance results comparing MPI-based implementations of the popular Conjugate Gradient (CG) method and several of its communication hiding (or 'pipelined') variants. Pipelined CG methods are designed to efficiently…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-17 Siegfried Cools , Jeffrey Cornelis , Pieter Ghysels , Wim Vanroose

High-order bases provide major advantages over linear ones in terms of efficiency, as they provide (for the same physical model) higher accuracy for the same running time, and reliability, as they are less affected by locking artifacts and…

Graphics · Computer Science 2023-05-30 Zachary Ferguson , Pranav Jain , Denis Zorin , Teseo Schneider , Daniele Panozzo

We consider adaptive finite element methods (AFEMs) with inexact algebraic solvers for second-order symmetric linear elliptic diffusion problems. Optimal complexity of AFEM, i.e., optimal convergence rates with respect to the overall…

Numerical Analysis · Mathematics 2026-04-10 Paula Hilbert , Ani Miraçi , Dirk Praetorius

Model predictive control (MPC) for linear dynamical systems requires solving an optimal control structured quadratic program (QP) at each sampling instant. This paper proposes a primal active-set strategy (PRESAS) for the efficient solution…

Optimization and Control · Mathematics 2020-07-14 Rien Quirynen , Stefano Di Cairano

We describe a number of recently developed techniques for improving the performance of large-scale nuclear configuration interaction calculations on high performance parallel computers. We show the benefit of using a preconditioned block…

Numerical Analysis · Computer Science 2017-12-29 Meiyue Shao , Hasan Metin Aktulga , Chao Yang , Esmond G. Ng , Pieter Maris , James P. Vary