English
Related papers

Related papers: Accurate error estimation in CG

200 papers

Correcting scan-positional errors is critical in achieving electron ptychography with both high resolution and high precision. This is a demanding and challenging task due to the sheer number of parameters that need to be optimized. For…

Other Condensed Matter · Physics 2022-11-08 Shoucong Ning , Wenhui Xu , Leyi Loh , Zhen Lu , Michel Bosman , Fucai Zhang , Qian He

Efficient numerical solvers for partial differential equations empower science and engineering. One of the commonly employed numerical solvers is the preconditioned conjugate gradient (PCG) algorithm which can solve large systems to a given…

Numerical Analysis · Mathematics 2023-09-07 Yichen Li , Peter Yichen Chen , Tao Du , Wojciech Matusik

An open problem that arises when using modern iterative linear solvers, such as the preconditioned conjugate gradient (PCG) method or Generalized Minimum RESidual method (GMRES) is how to choose the residual tolerance in the linear solver…

Numerical Analysis · Mathematics 2010-04-27 Matthew Dixon , Zhaojun Bai , Charles Brush , Francis Chung , Emin Dogrul , Tariq Kadir

We propose a novel preconditioned inexact primal-dual interior point method for constrained convex quadratic programming problems. The algorithm we describe invokes the preconditioned conjugate gradient method on a new reduced Schur…

Numerical Analysis · Mathematics 2021-12-28 Samah Karim , Edgar Solomonik

Chvatal-Gomory cutting planes (CG-cuts for short) are a fundamental tool in Integer Programming. Given any single CG-cut, one can derive an entire family of CG-cuts, by `iterating' its multiplier vector modulo one. This leads naturally to…

Optimization and Control · Mathematics 2014-04-15 Iskander Aliev , Adam N. Letchford

We consider minimization of a smooth nonconvex objective function using an iterative algorithm based on Newton's method and the linear conjugate gradient algorithm, with explicit detection and use of negative curvature directions for the…

Optimization and Control · Mathematics 2018-11-14 Clément W. Royer , Michael O'Neill , Stephen J. Wright

In this paper, we consider the nonconvex quadratically constrained quadratic programming (QCQP) with one quadratic constraint. By employing the conjugate gradient method, an efficient algorithm is proposed to solve QCQP that exploits the…

Optimization and Control · Mathematics 2018-07-17 Akram Taati , Maziar Salahi

Recently, a Riemannian proximal Newton method has been developed for optimizing problems in the form of $\min_{x\in\mathcal{M}} f(x) + \mu \|x\|_1$, where $\mathcal{M}$ is a compact embedded submanifold and $f(x)$ is smooth. Although this…

Optimization and Control · Mathematics 2025-03-25 Wen Huang , Wutao Si

In recent years, topology optimization has been developed sufficiently and many researchers have concentrated on enhancing to computationally numerical algorithms for computational effectiveness of this method. Along with the development of…

Numerical Analysis · Mathematics 2023-01-19 Nam G. Luu , Thanh T. Banh

In this paper, we propose a proximal gradient method and an accelerated proximal gradient method for solving composite optimization problems, where the objective function is the sum of a smooth and a convex, possibly nonsmooth, function. We…

Optimization and Control · Mathematics 2025-07-22 Raghu Bollapragada , Shagun Gupta

This paper proposes probabilistic conformal prediction (PCP), a predictive inference algorithm that estimates a target variable by a discontinuous predictive set. Given inputs, PCP construct the predictive set based on random samples from…

Machine Learning · Statistics 2022-06-22 Zhendong Wang , Ruijiang Gao , Mingzhang Yin , Mingyuan Zhou , David M. Blei

This paper proposes a novel framework for implicit multi-camera system calibration utilizing Gaussian Process (GP) regression. Conventional explicit calibration methods are constrained by rigid mathematical models and struggle with complex,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Ivan De Boi , Bart Ribbens , Veronika Golanova , Ursula Kapov , Simon Verspeek

We propose a two-level nested preconditioned iterative scheme for solving sparse linear systems of equations in which the coefficient matrix is symmetric and indefinite with relatively small number of negative eigenvalues. The proposed…

Numerical Analysis · Computer Science 2019-01-29 Murat Manguoglu , Volker Mehrmann

Generalized cross-validation (GCV) is a widely-used method for estimating the squared out-of-sample prediction risk that employs a scalar degrees of freedom adjustment (in a multiplicative sense) to the squared training error. In this…

Statistics Theory · Mathematics 2024-04-23 Pierre C. Bellec , Jin-Hong Du , Takuya Koriyama , Pratik Patil , Kai Tan

The computational efficiency of approximate Bayesian computation (ABC) has been improved by using surrogate models such as Gaussian processes (GP). In one such promising framework the discrepancy between the simulated and observed data is…

Machine Learning · Statistics 2020-08-07 Marko Järvenpää , Aki Vehtari , Pekka Marttinen

Motivated by applications arising from sensor networks and machine learning, we consider the problem of minimizing a finite sum of nondifferentiable convex functions where each component function is associated with an agent and a…

Optimization and Control · Mathematics 2021-03-22 Harshal D. Kaushik , Farzad Yousefian

In this article, we propose a new method for calculating the mixed correlation coefficient (Pearson, polyserial and polychoric) matrix and its covariance matrix based on the GMM framework. We build moment equations for each coefficient and…

Computation · Statistics 2024-04-11 Ben Liu , Peng Zhang , Yi Feng , Xiaowei Lou

In this paper, we present a sharp analysis for a class of alternating projected gradient descent algorithms which are used to solve the covariate adjusted precision matrix estimation problem in the high-dimensional setting. We demonstrate…

Information Theory · Computer Science 2022-01-13 Xiao Lv , Wei Cui , Yulong Liu

Gaussian Processes (GPs) are powerful kernelized methods for non-parameteric regression used in many applications. However, their use is limited to a few thousand of training samples due to their cubic time complexity. In order to scale GPs…

Machine Learning · Statistics 2021-12-20 Manuel Schürch , Dario Azzimonti , Alessio Benavoli , Marco Zaffalon

Nesterov's accelerated gradient method for minimizing a smooth strongly convex function $f$ is known to reduce $f(\x_k)-f(\x^*)$ by a factor of $\eps\in(0,1)$ after $k\ge O(\sqrt{L/\ell}\log(1/\eps))$ iterations, where $\ell,L$ are the two…

Optimization and Control · Mathematics 2016-05-03 Sahar Karimi , Stephen A. Vavasis