English
Related papers

Related papers: Scheduled Relaxation Jacobi method: improvements a…

200 papers

Many computer vision problems can be formulated as binary quadratic programs (BQPs). Two classic relaxation methods are widely used for solving BQPs, namely, spectral methods and semidefinite programming (SDP), each with their own…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Peng Wang , Chunhua Shen , Anton van den Hengel

A sequential quadratic optimization algorithm is proposed for solving smooth nonlinear equality constrained optimization problems in which the objective function is defined by an expectation of a stochastic function. The algorithmic…

Optimization and Control · Mathematics 2023-03-17 Albert S. Berahas , Frank E. Curtis , Michael J. O'Neill , Daniel P. Robinson

Stochastic partial differential equations (SPDEs) are ubiquitous in engineering and computational sciences. The stochasticity arises as a consequence of uncertainty in input parameters, constitutive relations, initial/boundary conditions,…

Data Analysis, Statistics and Probability · Physics 2020-01-29 Sharmila Karumuri , Rohit Tripathy , Ilias Bilionis , Jitesh Panchal

Solving symmetric positive semidefinite linear systems is an essential task in many scientific computing problems. While Jacobi-type methods, including the classical Jacobi method and the weighted Jacobi method, exhibit simplicity in their…

Optimization and Control · Mathematics 2025-10-16 Ling Liang , Qiyuan Pang , Kim-Chuan Toh , Haizhao Yang

We show how the basic idea of parabolic Jacobi relaxation can be modified to obtain a new class of hyperbolic relaxation schemes that are suitable for the solution of elliptic equations. Some of the analytic and numerical properties of…

General Relativity and Quantum Cosmology · Physics 2018-10-31 Hannes R. Rüter , David Hilditch , Marcus Bugner , Bernd Brügmann

Maximum a posteriori (MAP) inference over discrete Markov random fields is a fundamental task spanning a wide spectrum of real-world applications, which is known to be NP-hard for general graphs. In this paper, we propose a novel…

Machine Learning · Computer Science 2015-01-06 Qixing Huang , Yuxin Chen , Leonidas Guibas

Hamilton-Jacobi partial differential equations (HJ PDEs) have deep connections with a wide range of fields, including optimal control, differential games, and imaging sciences. By considering the time variable to be a higher dimensional…

Machine Learning · Computer Science 2023-12-12 Paula Chen , Tingwei Meng , Zongren Zou , Jérôme Darbon , George Em Karniadakis

We consider adaptive approximations of the parameter-to-solution map for elliptic operator equations depending on a large or infinite number of parameters, comparing approximation strategies of different degrees of nonlinearity: sparse…

Numerical Analysis · Mathematics 2017-04-04 Markus Bachmayr , Albert Cohen , Wolfgang Dahmen

In this paper, we propose a two-level block preconditioned Jacobi-Davidson (BPJD) method for efficiently solving discrete eigenvalue problems resulting from finite element approximations of $2m$th ($m = 1, 2$) order symmetric elliptic…

Numerical Analysis · Mathematics 2023-04-13 Qigang Liang , Wei Wang , Xuejun Xu

We present a reduced basis (RB) method for parametrized linear elliptic partial differential equations (PDEs) in a least-squares finite element framework. A rigorous and reliable error estimate is developed, and is shown to bound the error…

Numerical Analysis · Mathematics 2020-09-24 Jehanzeb Hameed Chaudhry , Luke N. Olson , Peter Sentz

Low-rank methods for semidefinite programming (SDP) have gained a lot of interest recently, especially in machine learning applications. Their analysis often involves determinant-based or Schatten-norm penalties, which are hard to implement…

Optimization and Control · Mathematics 2021-12-07 Mikhail Krechetov , Jakub Marecek , Yury Maximov , Martin Takac

The classic method for computing the spectral decomposition of a real symmetric matrix, the Jacobi algorithm, can be accelerated by using mixed precision arithmetic. The Jacobi algorithm is aiming to reduce the off-diagonal entries…

Numerical Analysis · Mathematics 2025-09-03 Zhengbo Zhou

We investigate the acceleration of stationary iterations for multi-term Sylvester equation by means of reduced rank extrapolation (RRE). Theoretical convergence results and implementations are provided for both small and large-scale…

Numerical Analysis · Mathematics 2026-03-16 Peter Benner , Pascal den Boef , Patrick Kürschner , Xiaobo Liu , Jens Saak

In this paper we present the theoretical framework needed to justify the use of a kernel-based collocation method (meshfree approximation method) to estimate the solution of high-dimensional stochastic partial differential equations…

Numerical Analysis · Mathematics 2012-09-11 Igor Cialenco , Gregory E. Fasshauer , Qi Ye

In this paper, we concentrate on a particular category of quadratically constrained quadratic programming (QCQP): nonconvex QCQP with one equality constraint. This type of QCQP problem optimizes a quadratic objective under a fixed…

Optimization and Control · Mathematics 2025-06-05 Licheng Zhao , Rui Zhou , Wenqiang Pu

We propose and analyze a sequential quadratic programming algorithm for minimizing a noisy nonlinear smooth function subject to noisy nonlinear smooth equality constraints. The algorithm uses a step decomposition strategy and, as a result,…

Optimization and Control · Mathematics 2025-03-11 Albert S. Berahas , Jiahao Shi , Baoyu Zhou

Stochastic sampling methods are arguably the most direct and least intrusive means of incorporating parametric uncertainty into numerical simulations of partial differential equations with random inputs. However, to achieve an overall error…

Numerical Analysis · Mathematics 2014-04-09 Hans-Werner van Wyk

We consider the estimation of parameter-dependent statistics of functional outputs of elliptic boundary value problems (BVPs) with parametrized random and deterministic inputs. For a given value of the deterministic paremeter, a stochastic…

Numerical Analysis · Mathematics 2020-05-12 Sebastian Ullmann , Christopher Müller , Jens Lang

(Partial) differential equations (PDEs) are fundamental tools for describing natural phenomena, making their solution crucial in science and engineering. While traditional methods, such as the finite element method, provide reliable…

Machine Learning · Computer Science 2025-03-11 Viggo Moro , Luiz F. O. Chamon

This paper presents a numerical method for variable coefficient elliptic PDEs with mostly smooth solutions on two dimensional domains. The PDE is discretized via a multi-domain spectral collocation method of high local order (order 30 and…

Numerical Analysis · Mathematics 2016-12-09 Tracy Babb , Adrianna Gillman , Sijia Hao , Per-Gunnar Martinsson