English
Related papers

Related papers: Polynomial Preconditioned GMRES to Reduce Communic…

200 papers

We revisit gradient-based optimization for infinite projected entangled pair states (iPEPS), a tensor network ansatz for simulating many-body quantum systems. This approach is hindered by two major challenges: the high computational cost of…

Strongly Correlated Electrons · Physics 2026-03-09 Xing-Yu Zhang , Qi Yang , Philippe Corboz , Jutho Haegeman , Wei Tang

The R package optimParallel provides a parallel version of the gradient-based optimization methods of optim(). The main function of the package is optimParallel(), which has the same usage and output as optim(). Using optimParallel() can…

Computation · Statistics 2018-05-01 Florian Gerber , Reinhard Furrer

This paper proposes a new gradient-based optimization approach for designing optimal feedback kernels for parabolic distributed parameter systems with boundary control. Unlike traditional kernel optimization methods for parabolic systems,…

Optimization and Control · Mathematics 2016-03-16 Zhigang Ren , Chao Xu , Qun Lin , Ryan Loxton

This paper addresses the efficient solution of linear systems arising from curl-conforming finite element discretizations of $H(\mathrm{curl})$ elliptic problems with heterogeneous coefficients. We first employ the discrete form of a…

Numerical Analysis · Mathematics 2025-06-10 Chupeng Ma , Yongwei Zhang

We demonstrate applications of algebraic techniques that optimize and certify polynomial inequalities to problems of interest in the operations research and transportation engineering communities. Three problems are considered: (i) wireless…

Optimization and Control · Mathematics 2015-04-24 Amir Ali Ahmadi , Anirudha Majumdar

The Kernel Polynomial Method (KPM) is one of the fast diagonalization methods used for simulations of quantum systems in research fields of condensed matter physics and chemistry. The algorithm has a difficulty to be parallelized on a…

Computational Physics · Physics 2011-05-30 Shixun Zhang , Shinichi Yamagiwa , Masahiko Okumura , Seiji Yunoki

Clustering is an important tool in data analysis, with K-means being popular for its simplicity and versatility. However, it cannot handle non-linearly separable clusters. Kernel K-means addresses this limitation but requires a large kernel…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-29 Julian Bellavita , Matthew Rubino , Nakul Iyer , Andrew Chang , Aditya Devarakonda , Flavio Vella , Giulia Guidi

Gaussian processes (GP) are Bayesian non-parametric models that are widely used for probabilistic regression. Unfortunately, it cannot scale well with large data nor perform real-time predictions due to its cubic time cost in the data size.…

Machine Learning · Computer Science 2014-08-12 Jie Chen , Nannan Cao , Kian Hsiang Low , Ruofei Ouyang , Colin Keng-Yan Tan , Patrick Jaillet

Gaussian processes (GP) are Bayesian non-parametric models that are widely used for probabilistic regression. Unfortunately, it cannot scale well with large data nor perform real-time predictions due to its cubic time cost in the data size.…

Machine Learning · Statistics 2013-05-27 Jie Chen , Nannan Cao , Kian Hsiang Low , Ruofei Ouyang , Colin Keng-Yan Tan , Patrick Jaillet

The hybrid analog/digital architecture that connects a limited number of RF chains to multiple antennas through phase shifters could effectively address the energy consumption issues in massive multiple-input multiple-output (MIMO) systems.…

Information Theory · Computer Science 2025-01-07 Yifan Guo

In [Hayami K, Sugihara M. Numer Linear Algebra Appl. 2011; 18:449--469], the authors analyzed the convergence behaviour of the Generalized Minimal Residual (GMRES) method for the least squares problem $ \min_{ {\bf x} \in {\bf R}^n} {\|…

Numerical Analysis · Mathematics 2021-12-28 Ken Hayami , Kota Sugihara

In this work, we propose a generalized alternating nonlinear generalized minimal residual method (GA-NGMRES) to accelerate first-order optimization schemes for PDE-constrained optimization problems governed by transport equations. We apply…

Optimization and Control · Mathematics 2025-10-13 Yunhui He , Andreas Mang

We are interested in obtaining approximate solutions to parameterized linear systems of the form $A(\mu) x(\mu) = b$ for many values of the parameter $\mu$. Here $A(\mu)$ is large, sparse, and nonsingular, with a nonlinear analytic…

Numerical Analysis · Mathematics 2022-06-13 Siobhán Correnty , Elias Jarlebring , Kirk M. Soodhalter

Algebraic multigrid (AMG) is a widely used scalable solver and preconditioner for large-scale linear systems resulting from the discretization of a wide class of elliptic PDEs. While AMG has optimal computational complexity, the cost of…

Mathematical Software · Computer Science 2020-01-22 Wayne B. Mitchell , Robert Strzodka , Robert D. Falgout

In this note we exploit polynomial preconditioners for the Conjugate Gradient method to solve large symmetric positive definite linear systems in a parallel environment. We put in connection a specialized Newton method to solve the matrix…

Numerical Analysis · Mathematics 2020-11-30 Luca Bergamaschi , Angeles Martinez

For some typical and widely used non-convex half-quadratic regularization models and the Ambrosio-Tortorelli approximate Mumford-Shah model, based on the Kurdyka-\L ojasiewicz analysis and the recent nonconvex proximal algorithms, we…

Optimization and Control · Mathematics 2021-07-30 Shengxiang Deng , Ismail Ben Ayed , Hongpeng Sun

Physics-informed machine learning (PIML) has emerged as a promising alternative to conventional numerical methods for solving partial differential equations (PDEs). PIML models are increasingly built via deep neural networks (NNs) whose…

Machine Learning · Computer Science 2024-09-30 Carlos Mora , Amin Yousefpour , Shirin Hosseinmardi , Ramin Bostanabad

The Crank-Nicolson (CN) method is a well-known time integrator for evolutionary partial differential equations (PDEs) arising in many real-world applications. Since the solution at any time depends on the solution at previous time steps,…

Numerical Analysis · Mathematics 2024-02-13 Yong-Liang Zhao , Xian-Ming Gu , Cornelis W. Oosterlee

Interprocessor communication often dominates the runtime of large matrix computations. We present a parallel algorithm for computing QR decompositions whose bandwidth cost (communication volume) can be decreased at the cost of increasing…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-15 Grey Ballard , James Demmel , Laura Grigori , Mathias Jacquelin , Nicholas Knight

The celebrated minimum residual method (MINRES), proposed in the seminal paper of Paige and Saunders, has seen great success and widespread use in solving Hermitian (and complex-symmetric) linear systems. Unless the system is consistent,…

Numerical Analysis · Mathematics 2025-05-22 Yang Liu , Andre Milzarek , Fred Roosta