English
Related papers

Related papers: Orthogononalization on a general purpose graphics …

200 papers

Developing a contemporary optimal transport (OT) solver requires navigating trade-offs among several critical requirements: GPU parallelization, scalability to high-dimensional problems, theoretical convergence guarantees, empirical…

Machine Learning · Computer Science 2025-04-04 Mete Kemertas , Amir-massoud Farahmand , Allan D. Jepson

In this paper, we address the challenge of solving large-scale graph-structured nonlinear programs (gsNLPs) in a scalable manner. GsNLPs are problems in which the objective and constraint functions are associated with nodes on a graph and…

Optimization and Control · Mathematics 2026-05-19 Runxin Ni , Haoxuan Wang , Sen Na , Sungho Shin , Mihai Anitescu

The geometric multigrid method (GMG) is one of the most efficient solving techniques for discrete algebraic systems arising from elliptic partial differential equations. GMG utilizes a hierarchy of grids or discretizations and reduces the…

Numerical Analysis · Mathematics 2013-01-14 Chunsheng Feng , Shi Shu , Jinchao Xu , Chen-Song Zhang

We propose a new hybrid topology optimization algorithm based on multigrid approach that combines the parallelization strategy of CPU using OpenMP and heavily multithreading capabilities of modern Graphics Processing Units (GPU). In…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-01 Arya Prakash Padhi , Souvik Chakraborty , Anupam Chakrabarti , Rajib Chowdhury

This paper presents a highly-parallelizable parallel-in-time algorithm for efficient solution of nonlinear time-periodic problems. It is based on the time-periodic extension of the Parareal method, known to accelerate sequential…

Numerical Analysis · Mathematics 2020-07-08 Iryna Kulchytska-Ruchka , Sebastian Schöps

Nonlinear equations are challenging to solve due to their inherently nonlinear nature. As analytical solutions typically do not exist, numerical methods have been developed to tackle their solutions. In this article, we give a quantum…

Quantum Physics · Physics 2025-11-04 Nhat A. Nghiem , Tzu-Chieh Wei

We describe the GPU implementation of shifted or multimass iterative solvers for sparse linear systems of the sort encountered in lattice gauge theory. We provide a generic tool that can be used by those without GPU programming experience…

High Energy Physics - Lattice · Physics 2011-02-16 Richard Galvez , Greg van Anders

This paper is devoted to studying the global and finite convergence of the semi-smooth Newton method for solving a piecewise linear system that arises in cone-constrained quadratic programming problems and absolute value equations. We first…

Optimization and Control · Mathematics 2023-01-24 Nicolas F. Armijo , Yunier Bello-Cruz , Gabriel Haeser

We present the numerical methods and GPU-accelerated implementation underlying a Total Lagrangian finite element framework for finite-deformation flexible multibody dynamics, introduced in the companion paper [1]. The framework supports…

Computational Engineering, Finance, and Science · Computer Science 2026-05-04 Zhenhao Zhou , Ruochun Zhang , Ganesh Arivoli , Dan Negrut

The analysis of complex nonlinear systems is often carried out using simpler piecewise linear representations of them. A principled and practical technique is proposed to linearize and evaluate arbitrary continuous nonlinear functions using…

Optimization and Control · Mathematics 2017-11-10 Guillermo Gallego , Daniel Berjón , Narciso García

The main objective of this work consists in analyzing sub-structuring method for the parallel solution of sparse linear systems with matrices arising from the discretization of partial differential equations such as finite element, finite…

Numerical Analysis · Mathematics 2021-08-31 Abal-Kassim Cheik Ahamed , Frédéric Magoulès

The optimisation of neural networks can be sped up by orthogonalising the gradients before the optimisation step, ensuring the diversification of the learned representations. We orthogonalise the gradients of the layer's components/filters…

Machine Learning · Computer Science 2022-02-16 Mark Tuddenham , Adam Prügel-Bennett , Jonathan Hare

We study the problem of executing an application represented by a precedence task graph on a parallel machine composed of standard computing cores and accelerators. Contrary to most existing approaches, we distinguish the allocation and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-20 Marcos Amaris , Giorgio Lucarelli , Clément Mommessin , Denis Trystram

This work is concerned with the efficient optimization method for solving a large class of optimal mass transport problems. An inexact primal-dual algorithm is presented from the time discretization of a proper dynamical system, and by…

Optimization and Control · Mathematics 2022-07-29 Jun Hu , Hao Luo , Zihang Zhang

We solve the Hubbard model with the exact diagonalization method on a graphics processing unit (GPU). We benchmark our GPU program against a sequential CPU code by using the Lanczos algorithm to solve the ground state energy in two cases: a…

Computational Physics · Physics 2012-06-20 Topi Siro , Ari Harju

The Kernel Polynomial Method (KPM) is one of the fast diagonalization methods used for simulations of quantum systems in research fields of condensed matter physics and chemistry. The algorithm has a difficulty to be parallelized on a…

Computational Physics · Physics 2011-05-30 Shixun Zhang , Shinichi Yamagiwa , Masahiko Okumura , Seiji Yunoki

We present a first step towards a multigrid method for solving the min-cost flow problem. Specifically, we present a strategy that takes advantage of existing black-box fast iterative linear solvers, i.e. algebraic multigrid methods. We…

Optimization and Control · Mathematics 2016-12-02 Alessio Quaglino , Rolf Krause

Parameter estimation problems of mathematical models can often be formulated as nonlinear least squares problems. Typically these problems are solved numerically using iterative methods. The local minimiserobtained using these iterative…

Numerical Analysis · Mathematics 2020-04-07 Yasunori Aoki , Ken Hayami , Kota Toshimoto , Yuichi Sugiyama

High fidelity scientific simulations modeling physical phenomena typically require solving large linear systems of equations which result from discretization of a partial differential equation (PDE) by some numerical method. This step often…

Mathematical Software · Computer Science 2020-07-01 Mohammad Shafaet Islam , Qiqi Wang

Group synchronization is a fundamental task involving the recovery of group elements from pairwise measurements. For orthogonal group synchronization, the most common approach reformulates the problem as a constrained nonconvex optimization…

Machine Learning · Statistics 2026-04-10 Haiyang Peng , Deren Han , Xin Chen , Meng Huang