English
Related papers

Related papers: GPU-accelerated dynamic nonlinear optimization wit…

200 papers

We propose a reduced-space formulation for optimizing over trained neural networks where the network's outputs and derivatives are evaluated on a GPU. To do this, we treat the neural network as a "gray box" where intermediate variables and…

Machine Learning · Computer Science 2025-12-10 Robert Parker , Oscar Dowson , Nicole LoGiudice , Manuel Garcia , Russell Bent

In this paper, we aim to introduce a new perspective when comparing highly parallelized algorithms on GPU: the energy consumption of the GPU. We give an analysis of the performance of linear algebra operations, including addition of…

Numerical Analysis · Mathematics 2021-12-22 Abal-Kassim Cheik Ahamed , Alban Desmaison , Frederic Magoules

This paper presents a hybrid CPU-GPU framework for solving combinatorial scheduling problems formulated as Integer Linear Programming (ILP). While scheduling underpins many optimization tasks in computing systems, solving these problems…

Machine Learning · Computer Science 2026-04-01 Mingju Liu , Jiaqi Yin , Alvaro Velasquez , Cunxi Yu

Integrating renewable resources within the transmission grid at a wide scale poses significant challenges for economic dispatch as it requires analysis with more optimization parameters, constraints, and sources of uncertainty. This…

Computational Engineering, Finance, and Science · Computer Science 2023-08-17 Kasia Świrydowicz , Nicholson Koukpaizan , Tobias Ribizel , Fritz Göbel , Shrirang Abhyankar , Hartwig Anzt , Slaven Peleš

We present the GPU implementation of the general-purpose interior-point solver Clarabel for convex optimization problems with conic constraints. We introduce a mixed parallel computing strategy that processes linear constraints first, then…

Optimization and Control · Mathematics 2025-11-04 Yuwen Chen , Danny Tse , Parth Nobel , Paul Goulart , Stephen Boyd

Spatial Branch and Bound (B&B) algorithms are widely used for solving nonconvex problems to global optimality, yet they remain computationally expensive. Though some works have been carried out to speed up B&B via CPU parallelization, GPU…

Optimization and Control · Mathematics 2025-07-29 Hongzhen Zhang , Tim Kerkenhoff , Neil Kichler , Manuel Dahmen , Alexander Mitsos , Uwe Naumann , Dominik Bongartz

We report numerical results on solving constrained linear-quadratic model predictive control (MPC) problems by exploiting graphics processing units (GPUs). The presented method reduces the MPC problem by eliminating the state variables and…

Optimization and Control · Mathematics 2026-05-11 David Cole , Sungho Shin , François Pacaud , Victor M. Zavala , Mihai Anitescu

We introduce a GPU-accelerated Monte Carlo framework for nonconvex, free-final-time trajectory optimization problems. This framework makes use of the prox-linear method, which belongs to the larger family of sequential convex programming…

Optimization and Control · Mathematics 2024-04-30 Govind M. Chari , Abhinav G. Kamath , Purnanand Elango , Behçet Açıkmeşe

We demonstrate a high-performance vendor-agnostic method for massively parallel solving of ensembles of ordinary differential equations (ODEs) and stochastic differential equations (SDEs) on GPUs. The method is integrated with a widely used…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-20 Utkarsh Utkarsh , Valentin Churavy , Yingbo Ma , Tim Besard , Prakitr Srisuma , Tim Gymnich , Adam R. Gerlach , Alan Edelman , George Barbastathis , Richard D. Braatz , Christopher Rackauckas

This paper introduces cuHALLaR, a GPU-accelerated implementation of the HALLaR method proposed in Monteiro et al. 2024 for solving large-scale semidefinite programming (SDP) problems. We demonstrate how our Julia-based implementation…

A projection-based immersed boundary method is dominated by sparse linear algebra routines. Using the open-source Cusp library, we observe a speedup (with respect to a single CPU core) which reflects the constraints of a bandwidth-dominated…

Computational Engineering, Finance, and Science · Computer Science 2016-04-12 Simon K Layton , Anush Krishnan , Lorena A. Barba

We propose a GPU-accelerated distributed optimization algorithm for controlling multi-phase optimal power flow in active distribution systems with dynamically changing topologies. To handle varying network configurations and enable…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-15 Minseok Ryu , Geunyeong Byeon , Kibaek Kim

We develop a GPU-accelerated dynamic programming (DP) method for valuing, operating, and bidding energy storage under multistage stochastic electricity prices. Motivated by computational limitations in existing models, we formulate DP…

Optimization and Control · Mathematics 2025-11-20 Thomas Lee , Andy Sun

The present work describes the development of heterogeneous GPGPU implicit CFD coupled solvers, encompassing both density- and pressure- based approaches. In this setup, the assembled linear matrix is offloaded onto multiple GPUs using…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-14 Stefano Oliani , Ettore Fadiga , Ivan Spisso , Luigi Capone , Federico Piscaglia

In this thesis we develop techniques to efficiently solve numerical Partial Differential Equations (PDEs) using Graphical Processing Units (GPUs). Focus is put on both performance and re--usability of the methods developed, to this end a…

Numerical Analysis · Mathematics 2021-01-19 Andrew Gloster

This paper discusses the potential of graphics processing units (GPUs) in high-dimensional optimization problems. A single GPU card with hundreds of arithmetic cores can be inserted in a personal computer and dramatically accelerates many…

Computation · Statistics 2015-03-13 Hua Zhou , Kenneth Lange , Marc A. Suchard

We propose a GPU-based distributed optimization algorithm, aimed at controlling optimal power flow in multi-phase and unbalanced distribution systems. Typically, conventional distributed optimization algorithms employed in such scenarios…

Optimization and Control · Mathematics 2023-10-17 Minseok Ryu , Geunyeong Byeon , Kibaek Kim

We present a GPU-accelerated version of a high-order discontinuous Galerkin discretization of the unsteady incompressible Navier-Stokes equations. The equations are discretized in time using a semi-implicit scheme with explicit treatment of…

Numerical Analysis · Mathematics 2018-05-08 Ali Karakus , Noel Chalmers , Kasia Swirydowicz , Timothy Warburton

Latent Dirichlet Allocation(LDA) is a popular topic model. Given the fact that the input corpus of LDA algorithms consists of millions to billions of tokens, the LDA training process is very time-consuming, which may prevent the usage of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-14 Xiaolong Xie , Yun Liang , Xiuhong Li , Wei Tan

As part of the Exascale Computing Project (ECP), a recent focus of development efforts for the SUite of Nonlinear and DIfferential/ALgebraic equation Solvers (SUNDIALS) has been to enable GPU-accelerated time integration in scientific…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-04 Cody J. Balos , David J. Gardner , Carol S. Woodward , Daniel R. Reynolds