English
Related papers

Related papers: cuPDLPx: A Further Enhanced GPU-Based First-Order …

200 papers

In this paper, we investigate GPU based parallel triangular solvers systematically. The parallel triangular solvers are fundamental to incomplete LU factorization family preconditioners and algebraic multigrid solvers. We develop a new…

Mathematical Software · Computer Science 2016-06-03 Zhangxin Chen , Hui Liu , Bo Yang

This technical note documents the implementation and use of the Primal-Dual Conic Programming Solver (PDCS), a first-order solver for large-scale conic optimization problems introduced by Lin et al. (arXiv:2505.00311). It describes the…

Optimization and Control · Mathematics 2026-03-17 Zhenwei Lin , Zikai Xiong , Dongdong Ge , Yinyu Ye

Dense, discrete Graphical Models with pairwise potentials are a powerful class of models which are employed in state-of-the-art computer vision and bio-imaging applications. This work introduces a new MAP-solver, based on the popular Dual…

Machine Learning · Computer Science 2020-04-20 Siddharth Tourani , Alexander Shekhovtsov , Carsten Rother , Bogdan Savchynskyy

This paper presents the implementation of a HLLC finite volume solver using GPU technology for the solution of shallow water problems in two dimensions. It compares both CPU and GPU approaches for implementing all the solver's steps. The…

Computational Engineering, Finance, and Science · Computer Science 2018-07-03 Fabrice Zaoui

We present a convex hull algorithm that is accelerated on commodity graphics hardware. We analyze and identify the hurdles of writing a recursive divide and conquer algorithm on the GPU and divise a framework for representing this class of…

Computational Geometry · Computer Science 2015-03-20 Stanley Tzeng , John D. Owens

We present GFORS, a GPU-accelerated framework for large binary integer programs. It couples a first-order (PDHG-style) routine that guides the search in the continuous relaxation with a randomized, feasibility-aware sampling module that…

Optimization and Control · Mathematics 2025-11-03 Ningji Wei , Jiaming Liang

GPUs have gained significant popularity over the past decade, extending beyond their original role in graphics rendering. This evolution has brought GPU security and reliability to the forefront of concerns. Prior research has shown that…

Cryptography and Security · Computer Science 2026-01-06 Saurabh Singh , Ruobing Han , Jaewon Lee , Seonjin Na , Yonghae Kim , Taesoo Kim , Hyesoon Kim

We present a set of rules to guide the design of GPU algorithms. These rules are grounded on the principle of reducing waste in GPU utility to achieve good speed up. In accordance to these rules, we propose GPU algorithms for 2D…

Graphics · Computer Science 2020-07-02 Zhenghai Chen , Tiow-Seng Tan , Hong-Yang Ong

We study a class of generalized linear programs (GLP) in a large-scale setting, which includes simple, possibly nonsmooth convex regularizer and simple convex set constraints. By reformulating (GLP) as an equivalent convex-concave min-max…

Optimization and Control · Mathematics 2023-04-10 Chaobing Song , Cheuk Yin Lin , Stephen J. Wright , Jelena Diakonikolas

Combinatorial optimization problems arise in logistics, scheduling, and resource allocation, yet existing approaches face a fundamental trade-off among generality, performance, and usability. We present cuGenOpt, a GPU-accelerated…

Artificial Intelligence · Computer Science 2026-03-20 Yuyang Liu

We study parallel particle-in-cell (PIC) methods for low-temperature plasmas (LTPs), which discretize kinetic formulations that capture the time evolution of the probability density function of particles as a function of position and…

Computational Engineering, Finance, and Science · Computer Science 2025-08-12 James Almgren-Bell , Nader Al Awar , Dilip S Geethakrishnan , Milos Gligoric , George Biros

In this paper, we address a long-standing challenge: how to achieve both efficiency and scalability in solving semidefinite programming problems. We propose breakthrough acceleration techniques for a wide range of low-rank…

Optimization and Control · Mathematics 2024-08-27 Qiushi Han , Zhenwei Lin , Hanwen Liu , Caihua Chen , Qi Deng , Dongdong Ge , Yinyu Ye

A projection-based immersed boundary method is dominated by sparse linear algebra routines. Using the open-source Cusp library, we observe a speedup (with respect to a single CPU core) which reflects the constraints of a bandwidth-dominated…

Computational Engineering, Finance, and Science · Computer Science 2016-04-12 Simon K Layton , Anush Krishnan , Lorena A. Barba

Gaussian Process Regression (GPR) is an important type of supervised machine learning model with inherent uncertainty measure in its predictions. We propose a new framework, nuGPR, to address the well-known challenge of high computation…

Machine Learning · Computer Science 2025-10-15 Ziqi Zhao , Vivek Sarin

Block-tridiagonal systems are prevalent in state estimation and optimal control, and solving these systems is often the computational bottleneck. Improving the underlying solvers therefore has a direct impact on the real-time performance of…

Mathematical Software · Computer Science 2025-12-05 David Jin , Alexis Montoison , Sungho Shin

We describe an efficient implementation of a recent simplex-type algorithm for the exact solution of separated continuous linear programs, and compare it with linear programming approximation of these problems obtained via discretization of…

Optimization and Control · Mathematics 2021-10-07 Evgeny Shindin , Michael Masin , Gideon Weiss , Alexander Zadorojniy

Large language models (LLMs) are computationally intensive. The computation workload and the memory footprint grow quadratically with the dimension (layer width). Most of LLMs' parameters come from the linear layers of the transformer…

Machine Learning · Computer Science 2024-02-22 Xiao-Yang Liu , Jie Zhang , Guoxuan Wang , Weiqing Tong , Anwar Walid

We introduce a GPU-accelerated Monte Carlo framework for nonconvex, free-final-time trajectory optimization problems. This framework makes use of the prox-linear method, which belongs to the larger family of sequential convex programming…

Optimization and Control · Mathematics 2024-04-30 Govind M. Chari , Abhinav G. Kamath , Purnanand Elango , Behçet Açıkmeşe

The continued growth in the processing power of FPGAs coupled with high bandwidth memories (HBM), makes systems like the Xilinx U280 credible platforms for linear solvers which often dominate the run time of scientific and engineering…

Hardware Architecture · Computer Science 2023-01-02 Linghao Song , Licheng Guo , Suhail Basalama , Yuze Chi , Robert F. Lucas , Jason Cong

A framework is developed for applying accelerated methods to general hyperbolic programming, including linear, second-order cone, and semidefinite programming as special cases. The approach replaces a hyperbolic program with a convex…

Optimization and Control · Mathematics 2017-05-30 James Renegar