English
Related papers

Related papers: Solving Linear Systems on a GPU with Hierarchicall…

200 papers

Developing efficient hardware accelerators for mathematical kernels used in scientific applications and machine learning has traditionally been a labor-intensive task. These accelerators typically require low-level programming in Verilog or…

Hardware Architecture · Computer Science 2025-09-15 Doru Thom Popovici , Mario Vega , Angelos Ioannou , Fabien Chaix , Dania Mosuli , Blair Reasoner , Tan Nguyen , Xiaokun Yang , John Shalf

Matrix diagonalization is almost always involved in computing the density matrix needed in quantum chemistry calculations. In the case of modest matrix sizes ($\lesssim$ 5000), performance of traditional dense diagonalization algorithms on…

Chemical Physics · Physics 2023-06-23 Joshua Finkelstein , Christian F. A. Negre , Jean-Luc Fattebert

We investigate the problem of certifying optimality for sparse generalized linear models (GLMs), where sparsity is enforced through a cardinality constraint. While Branch-and-Bound (BnB) frameworks can certify optimality using perspective…

Optimization and Control · Mathematics 2026-03-03 Jiachang Liu , Andrea Lodi , Soroosh Shafiee

When modeling scientific and industrial problems, geometries are typically modeled by explicit boundary representations obtained from computer-aided design software. Unfitted (also known as embedded or immersed) finite element methods offer…

Computational Engineering, Finance, and Science · Computer Science 2024-05-24 Pere A. Martorell , Santiago Badia

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

Machine Learning · Computer Science 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu

We propose a parameter-minimal neural architecture for solving differential equations by restricting the hypothesis class to Horner-factorized polynomials, yielding an implicit, differentiable trial solution with only a small set of…

Machine Learning · Computer Science 2026-02-17 T. Matulić , D. Seršić

We provide a flexible, open-source framework for hardware acceleration, namely massively-parallel execution on general-purpose graphics processing units (GPUs), applied to the hierarchical Poincar\'e--Steklov (HPS) family of algorithms for…

Numerical Analysis · Mathematics 2025-11-17 Owen Melia , Daniel Fortunato , Jeremy Hoskins , Rebecca Willett

Large-scale eigenvalue computations on sparse matrices are a key component of graph analytics techniques based on spectral methods. In such applications, an exhaustive computation of all eigenvalues and eigenvectors is impractical and…

Hardware Architecture · Computer Science 2021-03-19 Francesco Sgherzi , Alberto Parravicini , Marco Siracusa , Marco Domenico Santambrogio

Structural parameters are normally extracted from observed galaxies by fitting analytic light profiles to the observations. Obtaining accurate fits to high-resolution images is a computationally expensive task, requiring many model…

Instrumentation and Methods for Astrophysics · Physics 2015-03-17 Benjamin R. Barsdell , David G. Barnes , Christopher J. Fluke

LU factorization for sparse matrices is the most important computing step for many engineering and scientific computing problems such as circuit simulation. But parallelizing LU factorization with the Graphic Processing Units (GPU) still…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-14 Shaoyi Peng , Sheldon X. -D. Tan

We study a family of (potentially non-convex) constrained optimization problems with convex composite structure. Through a novel analysis of non-smooth geometry, we show that proximal-type algorithms applied to exact penalty formulations of…

Optimization and Control · Mathematics 2019-03-04 Yu Bai , John Duchi , Song Mei

We consider the problem of solving a large-scale system of linear equations in a distributed or federated manner by a taskmaster and a set of machines, each possessing a subset of the equations. We provide a comprehensive comparison of two…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-24 Boris Velasevic , Rohit Parasnis , Christopher G. Brinton , Navid Azizan

We present factorization and solution phases for a new linear complexity direct solver designed for concurrent batch operations on fine-grained parallel architectures, for matrices amenable to hierarchical representation. We focus on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-16 Wajih Boukaram , David Keyes , Sherry Li , Yang Liu , George Turkiyyah

Matrices with the displacement structures of circulant, Toeplitz, and Hankel types as well as matrices with structures generalizing these types are omnipresent in computations of sciences and engineering. In this paper, we present efficient…

Quantum Physics · Physics 2021-10-06 Lin-Chun Wan , Chao-Hua Yu , Shi-Jie Pan , Su-Juan Qin , Fei Gao , Qiao-Yan Wen

This paper presents the implementation of a HLLC finite volume solver using GPU technology for the solution of shallow water problems in two dimensions. It compares both CPU and GPU approaches for implementing all the solver's steps. The…

Computational Engineering, Finance, and Science · Computer Science 2018-07-03 Fabrice Zaoui

We investigate the solution of low-rank matrix approximation problems using the truncated SVD. For this purpose, we develop and optimize GPU implementations for the randomized SVD and a blocked variant of the Lanczos approach. Our work…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-12 Andres E. Tomas , Enrique S. Quintana-Orti , Hartwig Anzt

We present an efficient algorithm for solving local linear systems with a boundary condition using the Green's function of a connected induced subgraph related to the system. We introduce the method of using the Dirichlet heat kernel…

Data Structures and Algorithms · Computer Science 2015-08-03 Fan Chung , Olivia Simpson

Existing block-diagonal representation researches mainly focuses on casting block-diagonal regularization on training data, while only little attention is dedicated to concurrently learning both block-diagonal representations of training…

Computer Vision and Pattern Recognition · Computer Science 2017-07-13 Zheng Zhang , Yong Xu , Ling Shao , Jian Yang

The vision of super computer at every desk can be realized by powerful and highly parallel CPUs or GPUs or APUs. Graphics processors once specialized for the graphics applications only, are now used for the highly computational intensive…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-04-16 Chittampally Vasanth Raja , Srinivas Balasubramanian , Prakash S Raghavendra

We provide a randomized linear time approximation scheme for a generic problem about clustering of binary vectors subject to additional constrains. The new constrained clustering problem encompasses a number of problems and by solving it,…

Data Structures and Algorithms · Computer Science 2018-07-20 Fedor V. Fomin , Petr A. Golovach , Daniel Lokshtanov , Fahad Panolan , Saket Saurabh