English
Related papers

Related papers: Massively Parallel Reductions in Multivariate Poly…

200 papers

Sparse matrix-vector multiplication (spMVM) is the dominant operation in many sparse solvers. We investigate performance properties of spMVM with matrices of various sparsity patterns on the nVidia "Fermi" class of GPGPUs. A new "padded…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-03-08 Moritz Kreutzer , Georg Hager , Gerhard Wellein , Holger Fehske , Achim Basermann , Alan R. Bishop

Training massive-scale deep learning models on datasets spanning tens of terabytes presents critical challenges in hardware utilization and training reproducibility. In this paper, we identify and resolve profound data-loading bottlenecks…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-24 Kashish Mittal , Di Yu , Roozbeh Ketabi , Arushi Arora , Brendon Lapp , Peng Zhang

We study a graph partitioning problem motivated by the simulation of the physical movement of multi-body systems on an atomistic level, where the forces are calculated from a quantum mechanical description of the electrons. Several advanced…

In this work, we study several variants of matrix reduction via Gaussian elimination that try to keep the reduced matrix sparse. The motivation comes from the growing field of topological data analysis where matrix reduction is the major…

Computational Geometry · Computer Science 2024-06-14 Ulrich Bauer , Talha Bin Masood , Barbara Giunti , Guillaume Houry , Michael Kerber , Abhishek Rathod

Sparse matrix-vector multiplication (SpMV) is a crucial computing kernel with widespread applications in iterative algorithms. Over the past decades, research on SpMV optimization has made remarkable strides, giving rise to various…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-10 Jianhua Gao , Bingjie Liu , Weixing Ji , Hua Huang

The explosion of Big Data was followed by the proliferation of numerous complex parallel software stacks whose aim is to tackle the challenges of data deluge. A drawback of a such multi-layered hierarchical deployment is the inability to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-01 Colin Barrett , Christos Kotselidis , Mikel Luján

In this paper, we consider an approach to the parallelizing of the algorithms realizing the modified probability changigng method with adaptation and partial rollback procedure for constrained pseudo-Boolean optimization problems. Existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-09-03 Lev Kazakovtsev

We compare different methods for sampling from discrete probability distributions and introduce a new algorithm which is especially efficient on massively parallel processors, such as GPUs. The scheme preserves the distribution properties…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-02 Nikolaus Binder , Alexander Keller

Pseudorandom number generators are required for many computational tasks, such as stochastic modelling and simulation. This paper investigates the serial CPU and parallel GPU implementation of a Linear Congruential Generator based on the…

Mathematical Software · Computer Science 2012-06-25 Gleb Beliakov , Michael Johnstone , Doug Creighton , Tim Wilkin

Sparse matrix reordering can significantly reduce the fill-in during matrix factorization, thereby decreasing the computational and storage requirements in sparse matrix computations. Finding a minimal fill-in ordering is known to be an…

Machine Learning · Computer Science 2026-05-19 Ziwei Li , Tao Yuan , Shuzi Niu , Huiyuan Li

A classical problem in Distance Geometry, with multiple practical applications (in molecular structure determination, sensor network localization etc.) is to find the possible placements of the vertices of a graph with given edge lengths.…

Combinatorics · Mathematics 2021-11-30 Goran Malić , Ileana Streinu

Tomographic imaging has benefited from advances in X-ray sources, detectors and optics to enable novel observations in science, engineering and medicine. These advances have come with a dramatic increase of input data in the form of faster…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-25 Stefano Marchesini , Anuradha Trivedi , Pablo Enfedaque , Talita Perciano , Dilworth Parkinson

In linear optimization, matrix structure can often be exploited algorithmically. However, beneficial presolving reductions sometimes destroy the special structure of a given problem. In this article, we discuss structure-aware…

Optimization and Control · Mathematics 2019-08-05 Ambros Gleixner , Nils-Christian Kempke , Thorsten Koch , Daniel Rehfeldt , Svenja Uslu

In the field of equation learning, exhaustively considering all possible equations derived from a basis function dictionary is infeasible. Sparse regression and greedy algorithms have emerged as popular approaches to tackle this challenge.…

Machine Learning · Statistics 2023-11-28 Daniel Nickelsen , Bubacarr Bah

Posynomials are nonnegative combinations of monomials with possibly fractional and both positive and negative exponents. Posynomial models are widely used in various engineering design endeavors, such as circuits, aerospace and structural…

Systems and Control · Computer Science 2014-03-17 Giuseppe C. Calafiore , Laurent El Ghaoui , Carlo Novara

The efficient solution of moderately large-scale linear systems arising from the KKT conditions in optimal control problems (OCPs) is a critical challenge in robotics. With the stagnation of Moore's law, there is growing interest in…

Optimization and Control · Mathematics 2025-05-21 Shaohui Yang , Toshiyuki Ohtsuka , Brian Plancher , Colin N. Jones

Gaussian elimination with full pivoting generates a PLUQ matrix decomposition. Depending on the strategy used in the search for pivots, the permutation matrices can reveal some information about the row or the column rank profiles of the…

Numerical Analysis · Computer Science 2013-05-21 Jean-Guillaume Dumas , Clément Pernet , Ziad Sultan

Data-driven modeling plays an increasingly important role in different areas of engineering. For most of existing methods, such as genetic programming (GP), the convergence speed might be too slow for large scale problems with a large…

Optimization and Control · Mathematics 2017-06-29 Chen Chen , Changtong Luo , Zonglin Jiang

Graph Pattern Mining (GPM) extracts higher-order information in a large graph by searching for small patterns of interest. GPM applications are computationally expensive, and thus attractive for GPU acceleration. Unfortunately, due to the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-28 Xuhao Chen , Arvind

Architectures with multiple classes of memory media are becoming a common part of mainstream supercomputer deployments. So called multi-level memories offer differing characteristics for each memory component including variation in…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-04 Mehmet Deveci , Simon D. Hammond , Michael M. Wolf , Sivasankaran Rajamanickam