English
Related papers

Related papers: Parallelization of the inverse fast multipole meth…

200 papers

Polynomial systems occur in many areas of science and engineering. Unlike general nonlinear systems, the algebraic structure enables to compute all solutions of a polynomial system. We describe our massive parallel predictor-corrector…

Mathematical Software · Computer Science 2015-05-05 Jan Verschelde , Xiangcheng Yu

Sequential numerical methods for integrating initial value problems (IVPs) can be prohibitively expensive when high numerical accuracy is required over the entire interval of integration. One remedy is to integrate in a parallel fashion,…

Numerical Analysis · Mathematics 2022-09-26 Kamran Pentland , Massimiliano Tamborrino , T. J. Sullivan , James Buchanan , L. C. Appel

We introduce Stream-K, a work-centric parallelization of matrix multiplication (GEMM) and related computations in dense linear algebra. Whereas contemporary decompositions are primarily tile-based, our method operates by partitioning an…

Data Structures and Algorithms · Computer Science 2023-01-11 Muhammad Osama , Duane Merrill , Cris Cecka , Michael Garland , John D. Owens

In this paper, we evaluate the performance of various parallel optimization methods for Kernel Support Vector Machines on multicore CPUs and GPUs. In particular, we provide the first comparison of algorithms with explicit and implicit…

Machine Learning · Computer Science 2014-04-04 Stephen Tyree , Jacob R. Gardner , Kilian Q. Weinberger , Kunal Agrawal , John Tran

Numerically solving ordinary differential equations (ODEs) is a naturally serial process and as a result the vast majority of ODE solver software are serial. In this manuscript we developed a set of parallelized ODE solvers using…

Numerical Analysis · Mathematics 2022-09-13 Utkarsh , Chris Elrod , Yingbo Ma , Christopher Rackauckas

A distributed-memory parallelization strategy for the density matrix renormalization group is proposed for cases where correlation functions are required. This new strategy has substantial improvements with respect to previous works. A…

Strongly Correlated Electrons · Physics 2010-04-20 Julian Rincon , D. J. Garcia , K. Hallberg

The creation of practical deep learning data-products often requires parallelization across processors and computers to make deep learning feasible on large data sets, but bottlenecks in communication bandwidth make it difficult to attain…

Neural and Evolutionary Computing · Computer Science 2016-02-22 Tim Dettmers

Embedding models in natural language processing (NLP) increasingly rely on deep architectures such as BERT, while simpler models such as Word2Vec provide efficient representations but limited interpretability. The Tsetlin Machine (TM)…

Machine Learning · Computer Science 2026-05-11 Ahmed K. Kadhim , Lei Jiao , Rishad Shafik , Ole-Christoffer Granmo , Mayur Kishor Shende

In this paper, we propose an empirical method for evaluating the performance of parallel code. Our method is based on a simple idea that is surprisingly effective in helping to identify causes of poor performance, such as high…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-15 Umut A. Acar , Arthur Charguéraud , Mike Rainey

Among optimal hierarchical algorithms for the computational solution of elliptic problems, the Fast Multipole Method (FMM) stands out for its adaptability to emerging architectures, having high arithmetic intensity, tunable accuracy, and…

Numerical Analysis · Computer Science 2016-01-20 Huda Ibeid , Rio Yokota , Jennifer Pestana , David Keyes

As one of the most popular classifiers, linear SVMs still have challenges in dealing with very large-scale problems, even though linear or sub-linear algorithms have been developed recently on single machines. Parallel computing methods…

Machine Learning · Computer Science 2015-12-25 Hugh Perkins , Minjie Xu , Jun Zhu , Bo Zhang

The study deals with the parallelization of 2D and 3D finite element based Navier-Stokes codes using direct solvers. Development of sparse direct solvers using multifrontal solvers has significantly reduced the computational time of direct…

Mathematical Software · Computer Science 2009-10-13 Mandhapati P. Raju

Identifying the sets of operations that can be executed simultaneously is an important problem appearing in many parallel applications. By modeling the operations and their interactions as a graph, one can identify the independent…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-07-28 Ahmet Erdem Sarıyüce , Erik Saule , Ümit V. Çatalyürek

The paper presents a combination of the time-parallel "parallel full approximation scheme in space and time" (PFASST) with a parallel multigrid method (PMG) in space, resulting in a mesh-based solver for the three-dimensional heat equation…

Numerical Analysis · Computer Science 2015-07-28 Robert Speck , Daniel Ruprecht , Matthew Emmett , Matthias Bolten , Rolf Krause

Energy efficiency of training and inferencing with large neural network models is a critical challenge facing the future of sustainable large-scale machine learning workloads. This paper introduces an alternative strategy, called phantom…

Machine Learning · Computer Science 2026-02-10 Sudip K. Seal , Maksudul Alam , Jorge Ramirez , Sajal Dash , Hao Lu

The Multilevel Monte Carlo (MLMC) method has proven to be an effective variance-reduction statistical method for Uncertainty Quantification (UQ) in Partial Differential Equation (PDE) models, combining model computations at different levels…

Mathematical Software · Computer Science 2023-05-24 Santiago Badia , Jerrad Hampton , Javier Principe

We investigate a parallelization strategy for dense matrix factorization (DMF) algorithms, using OpenMP, that departs from the legacy (or conventional) solution, which simply extracts concurrency from a multithreaded version of BLAS. This…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-20 Sandra Catalán , Adrián Castelló , Francisco D. Igual , Rafael Rodríguez-Sánchez , Enrique S. Quintana-Ortí

In this study, we present a parallel topology algorithm with a suitable interpolation method for chimera simulations in CFD. The implementation is done in the unstructured Finite Volume (FV) framework and special attention is given to the…

Fluid Dynamics · Physics 2023-05-29 Spiros Zafeiris , George Papadakis

In this paper we combine an infeasible Interior Point Method (IPM) with the Proximal Method of Multipliers (PMM). The resulting algorithm (IP-PMM) is interpreted as a primal-dual regularized IPM, suitable for solving linearly constrained…

Optimization and Control · Mathematics 2021-02-01 Spyridon Pougkakiotis , Jacek Gondzio

We introduce a novel hybrid methodology combining classical finite element methods (FEM) with neural networks to create a well-performing and generalizable surrogate model for forward and inverse problems. The residual from finite element…

Computational Engineering, Finance, and Science · Computer Science 2022-05-18 Rishith Ellath Meethal , Birgit Obst , Mohamed Khalil , Aditya Ghantasala , Anoop Kodakkal , Kai-Uwe Bletzinger , Roland Wüchner