English
Related papers

Related papers: Restructuring expression dags for efficient parall…

200 papers

Diagonalization of a large matrix is the computational bottleneck in many applications such as electronic structure calculations. We show that a speedup of over 30% can be achieved by exploiting 32-bit floating point operations, while…

Computational Physics · Physics 2011-08-24 Eiji Tsuchida , Yoong-Kee Choe

Recent advances in Retrieval-Augmented Generation (RAG) systems have popularized semantic chunking, which aims to improve retrieval performance by dividing documents into semantically coherent segments. Despite its growing adoption, the…

Computation and Language · Computer Science 2024-10-18 Renyi Qu , Ruixuan Tu , Forrest Bao

The rapid advancement in Large Language Models has been met with significant challenges in their training processes, primarily due to their considerable computational and memory demands. This research examines parallelization techniques…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-27 Ishan Patwardhan , Shubham Gandhi , Om Khare , Amit Joshi , Suraj Sawant

In this paper we introduce the first efficient external-memory algorithm to compute the bisimilarity equivalence classes of a directed acyclic graph (DAG). DAGs are commonly used to model data in a wide variety of practical applications,…

Data Structures and Algorithms · Computer Science 2018-03-05 Jelle Hellings , George H. L. Fletcher , Herman Haverkort

In this work we show that randomized (block) coordinate descent methods can be accelerated by parallelization when applied to the problem of minimizing the sum of a partially separable smooth convex function and a simple separable convex…

Optimization and Control · Mathematics 2013-11-27 Peter Richtárik , Martin Takáč

Prior work on Automatically Scalable Computation (ASC) suggests that it is possible to parallelize sequential computation by building a model of whole-program execution, using that model to predict future computations, and then…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-21 Peter Kraft , Amos Waterland , Daniel Y Fu , Anitha Gollamudi , Shai Szulanski , Margo Seltzer

In data-parallel synchronous training of deep neural networks, different devices (replicas) run the same program with different partitions of the training batch, but weight update computation is repeated on all replicas, because the weights…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-05 Yuanzhong Xu , HyoukJoong Lee , Dehao Chen , Hongjun Choi , Blake Hechtman , Shibo Wang

Compiler optimizations, usually expressed as rewrites on program graphs, are a core part of all modern compilers. However, even production compilers have bugs, and these bugs are difficult to detect and resolve. The problem only becomes…

Programming Languages · Computer Science 2014-07-31 William Mansky , Dennis Griffith , Elsa L. Gunter

As deep neural networks (DNNs) become deeper, the training time increases. In this perspective, multi-GPU parallel computing has become a key tool in accelerating the training of DNNs. In this paper, we introduce a novel methodology to…

Numerical Analysis · Mathematics 2024-07-08 Chang-Ock Lee , Youngkyu Lee , Jongho Park

In this paper the performance of a parallel iterated Runge-Kutta method is compared versus those of the serial fouth order Runge-Kutta and Dormand-Prince methods. It was found that, typically, the runtime for the parallel method is…

Numerical Analysis · Mathematics 2016-01-12 Alejandra Gaitán Montejo , Octavio A. Michel-Manzo , César A. Terrero-Escalante

In this work, a new parallel dual-grid multiscale approach for CFD-DEM couplings is investigated. Dual- grid multiscale CFD-DEM couplings have been recently developed and successfully adopted in different applications still, an efficient…

Computational Engineering, Finance, and Science · Computer Science 2018-12-26 Gabriele Pozzetti , Hrvoje Jasak , Xavier Besseron , Alban Rousset , Bernhard Peters

We describe a methodology for designing efficient parallel and distributed scientific software. This methodology utilizes sequences of mechanizable algebra--based optimizing transformations. In this study, we apply our methodology to the…

Software Engineering · Computer Science 2008-11-18 Harry B. Hunt , Lenore R. Mullin , Daniel J. Rosenkrantz , James E. Raynolds

The ability to express a program as a hierarchical composition of parts is an essential tool in managing the complexity of software and a key abstraction this provides is to separate the representation of data from the computation. Many…

Programming Languages · Computer Science 2012-10-04 James Hanlon , Simon J. Hollis , David May

Simulations of physical phenomena are essential to the expedient design of precision components in aerospace and other high-tech industries. These phenomena are often described by mathematical models involving partial differential equations…

Computational Physics · Physics 2017-01-05 Daniel Magee , Kyle E Niemeyer

In modern digital filter chip design, efficient resource utilization is a hot topic. Due to the linear phase characteristics of FIR filters, a pulsed fully parallel structure can be applied to address the problem. To further reduce hardware…

Hardware Architecture · Computer Science 2023-11-27 Mengwei Hu , Zhengxiong Li , Xianyang Jiang

Scheduling job flows efficiently and rapidly on distributed computing clusters is one of huge challenges for daily operation of data centers. In a practical scenario, a single job consists of numerous stages with complex dependency relation…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-22 Jinhong Luo , Yunfan Zhou , Xijun Li , Mingxuan Yuan , Jianguo Yao , Jia Zeng

This article introduces a novel methodology for the massive parallelization of projection-based depths, addressing the computational challenges of data depth in high-dimensional spaces. We propose an algorithmic framework based on Refined…

Computation · Statistics 2025-06-11 Leonardo Leone , Pavlo Mozharovskyi , David Bounie

We study the classic subgraph enumeration problem under distributed settings. Existing solutions either suffer from severe memory crisis or rely on large indexes, which makes them impractical for very large graphs. Most of them follow a…

Databases · Computer Science 2019-01-24 Xuguang Ren , Junhu Wang , Wook-Shin Han , Jeffrey Xu Yu

Recently directed acyclic graph (DAG) structure learning is formulated as a constrained continuous optimization problem with continuous acyclicity constraints and was solved iteratively through subproblem optimization. To further improve…

Machine Learning · Computer Science 2021-06-15 Yue Yu , Tian Gao , Naiyu Yin , Qiang Ji

Run to run variability in parallel programs caused by floating-point non-associativity has been known to significantly affect reproducibility in iterative algorithms, due to accumulating errors. Non-reproducibility can critically affect the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-31 Sanjif Shanmugavelu , Mathieu Taillefumier , Christopher Culver , Oscar Hernandez , Mark Coletti , Ada Sedova