English
Related papers

Related papers: Astra: Efficient and Money-saving Automatic Parall…

200 papers

The proliferation of heterogeneous chip multiprocessors in recent years has reached unprecedented levels. Traditional homogeneous platforms have shown fundamental limitations when it comes to enabling high-performance yet-ultra-low-power…

Resource constrained project scheduling is an important combinatorial optimisation problem with many practical applications. With complex requirements such as precedence constraints, limited resources, and finance-based objectives, finding…

Neural and Evolutionary Computing · Computer Science 2022-10-21 Dhananjay R. Thiruvady , Su Nguyen , Christian Blum , Andreas T. Ernst

This paper presents a deeply pipelined and massively parallel Binary Search Tree (BST) accelerator for Field Programmable Gate Arrays (FPGAs). Our design relies on the extremely parallel on-chip memory, or Block RAMs (BRAMs) architecture of…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-04 Oyku Melikoglu , Oguz Ergin , Behzad Salami , Julian Pavon , Osman Unsal , Adrian Cristal

Multi-device inference can reduce Transformer latency by parallelizing computation. However, existing methods require high inter-device bandwidth, making them impractical for bandwidth-constrained environments. We present ASTRA, a…

Machine Learning · Computer Science 2026-05-28 Xiao Liu , Lijun Zhang , Deepak Ganesan , Hui Guan

Existing work only effective on a given number of GPUs, often neglecting the complexities involved in manually determining the specific types and quantities of GPUs needed, which can be a significant burden for developers. To address this…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-20 Zihan Chang , Sheng Xiao , Shuibing He , Siling Yang , Zhe Pan , Dong Li

Recent advances in computer architecture and networking opened the opportunity for parallelizing the clustering algorithms. This divide-and-conquer strategy often results in better results to centralized clustering with a much-improved time…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-15 Ahmed Ibrahim , Rokaya Hassanien

We discuss several strategies to implement Dykstra's projection algorithm on NVIDIA's compute unified device architecture (CUDA). Dykstra's algorithm is the central step in and the computationally most expensive part of statistical…

Computational Physics · Physics 2015-03-13 Jan Lebert , Lutz Künneke , Johannes Hagemann , Stephan C. Kramer

Video diffusion transformers (vDiTs) have made tremendous progress in text-to-video generation, but their high compute demands pose a major challenge for practical deployment. While studies propose acceleration methods to reduce workload at…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Haosong Liu , Yuge Cheng , Wenxuan Miao , Zihan Liu , Aiyue Chen , Jing Lin , Yiwu Yao , Chen Chen , Jingwen Leng , Yu Feng , Minyi Guo

The evolution in the design of modern parallel platforms leads to revisit the scheduling jobs on distributed heterogeneous resources. The goal of this survey is to present the main existing algorithms, to classify them based on their…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-31 Olivier Beaumont , Louis-claude Canon , Lionel Eyraud-Dubois , Giorgio Lucarelli , Loris Marchal , Clément Mommessin , Bertrand Simon , Denis Trystram

Reducing energy consumption is a challenge that is faced on a daily basis by teams from the High-Performance Computing as well as the Embedded domain. This issue is mostly attacked from an hardware perspective, by devising architectures…

Performance · Computer Science 2015-11-30 Baptiste Delporte , Roberto Rigamonti , Alberto Dassatti

The FEAST algorithm is a subspace iteration method that uses a spectral projector as a rational filter in order to efficiently solve interior eigenvalue problems in parallel. Although the solutions from the FEAST algorithm converge rapidly…

Numerical Analysis · Mathematics 2016-05-30 Brendan Gavin , Eric Polizzi

To solve optimization problems with parabolic PDE constraints, often methods working on the reduced objective functional are used. They are computationally expensive due to the necessity of solving both the state equation and a…

Optimization and Control · Mathematics 2019-12-17 Sebastian Götschel , Michael L. Minion

In modern digital filter chip design, efficient resource utilization is a hot topic. Due to the linear phase characteristics of FIR filters, a pulsed fully parallel structure can be applied to address the problem. To further reduce hardware…

Hardware Architecture · Computer Science 2023-11-27 Mengwei Hu , Zhengxiong Li , Xianyang Jiang

Efficient and real time segmentation of color images has a variety of importance in many fields of computer vision such as image compression, medical imaging, mapping and autonomous navigation. Being one of the most computationally…

Computer Vision and Pattern Recognition · Computer Science 2017-10-09 Roopal Nahar , Akanksha Baranwal , K. Madhava Krishna

We study parallel algorithms for the minimization of Deterministic Finite Automata (DFAs). In particular, we implement four different massively parallel algorithms on Graphics Processing Units (GPUs). Our results confirm the expectations…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-31 Jan Martens , Anton Wijs

Current neural architecture search (NAS) algorithms still require expert knowledge and effort to design a search space for network construction. In this paper, we consider automating the search space design to minimize human interference,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Daquan Zhou , Xiaojie Jin , Xiaochen Lian , Linjie Yang , Yujing Xue , Qibin Hou , Jiashi Feng

The transducer architecture is becoming increasingly popular in the field of speech recognition, because it is naturally streaming as well as high in accuracy. One of the drawbacks of transducer is that it is difficult to decode in a fast…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Wei Kang , Liyong Guo , Fangjun Kuang , Long Lin , Mingshuang Luo , Zengwei Yao , Xiaoyu Yang , Piotr Żelasko , Daniel Povey

Correlation Power Analysis (CPA) is a type of power analysis based side channel attack that can be used to derive the secret key of encryption algorithms including DES (Data Encryption Standard) and AES (Advanced Encryption Standard). A…

Performance · Computer Science 2014-12-25 Hasindu Gamaarachchi , Roshan Ragel , Darshana Jayasinghe

In this note, we present the stability as well as performance analysis of asynchronous parallel computing algorithm implemented in 1D heat equation with CUDA. The primary objective of this note lies in dissemination of asynchronous parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-03 Kooktae Lee , Raktim Bhattacharya

This paper presents a methodology for simultaneous heterogeneous computing, named ENEAC, where a quad core ARM Cortex-A53 CPU works in tandem with a preprogrammed on-board FPGA accelerator. A heterogeneous scheduler distributes the tasks…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-16 Kris Nikov , Mohammad Hosseinabady , Rafael Asenjo , Andrés Rodríguezz , Angeles Navarro , Jose Nunez-Yanez