English
Related papers

Related papers: Toward Terabits-per-second Communications: A High-…

200 papers

This paper describes a new method for representing embedding tables of graph neural networks (GNNs) more compactly via tensor-train (TT) decomposition. We consider the scenario where (a) the graph data that lack node features, thereby…

Machine Learning · Computer Science 2022-06-22 Chunxing Yin , Da Zheng , Israt Nisa , Christos Faloutos , George Karypis , Richard Vuduc

Graph neural networks (GNNs) have emerged as a promising direction. Training large-scale graphs that relies on distributed computing power poses new challenges. Existing distributed GNN systems leverage data parallelism by partitioning the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-31 Xin Ai , Hao Yuan , Zeyu Ling , Qiange Wang , Yanfeng Zhang , Zhenbo Fu , Chaoyi Chen , Yu Gu , Ge Yu

This paper introduces a highly efficient greedy decoding algorithm for Transducer-based speech recognition models. We redesign the standard nested-loop design for RNN-T decoding, swapping loops over frames and labels: the outer loop…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-20 Vladimir Bataev , Hainan Xu , Daniel Galvez , Vitaly Lavrukhin , Boris Ginsburg

Graph neural networks (GNNs) are among the most powerful tools in deep learning. They routinely solve complex problems on unstructured networks, such as node classification, graph classification, or link prediction, with high accuracy.…

Machine Learning · Computer Science 2023-08-21 Maciej Besta , Torsten Hoefler

Identifying the sets of operations that can be executed simultaneously is an important problem appearing in many parallel applications. By modeling the operations and their interactions as a graph, one can identify the independent…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-07-28 Ahmet Erdem Sarıyüce , Erik Saule , Ümit V. Çatalyürek

There has been a rise in decoding quantum error correction codes with neural network based decoders, due to the good decoding performance achieved and adaptability to any noise model. However, the main challenge is scalability to larger…

Quantum Physics · Physics 2019-02-07 Savvas Varsamopoulos , Koen Bertels , Carmen G. Almudever

Partitioning a graph into blocks of roughly equal weight while cutting only few edges is a fundamental problem in computer science with numerous practical applications. While shared-memory parallel partitioners have recently matured to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-06 Peter Sanders , Daniel Seemaier

Fault-tolerant quantum computing will require error rates far below those achievable with physical qubits. Quantum error correction (QEC) bridges this gap, but depends on decoders being simultaneously fast, accurate, and scalable. This…

Subgraph counting aims to count the occurrences of a subgraph template T in a given network G. The basic problem of computing structural properties such as counting triangles and other subgraphs has found applications in diverse domains.…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-03-12 Langshi Chen , Jiayu Li , Ariful Azad , Lei Jiang , Madhav Marathe , Anil Vullikanti , Andrey Nikolaev , Egor Smirnov , Ruslan Israfilov , Judy Qiu

Given a large data graph, trimming techniques can reduce the search space by removing vertices without outgoing edges. One application is to speed up the parallel decomposition of graphs into strongly connected components (SCC…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-11 Bin Guo , Emil Sekerinski

An efficient error reconciliation scheme is important for post-processing of quantum key distribution (QKD). Recently, a multi-matrix low-density parity-check codes based reconciliation algorithm which can provide remarkable perspectives…

Quantum Physics · Physics 2020-01-23 Yu Guo , Chaohui Gao , Dong Jiang , Lijun Chen

In parallel computing, a valid graph coloring yields a lock-free processing of the colored tasks, data points, etc., without expensive synchronization mechanisms. However, coloring is not free and the overhead can be significant. In…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-11 Mustafa Kemal Taş , Kamer Kaya , Erik Saule

Memory is a critical design consideration in current data-intensive DNN accelerators, as it profoundly determines energy consumption, bandwidth requirements, and area costs. As DNN structures become more complex, a larger on-chip memory…

Hardware Architecture · Computer Science 2024-02-02 Zhanhong Tan , Zijian Zhu , Kaisheng Ma

Subgraph counting aims to count the number of occurrences of a subgraph T (aka as a template) in a given graph G. The basic problem has found applications in diverse domains. The problem is known to be computationally challenging - the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-27 Langshi Chen , Bo Peng , Sabra Ossen , Anil Vullikanti , Madhav Marathe , Lei Jiang , Judy Qiu

Deep convolutional neural networks (CNN) are widely used in modern artificial intelligence (AI) and smart vision systems but also limited by computation latency, throughput, and energy efficiency on a resource-limited scenario, such as…

Hardware Architecture · Computer Science 2017-09-18 Yuan Du , Li Du , Yilei Li , Junjie Su , Mau-Chung Frank Chang

Polar codes are a new class of block codes with an explicit construction that provably achieve the capacity of various communications channels, even with the low-complexity successive-cancellation (SC) decoding algorithm. Yet, the more…

In this paper, we implemented both sequential and parallel version of fractal image compression algorithms using CUDA (Compute Unified Device Architecture) programming model for parallelizing the program in Graphics Processing Unit for…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-04-04 Md. Enamul Haque , Abdullah Al Kaisan , Mahmudur R Saniat , Aminur Rahman

A new coding scheme for general N-node relay networks is presented for unicast, multicast, and broadcast. The proposed distributed decode-forward scheme combines and generalizes Marton coding for single-hop broadcast channels and the…

Information Theory · Computer Science 2017-01-12 Sung Hoon Lim , Kwang Taik Kim , Young-Han Kim

This paper presents a GPU-accelerated decoder for quantum low-density parity-check (QLDPC) codes that achieves sub-$63$ $\mu$s latency, below the surface code decoder's real-time threshold demonstrated on Google's Willow quantum processor.…

Modern platforms for potential qubit candidates, such as trapped ions or neutral atoms, allow long range connectivity between distant physical qubits through shuttling. This opens up an avenue for transversal logical CNOT gates between…

Quantum Physics · Physics 2025-04-14 Kwok Ho Wan , Mark Webber , Austin G. Fowler , Winfried K. Hensinger