English
Related papers

Related papers: NaNet:a low-latency NIC enabling GPU-based, real-t…

200 papers

Realizing a controllable network with multiple degrees of interaction is a challenge to physics and engineering. Here, we experimentally report an on-chip reconfigurable network based on nanoelectromechanical resonators with…

Quantum Physics · Physics 2020-09-08 Tian Tian , Shaochun Lin , Liang Zhang , Peiran Yin , Pu Huang , Changkui Duan , Liang Jiang , Jiangfeng Du

With the rapid innovation of GPUs, heterogeneous GPU clusters in both public clouds and on-premise data centers have become increasingly commonplace. In this paper, we demonstrate how pipeline parallelism, a technique wellstudied for…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-28 Z. Jonny Kong , Qiang Xu , Y. Charlie Hu

We introduce PropNEAT, a fast backpropagation implementation of NEAT that uses a bidirectional mapping of the genome graph to a layer-based architecture that preserves the NEAT genomes whilst enabling efficient GPU backpropagation. We test…

Machine Learning · Computer Science 2024-11-07 Michael Merry , Patricia Riddle , Jim Warren

DCentNet is a novel decentralized multistage signal classification approach designed for biomedical data from IoT wearable sensors, integrating early exit points (EEP) to enhance energy efficiency and processing speed. Unlike traditional…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Xiaolin Li , Binhua Huang , Barry Cardiff , Deepu John

On-device inference of machine learning models for mobile phones is desirable due to its lower latency and increased privacy. Running such a compute-intensive task solely on the mobile CPU, however, can be difficult due to limited computing…

With the growing number of data-intensive workloads, GPU, which is the state-of-the-art single-instruction-multiple-thread (SIMT) processor, is hindered by the memory bandwidth wall. To alleviate this bottleneck, previously proposed…

Hardware Architecture · Computer Science 2021-03-12 Xinfeng Xie , Peng Gu , Yufei Ding , Dimin Niu , Hongzhong Zheng , Yuan Xie

Phase change memory (PCM) devices are known to reduce in power consumption as the bit volume and contact area of their electrodes are scaled down. Here, we demonstrate two types of low-power PCM devices with lateral graphene ribbon…

This paper presents GraphAGILE, a domain-specific FPGA-based overlay accelerator for graph neural network (GNN) inference. GraphAGILE consists of (1) \emph{a novel unified architecture design} with an \emph{instruction set}, and (2) \emph{a…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-25 Bingyi Zhang , Hanqing Zeng , Viktor Prasanna

We present Net2Vec, a flexible high-performance platform that allows the execution of deep learning algorithms in the communication network. Net2Vec is able to capture data from the network at more than 60Gbps, transform it into meaningful…

Networking and Internet Architecture · Computer Science 2017-05-12 Roberto Gonzalez , Filipe Manco , Alberto Garcia-Duran , Jose Mendes , Felipe Huici , Saverio Niccolini , Mathias Niepert

Over the most recent years, quantized graph neural network (QGNN) attracts lots of research and industry attention due to its high robustness and low computation and memory overhead. Unfortunately, the performance gains of QGNN have never…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-03 Yuke Wang , Boyuan Feng , Yufei Ding

In this paper, we propose an open source, production first, and production ready speech recognition toolkit called WeNet in which a new two-pass approach is implemented to unify streaming and non-streaming end-to-end (E2E) speech…

Sound · Computer Science 2021-12-30 Zhuoyuan Yao , Di Wu , Xiong Wang , Binbin Zhang , Fan Yu , Chao Yang , Zhendong Peng , Xiaoyu Chen , Lei Xie , Xin Lei

Gated DeltaNet (GDN) is a linear attention mechanism that replaces the growing KV cache with a fixed-size recurrent state. Hybrid LLMs like Qwen3-Next use 75% GDN layers and achieve competitive accuracy to attention-only models. However, at…

Hardware Architecture · Computer Science 2026-03-09 Neelesh Gupta , Peter Wang , Rajgopal Kannan , Viktor K. Prasanna

We demonstrate an FPGA implementation of a parallel and reconfigurable architecture for sparse neural networks, capable of on-chip training and inference. The network connectivity uses pre-determined, structured sparsity to significantly…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-29 Sourya Dey , Diandian Chen , Zongyang Li , Souvik Kundu , Kuan-Wen Huang , Keith M. Chugg , Peter A. Beerel

Processing-In-Memory (PIM) architectures offer a promising approach to accelerate Graph Neural Network (GNN) training and inference. However, various PIM devices such as ReRAM, FeFET, PCM, MRAM, and SRAM exist, with each device offering…

Modern datacenters increasingly rely on low-power, single-slot inference accelerators to balance performance, energy efficiency, and rack density constraints. The NVIDIA T4 GPU has become widely deployed due to strong performance per watt…

Performance · Computer Science 2026-05-07 Kathiravan Palaniappan

Binarized Neural Networks (BNNs) significantly reduce the computation and memory demands with binarized weights and activations compared to full-precision NNs. Executing a layer in a BNN on different devices of a heterogeneous…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-13 Leonard David Bereholschi , Ching-Chi Lin , Mikail Yayla , Jian-Jia Chen

Large-scale network sensing plays a vital role in network traffic analysis and characterization. As network packet data grows increasingly large, parallel methods have become mainstream for network analytics. While effective, GPU-based…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-17 Michael Mandulak , Sayan Ghosh , S M Ferdous , Mahantesh Halappanavar , George Slota

The real-time performance of recommender models depends on the continuous integration of massive volumes of new user interaction data into training pipelines. While GPUs have scaled model training throughput, the data preprocessing stage -…

Hardware Architecture · Computer Science 2026-02-26 Yu Zhu , Wenqi Jiang , Piyumi Jasin Pathiranage , Yongjun He , Gustavo Alonso

With the wide adoption of AI applications, there is a pressing need of enabling real-time neural network (NN) inference on small embedded devices, but deploying NNs and achieving high performance of NN inference on these small devices is…

Machine Learning · Computer Science 2023-12-25 Kai Huang , Wei Gao

Near-sensor data analytics is a promising direction for IoT endpoints, as it minimizes energy spent on communication and reduces network load - but it also poses security concerns, as valuable data is stored or sent over the network at…