English
Related papers

Related papers: Achieving High Throughput with a Trainable Neural-…

200 papers

With the rapidly-developing high-speed wireless communications, the 60 GHz millimeter-wave frequency range and radio-over-fiber systems have been investigated as a promising solution to deliver mm-wave signals. Neural networks have been…

Signal Processing · Electrical Eng. & Systems 2020-05-20 Jeonghun Lee , Jiayuan He , Ke Wang

In this paper, we introduce a new nonlinear optical channel equalizer based on Transformers. By leveraging parallel computation and attending directly to the memory across a sequence of symbols, we show that Transformers can be used…

Information Theory · Computer Science 2024-08-02 Behnam Behinaein Hamgini , Hossein Najafi , Ali Bakhshali , Zhuhong Zhang

Deep Neural Networks (DNNs) are capable of solving complex problems in domains related to embedded systems, such as image and natural language processing. To efficiently implement DNNs on a specific FPGA platform for a given cost criterion,…

Hardware Architecture · Computer Science 2021-10-22 Jonas Ney , Dominik Loroch , Vladimir Rybalkin , Nico Weber , Jens Krüger , Norbert Wehn

To cope with the increasing demand and computational intensity of deep neural networks (DNNs), industry and academia have turned to accelerator technologies. In particular, FPGAs have been shown to provide a good balance between performance…

Hardware Architecture · Computer Science 2018-07-12 Yongming Shen , Tianchu Ji , Michael Ferdman , Peter Milder

With the rise of artificial intelligence in recent years, Deep Neural Networks (DNNs) have been widely used in many domains. To achieve high performance and energy efficiency, hardware acceleration (especially inference) of DNNs is…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-17 Linghao Song , Jiachen Mao , Youwei Zhuo , Xuehai Qian , Hai Li , Yiran Chen

Distributed full-graph training of Graph Neural Networks (GNNs) over large graphs is bandwidth-demanding and time-consuming. Frequent exchanges of node features, embeddings and embedding gradients (all referred to as messages) across…

Machine Learning · Computer Science 2023-06-05 Borui Wan , Juntao Zhao , Chuan Wu

Convolutional Neural Networks (CNN) has become more popular choice for various tasks such as computer vision, speech recognition and natural language processing. Thanks to their large computational capability and throughput, GPUs ,which are…

Machine Learning · Computer Science 2018-11-28 Natan Liss , Chaim Baskin , Avi Mendelson , Alex M. Bronstein , Raja Giryes

We present the results of the comparative analysis of the performance versus complexity for several types of artificial neural networks (NNs) used for nonlinear channel equalization in coherent optical communication systems. The comparison…

Graphics Processing Units (GPUs) are currently the dominating programmable architecture for Deep Learning (DL) accelerators. The adoption of Field Programmable Gate Arrays (FPGAs) in DL accelerators is however getting momentum. In this…

Hardware Architecture · Computer Science 2021-02-03 Walther Carballo-Hernández , Maxime Pelcat , François Berry

Message-passing graph neural network interatomic potentials (GNN-IPs), particularly those with equivariant representations such as NequIP, are attracting significant attention due to their data efficiency and high accuracy. However,…

Materials Science · Physics 2024-06-13 Yutack Park , Jaesun Kim , Seungwoo Hwang , Seungwu Han

Low-complexity neural networks (NNs) have successfully been applied for digital signal processing (DSP) in short-reach intensity-modulated directly detected optical links, where chromatic dispersion-induced impairments significantly limit…

Signal Processing · Electrical Eng. & Systems 2023-08-29 Yevhenii Osadchuk , Ognjen Jovanovic , Stenio M. Ranzini , Roman Dischler , Vahid Aref , Darko Zibar , Francesco Da Ros

With the growing model size, deep neural networks (DNN) are increasingly trained over massive GPU accelerators, which demands a proper parallelization plan that transforms a DNN model into fine-grained tasks and then schedules them to GPUs…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-24 Zhiqi Lin , Youshan Miao , Guodong Liu , Xiaoxiang Shi , Quanlu Zhang , Fan Yang , Saeed Maleki , Yi Zhu , Xu Cao , Cheng Li , Mao Yang , Lintao Zhang , Lidong Zhou

The Graph Convolutional Network (GCN) model and its variants are powerful graph embedding tools for facilitating classification and clustering on graphs. However, a major challenge is to reduce the complexity of layered GCNs and make them…

Machine Learning · Computer Science 2020-08-06 Hanqing Zeng , Hongkuan Zhou , Ajitesh Srivastava , Rajgopal Kannan , Viktor Prasanna

Binarized neural networks (BNNs) are gaining interest in the deep learning community due to their significantly lower computational and memory cost. They are particularly well suited to reconfigurable logic devices, which contain an…

Computer Vision and Pattern Recognition · Computer Science 2017-01-30 Nicholas J. Fraser , Yaman Umuroglu , Giulio Gambardella , Michaela Blott , Philip Leong , Magnus Jahre , Kees Vissers

Nowadays most research in visual recognition using Convolutional Neural Networks (CNNs) follows the "deeper model with deeper confidence" belief to gain a higher recognition accuracy. At the same time, deeper model brings heavier…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Mohammad Farhadi , Mehdi Ghasemi , Yezhou Yang

As the size of real-world graphs increases, training Graph Neural Networks (GNNs) has become time-consuming and requires acceleration. While previous works have demonstrated the potential of utilizing FPGA for accelerating GNN training, few…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-06 Yi-Chien Lin , Bingyi Zhang , Viktor Prasanna

Computer vision on low-power edge devices enables applications including search-and-rescue and security. State-of-the-art computer vision algorithms, such as Deep Neural Networks (DNNs), are too large for inference on low-power edge…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Abhinav Goel , Caleb Tung , Xiao Hu , George K. Thiruvathukal , James C. Davis , Yung-Hsiang Lu

This paper presents a comprehensive review of recent advances in deploying convolutional neural networks (CNNs) for object detection, classification, and tracking on Field Programmable Gate Arrays (FPGAs). With the increasing demand for…

Hardware Architecture · Computer Science 2025-09-05 Safa Mohammed Sali , Mahmoud Meribout , Ashiyana Abdul Majeed

Graph-structured data is ubiquitous in the real world, and Graph Neural Networks (GNNs) have become increasingly popular in various fields due to their ability to process such irregular data directly. However, as data scale, GNNs become…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-10 Xianfeng Song , Yi Zou , Zheng Shi

Developing strong AI signifies the arrival of technological singularity, contributing greatly to advancing human civilization and resolving social issues. Neural networks (NNs) and deep learning, which utilize NNs, are expected to lead to…

Machine Learning · Computer Science 2024-09-09 Kei Itoh