English
Related papers

Related papers: FINN: A Framework for Fast, Scalable Binarized Neu…

200 papers

In this paper, we present MicroNet, which is an efficient convolutional neural network using extremely low computational cost (e.g. 6 MFLOPs on ImageNet classification). Such a low cost network is highly desired on edge devices, yet usually…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Yunsheng Li , Yinpeng Chen , Xiyang Dai , Dongdong Chen , Mengchen Liu , Lu Yuan , Zicheng Liu , Lei Zhang , Nuno Vasconcelos

Graph neural networks (GNNs) have recently exploded in popularity thanks to their broad applicability to ubiquitous graph-related problems such as quantum chemistry, drug discovery, and high energy physics. However, meeting demand for novel…

Machine Learning · Computer Science 2022-01-24 Stefan Abi-Karam , Yuqi He , Rishov Sarkar , Lakshmi Sathidevi , Zihang Qiao , Cong Hao

Vision Transformers (ViTs) have achieved significant success in computer vision. However, their intensive computations and massive memory footprint challenge ViTs' deployment on embedded devices, calling for efficient ViTs. Among them,…

Hardware Architecture · Computer Science 2024-04-01 Haikuo Shao , Huihong Shi , Wendong Mao , Zhongfeng Wang

New heterogeneous computing paradigms on dedicated hardware with increased parallelization, such as Field Programmable Gate Arrays (FPGAs), offer exciting solutions with large potential gains. The growing applications of machine learning…

Convolutional Neural Networks (CNNs) have demonstrated their effectiveness in numerous vision tasks. However, their high processing requirements necessitate efficient hardware acceleration to meet the application's performance targets. In…

Hardware Architecture · Computer Science 2024-03-29 Petros Toupas , Zhewen Yu , Christos-Savvas Bouganis , Dimitrios Tzovaras

Accelerating Human Action Recognition (HAR) efficiently for real-time surveillance and robotic systems on edge chips remains a challenging research field, given its high computational and memory requirements. This paper proposed an…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Azzam Alhussain , Mingjie Lin

We present the application of a class of deep learning, known as Physics Informed Neural Networks (PINN), to learning and discovery in solid mechanics. We explain how to incorporate the momentum balance and constitutive relations into PINN,…

Machine Learning · Computer Science 2020-05-12 Ehsan Haghighat , Maziar Raissi , Adrian Moure , Hector Gomez , Ruben Juanes

Spiking Neural Networks (SNN) are third-generation Artificial Neural Networks (ANN) which are close to the biological neural system. In recent years SNN has become popular in the area of robotics and embedded applications, therefore, it has…

Neural and Evolutionary Computing · Computer Science 2020-10-06 Shikhar Gupta , Arpan Vyas , Gaurav Trivedi

This paper aims to accelerate the test-time computation of convolutional neural networks (CNNs), especially very deep CNNs that have substantially impacted the computer vision community. Unlike previous methods that are designed for…

Computer Vision and Pattern Recognition · Computer Science 2015-11-19 Xiangyu Zhang , Jianhua Zou , Kaiming He , Jian Sun

Deep neural networks (DNN) have demonstrated effectiveness for various applications such as image processing, video segmentation, and speech recognition. Running state-of-the-art DNNs on current systems mostly relies on either…

Neural and Evolutionary Computing · Computer Science 2019-04-15 Mohsen Imani , Mohammad Samragh , Yeseong Kim , Saransh Gupta , Farinaz Koushanfar , Tajana Rosing

We demonstrate an FPGA implementation of a parallel and reconfigurable architecture for sparse neural networks, capable of on-chip training and inference. The network connectivity uses pre-determined, structured sparsity to significantly…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-29 Sourya Dey , Diandian Chen , Zongyang Li , Souvik Kundu , Kuan-Wen Huang , Keith M. Chugg , Peter A. Beerel

FPGA-based accelerators are becoming more popular for deep neural network due to the ability to scale performance with increasing degree of specialization with dataflow architectures or custom data types. To reduce the barrier for software…

Hardware Architecture · Computer Science 2022-04-12 Syed Asad Alam , David Gregg , Giulio Gambardella , Thomas Preusser , Michaela Blott

Convolutional Neural Networks (CNNs) have gained high popularity as a tool for computer vision tasks and for that reason are used in various applications. There are many different concepts, like single shot detectors, that have been…

Machine Learning · Computer Science 2025-05-21 Ilkay Wunderlich , Benjamin Koch , Sven Schönfeld

Automatic algorithm-hardware co-design for DNN has shown great success in improving the performance of DNNs on FPGAs. However, this process remains challenging due to the intractable search space of neural network architectures and hardware…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Zhen Dong , Yizhao Gao , Qijing Huang , John Wawrzynek , Hayden K. H. So , Kurt Keutzer

The record-breaking achievements of deep neural networks (DNNs) in image classification and detection tasks resulted in a surge of new computer vision applications during the past years. However, their computational complexity is…

Image and Video Processing · Electrical Eng. & Systems 2021-06-25 Petar Jokic , Stephane Emery , Luca Benini

Advancements in adapting deep convolution architectures for Spiking Neural Networks (SNNs) have significantly enhanced image classification performance and reduced computational burdens. However, the inability of Multiplication-Free…

Neural and Evolutionary Computing · Computer Science 2024-04-29 Boyan Li , Luziwei Leng , Shuaijie Shen , Kaixuan Zhang , Jianguo Zhang , Jianxing Liao , Ran Cheng

We introduce a compositional physics-aware FInite volume Neural Network (FINN) for learning spatiotemporal advection-diffusion processes. FINN implements a new way of combining the learning abilities of artificial neural networks with…

Machine Learning · Computer Science 2022-05-30 Matthias Karlbauer , Timothy Praditia , Sebastian Otte , Sergey Oladyshkin , Wolfgang Nowak , Martin V. Butz

This paper implements a Binary Neural Network (BNN) based YOLOv3-tiny-like object detector on a low-cost FPGA. The network takes 320*320*3 RGB images as input. Its main convolution layers use 1-bit weights and 8-bit activations, while Conv1…

Hardware Architecture · Computer Science 2026-05-12 Xuyu Zhao , Yunpeng Wu , Mengyuan Zhu , Haoyu Huang , Xiaoyu Xu , Yanjing Li , Gaolong Zhang , Baochang Zhang

Convolutional Neural Networks (CNN) increase depth by stacking convolutional layers, and deeper network models perform better in image recognition. Empirical research shows that simply stacking convolutional layers does not make the network…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Rui-Yang Ju , Jen-Shiun Chiang , Chih-Chia Chen , Yu-Shian Lin

Photonic computing is a computing paradigm which have great potential to overcome the energy bottlenecks of electronic von Neumann architecture. Throughput and power consumption are fundamental limitations of…

Emerging Technologies · Computer Science 2026-04-06 Saurabh Ranjan , Sonika Thakral , Amit Sehgal