English
Related papers

Related papers: TRON: Transformer Neural Network Acceleration with…

200 papers

Convolutional Neural Networks (CNN) have dominated the field of detection ever since the success of AlexNet in ImageNet classification [12]. With the sweeping reform of Transformers [27] in natural language processing, Carion et al. [2]…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Chi Zhang , Lijuan Liu , Xiaoxue Zang , Frederick Liu , Hao Zhang , Xinying Song , Jindong Chen

Spiking Neural Networks (SNNs) have garnered attention over recent years due to their increased energy efficiency and advantages in terms of operational complexity compared to traditional Artificial Neural Networks (ANNs). Two important…

Neural and Evolutionary Computing · Computer Science 2025-01-15 Daniel Windhager , Lothar Ratschbacher , Bernhard A. Moser , Michael Lunglmayr

Photonic Microring Resonator (MRR) based hardware accelerators have been shown to provide disruptive speedup and energy-efficiency improvements for processing deep Convolutional Neural Networks (CNNs). However, previous MRR-based CNN…

Hardware Architecture · Computer Science 2022-07-13 Sairam Sri Vatsavai , Ishan G Thakkar

Since introduced, Swin Transformer has achieved remarkable results in the field of computer vision, it has sparked the need for dedicated hardware accelerators, specifically catering to edge computing demands. For the advantages of…

Hardware Architecture · Computer Science 2023-08-29 Zhiyang Liu , Pengyu Yin , Zhenhua Ren

As deep neural network (DNN) models grow ever-larger, they can achieve higher accuracy and solve more complex problems. This trend has been enabled by an increase in available compute power; however, efforts to continue to scale electronic…

Emerging Technologies · Computer Science 2020-06-25 Liane Bernstein , Alexander Sludds , Ryan Hamerly , Vivienne Sze , Joel Emer , Dirk Englund

Transformers have revolutionized deep learning and generative modeling to enable unprecedented advancements in natural language processing tasks and beyond. However, designing hardware accelerators for executing transformer models is…

Hardware Architecture · Computer Science 2024-08-08 Pratyush Dhingra , Janardhan Rao Doppa , Partha Pratim Pande

Semantic grids can be useful representations of the scene around an autonomous system. By having information about the layout of the space around itself, a robot can leverage this type of representation for crucial tasks such as navigation…

In recent years, Spiking Neural Networks (SNNs) have gathered significant interest due to their temporal understanding capabilities. This work introduces, to the best of our knowledge, the first Cortical Column like hybrid architecture for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Aaron Bateni

Two detection systems based on optical readout were developed: a. Integrative optical detector A 2nd generation of Time-Resolved Integrative Optical Neutron (TRION) detector was developed. It is based on an integrative optical technique,…

Instrumentation and Detectors · Physics 2017-05-01 Ilan Mor

Recent success in deep neural networks has generated strong interest in hardware accelerators to improve speed and energy consumption. This paper presents a new type of photonic accelerator based on coherent detection that is scalable to…

Emerging Technologies · Computer Science 2019-05-21 Ryan Hamerly , Liane Bernstein , Alexander Sludds , Marin Soljačić , Dirk Englund

Tremendous advances in image restoration tasks such as denoising and super-resolution have been achieved using neural networks. Such approaches generally employ very deep architectures, large number of parameters, large receptive fields and…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Shuhang Gu , Radu Timofte , Luc Van Gool

Spiking neural networks (SNNs) are the third generation of neural networks and can explore both rate and temporal coding for energy-efficient event-driven computation. However, the decision accuracy of existing SNN designs is contingent…

Neural and Evolutionary Computing · Computer Science 2020-02-25 Changqing Xu , Wenrui Zhang , Yu Liu , Peng Li

Fusion is a technique for merging multiple independently-trained neural networks in order to combine their capabilities. Past attempts have been restricted to the case of fully-connected, convolutional, and residual networks. This paper…

Machine Learning · Computer Science 2024-04-23 Moritz Imfeld , Jacopo Graldi , Marco Giordano , Thomas Hofmann , Sotiris Anagnostidis , Sidak Pal Singh

Image super-resolution generation aims to generate a high-resolution image from its low-resolution image. However, more complex neural networks bring high computational costs and memory storage. It is still an active area for offering the…

Image and Video Processing · Electrical Eng. & Systems 2023-10-23 Neeraj Baghel , Shiv Ram Dubey , Satish Kumar Singh

Computer vision has achieved remarkable success by (a) representing images as uniformly-arranged pixel arrays and (b) convolving highly-localized features. However, convolutions treat all image pixels equally regardless of importance;…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Bichen Wu , Chenfeng Xu , Xiaoliang Dai , Alvin Wan , Peizhao Zhang , Zhicheng Yan , Masayoshi Tomizuka , Joseph Gonzalez , Kurt Keutzer , Peter Vajda

Agent-based Transformers have been widely adopted in recent reinforcement learning advances due to their demonstrated ability to solve complex tasks. However, the high computational complexity of Transformers often results in significant…

Machine Learning · Computer Science 2025-05-21 Mohammad Irfan Uddin , Nishad Tasnim , Md Omor Faruk , Zejian Zhou

Convolutional Neural Networks (CNNs) are powerful and highly ubiquitous tools for extracting features from large datasets for applications such as computer vision and natural language processing. However, a convolution is a computationally…

Standard decoders for neural machine translation autoregressively generate a single target token per time step, which slows inference especially for long outputs. While architectural advances such as the Transformer fully parallelize the…

Computation and Language · Computer Science 2020-10-06 Nader Akoury , Kalpesh Krishna , Mohit Iyyer

Previous work has shown that it is possible to train deep neural networks with low precision weights and activations. In the extreme case it is even possible to constrain the network to binary values. The costly floating point…

Neural and Evolutionary Computing · Computer Science 2017-11-30 Sam Leroux , Steven Bohez , Tim Verbelen , Bert Vankeirsbilck , Pieter Simoens , Bart Dhoedt

Transformer-based neural models are used in many AI applications. Training these models is expensive, as it takes huge GPU resources and long duration. It is challenging because typical data like sentences have variable lengths, and…

Computation and Language · Computer Science 2022-06-17 Xiaohui Wang , Yang Wei , Ying Xiong , Guyue Huang , Xian Qian , Yufei Ding , Mingxuan Wang , Lei Li