English
Related papers

Related papers: Origami: A 803 GOp/s/W Convolutional Network Accel…

200 papers

Hardware accelerators for convolution neural networks (CNNs) enable real-time applications of artificial intelligence technology. However, most of the existing designs suffer from low hardware utilization or high area cost due to complex…

Hardware Architecture · Computer Science 2022-05-06 Kuo-Wei Chang , Tian-Sheuan Chang

Tiny Machine Learning (TinyML) applications impose uJ/Inference constraints, with a maximum power consumption of tens of mW. It is extremely challenging to meet these requirements at a reasonable accuracy level. This work addresses the…

Hardware Architecture · Computer Science 2022-12-02 Moritz Scherer , Alfio Di Mauro , Tim Fischer , Georg Rutishauser , Luca Benini

Targeting vision applications at the edge, in this work, we systematically explore and propose a high-performance and energy-efficient Optical In-Sensor Accelerator architecture called OISA for the first time. Taking advantage of the…

Hardware Architecture · Computer Science 2023-12-01 Mehrdad Morsali , Sepehr Tabrizchi , Deniz Najafi , Mohsen Imani , Mahdi Nikdast , Arman Roohi , Shaahin Angizi

Optical artificial neural networks (ONNs) have significant potential for ultra-high computing speed and energy efficiency. We report a novel approach to ONNs that uses integrated Kerr optical microcombs. This approach is programmable and…

Signal Processing · Electrical Eng. & Systems 2021-05-24 Mengxi Tan , Xingyuan Xu , David J. Moss

This paper introduces the first low-power hardware accelerator for Spiking Transformers, an emerging alternative to traditional artificial neural networks. By modifying the base Spikformer model to use IAND instead of residual addition, the…

Hardware Architecture · Computer Science 2025-03-26 Bo-Yu Chen , Tian-Sheuan Chang

Recent success in deep neural networks has generated strong interest in hardware accelerators to improve speed and energy consumption. This paper presents a new type of photonic accelerator based on coherent detection that is scalable to…

Emerging Technologies · Computer Science 2019-05-21 Ryan Hamerly , Liane Bernstein , Alexander Sludds , Marin Soljačić , Dirk Englund

Deploying state-of-the-art CNNs requires power-hungry processors and off-chip memory. This precludes the implementation of CNNs in low-power embedded systems. Recent research shows CNNs sustain extreme quantization, binarizing their weights…

Computer Vision and Pattern Recognition · Computer Science 2018-09-12 Andrawes Al Bahou , Geethan Karunaratne , Renzo Andri , Lukas Cavigelli , Luca Benini

The ever-growing deep learning technologies are making revolutionary changes for modern life. However, conventional computing architectures are designed to process sequential and digital programs, being extremely burdened with performing…

Emerging Technologies · Computer Science 2022-12-21 Yuyao Huang , Tingzhao Fu , Honghao Huang , Sigang Yang , Hongwei Chen

We present an approach to accelerating a wide variety of image processing operators. Our approach uses a fully-convolutional network that is trained on input-output pairs that demonstrate the operator's action. After training, the original…

Computer Vision and Pattern Recognition · Computer Science 2017-09-05 Qifeng Chen , Jia Xu , Vladlen Koltun

Optical neural networks (ONNs), or optical neuromorphic hardware accelerators, have the potential to dramatically enhance the computing power and energy efficiency of mainstream electronic processors, due to their ultralarge bandwidths of…

We explore techniques to significantly improve the compute efficiency and performance of Deep Convolution Networks without impacting their accuracy. To improve the compute efficiency, we focus on achieving high accuracy with extremely…

Machine Learning · Computer Science 2016-10-04 Ganesh Venkatesh , Eriko Nurvitadhi , Debbie Marr

A software-defined optical receiver is implemented on an off-the-shelf commercial graphics processing unit (GPU). The receiver provides real-time signal processing functionality to process 1 GBaud minimum phase (MP) 4-, 8-, 16-, 32-, 64-,…

Foundation models, exemplified by GPT technology, are discovering new horizons in artificial intelligence by executing tasks beyond their designers' expectations. While the present generation provides fundamental advances in understanding…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Maksim Makarenko , Qizhou Wang , Arturo Burguete-Lopez , Silvio Giancola , Bernard Ghanem , Luca Passone , Andrea Fratalocchi

The escalating data volume and complexity resulting from the rapid expansion of artificial intelligence (AI), internet of things (IoT) and 5G/6G mobile networks is creating an urgent need for energy-efficient, scalable computing hardware.…

We propose a Digital Neuron, a hardware inference accelerator for convolutional deep neural networks with integer inputs and integer weights for embedded systems. The main idea to reduce circuit area and power consumption is manipulating…

Signal Processing · Electrical Eng. & Systems 2019-02-08 Hyunbin Park , Dohyun Kim , Shiho Kim

Optical architectures have been emerging as an energy-efficient and high-throughput hardware platform to accelerate computationally intensive general matrix-matrix multiplications (GEMMs) in modern machine learning (ML) algorithms. However,…

Emerging Technologies · Computer Science 2022-04-01 Jichao Fan , Yingheng Tang , Weilu Gao

Neural networks have become indispensable for a wide range of applications, but they suffer from high computational- and memory-requirements, requiring optimizations from the algorithmic description of the network to the hardware…

Signal Processing · Electrical Eng. & Systems 2020-05-05 Andreas Toftegaard Kristensen , Robert Giterman , Alexios Balatsoukas-Stimming , Andreas Burg

Deep learning based superresolution achieves high-quality results, but its heavy computational workload, large buffer, and high external memory bandwidth inhibit its usage in mobile devices. To solve the above issues, this paper proposes a…

Hardware Architecture · Computer Science 2022-05-10 An-Jung Huang , Kai-Chieh Hsu , Tian-Sheuan Chang

Radio frequency particle accelerators are ubiquitous in ultra-small and ultrafast science, but their size and cost has prompted exploration of compact and scalable alternatives like the dielectric laser accelerator. We present the first…

Accelerator Physics · Physics 2014-12-19 Kenneth J. Leedle , R. Fabian Pease , Robert L. Byer , James S. Harris

Convolutional neural networks (CNNs) have been widely employed in many applications such as image classification, video analysis and speech recognition. Being compute-intensive, CNN computations are mainly accelerated by GPUs with high…

Hardware Architecture · Computer Science 2016-11-09 Dong Wang , Jianjing An , Ke Xu