中文
相关论文

相关论文: SONIC: A Sparse Neural Network Inference Accelerat…

200 篇论文

Spiking Neural Networks (SNNs) are developed as a promising alternative to Artificial Neural networks (ANNs) due to their more realistic brain-inspired computing models. SNNs have sparse neuron firing over time, i.e., spatio-temporal…

硬件体系结构 · 计算机科学 2023-12-19 Qinyu Chen , Chang Gao , Xinyuan Fang , Haitao Luan

The computational demands of modern Deep Neural Networks (DNNs) are immense and constantly growing. While training costs usually capture public attention, inference demands are also contributing in significant computational, energy and…

While the exponential growth of the space sector and new operative concepts ask for higher spacecraft autonomy, the development of AI-assisted space systems was so far hindered by the low availability of power and energy typical of space…

神经与进化计算 · 计算机科学 2025-12-15 Paolo Lunghi , Stefano Silvestrini , Dominik Dold , Gabriele Meoni , Alexander Hadjiivanov , Dario Izzo

Spiking Neural Networks (SNNs) have gained huge attention as a potential energy-efficient alternative to conventional Artificial Neural Networks (ANNs) due to their inherent high-sparsity activation. Recently, SNNs with backpropagation…

神经与进化计算 · 计算机科学 2022-12-20 Ruokai Yin , Abhishek Moitra , Abhiroop Bhattacharjee , Youngeun Kim , Priyadarshini Panda

Neural network models are widely used in solving many challenging problems, such as computer vision, personalized recommendation, and natural language processing. Those models are very computationally intensive and reach the hardware limit…

机器学习 · 计算机科学 2020-04-28 Fei Sun , Minghai Qin , Tianyun Zhang , Liu Liu , Yen-Kuang Chen , Yuan Xie

This paper describes a novel approach of packing sparse convolutional neural networks for their efficient systolic array implementations. By combining subsets of columns in the original filter matrix associated with a convolutional layer,…

机器学习 · 计算机科学 2018-11-13 H. T. Kung , Bradley McDanel , Sai Qian Zhang

Recent success in deep neural networks has generated strong interest in hardware accelerators to improve speed and energy consumption. This paper presents a new type of photonic accelerator based on coherent detection that is scalable to…

新兴技术 · 计算机科学 2019-05-21 Ryan Hamerly , Liane Bernstein , Alexander Sludds , Marin Soljačić , Dirk Englund

The rapid advancement of wireless communication technologies, including 5G, emerging 6G networks, and the large-scale deployment of the Internet of Things (IoT), has intensified the need for efficient spectrum utilization. Automatic…

硬件体系结构 · 计算机科学 2026-01-07 Kuilian Yang , Li Zhang , Ahmed M. Eltawil , Khaled Nabil Salama

In the rapidly evolving landscape of artificial intelligence, large language models (LLMs) and graph processing have emerged as transformative technologies for natural language processing (NLP), computer vision, and graph-structured data…

硬件体系结构 · 计算机科学 2024-01-17 Salma Afifi , Febin Sunny , Mahdi Nikdast , Sudeep Pasricha

Spiking Neural Networks (SNNs) are highly efficient due to their spike-based activation, which inherently produces bit-sparse computation patterns. Existing hardware implementations of SNNs leverage this sparsity pattern to avoid wasteful…

硬件体系结构 · 计算机科学 2025-04-04 Chiyue Wei , Cong Guo , Feng Cheng , Shiyu Li , Hao "Frank" Yang , Hai "Helen" Li , Yiran Chen

Deployment of deep neural networks in resource-constrained embedded systems requires innovative algorithmic solutions to facilitate their energy and memory efficiency. To further ensure the reliability of these systems against malicious…

神经与进化计算 · 计算机科学 2025-05-23 Mathias Schmolli , Maximilian Baronig , Robert Legenstein , Ozan Özdenizci

Embedded systems acquire information about the real world from sensors and process it to make decisions and/or for transmission. In some situations, the relationship between the data and the decision is complex and/or the amount of data to…

机器学习 · 计算机科学 2021-06-29 Florian Bacho , Dominique Chu

Sparse connectivity is a hallmark of the brain and a desired property of artificial neural networks. It promotes energy efficiency, simplifies training, and enhances the robustness of network function. Thus, a detailed understanding of how…

无序系统与神经网络 · 物理学 2024-09-10 Mirza M. Junaid Baig , Armen Stepanyants

In this work we numerically analyze a passive photonic integrated neuromorphic accelerator based on hardware-friendly optical spectrum slicing nodes. The proposed scheme can act as a fully analogue convolutional layer, preprocessing…

Binary neural networks (BNNs) have demonstrated their ability to solve complex tasks with comparable accuracy as full-precision deep neural networks (DNNs), while also reducing computational power and storage requirements and increasing the…

机器学习 · 计算机科学 2022-07-12 Riccardo Schiavone , Maria A. Zuluaga

Exploiting sparsity in deep neural networks (DNNs) has been a promising area for meeting the growing computation requirements. To minimize the overhead of sparse acceleration, hardware designers have proposed structured sparsity support,…

机器学习 · 计算机科学 2025-05-27 Geonhwa Jeong , Po-An Tsai , Abhimanyu R. Bambhaniya , Stephen W. Keckler , Tushar Krishna

Sparse coding can learn good robust representation to noise and model more higher-order representation for image classification. However, the inference algorithm is computationally expensive even though the supervised signals are used to…

计算机视觉与模式识别 · 计算机科学 2015-01-06 Jun Li , Heyou Chang , Jian Yang

Spiking neural networks (SNNs) that mimic information transmission in the brain can energy-efficiently process spatio-temporal information through discrete and sparse spikes, thereby receiving considerable attention. To improve accuracy and…

神经与进化计算 · 计算机科学 2022-06-14 Byunggook Na , Jisoo Mok , Seongsik Park , Dongjin Lee , Hyeokjun Choe , Sungroh Yoon

As spiking-based deep learning inference applications are increasing in embedded systems, these systems tend to integrate neuromorphic accelerators such as $\mu$Brain to improve energy efficiency. We propose a $\mu$Brain-based scalable…

神经与进化计算 · 计算机科学 2021-11-24 M. Lakshmi Varshika , Adarsha Balaji , Federico Corradi , Anup Das , Jan Stuijt , Francky Catthoor

Herein, a bit-wise Convolutional Neural Network (CNN) in-memory accelerator is implemented using Spin-Orbit Torque Magnetic Random Access Memory (SOT-MRAM) computational sub-arrays. It utilizes a novel AND-Accumulation method capable of…

机器学习 · 计算机科学 2019-04-18 Arman Roohi , Shaahin Angizi , Deliang Fan , Ronald F DeMara