中文
相关论文

相关论文: Spiking Vision Transformer with Saccadic Attention

200 篇论文

Reinforcement learning agents based on Transformer architectures have achieved impressive performance on sequential decision-making tasks, but their reliance on dense matrix operations makes them ill-suited for energy-constrained,…

机器学习 · 计算机科学 2025-09-01 Vishal Pandey , Debasmita Biswas

Vision Transformers (ViTs) have redefined image classification by leveraging self-attention to capture complex patterns and long-range dependencies between image patches. However, a key challenge for ViTs is efficiently incorporating…

计算机视觉与模式识别 · 计算机科学 2025-01-09 Shravan Venkatraman , Jaskaran Singh Walia , Joe Dhanith P R

Spiking Neural Networks (SNNs), renowned for their low power consumption, brain-inspired architecture, and spatio-temporal representation capabilities, have garnered considerable attention in recent years. Similar to Artificial Neural…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Shibo Zhou , Bo Yang , Mengwen Yuan , Runhao Jiang , Rui Yan , Gang Pan , Huajin Tang

Graph representation learning has become a crucial task in machine learning and data mining due to its potential for modeling complex structures such as social networks, chemical compounds, and biological systems. Spiking neural networks…

人工智能 · 计算机科学 2024-03-27 Huifeng Yin , Mingkun Xu , Jing Pei , Lei Deng

Autonomous driving perception demands accurate and efficient processing of three-dimensional sensor data under strict power constraints. Traditional convolutional neural networks achieve strong detection accuracy but are computationally…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Sambit Mohapatra , Senthil Yogamani , Heinrich Gotzig , Patrick Mader

Automotive embedded algorithms have very high constraints in terms of latency, accuracy and power consumption. In this work, we propose to train spiking neural networks (SNNs) directly on data coming from event cameras to design fast and…

计算机视觉与模式识别 · 计算机科学 2022-05-10 Loïc Cordone , Benoît Miramond , Philippe Thierion

Spiking neural networks (SNNs) are the third generation of neural networks that are biologically inspired to process data in a fashion that emulates the exchange of signals in the brain. Within the Computer Vision community SNNs have…

音频与语音处理 · 电气工程与系统科学 2024-09-04 William Bjorndahl , Jack Easton , Austin Modoff , Eric C. Larson , Joseph Camp , Prasanna Rangarajan

While the exponential growth of the space sector and new operative concepts ask for higher spacecraft autonomy, the development of AI-assisted space systems was so far hindered by the low availability of power and energy typical of space…

神经与进化计算 · 计算机科学 2025-12-15 Paolo Lunghi , Stefano Silvestrini , Dominik Dold , Gabriele Meoni , Alexander Hadjiivanov , Dario Izzo

Spiking Neural Networks (SNNs) have emerged as a promising tool for event-based optical flow estimation tasks due to their ability to leverage spatio-temporal information and low-power capabilities. However, the performance of SNN models is…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Hongze Sun , Jun Wang , Wuque Cai , Duo Chen , Qianqian Liao , Jiayi He , Yan Cui , Dezhong Yao , Daqing Guo

The evolution of Vision Transformers has led to their widespread adaptation to different domains. Despite large-scale success, there remain significant challenges including their reliance on extensive computational and memory resources for…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Suyash Gaurav , Muhammad Farhan Humayun , Jukka Heikkonen , Jatin Chaudhary

Bio-inspired Spiking Neural Networks (SNN) are now demonstrating comparable accuracy to intricate convolutional neural networks (CNN), all while delivering remarkable energy and latency efficiency when deployed on neuromorphic hardware. In…

计算机视觉与模式识别 · 计算机科学 2023-12-13 Gourav Datta , Zeyu Liu , James Diffenderfer , Bhavya Kailkhura , Peter A. Beerel

Visual attention can be defined as the behavioral and cognitive process of selectively focusing on a discrete aspect of sensory cues while disregarding other perceivable information. This biological mechanism, more specifically saliency…

计算机视觉与模式识别 · 计算机科学 2021-06-01 Amélie Gruel , Jean Martinet

Spiking neural networks (SNNs) recently gained momentum due to their low-power multiplication-free computing and the closer resemblance of biological processes in the nervous system of humans. However, SNNs require very long spike trains…

硬件体系结构 · 计算机科学 2022-06-07 Daniel Gerlinghoff , Zhehui Wang , Xiaozhe Gu , Rick Siow Mong Goh , Tao Luo

The vanilla self-attention mechanism inherently relies on pre-defined and steadfast computational dimensions. Such inflexibility restricts it from possessing context-oriented generalization that can bring more contextual cues and global…

计算机视觉与模式识别 · 计算机科学 2022-07-19 Rui Yang , Hailong Ma , Jie Wu , Yansong Tang , Xuefeng Xiao , Min Zheng , Xiu Li

Spiking Neural Networks, as a third-generation neural network, are well-suited for edge AI applications due to their binary spike nature. However, when it comes to complex tasks like object detection, SNNs often require a substantial number…

计算机视觉与模式识别 · 计算机科学 2023-09-28 Nemin Qiu , Chuang Zhu

Recently, Vision Transformers (ViTs) have attracted a lot of attention in the field of computer vision. Generally, the powerful representative capacity of ViTs mainly benefits from the self-attention mechanism, which has a high computation…

计算机视觉与模式识别 · 计算机科学 2023-10-12 Deli Yu , Teng Xi , Jianwei Li , Baopu Li , Gang Zhang , Haocheng Feng , Junyu Han , Jingtuo Liu , Errui Ding , Jingdong Wang

Spiking neural networks (SNNs) serve as one type of efficient model to process spatio-temporal patterns in time series, such as the Address-Event Representation data collected from Dynamic Vision Sensor (DVS). Although convolutional SNNs…

神经与进化计算 · 计算机科学 2024-01-09 Qi Xu , Yuyuan Gao , Jiangrong Shen , Yaxin Li , Xuming Ran , Huajin Tang , Gang Pan

The spiking neural networks (SNNs) that efficiently encode temporal sequences have shown great potential in extracting audio-visual joint feature representations. However, coupling SNNs (binary spike sequences) with transformers…

多媒体 · 计算机科学 2024-07-12 Wenrui Li , Penghong Wang , Ruiqin Xiong , Xiaopeng Fan

Spiking neural networks (SNNs) have gained attention as a promising alternative to traditional artificial neural networks (ANNs) due to their potential for energy efficiency and their ability to model spiking behavior in biological systems.…

神经与进化计算 · 计算机科学 2023-03-27 Hadjer Benmeziane , Amine Ziad Ounnoughene , Imane Hamzaoui , Younes Bouhadjar

Spiking Neural Networks (SNNs) are highly energy-efficient due to event-driven, sparse computation, but their training is challenged by spike non-differentiability and trade-offs among performance, efficiency, and biological plausibility.…

神经与进化计算 · 计算机科学 2026-01-30 Zihan Huang , Zijie Xu , Yihan Huang , Shanshan Jia , Tong Bu , Yiting Dong , Wenxuan Liu , Jianhao Ding , Zhaofei Yu , Tiejun Huang