English
Related papers

Related papers: SpikeMba: Multi-Modal Spiking Saliency Mamba for T…

200 papers

Existing CNN-based speech separation models face local receptive field limitations and cannot effectively capture long time dependencies. Although LSTM and Transformer-based speech separation models can avoid this problem, their high…

Sound · Computer Science 2024-09-11 Kai Li , Guo Chen , Runxuan Yang , Xiaolin Hu

Video-based pretraining offers immense potential for learning strong visual representations on an unprecedented scale. Recently, masked video modeling methods have shown promising scalability, yet fall short in capturing higher-level…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Mohammadreza Salehi , Michael Dorkenwald , Fida Mohammad Thoker , Efstratios Gavves , Cees G. M. Snoek , Yuki M. Asano

The integration of event cameras and spiking neural networks (SNNs) promises energy-efficient visual intelligence, yet scarce event data and the sparsity of DVS outputs hinder effective training. Prior knowledge transfers from RGB to DVS…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yuqi Xie , Shuhan Ye , Yi Yu , Chong Wang , Qixin Zhang , Jiazhen Xu , Le Shen , Yuanbin Qian , Jiangbo Qian , Guoqi Li

Temporal processing is fundamental for both biological and artificial intelligence systems, as it enables the comprehension of dynamic environments and facilitates timely responses. Spiking Neural Networks (SNNs) excel in handling such data…

Neural and Evolutionary Computing · Computer Science 2025-02-14 Chenxiang Ma , Xinyi Chen , Yanchen Li , Qu Yang , Yujie Wu , Guoqi Li , Gang Pan , Huajin Tang , Kay Chen Tan , Jibin Wu

In various domains, Sequential Recommender Systems (SRS) have become essential due to their superior capability to discern intricate user preferences. Typically, SRS utilize transformer-based architectures to forecast the subsequent item…

Artificial Intelligence · Computer Science 2024-12-25 Ziwei Liu , Qidong Liu , Yejing Wang , Wanyu Wang , Pengyue Jia , Maolin Wang , Zitao Liu , Yi Chang , Xiangyu Zhao

The problem of imputing multivariate time series spans a wide range of fields, from clinical healthcare to multi-sensor systems. Initially, Recurrent Neural Networks (RNNs) were employed for this task; however, their error accumulation…

Machine Learning · Computer Science 2024-10-10 Javier Solís-García , Belén Vega-Márquez , Juan A. Nepomuceno , Isabel A. Nepomuceno-Chamorro

Known as low energy consumption networks, spiking neural networks (SNNs) have gained a lot of attention within the past decades. While SNNs are increasing competitive with artificial neural networks (ANNs) for vision tasks, they are rarely…

Computation and Language · Computer Science 2024-12-25 Shuaijie Shen , Chao Wang , Renzhuo Huang , Yan Zhong , Qinghai Guo , Zhichao Lu , Jianguo Zhang , Luziwei Leng

Multi-modal semantic segmentation significantly enhances AI agents' perception and scene understanding, especially under adverse conditions like low-light or overexposed environments. Leveraging additional modalities (X-modality) like…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Zifu Wan , Pingping Zhang , Yuhao Wang , Silong Yong , Simon Stepputtis , Katia Sycara , Yaqi Xie

Visual Geometry Grounded Transformers (VGGT) have set new benchmarks in high-fidelity 3D scene reconstruction. However, as the sequence length increases, these models suffer from catastrophic geometric forgetting and accumulation drift,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Tianchen Deng , Zhenxiang Xiong , Nailin Wang , Fangjinhua Wang , Jiuming Liu , Jianfei Yang , Hesheng Wang

Although MODIS time series data are critical for supporting dynamic, large-scale land cover land use classification, it is a challenging task to capture the subtle class signature information due to key MODIS difficulties, e.g., high…

Image and Video Processing · Electrical Eng. & Systems 2025-08-06 Zack Dewis , Zhengsen Xu , Yimin Zhu , Motasem Alkayid , Mabel Heffring , Lincoln Linlin Xu

Mainstream Transformer-based large language models face major efficiency bottlenecks: training computation scales quadratically with sequence length, and inference memory grows linearly, limiting long-context processing. Building large…

Self-supervised video hashing (SSVH) is a practical task in video indexing and retrieval. Although Transformers are predominant in SSVH for their impressive temporal modeling capabilities, they often suffer from computational and memory…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jinpeng Wang , Niu Lian , Jun Li , Yuting Wang , Yan Feng , Bin Chen , Yongbing Zhang , Shu-Tao Xia

Spiking Neural Networks (SNNs) are considered naturally suited for temporal processing, with membrane potential propagation widely regarded as the core temporal modeling mechanism. However, existing research lack analysis of its actual…

Neural and Evolutionary Computing · Computer Science 2025-12-08 Yiting Dong , Zhaofei Yu , Jianhao Ding , Zijie Xu , Tiejun Huang

State Space Models (SSMs)-most notably RNNs-have historically played a central role in sequential modeling. Although attention mechanisms such as Transformers have since dominated due to their ability to model global context, their…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Hyun-kyu Ko , Youbin Kim , Jihyeon Park , Dongheok Park , Gyeongjin Kang , Wonjun Cho , Hyung Yi , Eunbyung Park

Visual tracking aims to automatically estimate the state of a target object in a video sequence, which is challenging especially in dynamic scenarios. Thus, numerous methods are proposed to introduce temporal cues to enhance tracking…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yinchao Ma , Dengqing Yang , Zhangyu He , Wenfei Yang , Tianzhu Zhang

The rapid growth of long-duration, high-definition videos has made efficient video quality assessment (VQA) a critical challenge. Existing research typically tackles this problem through two main strategies: reducing model parameters and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Yachun Mi , Yu Li , Weicheng Meng , Chaofeng Chen , Chen Hui , Shaohui Liu

Global effective receptive field plays a crucial role for image style transfer (ST) to obtain high-quality stylized results. However, existing ST backbones (e.g., CNNs and Transformers) suffer huge computational complexity to achieve global…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Hongda Liu , Longguang Wang , Ye Zhang , Ziru Yu , Yulan Guo

State space models (SSMs) with selection mechanisms and hardware-aware architectures, namely Mamba, have recently demonstrated significant promise in long-sequence modeling. Since the self-attention mechanism in transformers has quadratic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Hanwei Zhang , Ying Zhu , Dan Wang , Lijun Zhang , Tianxiang Chen , Zi Ye

Recent years have witnessed Spiking Neural Networks (SNNs) gaining attention for their ultra-low energy consumption and high biological plausibility compared with traditional Artificial Neural Networks (ANNs). Despite their distinguished…

Neural and Evolutionary Computing · Computer Science 2024-08-30 Jiahang Cao , Hanzhong Guo , Ziqing Wang , Deming Zhou , Hao Cheng , Qiang Zhang , Renjing Xu

Human motion understanding is a fundamental task with diverse practical applications, facilitated by the availability of large-scale motion capture datasets. Recent studies focus on text-motion tasks, such as text-based motion generation,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Xinghan Wang , Zixi Kang , Yadong Mu