中文
相关论文

相关论文: SELD-Mamba: Selective State-Space Model for Sound …

200 篇论文

Sound event localization and detection (SELD) systems using audio recordings from a microphone array rely on spatial cues for determining the location of sound events. As a consequence, the localization performance of such systems is to a…

音频与语音处理 · 电气工程与系统科学 2024-09-02 Axel Berg , Johanna Engman , Jens Gulin , Karl Åström , Magnus Oskarsson

Hyperspectral image (HSI) classification constitutes the fundamental research in remote sensing fields. Convolutional Neural Networks (CNNs) and Transformers have demonstrated impressive capability in capturing spectral-spatial contextual…

计算机视觉与模式识别 · 计算机科学 2024-08-09 Yan He , Bing Tu , Bo Liu , Jun Li , Antonio Plaza

Traffic flow estimation (TFE) is crucial for urban intelligent traffic systems. While traditional on-road detectors are hindered by limited coverage and high costs, cloud computing and data mining of vehicular network data, such as driving…

人工智能 · 计算机科学 2024-07-12 Doncheng Yuan , Jianzhe Xue , Jinshan Su , Wenchao Xu , Haibo Zhou

Transformers have become dominant in large-scale deep learning tasks across various domains, including text, 2D and 3D vision. However, the quadratic complexity of their attention mechanism limits their efficiency as the sequence length…

计算机视觉与模式识别 · 计算机科学 2024-11-04 Nursena Köprücü , Destiny Okpekpe , Antonio Orvieto

Sound event localisation and detection (SELD) is a problem in the field of automatic listening that aims at the temporal detection and localisation (direction of arrival estimation) of sound events within an audio clip, usually of long…

State-space models (SSMs), exemplified by S4, have introduced a novel context modeling method by integrating state-space techniques into deep learning. However, they struggle with global context modeling due to their data-independent…

计算机视觉与模式识别 · 计算机科学 2025-03-28 Hamid Suleman , Syed Talal Wasim , Muzammal Naseer , Juergen Gall

Sequential Recommenders have been widely applied in various online services, aiming to model users' dynamic interests from their sequential interactions. With users increasingly engaging with online platforms, vast amounts of lifelong user…

信息检索 · 计算机科学 2024-03-26 Jiyuan Yang , Yuanzi Li , Jingyu Zhao , Hanbing Wang , Muyang Ma , Jun Ma , Zhaochun Ren , Mengqi Zhang , Xin Xin , Zhumin Chen , Pengjie Ren

Physics-informed machine learning (PIML) has emerged as a promising alternative to classical methods for predicting dynamical systems, offering faster and more generalizable solutions. However, existing models, including recurrent neural…

机器学习 · 计算机科学 2025-01-28 Zheyuan Hu , Nazanin Ahmadi Daryakenari , Qianli Shen , Kenji Kawaguchi , George Em Karniadakis

State-space modeling has emerged as a powerful paradigm for sequence analysis in various tasks such as natural language processing, time-series forecasting, and signal processing. In this work, we propose an \emph{Adaptive State-Space…

机器学习 · 计算机科学 2025-07-31 Alice Zhang , Chao Li

Accurate direction-of-arrival (DOA) estimation for sound sources is challenging due to the continuous changes in acoustic characteristics across time and frequency. In such scenarios, accurate localization relies on the ability to aggregate…

信号处理 · 电气工程与系统科学 2025-10-30 Qi You , Qinghua Huang , Yi-Cheng Lin

In recent years, Transformers have become the de-facto architecture for long-term sequence forecasting (LTSF), but faces challenges such as quadratic complexity and permutation invariant bias. A recent model, Mamba, based on selective state…

机器学习 · 计算机科学 2024-05-28 Xiuding Cai , Yaoyao Zhu , Xueyao Wang , Yu Yao

Motion prediction is crucial for autonomous driving, as it enables accurate forecasting of future vehicle trajectories based on historical inputs. This paper introduces Trajectory Mamba, a novel efficient trajectory prediction framework…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Yizhou Huang , Yihua Cheng , Kezhi Wang

Event cameras draw inspiration from biological systems, boasting low latency and high dynamic range while consuming minimal power. The most current approach to processing Event Cloud often involves converting it into frame-based…

计算机视觉与模式识别 · 计算机科学 2025-03-31 Hongwei Ren , Yue Zhou , Jiadong Zhu , Haotian Fu , Yulong Huang , Xiaopeng Lin , Yuetong Fang , Fei Ma , Hao Yu , Bojun Cheng

Recurrent neural networks and Transformers have recently dominated most applications in hyperspectral (HS) imaging, owing to their capability to capture long-range dependencies from spectrum sequences. However, despite the success of these…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Jing Yao , Danfeng Hong , Chenyu Li , Jocelyn Chanussot

Effectively modeling global context information in hyperspectral image (HSI) denoising is crucial, but prevailing methods using convolution or transformers still face localized or computational efficiency limitations. Inspired by the…

计算机视觉与模式识别 · 计算机科学 2025-09-16 Yang Liu , Jiahua Xiao , Xiang Song , Yu Guo , Peilin Jiang , Haiwei Yang , Fei Wang

Leveraging its robust linear global modeling capability, Mamba has notably excelled in computer vision. Despite its success, existing Mamba-based vision models have overlooked the nuances of event-driven tasks, especially in video…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Chengjie Ge , Xueyang Fu , Peng He , Kunyu Wang , Chengzhi Cao , Zheng-Jun Zha

Recent years have witnessed significant advancements in light field image super-resolution (LFSR) owing to the progress of modern neural networks. However, these methods often face challenges in capturing long-range dependencies (CNN-based)…

计算机视觉与模式识别 · 计算机科学 2024-06-19 Wang xia , Yao Lu , Shunzhou Wang , Ziqi Wang , Peiqi Xia , Tianfei Zhou

This study presents an audio-visual information fusion approach to sound event localization and detection (SELD) in low-resource scenarios. We aim at utilizing audio and video modality information through cross-modal learning and…

音频与语音处理 · 电气工程与系统科学 2024-06-24 Ya Jiang , Qing Wang , Jun Du , Maocheng Hu , Pengfei Hu , Zeyan Liu , Shi Cheng , Zhaoxu Nian , Yuxuan Dong , Mingqi Cai , Xin Fang , Chin-Hui Lee

Sound event localization and detection (SELD) aims to determine the appearance of sound classes, together with their Direction of Arrival (DOA). However, current SELD systems can only predict the activities of specific classes, for example,…

音频与语音处理 · 电气工程与系统科学 2024-06-25 Jinzheng Zhao , Xinyuan Qian , Yong Xu , Haohe Liu , Yin Cao , Davide Berghi , Wenwu Wang

Skeleton-based action recognition has garnered significant attention in the computer vision community. Inspired by the recent success of the selective state-space model (SSM) Mamba in modeling 1D temporal sequences, we propose TSkel-Mamba,…

计算机视觉与模式识别 · 计算机科学 2025-12-15 Yanan Liu , Jun Liu , Hao Zhang , Dan Xu , Hossein Rahmani , Mohammed Bennamoun , Qiuhong Ke