English
Related papers

Related papers: AudioRWKV: Efficient and Stable Bidirectional RWKV…

200 papers

Transformers have generally supplanted recurrent neural networks as the dominant architecture for both natural language processing tasks and for modelling the effect of predictability on online human language comprehension. However, two…

Computation and Language · Computer Science 2024-08-27 James A. Michaelov , Catherine Arnett , Benjamin K. Bergen

Radio map (RM) has recently attracted much attention since it can provide real-time and accurate spatial channel information for 6G services and applications. However, current deep learning-based methods for RM construction exhibit well…

Signal Processing · Electrical Eng. & Systems 2025-08-14 Honggang Jia , Nan Cheng , Xiucheng Wang , Conghao Zhou , Ruijin Sun , Xuemin , Shen

RWKV is a modern RNN architecture with comparable performance to Transformer, but still faces challenges when deployed to resource-constrained devices. Post Training Quantization (PTQ), which is a an essential technique to reduce model size…

Machine Learning · Computer Science 2025-05-08 Chen Xu , Yuxuan Yue , Zukang Xu , Xing Hu , Jiangyong Yu , Zhixuan Chen , Sifan Zhou , Zhihang Yuan , Dawei Yang

Audio tagging is an important task of mapping audio samples to their corresponding categories. Recently endeavours that exploit transformer models in this field have achieved great success. However, the quadratic self-attention cost limits…

Sound · Computer Science 2024-05-24 Jiaju Lin , Haoxuan Hu

Existing key-value (KV) cache compression methods for large language models (LLMs) often rely on token eviction, which risks losing critical local information in both long prefilling and decoding scenarios. When extrapolating beyond the…

Computation and Language · Computer Science 2026-01-30 Jushi Kai , Yixuan Wang , Boyi Zeng , Haoli Bai , Bo Jiang , Ziwei He , Zhouhan Lin

Traditional Transformers face a major bottleneck in long-sequence time series forecasting due to their quadratic complexity $(\mathcal{O}(T^2))$ and their limited ability to effectively exploit frequency-domain information. Inspired by…

Machine Learning · Computer Science 2025-12-10 Qingyuan Yang , Shizhuo Deng , Dongyue Chen , Da Teng , Zehua Gan

Magnetic Resonance Fingerprinting (MRF) enables fast quantitative imaging by matching signal evolutions to a predefined dictionary. However, conventional dictionary matching suffers from exponential growth in computational cost and memory…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Tianyi Ding , Hongli Chen , Yang Gao , Zhuang Xiong , Feng Liu , Martijn A. Cloos , Hongfu Sun

Transformers and their variants have achieved great success in speech processing. However, their multi-head self-attention mechanism is computationally expensive. Therefore, one novel selective state space model, Mamba, has been proposed as…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-04 Yang Xiao , Rohan Kumar Das

Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module. Many subquadratic-time architectures such as linear attention,…

Machine Learning · Computer Science 2024-06-03 Albert Gu , Tri Dao

We present SAM, a State-space Audio-language Model that integrates an audio encoder with a Mamba-2 backbone. SAM-2.7B achieves 21.1 mAP on AudioSet and 17.6 SPICE on AudioCaps, matching or surpassing larger 7B transformer-based models with…

Sound · Computer Science 2026-03-06 Taehan Lee , Jaehan Jung , Hyukjun Lee

Transformers have catalyzed advancements in computer vision and natural language processing (NLP) fields. However, substantial computational complexity poses limitations for their application in long-context tasks, such as high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Zhengcong Fei , Mingyuan Fan , Changqian Yu , Debang Li , Junshi Huang

Ultra-high-field 7T MRI offers enhanced spatial resolution and tissue contrast that enables the detection of subtle pathological changes in neurological disorders. However, the limited availability of 7T scanners restricts widespread…

Image and Video Processing · Electrical Eng. & Systems 2025-10-13 Yingtie Lei , Zimeng Li , Chi-Man Pun , Yupeng Liu , Xuhang Chen

To deploy LLMs on resource-contained platforms such as mobile robots and smartphones, non-transformers LLMs have achieved major breakthroughs. Recently, a novel RNN-based LLM family, Repentance Weighted Key Value (RWKV) has shown strong…

Machine Learning · Computer Science 2025-10-29 Wonkyo Choe , Yangfeng Ji , Felix Xiaozhu Lin

Multimodal Large Language Models (MLLMs) have attracted much attention for their multifunctionality. However, traditional Transformer architectures incur significant overhead due to their secondary computational complexity. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Wenjun Huang , Jiakai Pan , Jiahao Tang , Yanyu Ding , Yifei Xing , Yuhe Wang , Zhengzhuo Wang , Jianguo Hu

Whispered speech recognition presents significant challenges for conventional automatic speech recognition systems, particularly when combined with dialect variation. However, utilizing an efficient method to solve this problem using a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-30 Aref Farhadipour , Homayoon Beigi , Volker Dellwo , Hadi Veisi

Recent advances in extreme image compression have revealed that mapping pixel data into highly compact latent representations can significantly improve coding efficiency. However, most existing methods compress images into 2-D latent spaces…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Han Liu , Hengyu Man , Xingtao Wang , Wenrui Li , Debin Zhao

Efficient audio representations in a compressed continuous latent space are critical for generative audio modeling and Music Information Retrieval (MIR) tasks. However, some existing audio autoencoders have limitations, such as multi-stage…

Sound · Computer Science 2024-08-14 Marco Pasini , Stefan Lattner , George Fazekas

With the evolution of large language models, traditional Transformer models become computationally demanding for lengthy sequences due to the quadratic growth in computation with respect to the sequence length. Mamba, emerging as a…

Machine Learning · Computer Science 2024-08-22 Haoran Xu , Ziqian Liu , Rong Fu , Zhongling Su , Zerui Wang , Zheng Cai , Zhilin Pei , Xingcheng Zhang

Sequential recommendation systems aim to predict users' next preferences based on their interaction histories, but existing approaches face critical limitations in efficiency and multi-scale pattern recognition. While Transformer-based…

Information Retrieval · Computer Science 2025-05-08 Qianru Zhang , Liang Qu , Honggang Wen , Dong Huang , Siu-Ming Yiu , Nguyen Quoc Viet Hung , Hongzhi Yin

Speech Super-Resolution (SSR) is a task of enhancing low-resolution speech signals by restoring missing high-frequency components. Conventional approaches typically reconstruct log-mel features, followed by a vocoder that generates…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-04 Yongjoon Lee , Chanwoo Kim