English
Related papers

Related papers: Wave-U-Mamba: An End-To-End Framework For High-Qua…

200 papers

Recently, diffusion models (DMs) have been increasingly used in audio processing tasks, including speech super-resolution (SR), which aims to restore high-frequency content given low-resolution speech utterances. This is commonly achieved…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-22 Chin-Yun Yu , Sung-Lin Yeh , György Fazekas , Hao Tang

Mamba has demonstrated exceptional performance in visual tasks due to its powerful global modeling capabilities and linear computational complexity, offering considerable potential in hyperspectral image super-resolution (HSISR). However,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Shi Chen , Lefei Zhang , Liangpei Zhang

This paper explores an efficient solution for Space-time Super-Resolution, aiming to generate High-resolution Slow-motion videos from Low Resolution and Low Frame rate videos. A simplistic solution is the sequential running of Video Super…

Image and Video Processing · Electrical Eng. & Systems 2021-06-09 Saikat Dutta , Nisarg A. Shah , Anurag Mittal

Background: Three-dimensional, whole heart, balanced steady state free precession (WH-bSSFP) sequences provide delineation of intra-cardiac and vascular anatomy. However, they have long acquisition times. Here, we propose significant speed…

Image and Video Processing · Electrical Eng. & Systems 2019-12-24 Jennifer A. Steeden , Michael Quail , Alexander Gotschy , Andreas Hauptmann , Simon Arridge , Rodney Jones , Vivek Muthurangu

This paper presents CleanUMamba, a time-domain neural network architecture designed for real-time causal audio denoising directly applied to raw waveforms. CleanUMamba leverages a U-Net encoder-decoder structure, incorporating the Mamba…

Sound · Computer Science 2025-07-03 Sjoerd Groot , Qinyu Chen , Jan C. van Gemert , Chang Gao

Due to the diverse geographical environments, intricate landscapes, and high-density settlements, the automatic identification of urban village boundaries using remote sensing images remains a highly challenging task. This paper proposes a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Lulin Li , Ben Chen , Xuechao Zou , Junliang Xing , Pin Tao

In speech synthesis and speech enhancement systems, melspectrograms need to be precise in acoustic representations. However, the generated spectrograms are over-smooth, that could not produce high quality synthesized speech. Inspired by…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-04 Leyuan Sheng , Dong-Yan Huang , Evgeniy N. Pavlovskiy

We present Schr\"odinger Bridge Mamba (SBM), a novel model for efficient speech enhancement by integrating the Schr\"odinger Bridge (SB) training paradigm and the Mamba architecture. Experiments of joint denoising and dereverberation tasks…

Sound · Computer Science 2026-03-06 Jing Yang , Sirui Wang , Chao Wu , Lei Guo , Fan Fan

Current hyperspectral image (HSI) reconstruction methods primarily rely on image-level approaches, which are time-consuming to form abundant high-quality HSIs through imagers. In contrast, spectrometers offer a more efficient alternative by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yihong Leng , Jiaojiao Li , Haitao Xu , Rui Song

Reconstructing degraded images is a critical task in image processing. Although CNN and Transformer-based models are prevalent in this field, they exhibit inherent limitations, such as inadequate long-range dependency modeling and high…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Rui Deng , Tianpei Gu

We propose \textbf{U-Codec}, an \textbf{U}ltra low frame-rate neural speech \textbf{Codec} that achieves high-fidelity reconstruction and fast speech generation at an extremely low frame-rate of 5Hz (5 frames per second). Extreme…

Sound · Computer Science 2025-10-21 Xusheng Yang , Long Zhou , Wenfu Wang , Kai Hu , Shulin Feng , Chenxing Li , Meng Yu , Dong Yu , Yuexian Zou

Reference-based image super-resolution (RefSR) has shown promising success in recovering high-frequency details by utilizing an external reference image (Ref). In this task, texture details are transferred from the Ref image to the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Liying Lu , Wenbo Li , Xin Tao , Jiangbo Lu , Jiaya Jia

Deep learning techniques have revolutionized the infrared and visible image fusion (IVIF), showing remarkable efficacy on complex scenarios. However, current methods do not fully combine frequency domain features with global semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Tianpei Zhang , Yiming Zhu , Jufeng Zhao , Guangmang Cui , Yuchen Zheng

Historically lower-level tasks such as automatic speech recognition (ASR) and speaker identification are the main focus in the speech field. Interest has been growing in higher-level spoken language understanding (SLU) tasks recently, like…

Computation and Language · Computer Science 2022-04-25 Lin Yao , Jianfei Song , Ruizhuo Xu , Yingfang Yang , Zijian Chen , Yafeng Deng

Selective state space models (SSMs) represented by Mamba have demonstrated their computational efficiency and promising outcomes in various tasks, including automatic speech recognition (ASR). Mamba has been applied to ASR task with the…

Sound · Computer Science 2024-11-12 Yoshiki Masuyama , Koichi Miyazaki , Masato Murata

Image restoration endeavors to reconstruct a high-quality, detail-rich image from a degraded counterpart, which is a pivotal process in photography and various computer vision systems. In real-world scenarios, different types of degradation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Yuhong He , Long Peng , Qiaosi Yi , Chen Wu , Lu Wang

Accurate medical image segmentation remains challenging due to blurred lesion boundaries (LBA), loss of high-frequency details (LHD), and difficulty in modeling long-range anatomical structures (DC-LRSS). Vision Mamba employs…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Ze Rong , ZiYue Zhao , Zhaoxin Wang , Lei Ma

The typical Selective State-Space Model (SSM) used in Mamba addresses several limitations of Transformers, such as the quadratic computational complexity with respect to sequence length and the significant memory requirements during…

Computation and Language · Computer Science 2025-10-24 Shengkun Tang , Liqun Ma , Haonan Li , Mingjie Sun , Zhiqiang Shen

Generative Artificial Intelligence (AI) has gained significant attention in recent years, revolutionizing various applications across industries. Among these, advanced vision models for image super-resolution are in high demand,…

Image and Video Processing · Electrical Eng. & Systems 2025-02-21 Romina Aalishah , Mozhgan Navardi , Tinoosh Mohsenin

Recurrent neural networks and Transformers have recently dominated most applications in hyperspectral (HS) imaging, owing to their capability to capture long-range dependencies from spectrum sequences. However, despite the success of these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Jing Yao , Danfeng Hong , Chenyu Li , Jocelyn Chanussot