English
Related papers

Related papers: Self-supervised ControlNet with Spatio-Temporal Ma…

200 papers

Recently, Mamba-based super-resolution (SR) methods have demonstrated the ability to capture global receptive fields with linear complexity, addressing the quadratic computational cost of Transformer-based SR approaches. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Sichen Guo , Wenjie Li , Yuanyang Liu , Guangwei Gao , Jian Yang , Chia-Wen Lin

Image super-resolution (SR) is a critical technology for overcoming the inherent hardware limitations of sensors. However, existing approaches mainly focus on directly enhancing the final resolution, often neglecting effective control over…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Chenyu Li , Danfeng Hong , Bing Zhang , Zhaojie Pan , Naoto Yokoya , Jocelyn Chanussot

Due to storage and bandwidth limitations, videos transmitted over the Internet often exhibit low quality, characterized by low-resolution and compression artifacts. Although video super-resolution (VSR) is an efficient video enhancing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Hongyu An , Xinfeng Zhang , Shijie Zhao , Li Zhang , Ruiqin Xiong

Recent progress in remote sensing image (RSI) super-resolution (SR) has exhibited remarkable performance using deep neural networks, e.g., Convolutional Neural Networks and Transformers. However, existing SR methods often suffer from either…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Yi Xiao , Qiangqiang Yuan , Kui Jiang , Yuzeng Chen , Qiang Zhang , Chia-Wen Lin

This paper proposes ControlMambaIR, a novel image restoration method designed to address perceptual challenges in image deraining, deblurring, and denoising tasks. By integrating the Mamba network architecture with the diffusion model, the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Cheng Yang , Lijing Liang , Zhixun Su

Recent efforts on image restoration have focused on developing "all-in-one" models that can handle different degradation types and levels within single model. However, most of mainstream Transformer-based ones confronted with dilemma…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Aiwen Jiang , Hourong Chen , Zhiwen Chen , Jihua Ye , Mingwen Wang

The rapid growth of long-duration, high-definition videos has made efficient video quality assessment (VQA) a critical challenge. Existing research typically tackles this problem through two main strategies: reducing model parameters and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Yachun Mi , Yu Li , Weicheng Meng , Chaofeng Chen , Chen Hui , Shaohui Liu

Robust feature representations are essential for learning-based Multi-View Stereo (MVS), which relies on accurate feature matching. Recent MVS methods leverage Transformers to capture long-range dependencies based on local features…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Jianfei Jiang , Qiankun Liu , Hongyuan Liu , Haochen Yu , Liyong Wang , Jiansheng Chen , Huimin Ma

Motion style transfer is a significant research direction in the field of computer vision, enabling virtual digital humans to rapidly switch between different styles of the same motion, thereby significantly enhancing the richness and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Ziyun Qian , Zeyu Xiao , Xingliang Jin , Dingkang Yang , Mingcheng Li , Zhenyi Wu , Dongliang Kou , Peng Zhai , Lihua Zhang

Self-supervised Learning (SSL) has become a powerful paradigm for representation learning without manual annotations. However, most existing frameworks focus on global alignment and struggle to capture the hierarchical, multi-scale lesion…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Abdullah Al Mamun , Miaohua Zhang , David Ahmedt-Aristizabal , Zeeshan Hayder , Mohammad Awrangjeb

Video restoration (VR) aims to recover high-quality videos from degraded ones. Although recent zero-shot VR methods using pre-trained diffusion models (DMs) show good promise, they suffer from approximation errors during reverse diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Hengkang Wang , Yang Liu , Huidong Liu , Chien-Chih Wang , Yanhui Guo , Hongdong Li , Bryan Wang , Ju Sun

Video super-resolution (VSR) is a task that aims to reconstruct high-resolution (HR) frames from the low-resolution (LR) reference frame and multiple neighboring frames. The vital operation is to utilize the relative misaligned frames for…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Meiqin Liu , Shuo Jin , Chao Yao , Chunyu Lin , Yao Zhao

Transformer-based methods have achieved remarkable performance in event-based object detection, owing to the global modeling ability. However, they neglect the influence of non-event and noisy regions and process them uniformly, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Nan Yang , Yang Wang , Zhanwen Liu , Meng Li , Yisheng An , Xiangmo Zhao

MambaVoiceCloning (MVC) asks whether the conditioning path of diffusion-based TTS can be made fully SSM-only at inference, removing all attention and explicit RNN-style recurrence layers across text, rhythm, and prosody, while preserving or…

Sound · Computer Science 2026-04-02 Sahil Kumar , Namrataben Patel , Honggang Wang , Youshan Zhang

While Mamba has demonstrated strong performance in language modeling, its potential as a speech self-supervised learning (SSL) model remains underexplored, with prior studies limited to isolated tasks. To address this, we explore…

Computation and Language · Computer Science 2026-04-21 Tzu-Quan Lin , Heng-Cheng Kuo , Tzu-Chieh Wei , Hsi-Chun Cheng , Chun Wei Chen , Hsien-Fu Hsiao , Yu Tsao , Hung-yi Lee

Generative Artificial Intelligence (AI) has gained significant attention in recent years, revolutionizing various applications across industries. Among these, advanced vision models for image super-resolution are in high demand,…

Image and Video Processing · Electrical Eng. & Systems 2025-02-21 Romina Aalishah , Mozhgan Navardi , Tinoosh Mohsenin

Mamba is an efficient State Space Model (SSM) with linear computational complexity. Although SSMs are not suitable for handling non-causal data, Vision Mamba (ViM) methods still demonstrate good performance in tasks such as image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Juntao Zhang , Shaogeng Liu , Kun Bian , You Zhou , Pei Zhang , Jianning Liu , Jun Zhou , Bingyan Liu

Atmospheric turbulence is a major source of image degradation in long-range imaging systems. Although numerous deep learning-based turbulence mitigation (TM) methods have been proposed, many are slow, memory-hungry, and do not generalize…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Xingguang Zhang , Nicholas Chimitt , Xijun Wang , Yu Yuan , Stanley H. Chan

Diffusion-based models have shown strong performance in video super-resolution (VSR) and video frame interpolation (VFI). However, their role in the coupled space-time video super-resolution (STVSR) setting remains limited. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Zheng Chen , Ruofan Yang , Jin Han , Dehua Song , Zichen Zou , Chunming He , Yong Guo , Yulun Zhang

We introduce a novel state-space architecture for diffusion models, effectively harnessing spatial and frequency information to enhance the inductive bias towards local features in input images for image generation tasks. While state-space…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Hao Phung , Quan Dao , Trung Dao , Hoang Phan , Dimitris Metaxas , Anh Tran