English
Related papers

Related papers: Self-supervised ControlNet with Spatio-Temporal Ma…

200 papers

The essence of audio-visual segmentation (AVS) lies in locating and delineating sound-emitting objects within a video stream. While Transformer-based methods have shown promise, their handling of long-range dependencies struggles due to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Sitong Gong , Yunzhi Zhuge , Lu Zhang , Yifan Wang , Pingping Zhang , Lijun Wang , Huchuan Lu

In recent developments, the Mamba architecture, known for its selective state space approach, has shown potential in the efficient modeling of long sequences. However, its application in image generation remains underexplored. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Shentong Mo , Yapeng Tian

Recent advancements in video generation have demonstrated the potential of using video diffusion models as world models, with autoregressive generation of infinitely long videos through masked conditioning. However, such models, usually…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Taiye Chen , Zihan Ding , Anjian Li , Christina Zhang , Zeqi Xiao , Yisen Wang , Chi Jin

Recent advances in LiDAR 3D detection have demonstrated the effectiveness of Transformer-based frameworks in capturing the global dependencies from point cloud spaces, which serialize the 3D voxels into the flattened 1D sequence for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Xin Jin , Haisheng Su , Kai Liu , Cong Ma , Wei Wu , Fei Hui , Junchi Yan

In bandwidth-limited online video streaming, videos are usually downsampled and compressed. Although recent online video super-resolution (online VSR) approaches achieve promising results, they are still compute-intensive and fall short of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yuhang Wang , Hai Li , Shujuan Hou , Zhetao Dong , Xiaoyao Yang

Hyperspectral image (HSI) classification faces challenges such as high-dimensional data, limited training samples, and spectral redundancy, which often lead to overfitting and insufficient generalization capability. This paper proposes a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Guandong Li , Mengxia Ye

The prevalence of convolution neural networks (CNNs) and vision transformers (ViTs) has markedly revolutionized the area of single-image super-resolution (SISR). To further boost the SR performances, several techniques, such as residual…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Cheng Cheng , Hang Wang , Hongbin Sun

Existing salient object detection (SOD) models are generally constrained by the limited receptive fields of convolutional neural networks (CNNs) and quadratic computational complexity of Transformers. Recently, the emerging state-space…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Wenzhuo Zhao , Keren Fu , Jiahao He , Xiaohong Liu , Qijun Zhao , Guangtao Zhai

State Space Models (SSMs) with selective scan (Mamba) have been adapted into efficient vision models. Mamba, unlike Vision Transformers, achieves linear complexity for token interactions through a recurrent hidden state process. This…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Saarthak Kapse , Robin Betz , Srinivasan Sivanandan

In this paper, we propose Self-Navigated Residual Mamba (SNARM), a novel framework for universal industrial anomaly detection that leverages ``self-referential learning'' within test images to enhance anomaly discrimination. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Hanxi Li , Jingqi Wu , Lin Yuanbo Wu , Mingliang Li , Deyin Liu , Jialie Shen , Chunhua Shen

With the recent trend for ultra high definition displays, the demand for high quality and efficient video super-resolution (VSR) has become more important than ever. Previous methods adopt complex motion compensation strategies to exploit…

Image and Video Processing · Electrical Eng. & Systems 2019-09-19 Dario Fuoli , Shuhang Gu , Radu Timofte

A Recurrent Neural Network (RNN) for Video Super Resolution (VSR) is generally trained with randomly clipped and cropped short videos extracted from original training videos due to various challenges in learning RNNs. However, since this…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Hiroshi Mori , Norimichi Ukita

Diffusion transformers enable flexible generative modeling for video. However, it is still technically challenging and computationally expensive to generate high-resolution videos with rich semantics and complex motion. Similar to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Xunnong Xu , Mengying Cao

Given the remarkable achievements in image generation through diffusion models, the research community has shown increasing interest in extending these models to video generation. Recent diffusion models for video generation have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Yuta Oshima , Shohei Taniguchi , Masahiro Suzuki , Yutaka Matsuo

Video super-resolution (VSR) aims to estimate a high-resolution (HR) frame from a low-resolution (LR) frames. The key challenge for VSR lies in the effective exploitation of spatial correlation in an intra-frame and temporal dependency…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Young-Ju Choi , Young-Woon Lee , Byung-Gyu Kim

Single image super-resolution (SR) has long posed a challenge in the field of computer vision. While the advent of deep learning has led to the emergence of numerous methods aimed at tackling this persistent issue, the current methodologies…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Yuchun He , Yuhan He

Latent diffusion models have emerged as a leading paradigm for efficient video generation. However, as user expectations shift toward higher-resolution outputs, relying solely on latent computation becomes inadequate. A promising approach…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Liangbin Xie , Yu Li , Shian Du , Menghan Xia , Xintao Wang , Fanghua Yu , Ziyan Chen , Pengfei Wan , Jiantao Zhou , Chao Dong

Despite that convolution neural networks (CNN) have recently demonstrated high-quality reconstruction for video super-resolution (VSR), efficiently training competitive VSR models remains a challenging problem. It usually takes an order of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Lijian Lin , Xintao Wang , Zhongang Qi , Ying Shan

While the conditional sequence modeling with the transformer architecture has demonstrated its effectiveness in dealing with offline reinforcement learning (RL) tasks, it is struggle to handle out-of-distribution states and actions.…

Machine Learning · Computer Science 2025-01-23 Qi Lv , Xiang Deng , Gongwei Chen , Michael Yu Wang , Liqiang Nie

Video Super-Resolution (VSR) has achieved significant progress through diffusion models, effectively addressing the over-smoothing issues inherent in GAN-based methods. Despite recent advances, three critical challenges persist in VSR…

Image and Video Processing · Electrical Eng. & Systems 2025-07-28 Weisong Zhao , Jingkai Zhou , Xiangyu Zhu , Weihua Chen , Xiao-Yu Zhang , Zhen Lei , Fan Wang