English
Related papers

Related papers: Temporal Modulation Network for Controllable Space…

200 papers

Learned video compression (LVC) has witnessed remarkable advancements in recent years. Similar as the traditional video coding, LVC inherits motion estimation/compensation, residual coding and other modules, all of which are implemented…

Image and Video Processing · Electrical Eng. & Systems 2023-09-22 Yanbo Gao , Wenjia Huang , Shuai Li , Hui Yuan , Mao Ye , Siwei Ma

In this paper, we address the problem of enhancing perceptual quality in video super-resolution (VSR) using Diffusion Models (DMs) while ensuring temporal consistency among frames. We present StableVSR, a VSR method based on DMs that can…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Claudio Rota , Marco Buzzelli , Joost van de Weijer

The spatio-temporal information among video sequences is significant for video super-resolution (SR). However, the spatio-temporal information cannot be fully used by existing video SR methods since spatial feature extraction and temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Xinyi Ying , Longguang Wang , Yingqian Wang , Weidong Sheng , Wei An , Yulan Guo

Temporal human action detection aims to identify and localize action segments within untrimmed videos, serving as a pivotal task in video understanding. Despite the progress achieved by prior architectures like CNN and Transformer models,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Yicheng Qiu , Keiji Yanai

Deep convolutional networks have achieved great success for visual recognition in still images. However, for action recognition in videos, the advantage over traditional methods is not so evident. This paper aims to discover the principles…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Limin Wang , Yuanjun Xiong , Zhe Wang , Yu Qiao , Dahua Lin , Xiaoou Tang , Luc Van Gool

Deep 3-dimensional (3D) Convolutional Network (ConvNet) has shown promising performance on video recognition tasks because of its powerful spatio-temporal information fusion ability. However, the extremely intensive requirements on memory…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Haonan Wang , Jun Lin , Zhongfeng Wang

We consider the problem of space-time super-resolution (ST-SR): increasing spatial resolution of video frames and simultaneously interpolating frames to increase the frame rate. Modern approaches handle these axes one at a time. In…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Muhammad Haris , Greg Shakhnarovich , Norimichi Ukita

Recently, deep learning based video super-resolution (SR) methods have achieved promising performance. To simultaneously exploit the spatial and temporal information of videos, employing 3-dimensional (3D) convolutions is a natural…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Sheng Li , Fengxiang He , Bo Du , Lefei Zhang , Yonghao Xu , Dacheng Tao

The work in this paper is driven by the question how to exploit the temporal cues available in videos for their accurate classification, and for human action recognition in particular? Thus far, the vision community has focused on…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Ali Diba , Mohsen Fayyaz , Vivek Sharma , Amir Hossein Karami , Mohammad Mahdi Arzani , Rahman Yousefzadeh , Luc Van Gool

Temporal modeling is crucial for video super-resolution. Most of the video super-resolution methods adopt the optical flow or deformable convolution for explicitly motion compensation. However, such temporal modeling techniques increase the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Takashi Isobe , Xu Jia , Xin Tao , Changlin Li , Ruihuang Li , Yongjie Shi , Jing Mu , Huchuan Lu , Yu-Wing Tai

In this paper, we address the challenges in unsupervised video object segmentation (UVOS) by proposing an efficient algorithm, termed MTNet, which concurrently exploits motion and temporal cues. Unlike previous methods that focus solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Yunzhi Zhuge , Hongyu Gu , Lu Zhang , Jinqing Qi , Huchuan Lu

Temporal modeling in videos is a fundamental yet challenging problem in computer vision. In this paper, we propose a novel Temporal Bilinear (TB) model to capture the temporal pairwise feature interactions between adjacent frames. Compared…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Yanghao Li , Sijie Song , Yuqi Li , Jiaying Liu

The demand for high-resolution videos has been consistently rising across various domains, propelled by continuous advancements in science, technology, and societal. Nonetheless, challenges arising from limitations in imaging equipment…

Image and Video Processing · Electrical Eng. & Systems 2024-07-25 Congrui Fu , Hui Yuan , Hongji Xu , Hao Zhang , Liquan Shen

The explosive growth in video streaming gives rise to challenges on performing video understanding at high accuracy and low computation cost. Conventional 2D CNNs are computationally cheap but cannot capture temporal relationships; 3D CNN…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Ji Lin , Chuang Gan , Song Han

It is well believed that video captioning is a fundamental but challenging task in both computer vision and artificial intelligence fields. The prevalent approach is to map an input video to a variable-length output sentence in a sequence…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Jingwen Chen , Yingwei Pan , Yehao Li , Ting Yao , Hongyang Chao , Tao Mei

Given an untrimmed video and natural language query, video sentence grounding aims to localize the target temporal moment in the video. Existing methods mainly tackle this task by matching and aligning semantics of the descriptive sentence…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Wei Ji , Long Chen , Yinwei Wei , Yiming Wu , Tat-Seng Chua

Video super-resolution aims at generating a high-resolution video from its low-resolution counterpart. With the rapid rise of deep learning, many recently proposed video super-resolution methods use convolutional neural networks in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Xiaohong Liu , Lingshi Kong , Yang Zhou , Jiying Zhao , Jun Chen

Video super-resolution (VSR) aims to estimate a high-resolution (HR) frame from a low-resolution (LR) frames. The key challenge for VSR lies in the effective exploitation of spatial correlation in an intra-frame and temporal dependency…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Young-Ju Choi , Young-Woon Lee , Byung-Gyu Kim

Temporal action localization is an important task of computer vision. Though a variety of methods have been proposed, it still remains an open question how to predict the temporal boundaries of action segments precisely. Most works use…

Computer Vision and Pattern Recognition · Computer Science 2017-09-12 Ke Yang , Peng Qiao , Dongsheng Li , Shaohe Lv , Yong Dou

Existing diffusion-based video super-resolution (VSR) methods are susceptible to introducing complex degradations and noticeable artifacts into high-resolution videos due to their inherent randomness. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Shijun Shi , Jing Xu , Lijing Lu , Zhihang Li , Kai Hu