English
Related papers

Related papers: Frame-To-Frame Consistent Semantic Segmentation

200 papers

Temporal action localization is an important task of computer vision. Though many methods have been proposed, it still remains an open question how to predict the temporal location of action segments precisely. Most state-of-the-art works…

Computer Vision and Pattern Recognition · Computer Science 2019-02-15 Ke Yang , Xiaolong Shen , Peng Qiao , Shijie Li , Dongsheng Li , Yong Dou

This paper proposes a new framework for semantic segmentation of objects in videos. We address the label inconsistency problem of deep convolutional neural networks (DCNNs) by exploiting the fact that videos have multiple frames; in a few…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Seong-Jin Park , Ki-Sang Hong

We present TDNet, a temporally distributed network designed for fast and accurate video semantic segmentation. We observe that features extracted from a certain high-level layer of a deep CNN can be approximated by composing features…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Ping Hu , Fabian Caba Heilbron , Oliver Wang , Zhe Lin , Stan Sclaroff , Federico Perazzi

The ability to predict and therefore to anticipate the future is an important attribute of intelligence. It is also of utmost importance in real-time systems, e.g. in robotics or autonomous driving, which depend on visual scene…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Pauline Luc , Natalia Neverova , Camille Couprie , Jakob Verbeek , Yann LeCun

A major challenge for video semantic segmentation is the lack of labeled data. In most benchmark datasets, only one frame of a video clip is annotated, which makes most supervised methods fail to utilize information from the rest of the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Mingyu Ding , Zhe Wang , Bolei Zhou , Jianping Shi , Zhiwu Lu , Ping Luo

Deep convolutional networks have achieved great success for visual recognition in still images. However, for action recognition in videos, the advantage over traditional methods is not so evident. This paper aims to discover the principles…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Limin Wang , Yuanjun Xiong , Zhe Wang , Yu Qiao , Dahua Lin , Xiaoou Tang , Luc Van Gool

Applying image processing algorithms independently to each frame of a video often leads to undesired inconsistent results over time. Developing temporally consistent video-based extensions, however, requires domain knowledge for individual…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Wei-Sheng Lai , Jia-Bin Huang , Oliver Wang , Eli Shechtman , Ersin Yumer , Ming-Hsuan Yang

Computer vision tasks such as semantic segmentation perform very well in good weather conditions, but if the weather turns bad, they have problems to achieve this performance in these conditions. One possibility to obtain more robust and…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Andreas Pfeuffer , Klaus Dietmayer

A long-term video, such as a movie or TV show, is composed of various scenes, each of which represents a series of shots sharing the same semantic story. Spotting the correct scene boundary from the long-term video is a challenging task,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Haoqian Wu , Keyu Chen , Yanan Luo , Ruizhi Qiao , Bo Ren , Haozhe Liu , Weicheng Xie , Linlin Shen

Recent advancements in video semantic segmentation have made substantial progress by exploiting temporal correlations. Nevertheless, persistent challenges, including redundant computation and the reliability of the feature propagation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Yaoyan Zheng , Hongyu Yang , Di Huang

Classifying videos according to content semantics is an important problem with a wide range of applications. In this paper, we propose a hybrid deep learning framework for video classification, which is able to model static spatial…

Computer Vision and Pattern Recognition · Computer Science 2015-04-08 Zuxuan Wu , Xi Wang , Yu-Gang Jiang , Hao Ye , Xiangyang Xue

Semantic video segmentation is challenging due to the sheer amount of data that needs to be processed and labeled in order to construct accurate models. In this paper we present a deep, end-to-end trainable methodology to video segmentation…

Computer Vision and Pattern Recognition · Computer Science 2017-10-03 David Nilsson , Cristian Sminchisescu

Semantic segmentation is a well-addressed topic in the computer vision literature, but the design of fast and accurate video processing networks remains challenging. In addition, to run on embedded hardware, computer vision models often…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Evann Courdier , François Fleuret

Motivated by the previous success of Two-Dimensional Convolutional Neural Network (2D CNN) on image recognition, researchers endeavor to leverage it to characterize videos. However, one limitation of applying 2D CNN to analyze videos is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Junwu Weng , Donghao Luo , Yabiao Wang , Ying Tai , Chengjie Wang , Jilin Li , Feiyue Huang , Xudong Jiang , Junsong Yuan

Deep convolutional networks have achieved great success for image recognition. However, for action recognition in videos, their advantage over traditional methods is not so evident. We present a general and flexible video-level framework…

Computer Vision and Pattern Recognition · Computer Science 2017-05-09 Limin Wang , Yuanjun Xiong , Zhe Wang , Yu Qiao , Dahua Lin , Xiaoou Tang , Luc Van Gool

Video instance segmentation aims at predicting object segmentation masks for each frame, as well as associating the instances across multiple frames. Recent end-to-end video instance segmentation methods are capable of performing object…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Quanzeng You , Jiang Wang , Peng Chu , Andre Abrantes , Zicheng Liu

Convolutional networks optimized for accuracy on challenging, dense prediction tasks are prohibitively slow to run on each frame in a video. The spatial similarity of nearby video frames, however, suggests opportunity to reuse computation.…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Samvit Jain , Joseph E. Gonzalez

Video semantic segmentation requires to utilize the complex temporal relations between frames of the video sequence. Previous works usually exploit accurate optical flow to leverage the temporal relations, which suffer much from heavy…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Hao Wang , Weining Wang , Jing Liu

In recent years, advances in Artificial Intelligence have significantly impacted computer science, particularly in the field of computer vision, enabling solutions to complex problems such as video frame prediction. Video frame prediction…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jose M. Sánchez Velázquez , Mingbo Cai , Andrew Coney , Álvaro J. García- Tejedor , Alberto Nogales

Temporal consistency is the key challenge of video depth estimation. Previous works are based on additional optical flow or camera poses, which is time-consuming. By contrast, we derive consistency with less information. Since videos…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Yiran Wang , Zhiyu Pan , Xingyi Li , Zhiguo Cao , Ke Xian , Jianming Zhang