English
Related papers

Related papers: Motion-state Alignment for Video Semantic Segmenta…

200 papers

Comprehensive scene understanding is a critical enabler of robot autonomy. Semantic segmentation is one of the key scene understanding tasks which is pivotal for several robotics applications including autonomous driving, domestic service…

Robotics · Computer Science 2024-01-17 Juana Valeria Hurtado , Abhinav Valada

Semantic Segmentation combines two sub-tasks: the identification of pixel-level image masks and the application of semantic labels to those masks. Recently, so-called Foundation Models have been introduced; general models trained on very…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 David Balaban , Justin Medich , Pranay Gosar , Justin Hart

Text-based video segmentation aims to segment the target object in a video based on a describing sentence. Incorporating motion information from optical flow maps with appearance and linguistic modalities is crucial yet has been largely…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Wangbo Zhao , Kai Wang , Xiangxiang Chu , Fuzhao Xue , Xinchao Wang , Yang You

Semantic segmentation requires large amounts of pixel-wise annotations to learn accurate models. In this paper, we present a video prediction-based methodology to scale up training sets by synthesizing new training samples in order to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Yi Zhu , Karan Sapra , Fitsum A. Reda , Kevin J. Shih , Shawn Newsam , Andrew Tao , Bryan Catanzaro

In recent years, creative content generations like style transfer and neural photo editing have attracted more and more attention. Among these, cartoonization of real-world scenes has promising applications in entertainment and industry.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Zhenhuan Liu , Liang Li , Huajie Jiang , Xin Jin , Dandan Tu , Shuhui Wang , Zheng-Jun Zha

Image semantic segmentation is more and more being of interest for computer vision and machine learning researchers. Many applications on the rise need accurate and efficient segmentation mechanisms: autonomous driving, indoor navigation,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Alberto Garcia-Garcia , Sergio Orts-Escolano , Sergiu Oprea , Victor Villena-Martinez , Jose Garcia-Rodriguez

In this work, we aim for temporally consistent semantic segmentation throughout frames in a video. Many semantic segmentation algorithms process images individually which leads to an inconsistent scene interpretation due to illumination…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Manuel Rebol , Patrick Knöbelreiter

Semantic segmentation methods have achieved outstanding performance thanks to deep learning. Nevertheless, when such algorithms are deployed to new contexts not seen during training, it is necessary to collect and label scene-specific data…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Daniele Di Mauro , Antonino Furnari , Giuseppe Patanè , Sebastiano Battiato , Giovanni Maria Farinella

We study the problem of segmenting moving objects in unconstrained videos. Given a video, the task is to segment all the objects that exhibit independent motion in at least one frame. We formulate this as a learning problem and design our…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Pavel Tokmakov , Cordelia Schmid , Karteek Alahari

In this paper, we present a novel perceptual consistency perspective on video semantic segmentation, which can capture both temporal consistency and pixel-wise correctness. Given two nearby video frames, perceptual consistency measures how…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Yizhe Zhang , Shubhankar Borse , Hong Cai , Ying Wang , Ning Bi , Xiaoyun Jiang , Fatih Porikli

Semantic image segmentation is an important computer vision task that is difficult because it consists of both recognition and segmentation. The task is often cast as a structured output problem on an exponentially large output-space, which…

Computer Vision and Pattern Recognition · Computer Science 2017-09-07 Payman Yadollahpour

Localization is an essential task for mobile autonomous robotic systems that want to use pre-existing maps or create new ones in the context of SLAM. Today, many robotic platforms are equipped with high-accuracy 3D LiDAR sensors, which…

Motion segmentation is currently an active area of research in computer Vision. The task of comparing different methods of motion segmentation is complicated by the fact that researchers may use subtly different definitions of the problem.…

Computer Vision and Pattern Recognition · Computer Science 2016-11-01 Pia Bideau , Erik Learned-Miller

This paper proposes a new framework for semantic segmentation of objects in videos. We address the label inconsistency problem of deep convolutional neural networks (DCNNs) by exploiting the fact that videos have multiple frames; in a few…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Seong-Jin Park , Ki-Sang Hong

Simultaneous Localization and Mapping (SLAM) is one of the most essential techniques in many real-world robotic applications. The assumption of static environments is common in most SLAM algorithms, which however, is not the case for most…

Robotics · Computer Science 2022-05-17 Han Wang , Jing Ying Ko , Lihua Xie

In moving camera videos, motion segmentation is commonly performed using the image plane motion of pixels, or optical flow. However, objects that are at different depths from the camera can exhibit different optical flows even if they share…

Computer Vision and Pattern Recognition · Computer Science 2015-11-06 Manjunath Narayana , Allen Hanson , Erik Learned-Miller

Learning a data-driven spatio-temporal semantic representation of the objects is the key to coherent and consistent labelling in video. This paper proposes to achieve semantic video object segmentation by learning a data-driven…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Tinghuai Wang

Semantic segmentation is a critical task in computer vision aiming to identify and classify individual pixels in an image, with numerous applications in for example autonomous driving and medical image analysis. However, semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Halil Ibrahim Aysel , Xiaohao Cai , Adam Prügel-Bennett

As a critical clue of video super-resolution (VSR), inter-frame alignment significantly impacts overall performance. However, accurate pixel-level alignment is a challenging task due to the intricate motion interweaving in the video. In…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Qi Tang , Yao Zhao , Meiqin Liu , Jian Jin , Chao Yao

Object detection or localization is an incremental step in progression from coarse to fine digital image inference. It not only provides the classes of the image objects, but also provides the location of the image objects which have been…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Abdul Mueed Hafiz , Ghulam Mohiuddin Bhat