English
Related papers

Related papers: Merging Tasks for Video Panoptic Segmentation

200 papers

Panoptic segmentation unifies semantic segmentation and instance segmentation which has been attracting increasing attention in recent years. However, most existing research was conducted under a supervised learning setup whereas…

Computer Vision and Pattern Recognition · Computer Science 2021-03-04 Jiaxing Huang , Dayan Guan , Aoran Xiao , Shijian Lu

Visual segmentation seeks to partition images, video frames, or point clouds into multiple segments or groups. This technique has numerous real-world applications, such as autonomous driving, image editing, robot sensing, and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Xiangtai Li , Henghui Ding , Haobo Yuan , Wenwei Zhang , Jiangmiao Pang , Guangliang Cheng , Kai Chen , Ziwei Liu , Chen Change Loy

3D point cloud panoptic segmentation is the combined task to (i) assign each point to a semantic class and (ii) separate the points in each class into object instances. Recently there has been an increased interest in such comprehensive 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Binbin Xiang , Yuanwen Yue , Torben Peters , Konrad Schindler

In this paper, we introduce a novel network that generates semantic, instance, and part segmentation using a shared encoder and effectively fuses them to achieve panoptic-part segmentation. Unifying these three segmentation problems allows…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Sravan Kumar Jagadeesh , René Schuster , Didier Stricker

In image processing, a segmentation is a process of partitioning an image into multiple sets of pixels, that are defined as super-pixels. Each super-pixel is characterized by a label or parameter. Here, we are proposing a method for…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Amelia Carolina Sparavigna

Diffusion Probabilistic Models have recently attracted significant attention in the community of computer vision due to their outstanding performance. However, while a substantial amount of diffusion-based research has focused on generative…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Yingling Lu , Yijun Yang , Zhaohu Xing , Qiong Wang , Lei Zhu

Reference-based video object segmentation is an emerging topic which aims to segment the corresponding target object in each video frame referred by a given reference, such as a language expression or a photo mask. However, language…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Ruolin Yang , Da Li , Conghui Hu , Timothy Hospedales , Honggang Zhang , Yi-Zhe Song

A major challenge for video semantic segmentation is the lack of labeled data. In most benchmark datasets, only one frame of a video clip is annotated, which makes most supervised methods fail to utilize information from the rest of the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Mingyu Ding , Zhe Wang , Bolei Zhou , Jianping Shi , Zhiwu Lu , Ping Luo

How to make a segmentation model efficiently adapt to a specific video and to online target appearance variations are fundamentally crucial issues in the field of video object segmentation. In this work, a graph memory network is developed…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Xiankai Lu , Wenguan Wang , Martin Danelljan , Tianfei Zhou , Jianbing Shen , Luc Van Gool

We propose an end-to-end learning framework for segmenting generic objects in videos. Our method learns to combine appearance and motion information to produce pixel level segmentation masks for all prominent objects in videos. We formulate…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Suyog Dutt Jain , Bo Xiong , Kristen Grauman

Video Instance Segmentation (VIS) aims at segmenting and categorizing objects in videos from a closed set of training categories, lacking the generalization ability to handle novel categories in real-world videos. To address this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Haochen Wang , Cilin Yan , Shuai Wang , Xiaolong Jiang , XU Tang , Yao Hu , Weidi Xie , Efstratios Gavves

Video instance segmentation (VIS) is a critical task with diverse applications, including autonomous driving and video editing. Existing methods often underperform on complex and long videos in real world, primarily due to two factors.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Tao Zhang , Xingye Tian , Yu Wu , Shunping Ji , Xuebo Wang , Yuan Zhang , Pengfei Wan

The Segmentation Anything Model 2 (SAM2) has proven to be a powerful foundation model for promptable visual object segmentation in both images and videos, capable of storing object-aware memories and transferring them temporally through…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Syed Hesham Syed Ariff , Yun Liu , Guolei Sun , Jing Yang , Henghui Ding , Xue Geng , Xudong Jiang

Video object segmentation can be considered as one of the most challenging computer vision problems. Indeed, so far, no existing solution is able to effectively deal with the peculiarities of real-world videos, especially in cases of…

Computer Vision and Pattern Recognition · Computer Science 2016-01-06 Simone Palazzo , Concetto Spampinato , Daniela Giordano

Visual segmentation is a key perceptual function that partitions visual space and allows for detection, recognition and discrimination of objects in complex environments. The processes underlying human segmentation of natural images are…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Jonathan Vacher , Pascal Mamassian , Ruben Coen-Cagli

Despite the progress of image segmentation for accurate visual entity segmentation, completing the diverse requirements of image editing applications for different-level region-of-interest selections remains unsolved. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Lu Qi , Jason Kuen , Weidong Guo , Jiuxiang Gu , Zhe Lin , Bo Du , Yu Xu , Ming-Hsuan Yang

Existing open-world universal segmentation approaches usually leverage CLIP and pre-computed proposal masks to treat open-world segmentation tasks as proposal classification. However, 1) these works cannot handle universal segmentation in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Bowen Dong , Jiaxi Gu , Jianhua Han , Hang Xu , Wangmeng Zuo

3D panoptic segmentation is a challenging perception task, especially in autonomous driving. It aims to predict both semantic and instance annotations for 3D points in a scene. Although prior 3D panoptic segmentation approaches have…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Zihao Xiao , Longlong Jing , Shangxuan Wu , Alex Zihao Zhu , Jingwei Ji , Chiyu Max Jiang , Wei-Chih Hung , Thomas Funkhouser , Weicheng Kuo , Anelia Angelova , Yin Zhou , Shiwei Sheng

An intuition on human segmentation is that when a human is moving in a video, the video-context (e.g., appearance and motion clues) may potentially infer reasonable mask information for the whole human body. Inspired by this, based on…

Computer Vision and Pattern Recognition · Computer Science 2018-03-01 Xiaodan Liang , Yunchao Wei , Liang Lin , Yunpeng Chen , Xiaohui Shen , Jianchao Yang , Shuicheng Yan

Semi-supervised video object segmentation (VOS) aims to segment arbitrary target objects in video when the ground truth segmentation mask of the initial frame is provided. Due to this limitation of using prior knowledge about the target…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Suhwan Cho , Heansung Lee , Sungmin Woo , Sungjun Jang , Sangyoun Lee