English
Related papers

Related papers: A Simple Latent Diffusion Approach for Panoptic Se…

200 papers

Panoptic segmentation involves a combination of joint semantic segmentation and instance segmentation, where image contents are divided into two types: things and stuff. We present Panoptic SegFormer, a general framework for panoptic…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Zhiqi Li , Wenhai Wang , Enze Xie , Zhiding Yu , Anima Anandkumar , Jose M. Alvarez , Ping Luo , Tong Lu

Diffusion Probabilistic Methods are employed for state-of-the-art image generation. In this work, we present a method for extending such models for performing image segmentation. The method learns end-to-end, without relying on a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Tomer Amit , Tal Shaharbany , Eliya Nachmani , Lior Wolf

Panoptic segmentation combines instance and semantic predictions, allowing the detection of "things" and "stuff" simultaneously. Effectively approaching panoptic segmentation in remotely sensed data can be auspicious in many challenging…

Instance segmentation is an important task for biomedical and biological image analysis. Due to the complicated background components, the high variability of object appearances, numerous overlapping objects, and ambiguous object…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Dongnan Liu , Donghao Zhang , Yang Song , Heng Huang , Weidong Cai

Panoptic segmentation (PS) is a complex scene understanding task that requires providing high-quality segmentation for both thing objects and stuff regions. Previous methods handle these two classes with semantic and instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Naiyu Gao , Yanhu Shan , Xin Zhao , Kaiqi Huang

Panoptic segmentation unifies semantic segmentation and instance segmentation which has been attracting increasing attention in recent years. However, most existing research was conducted under a supervised learning setup whereas…

Computer Vision and Pattern Recognition · Computer Science 2021-03-04 Jiaxing Huang , Dayan Guan , Aoran Xiao , Shijian Lu

The proposed method extends upon the representational output of semantic instance segmentation by explicitly including both visible and occluded parts. A fully convolutional network is trained to produce consistent pixel-level embedding…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Yanfeng Liu , Eric Psota , Lance Pérez

Current semantic segmentation models typically require a substantial amount of manually annotated data, a process that is both time-consuming and resource-intensive. Alternatively, leveraging advanced text-to-image models such as Midjourney…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Bo Gao , Jianhui Wang , Xinyuan Song , Yangfan He , Fangxu Xing , Tianyu Shi

We present a new, embarrassingly simple approach to instance segmentation in images. Compared to many other dense prediction tasks, e.g., semantic segmentation, it is the arbitrary number of instances that have made instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Xinlong Wang , Tao Kong , Chunhua Shen , Yuning Jiang , Lei Li

This paper presents a weakly-supervised approach to object instance segmentation. Starting with known or predicted object bounding boxes, we learn object masks by playing a game of cut-and-paste in an adversarial learning setup. A mask…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Tal Remez , Jonathan Huang , Matthew Brown

Instance segmentation is essential for numerous computer vision applications, including robotics, human-computer interaction, and autonomous driving. Currently, popular models bring impressive performance in instance segmentation by…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Cuong Manh Hoang

Acquiring the channel state information from limited and noisy observations at pilot positions is critical for wireless multiple-input multiple-output (MIMO)-orthogonal frequency division multiplexing (OFDM) systems. In this paper, we view…

Signal Processing · Electrical Eng. & Systems 2026-04-13 Weijie Zhou , Zhaoyang Zhang , Yuzhi Yang , Sen Yan , Zhixian Kong , Merouane Debbah

Recent progress in imitation learning has been enabled by policy architectures that scale to complex visuomotor tasks, multimodal distributions, and large datasets. However, these methods often rely on learning from large amount of expert…

Robotics · Computer Science 2025-04-24 Amber Xie , Oleh Rybkin , Dorsa Sadigh , Chelsea Finn

Free-form image inpainting is the task of reconstructing parts of an image specified by an arbitrary binary mask. In this task, it is typically desired to generalize model capabilities to unseen mask types, rather than learning certain mask…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Moein Heidari , Alireza Morsali , Tohid Abedini , Samin Heydarian

Standard Latent Diffusion Models rely on a complex, three-part architecture consisting of a separate encoder, decoder, and diffusion network, which are trained in multiple stages. This modular design is computationally inefficient, leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Xiyuan Wang , Muhan Zhang

We present a novel end-to-end single-shot method that segments countable object instances (things) as well as background regions (stuff) into a non-overlapping panoptic segmentation at almost video frame rate. Current state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Mark Weber , Jonathon Luiten , Bastian Leibe

We demonstrate our solution for the 2019 COCO panoptic segmentation task. Our method first performs instance segmentation and semantic segmentation separately, then combines the two to generate panoptic segmentation results. To enhance the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Mehmet Yildirim , Yogesh Langhe

Image segmentation for video analysis plays an essential role in different research fields such as smart city, healthcare, computer vision and geoscience, and remote sensing applications. In this regard, a significant effort has been…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Omar Elharrouss , Somaya Al-Maadeed , Nandhini Subramanian , Najmath Ottakath , Noor Almaadeed , Yassine Himeur

3D photography renders a static image into a video with appealing 3D visual effects. Existing approaches typically first conduct monocular depth estimation, then render the input frame to subsequent frames with various viewpoints, and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Xiaodong Wang , Chenfei Wu , Shengming Yin , Minheng Ni , Jianfeng Wang , Linjie Li , Zhengyuan Yang , Fan Yang , Lijuan Wang , Zicheng Liu , Yuejian Fang , Nan Duan

In recent years, the task of segmenting foreground objects from background in a video, i.e. video object segmentation (VOS), has received considerable attention. In this paper, we propose a single end-to-end trainable deep neural network,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Ye Lyu , George Vosselman , Gui-Song Xia , Michael Ying Yang