English
Related papers

Related papers: Towards On-Board Panoptic Segmentation of Multispe…

200 papers

Panoptic segmentation, which is a novel task of unifying instance segmentation and semantic segmentation, has attracted a lot of attention lately. However, most of the previous methods are composed of multiple pathways with each pathway…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Sukjun Hwang , Seoung Wug Oh , Seon Joo Kim

3D point cloud panoptic segmentation is the combined task to (i) assign each point to a semantic class and (ii) separate the points in each class into object instances. Recently there has been an increased interest in such comprehensive 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Binbin Xiang , Yuanwen Yue , Torben Peters , Konrad Schindler

Understanding the scene in which an autonomous robot operates is critical for its competent functioning. Such scene comprehension necessitates recognizing instances of traffic participants along with general scene semantics which can be…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Rohit Mohan , Abhinav Valada

Amodal panoptic segmentation aims to connect the perception of the world to its cognitive understanding. It entails simultaneously predicting the semantic labels of visible scene regions and the entire shape of traffic participant…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Rohit Mohan , Abhinav Valada

Open-vocabulary panoptic reconstruction is essential for advanced robotics perception and simulation. However, existing methods based on 3D Gaussian Splatting (3DGS) often struggle to simultaneously achieve geometric accuracy, coherent…

Robotics · Computer Science 2026-04-14 Xuan Yu , Yuxuan Xie , Changjian Jiang , Shichao Zhai , Rong Xiong , Yu Zhang , Yue Wang

Satellite imaging has a central role in monitoring, detecting and estimating the intensity of key natural phenomena. One important feature of satellite images is the trade-off between spatial/spectral resolution and their revisiting time, a…

Image and Video Processing · Electrical Eng. & Systems 2022-04-28 Haoqing Li , Bhavia Duvviri , Ricardo Borsoi , Tales Imbiriba , Edward Beighley , Deniz Erdogmus , Pau Closas

We propose Panoptic Lifting, a novel approach for learning panoptic 3D volumetric representations from images of in-the-wild scenes. Once trained, our model can render color images together with 3D-consistent panoptic segmentation from…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Yawar Siddiqui , Lorenzo Porzi , Samuel Rota Buló , Norman Müller , Matthias Nießner , Angela Dai , Peter Kontschieder

Panoptic segmentation is a complex full scene parsing task requiring simultaneous instance and semantic segmentation at high resolution. Current state-of-the-art approaches cannot run in real-time, and simplifying these architectures to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Rui Hou , Jie Li , Arjun Bhargava , Allan Raventos , Vitor Guizilini , Chao Fang , Jerome Lynch , Adrien Gaidon

3D panoptic segmentation is a challenging perception task that requires both semantic segmentation and instance segmentation. In this task, we notice that images could provide rich texture, color, and discriminative information, which can…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Zhiwei Zhang , Zhizhong Zhang , Qian Yu , Ran Yi , Yuan Xie , Lizhuang Ma

Multimodal semantic communication has great potential to enhance downstream task performance by integrating complementary information across modalities. This paper introduces ProMSC-MIS, a novel Prompt-based Multimodal Semantic…

Multimedia · Computer Science 2025-08-28 Haoshuo Zhang , Yufei Bo , Meixia Tao

Panoptic segmentation is posed as a new popular test-bed for the state-of-the-art holistic scene understanding methods with the requirement of simultaneously segmenting both foreground things and background stuff. The state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Yangxin Wu , Gengwei Zhang , Hang Xu , Xiaodan Liang , Liang Lin

Semantically interpreting the traffic scene is crucial for autonomous transportation and robotics systems. However, state-of-the-art semantic segmentation pipelines are dominantly designed to work with pinhole cameras and train with narrow…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Kailun Yang , Xinxin Hu , Hao Chen , Kaite Xiang , Kaiwei Wang , Rainer Stiefelhagen

Panoptic segmentation is the combination of semantic and instance segmentation: assign the points in a 3D point cloud to semantic categories and partition them into distinct object instances. It has many obvious applications for outdoor…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Binbin Xiang , Torben Peters , Theodora Kontogianni , Frawa Vetterli , Stefano Puliti , Rasmus Astrup , Konrad Schindler

Reliable LiDAR panoptic segmentation (LPS), including both semantic and instance segmentation, is vital for many robotic applications, such as autonomous driving. This work proposes a new LPS framework named PANet to eliminate the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Jianbiao Mei , Yu Yang , Mengmeng Wang , Xiaojun Hou , Laijian Li , Yong Liu

State-of-the-art methods for semantic segmentation of images involve computationally intensive neural network architectures. Most of these methods are not adaptable to high-resolution image segmentation due to memory and other computational…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Siddharth Saravanan , Aditya Challa , Sravan Danda

Mammography is crucial for breast cancer surveillance and early diagnosis. However, analyzing mammography images is a demanding task for radiologists, who often review hundreds of mammograms daily, leading to overdiagnosis and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Kun Zhao , Jakub Prokop , Javier Montalt Tordera , Sadegh Mohammadi

Panoptic segmentation has recently unified semantic and instance segmentation, previously addressed separately, thus taking a step further towards creating more comprehensive and efficient perception systems. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Stefano Gasperini , Mohammad-Ali Nikouei Mahani , Alvaro Marcos-Ramiro , Nassir Navab , Federico Tombari

Panoptic segmentation assigns semantic and instance ID labels to every pixel of an image. As permutations of instance IDs are also valid solutions, the task requires learning of high-dimensional one-to-many mapping. As a result,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Ting Chen , Lala Li , Saurabh Saxena , Geoffrey Hinton , David J. Fleet

In recent years, semantic segmentation has become a pivotal tool in processing and interpreting satellite imagery. Yet, a prevalent limitation of supervised learning techniques remains the need for extensive manual annotations by experts.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Aysim Toker , Marvin Eisenberger , Daniel Cremers , Laura Leal-Taixé

As a rising task, panoptic segmentation is faced with challenges in both semantic segmentation and instance segmentation. However, in terms of speed and accuracy, existing LiDAR methods in the field are still limited. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Jinke Li , Xiao He , Yang Wen , Yuan Gao , Xiaoqiang Cheng , Dan Zhang