English
Related papers

Related papers: Multimodality Helps Few-shot 3D Point Cloud Semant…

200 papers

Few-shot object detection~(FSOD), which aims to detect novel objects with limited annotated instances, has made significant progress in recent years. However, existing methods still suffer from biased representations, especially for novel…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Zheng Wang , Yingjie Gao , Qingjie Liu , Yunhong Wang

Multimodal semantic communication has gained widespread attention due to its ability to enhance downstream task performance. A key challenge in such systems is the effective fusion of features from different modalities, which requires the…

Image and Video Processing · Electrical Eng. & Systems 2025-09-03 Haoshuo Zhang , Yufei Bo , Hongwei Zhang , Meixia Tao

Semantic segmentation of large-scale 3D point clouds is crucial for applications such as autonomous driving and urban digital twins. However, the sparse sampling pattern of LiDAR and the view-dependent geometric distortion in image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Shuai Zhang , Zhecheng Shi , Zhuxiao Li , Jing Ou , Tengxi Wang , Yuan Liu , Wufan Zhao

Effectively summarizing dense 3D point cloud data and extracting motion information of moving objects (moving object segmentation, MOS) is crucial to autonomous driving and robotics applications. How to effectively utilize motion and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Jintao Cheng , Xingming Chen , Jinxin Liang , Xiaoyu Tang , Xieyuanli Chen , Dachuan Li

This work explores the application of Federated Learning (FL) to Unsupervised Semantic image Segmentation (USS). Recent USS methods extract pixel-level features using frozen visual foundation models and refine them through self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Evangelos Charalampakis , Vasileios Mygdalis , Ioannis Pitas

Metric-based meta-learning techniques have successfully been applied to few-shot classification problems. In this paper, we propose to leverage cross-modal information to enhance metric-based few-shot learning methods. Visual and semantic…

Machine Learning · Computer Science 2020-02-19 Chen Xing , Negar Rostamzadeh , Boris N. Oreshkin , Pedro O. Pinheiro

We study few-shot semantic segmentation that aims to segment a target object from a query image when provided with a few annotated support images of the target class. Several recent methods resort to a feature masking (FM) technique to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Seonghyeon Moon , Samuel S. Sohn , Honglu Zhou , Sejong Yoon , Vladimir Pavlovic , Muhammad Haris Khan , Mubbasir Kapadia

Few-shot segmentation (FSS) aims to segment unseen classes given only a few annotated samples. Existing methods suffer the problem of feature undermining, i.e. potential novel classes are treated as background during training phase. Our…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Lihe Yang , Wei Zhuo , Lei Qi , Yinghuan Shi , Yang Gao

Few-shot semantic segmentation (FSS) aims to form class-agnostic models segmenting unseen classes with only a handful of annotations. Previous methods limited to the semantic feature and prototype representation suffer from coarse…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Bohao Peng , Zhuotao Tian , Xiaoyang Wu , Chengyao Wang , Shu Liu , Jingyong Su , Jiaya Jia

We study multi-sensor fusion for 3D semantic segmentation that is important to scene understanding for many applications, such as autonomous driving and robotics. Existing fusion-based methods, however, may not achieve promising performance…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Mingkui Tan , Zhuangwei Zhuang , Sitao Chen , Rong Li , Kui Jia , Qicheng Wang , Yuanqing Li

Few-shot semantic segmentation (FSS) aims to form class-agnostic models segmenting unseen classes with only a handful of annotations. Previous methods limited to the semantic feature and prototype representation suffer from coarse…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Bohao Peng , Zhuotao Tian , Xiaoyang Wu , Chenyao Wang , Shu Liu , Jingyong Su , Jiaya Jia

Few-shot semantic segmentation (FSS) methods have shown great promise in handling data-scarce scenarios, particularly in medical image segmentation tasks. However, most existing FSS architectures lack sufficient interpretability and fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Shengdong Zhang , Fan Jia , Xiang Li , Hao Zhang , Jun Shi , Liyan Ma , Shihui Ying

Few-shot segmentation (FSS) expects models trained on base classes to work on novel classes with the help of a few support images. However, when there exists a domain gap between the base and novel classes, the state-of-the-art FSS methods…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yuhang Lu , Xinyi Wu , Zhenyao Wu , Song Wang

LiDAR and camera are two modalities available for 3D semantic segmentation in autonomous driving. The popular LiDAR-only methods severely suffer from inferior segmentation on small and distant objects due to insufficient laser points, while…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Jiale Li , Hang Dai , Hao Han , Yong Ding

Multimodal semantic communication has great potential to enhance downstream task performance by integrating complementary information across modalities. This paper introduces ProMSC-MIS, a novel Prompt-based Multimodal Semantic…

Multimedia · Computer Science 2025-08-28 Haoshuo Zhang , Yufei Bo , Meixia Tao

Multimodal remote sensing data, acquired from diverse sensors, offer a comprehensive and integrated perspective of the Earth's surface. Leveraging multimodal fusion techniques, semantic segmentation enables detailed and accurate analysis of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Xianping Ma , Xiaokang Zhang , Man-On Pun , Bo Huang

The automatic semantic segmentation of the huge amount of acquired remote sensing data has become an important task in the last decade. Images and Point Clouds (PCs) are fundamental data representations, particularly in urban mapping…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Dominik Laupheimer , Norbert Haala

We propose Sym-Net, a novel framework for Few-Shot Segmentation (FSS) that addresses the critical issue of intra-class variation by jointly learning both query and support prototypes in a symmetrical manner. Unlike previous methods that…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Qun Li , Baoquan Sun , Fu Xiao , Yonggang Qi , Bir Bhanu

3D point clouds are rich in geometric structure information, while 2D images contain important and continuous texture information. Combining 2D information to achieve better 3D semantic segmentation has become mainstream in 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Chaolong Yang , Yuyao Yan , Weiguang Zhao , Jianan Ye , Xi Yang , Amir Hussain , Kaizhu Huang

Recognizing 3D part instances from a 3D point cloud is crucial for 3D structure and scene understanding. Several learning-based approaches use semantic segmentation and instance center prediction as training tasks and fail to further…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Chunyu Sun , Xin Tong , Yang Liu