English
Related papers

Related papers: DifFSS: Diffusion Model for Few-Shot Semantic Segm…

200 papers

Semantic segmentation models have two fundamental weaknesses: i) they require large training sets with costly pixel-level annotations, and ii) they have a static output space, constrained to the classes of the training set. Toward…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Fabio Cermelli , Massimiliano Mancini , Yongqin Xian , Zeynep Akata , Barbara Caputo

Infrared (IR) imaging is commonly used in various scenarios, including autonomous driving, fire safety and defense applications. Thus, semantic segmentation of such images is of great interest. However, this task faces several challenges,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Junno Yun , Mehmet Akçakaya

Generative diffusion models, famous for their performance in image generation, are popular in various cross-domain applications. However, their use in the communication community has been mostly limited to auxiliary tasks like data modeling…

Networking and Internet Architecture · Computer Science 2025-03-11 Ruihuai Liang , Bo Yang , Zhiwen Yu , Bin Guo , Xuelin Cao , Mérouane Debbah , H. Vincent Poor , Chau Yuen

In semantic segmentation, accurate prediction masks are crucial for downstream tasks such as medical image analysis and image editing. Due to the lack of annotated data, few-shot semantic segmentation (FSS) performs poorly in predicting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Chen-Bin Feng , Qi Lai , Kangdao Liu , Houcheng Su , Chi-Man Vong

We present Diff3F as a simple, robust, and class-agnostic feature descriptor that can be computed for untextured input shapes (meshes or point clouds). Our method distills diffusion features from image foundational models onto input shapes.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Niladri Shekhar Dutt , Sanjeev Muralikrishnan , Niloy J. Mitra

Few-shot segmentation (FSS) methods perform image segmentation for a particular object class in a target (query) image, using a small set of (support) image-mask pairs. Recent deep neural network based FSS methods leverage high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Siddhartha Gairola , Mayur Hemani , Ayush Chopra , Balaji Krishnamurthy

Few-shot semantic segmentation (FSS) aims to segment objects of unseen classes in query images with only a few annotated support images. Existing FSS algorithms typically focus on mining category representations from the single-view support…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Qinglong Cao , Yuntian Chen , Chao Ma , Xiaokang Yang

Diffusion models, a powerful and universal generative AI technology, have achieved tremendous success in computer vision, audio, reinforcement learning, and computational biology. In these applications, diffusion models provide flexible…

Machine Learning · Computer Science 2024-04-12 Minshuo Chen , Song Mei , Jianqing Fan , Mengdi Wang

Denosing diffusion model, as a generative model, has received a lot of attention in the field of image generation recently, thanks to its powerful generation capability. However, diffusion models have not yet received sufficient research in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 ZiHan Cao , ShiQi Cao , Xiao Wu , JunMing Hou , Ran Ran , Liang-Jian Deng

Segmentation refinement aims to enhance the initial coarse masks generated by segmentation algorithms. The refined masks are expected to capture more details and better contours of the target objects. Research on segmentation refinement has…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Seonghyeon Moon , Qingze , Liu , Haein Kong , Muhammad Haris Khan

Text-based image segmentation aims to delineate object boundaries within an image from text prompts, offering higher flexibility and broader application scope compared to traditional fixed-category segmentation tasks. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Zishen Qu , Xuesong Li , Haijian Gu , Hongwei Kang , Quan Meng , Tianrui Niu , Xin Yang , Ruidong Pan

Existing segmentation models trained on a single medical imaging dataset often lack robustness when encountering unseen organs or tumors. Developing a robust model capable of identifying rare or novel tumor categories not present during…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Rong Wu , Ziqi Chen , Liming Zhong , Heng Li , Hai Shu

The evolution of semantic segmentation has long been dominated by learning more discriminative image representations for classifying each pixel. Despite the prominent advancements, the priors of segmentation masks themselves, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Zeqiang Lai , Yuchen Duan , Jifeng Dai , Ziheng Li , Ying Fu , Hongsheng Li , Yu Qiao , Wenhai Wang

Recent advancements in deep learning for medical image segmentation are often limited by the scarcity of high-quality training data.While diffusion models provide a potential solution by generating synthetic images, their effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jianhao Xie , Ziang Zhang , Zhenyu Weng , Yuesheng Zhu , Guibo Luo

Few-shot segmentation (FSS) expects models trained on base classes to work on novel classes with the help of a few support images. However, when there exists a domain gap between the base and novel classes, the state-of-the-art FSS methods…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yuhang Lu , Xinyi Wu , Zhenyao Wu , Song Wang

Learning from a large corpus of data, pre-trained models have achieved impressive progress nowadays. As popular generative pre-training, diffusion models capture both low-level visual knowledge and high-level semantic relations. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Chaofan Ma , Yuhuan Yang , Chen Ju , Fei Zhang , Jinxiang Liu , Yu Wang , Ya Zhang , Yanfeng Wang

Collecting and annotating images with pixel-wise labels is time-consuming and laborious. In contrast, synthetic data can be freely available using a generative model (e.g., DALL-E, Stable Diffusion). In this paper, we show that it is…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Weijia Wu , Yuzhong Zhao , Mike Zheng Shou , Hong Zhou , Chunhua Shen

Few-Shot Segmentation (FSS) aims to segment novel classes using only a few annotated images. Despite considerable progress under pixel-wise support annotation, current FSS methods still face three issues: the inflexibility of backbone…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Shuai Chen , Fanman Meng , Chenhao Wu , Haoran Wei , Runtong Zhang , Qingbo Wu , Linfeng Xu , Hongliang Li

Few-shot Semantic Segmentation (FSS) aims to adapt a pretrained model to new classes with as few as a single labelled training sample per class. Despite the prototype based approaches have achieved substantial success, existing models are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Song Tang , Shaxu Yan , Xiaozhi Qi , Jianxin Gao , Mao Ye , Jianwei Zhang , Xiatian Zhu

Diffusion-based image super-resolution (SR) methods have demonstrated remarkable performance. Recent advancements have introduced deterministic sampling processes that reduce inference from 15 iterative steps to a single step, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Zihang Liu , Zhenyu Zhang , Hao Tang