English
Related papers

Related papers: Distillation Learning Guided by Image Reconstructi…

200 papers

The rapid progress of generative models such as GANs and diffusion models has led to the widespread proliferation of AI-generated images, raising concerns about misinformation, privacy violations, and trust erosion in digital media.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Jiazhen Yan , Ziqiang Li , Fan Wang , Boyu Wang , Ziwen He , Zhangjie Fu

Denoising diffusion models have found applications in image segmentation by generating segmented masks conditioned on images. Existing studies predominantly focus on adjusting model architecture or improving inference, such as test-time…

Image and Video Processing · Electrical Eng. & Systems 2023-12-11 Yunguan Fu , Yiwen Li , Shaheer U Saeed , Matthew J Clarkson , Yipeng Hu

Recent approaches have shown promises distilling diffusion models into efficient one-step generators. Among them, Distribution Matching Distillation (DMD) produces one-step generators that match their teacher in distribution, without…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Tianwei Yin , Michaël Gharbi , Taesung Park , Richard Zhang , Eli Shechtman , Fredo Durand , William T. Freeman

In the field of medical image segmentation, tackling Out-of-Distribution (OOD) segmentation tasks in a cost-effective manner remains a significant challenge. Universal segmentation models is a solution, which aim to generalize across the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Lingdong Shen , Fangxin Shang , Xiaoshuang Huang , Yehui Yang , Haifeng Huang , Shiming Xiang

Image segmentation, the process of dividing images into meaningful regions, is critical in medical applications for accurate diagnosis, treatment planning, and disease monitoring. Although manual segmentation by healthcare professionals…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Salma J. Ahmed , Emad A. Mohammed , Azam Asilian Bidgoli

Widely adopted medical image segmentation methods, although efficient, are primarily deterministic and remain poorly amenable to natural language prompts. Thus, they lack the capability to estimate multiple proposals, human interaction, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yuan Lin , Murong Xu , Marc Hölle , Chinmay Prabhakar , Andreas Maier , Vasileios Belagiannis , Bjoern Menze , Suprosanna Shit

Knowledge distillation allows transferring knowledge from a pre-trained model to another. However, it suffers from limitations, and constraints related to the two models need to be architecturally similar. Knowledge distillation addresses…

Image and Video Processing · Electrical Eng. & Systems 2020-09-03 Sajjad Abbasi , Mohsen Hajabdollahi , Pejman Khadivi , Nader Karimi , Roshanak Roshandel , Shahram Shirani , Shadrokh Samavi

Cross-Domain Few-Shot Semantic Segmentation (CD-FSS) seeks to segment unknown classes in unseen domains using only a few annotated examples. This setting is inherently challenging: source and target domains exhibit substantial distribution…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Pasquale De Marinis , Pieter M. Blok , Uzay Kaymak , Rogier Brussee , Gennaro Vessio , Giovanna Castellano

Interpreting the predictions of a black-box deep network can facilitate the reliability of its deployment. In this work, we propose a re-label distillation approach to learn a direct map from the input to the prediction in a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Yingying Hua , Shiming Ge , Daichi Zhang

Diffusion models have shown impressive performance for generative modelling of images. In this paper, we present a novel semantic segmentation method based on diffusion models. By modifying the training and sampling scheme, we show that…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Julia Wolleb , Robin Sandkühler , Florentin Bieder , Philippe Valmaggia , Philippe C. Cattin

Accurate medical image segmentation is fundamental to precision medicine, yet robust delineation remains challenging under heterogeneous appearances, ambiguous boundaries, and large anatomical variability. Similar intensity and texture…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zhiquan Chen , Haitao Wang , Guowei Zou , Hejun Wu

Segmentation is a fundamental task in medical image analysis. However, most existing methods focus on primary region extraction and ignore edge information, which is useful for obtaining accurate segmentation. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2019-07-26 Zhijie Zhang , Huazhu Fu , Hang Dai , Jianbing Shen , Yanwei Pang , Ling Shao

Recent research has found that knowledge distillation can be effective in reducing the size of a network and in increasing generalization. A pre-trained, large teacher network, for example, was shown to be able to bootstrap a student model…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Hyun Seung Lee , Christian Wallraven

Staining is essential in cell imaging and medical diagnostics but poses significant challenges, including high cost, time consumption, labor intensity, and irreversible tissue alterations. Recent advances in deep learning have enabled…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Ziwang Xu , Lanqing Guo , Satoshi Tsutsui , Shuyan Zhang , Alex C. Kot , Bihan Wen

We study the problem of dataset distillation - creating a small set of synthetic examples capable of training a good model. In particular, we study the problem of label distillation - creating synthetic labels for a small set of real…

Machine Learning · Computer Science 2020-12-15 Ondrej Bohdal , Yongxin Yang , Timothy Hospedales

Deep learning based models, generally, require a large number of samples for appropriate training, a requirement that is difficult to satisfy in the medical field. This issue can usually be avoided with a proper initialization of the…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Taibou Birgui Sekou , Moncef Hidane , Julien Olivier , Hubert Cardot

Cross-modal medical image segmentation presents a significant challenge, as different imaging modalities produce images with varying resolutions, contrasts, and appearances of anatomical structures. We introduce compositionality as an…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Aniek Eijpe , Valentina Corbetta , Kalina Chupetlovska , Regina Beets-Tan , Wilson Silva

In incremental classification tasks for hyperspectral images, catastrophic forgetting is an unavoidable challenge. While memory recall methods can mitigate this issue, they heavily rely on samples from old categories. This paper proposes a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Songfeng Zhu

Medical image annotation is constrained by privacy concerns and labor-intensive labeling, significantly limiting the performance and generalization of segmentation models. While mask-controllable diffusion models excel in synthesis, they…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Kunpeng Qiu , Zhiying Zhou , Yongxin Guo

The joint utilization of diverse data sources for medical imaging segmentation has emerged as a crucial area of research, aiming to address challenges such as data heterogeneity, domain shift, and data quality discrepancies. Integrating…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Eddardaa B. Loussaief , Mohammed Ayad , Domenc Puig , Hatem A. Rashwan