English
Related papers

Related papers: EmerDiff: Emerging Pixel-level Semantic Knowledge …

200 papers

Diffusion models have been shown to be capable of generating high-quality images, suggesting that they could contain meaningful internal representations. Unfortunately, the feature maps that encode a diffusion model's internal information…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Grace Luo , Lisa Dunlap , Dong Huk Park , Aleksander Holynski , Trevor Darrell

Medical image segmentation has been significantly advanced with the rapid development of deep learning (DL) techniques. Existing DL-based segmentation models are typically discriminative; i.e., they aim to learn a mapping from the input…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Tao Chen , Chenhui Wang , Zhihao Chen , Yiming Lei , Hongming Shan

Diffusion Probabilistic Models (DPMs) suffer from inefficient inference due to their slow sampling and high memory consumption, which limits their applicability to various medical imaging applications. In this work, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Fahim Ahmed Zaman , Mathews Jacob , Amanda Chang , Kan Liu , Milan Sonka , Xiaodong Wu

Image generation has recently seen tremendous advances, with diffusion models allowing to synthesize convincing images for a large variety of text prompts. In this article, we propose DiffEdit, a method to take advantage of text-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Guillaume Couairon , Jakob Verbeek , Holger Schwenk , Matthieu Cord

Given the inherently costly and time-intensive nature of pixel-level annotation, the generation of synthetic datasets comprising sufficiently diverse synthetic images paired with ground-truth pixel-level annotations has garnered increasing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Haoyu Wang , Lei Zhang , Wenrui Liu , Dengyang Jiang , Wei Wei , Chen Ding

In recent years, semantic segmentation has become a pivotal tool in processing and interpreting satellite imagery. Yet, a prevalent limitation of supervised learning techniques remains the need for extensive manual annotations by experts.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Aysim Toker , Marvin Eisenberger , Daniel Cremers , Laura Leal-Taixé

Semantic segmentation necessitates approaches that learn high-level characteristics while dealing with enormous amounts of data. Convolutional neural networks (CNNs) can learn unique and adaptive features to achieve this aim. However, due…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Hasan AlMarzouqi , Lyes Saad Saoud

Diffusion-based image super-resolution (SR) methods have demonstrated remarkable performance. Recent advancements have introduced deterministic sampling processes that reduce inference from 15 iterative steps to a single step, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Zihang Liu , Zhenyu Zhang , Hao Tang

The Diffusion Probabilistic Model (DPM) has recently gained popularity in the field of computer vision, thanks to its image generation applications, such as Imagen, Latent Diffusion Models, and Stable Diffusion, which have demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2023-12-27 Junde Wu , Wei Ji , Huazhu Fu , Min Xu , Yueming Jin , Yanwu Xu

Real-world image super-resolution (Real-ISR) has achieved a remarkable leap by leveraging large-scale text-to-image models, enabling realistic image restoration from given recognition textual prompts. However, these methods sometimes fail…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Jiahua Xiao , Jiawei Zhang , Dongqing Zou , Xiaodan Zhang , Jimmy Ren , Xing Wei

Semantic communication is expected to be one of the cores of next-generation AI-based communications. One of the possibilities offered by semantic communication is the capability to regenerate, at the destination side, images or videos…

Artificial Intelligence · Computer Science 2026-05-18 Eleonora Grassucci , Sergio Barbarossa , Danilo Comminiello

Deep Neural Networks (DNNs) have recently shown state of the art performance on semantic segmentation tasks, however, they still suffer from problems of poor boundary localization and spatial fragmented predictions. The difficulties lie in…

Computer Vision and Pattern Recognition · Computer Science 2018-10-29 Peng Jiang , Fanglin Gu , Yunhai Wang , Changhe Tu , Baoquan Chen

Diffusion models, known for their powerful generative capabilities, play a crucial role in addressing real-world super-resolution challenges. However, these models often focus on improving local textures while neglecting the impacts of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Chunyang Bi , Xin Luo , Sheng Shen , Mengxi Zhang , Huanjing Yue , Jingyu Yang

Introducing explicit constraints on the structural predictions has been an effective way to improve the performance of semantic segmentation models. Existing methods are mainly based on insufficient hand-crafted rules that only partially…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Boxi Wu , Shuai Zhao , Wenqing Chu , Zheng Yang , Deng Cai

Skin lesion segmentation plays a critical role in the early detection and accurate diagnosis of dermatological conditions. Denoising Diffusion Probabilistic Models (DDPMs) have recently gained attention for their exceptional…

Image and Video Processing · Electrical Eng. & Systems 2023-08-08 Afshin Bozorgpour , Yousef Sadegheih , Amirhossein Kazerouni , Reza Azad , Dorit Merhof

Significant strides have been made using large vision-language models, like Stable Diffusion (SD), for a variety of downstream tasks, including image editing, image correspondence, and 3D shape generation. Inspired by these advancements, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Aliasghar Khani , Saeid Asgari Taghanaki , Aditya Sanghi , Ali Mahdavi Amiri , Ghassan Hamarneh

Diffusion models have recently achieved significant success in various image manipulation tasks, including image super-resolution and perceptual quality enhancement. Pretrained text-to-image models, such as Stable Diffusion, have exhibited…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Sanchar Palit , Subhasis Chaudhuri , Biplab Banerjee

The Diffusion Model has not only garnered noteworthy achievements in the realm of image generation but has also demonstrated its potential as an effective pretraining method utilizing unlabeled data. Drawing from the extensive potential…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Muzhi Zhu , Yang Liu , Zekai Luo , Chenchen Jing , Hao Chen , Guangkai Xu , Xinlong Wang , Chunhua Shen

The performance of deep networks for semantic image segmentation largely depends on the availability of large-scale training images which are labelled at the pixel level. Typically, such pixel-level image labellings are obtained manually by…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Xiang Zhang , Wei Zhang , Jinye Peng , Jianping Fan

Training a Convolutional Neural Network (CNN) for semantic segmentation typically requires to collect a large amount of accurate pixel-level annotations, a hard and expensive task. In contrast, simple image tags are easier to gather. With…

Computer Vision and Pattern Recognition · Computer Science 2019-02-25 Carolina Redondo-Cabrera , Marcos Baptista-Ríos , Roberto J. López-Sastre