English
Related papers

Related papers: HS-Diffusion: Semantic-Mixing Diffusion for Head S…

200 papers

Fusion-based hyperspectral image (HSI) super-resolution aims to produce a high-spatial-resolution HSI by fusing a low-spatial-resolution HSI and a high-spatial-resolution multispectral image. Such a HSI super-resolution process can be…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Jianjun Liu , Zebin Wu , Liang Xiao

Brain signal visualization has emerged as an active research area, serving as a critical interface between the human visual system and computer vision models. Although diffusion models have shown promise in analyzing functional magnetic…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Bohan Zeng , Shanglin Li , Xuhui Liu , Sicheng Gao , Xiaolong Jiang , Xu Tang , Yao Hu , Jianzhuang Liu , Baochang Zhang

Diffusion models have shown promise in text generation, but often struggle with generating long, coherent, and contextually accurate text. Token-level diffusion doesn't model word-order dependencies explicitly and operates on short, fixed…

Computation and Language · Computer Science 2025-05-27 Xiaochen Zhu , Georgi Karadzhov , Chenxi Whitehouse , Andreas Vlachos

Applying pre-trained generative denoising diffusion models (DDMs) for downstream tasks such as image semantic editing usually requires either fine-tuning DDMs or learning auxiliary editing networks in the existing literature. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Ye Zhu , Yu Wu , Zhiwei Deng , Olga Russakovsky , Yan Yan

The advance of generative models for images has inspired various training techniques for image recognition utilizing synthetic images. In semantic segmentation, one promising approach is extracting pseudo-masks from attention maps in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Ryota Yoshihashi , Yuya Otsuka , Kenji Doi , Tomohiro Tanaka , Hirokatsu Kataoka

To achieve continuous massive data transmission with significantly reduced data payload, the users can adopt semantic communication techniques to compress the redundant information by transmitting semantic features instead. However, current…

Signal Processing · Electrical Eng. & Systems 2024-01-30 Youcheng Zeng , Xinxin He , Xu Chen , Haonan Tong , Zhaohui Yang , Yijun Guo , Jianjun Hao

Denoising diffusion probabilistic models for image inpainting aim to add the noise to the texture of image during the forward process and recover masked regions with unmasked ones of the texture via the reverse denoising process. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Haipeng Liu , Yang Wang , Biao Qian , Meng Wang , Yong Rui

Large-scale text-to-image models that can generate high-quality and diverse images based on textual prompts have shown remarkable success. These models aim ultimately to create complex scenes, and addressing the challenge of multi-subject…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Barak Battash , Amit Rozner , Lior Wolf , Ofir Lindenbaum

Denoising Diffusion Models (DDMs) have emerged as a strong competitor to Generative Adversarial Networks (GANs). However, despite their widespread use in image synthesis and editing applications, their latent space is still not as well…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 René Haas , Inbar Huberman-Spiegelglas , Rotem Mulayoff , Stella Graßhof , Sami S. Brandt , Tomer Michaeli

Transition Matching (TM) is an emerging paradigm for generative modeling that generalizes diffusion and flow-matching models as well as continuous-state autoregressive models. TM, similar to previous paradigms, gradually transforms noise…

Machine Learning · Computer Science 2025-12-16 Uriel Singer , Yaron Lipman

Traditional adversarial attacks concentrate on manipulating clean examples in the pixel space by adding adversarial perturbations. By contrast, semantic adversarial attacks focus on changing semantic attributes of clean examples, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Chenan Wang , Jinhao Duan , Chaowei Xiao , Edward Kim , Matthew Stamm , Kaidi Xu

We study the problem of generating intermediate images from image pairs with large motion while maintaining semantic consistency. Due to the large motion, the intermediate semantic information may be absent in input images. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Liao Shen , Tianqi Liu , Huiqiang Sun , Xinyi Ye , Baopu Li , Jianming Zhang , Zhiguo Cao

Many visual scenes can be described as compositions of latent factors. Effective recognition, reasoning, and editing often require not only forming such compositional representations, but also solving the decomposition problem. One popular…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Calvin Yeung , Ali Zakeri , Zhuowen Zou , Mohsen Imani

Preparing training data for deep vision models is a labor-intensive task. To address this, generative models have emerged as an effective solution for generating synthetic data. While current generative models produce image-level category…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Quang Nguyen , Truong Vu , Anh Tran , Khoi Nguyen

Significant disparities between the features of natural images and those inherent to histopathological images make it challenging to directly apply and transfer pre-trained models from natural images to histopathology tasks. Moreover, the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zhenfeng Zhuang , Min Cen , Yanfeng Li , Fangyu Zhou , Lequan Yu , Baptiste Magnier , Liansheng Wang

Structural guidance in an image-to-image translation allows intricate control over the shapes of synthesized images. Generating high-quality realistic images from user-specified rough hand-drawn sketches is one such task that aims to impose…

Graphics · Computer Science 2025-02-24 Prasun Roy , Saumik Bhattacharya , Subhankar Ghosh , Umapada Pal , Michael Blumenstein

Generating high-resolution images with generative models has recently been made widely accessible by leveraging diffusion models pre-trained on large-scale datasets. Various techniques, such as MultiDiffusion and SyncDiffusion, have further…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Stanislav Frolov , Brian B. Moser , Andreas Dengel

Diffusion models have demonstrated remarkable performance in image and video synthesis. However, scaling them to high-resolution inputs is challenging and requires restructuring the diffusion pipeline into multiple independent components,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Ivan Skorokhodov , Willi Menapace , Aliaksandr Siarohin , Sergey Tulyakov

In this paper, we introduce DreamID, a diffusion-based face swapping model that achieves high levels of ID similarity, attribute preservation, image fidelity, and fast inference speed. Unlike the typical face swapping training process,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Fulong Ye , Miao Hua , Pengze Zhang , Xinghui Li , Qichao Sun , Songtao Zhao , Qian He , Xinglong Wu

Despite the remarkable generative capabilities of diffusion models, their integration into safety-critical or scientifically rigorous applications remains hindered by the need to ensure compliance with stringent physical, structural, and…

Machine Learning · Computer Science 2025-06-03 Jacob K. Christopher , Michael Cardei , Jinhao Liang , Ferdinando Fioretto