English
Related papers

Related papers: MM-Diff: High-Fidelity Image Personalization via M…

200 papers

This paper presents innovative enhancements to diffusion models by integrating a novel multi-resolution network and time-dependent layer normalization. Diffusion models have gained prominence for their effectiveness in high-fidelity image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Qihao Liu , Zhanpeng Zeng , Ju He , Qihang Yu , Xiaohui Shen , Liang-Chieh Chen

Significant achievements in personalization of diffusion models have been witnessed. Conventional tuning-free methods mostly encode multiple reference images by averaging their image embeddings as the injection condition, but such an…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Zhuofan Zong , Dongzhi Jiang , Bingqi Ma , Guanglu Song , Hao Shao , Dazhong Shen , Yu Liu , Hongsheng Li

Multi-modality (MM) image fusion aims to render fused images that maintain the merits of different modalities, e.g., functional highlight and detailed textures. To tackle the challenge in modeling cross-modality features and decomposing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Zixiang Zhao , Haowen Bai , Jiangshe Zhang , Yulun Zhang , Shuang Xu , Zudi Lin , Radu Timofte , Luc Van Gool

Image data augmentation constitutes a critical methodology in modern computer vision tasks, since it can facilitate towards enhancing the diversity and quality of training datasets; thereby, improving the performance and robustness of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Panagiotis Alimisis , Ioannis Mademlis , Panagiotis Radoglou-Grammatikis , Panagiotis Sarigiannidis , Georgios Th. Papadopoulos

Diffusion models (DMs) have gained prominence due to their ability to generate high-quality varied images with recent advancements in text-to-image generation. The research focus is now shifting towards the controllability of DMs. A…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Enis Simsar , Alessio Tonioni , Yongqin Xian , Thomas Hofmann , Federico Tombari

While diffusion models show extraordinary talents in text-to-image generation, they may still fail to generate highly aesthetic images. More specifically, there is still a gap between the generated images and the real-world aesthetic images…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Shaojin Wu , Fei Ding , Mengqi Huang , Wei Liu , Qian He

In this work, we propose a novel framework to enable diffusion models to adapt their generation quality based on real-time network bandwidth constraints. Traditional diffusion models produce high-fidelity images by performing a fixed number…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Xi Zhang , Hanwei Zhu , Yan Zhong , Jiamang Wang , Weisi Lin

Current text-to-image diffusion models excel at generating diverse, high-quality images, yet they struggle to incorporate fine-grained camera metadata such as precise aperture settings. In this work, we introduce a novel text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Ayush Shrivastava , Connelly Barnes , Xuaner Zhang , Lingzhi Zhang , Andrew Owens , Sohrab Amirghodsi , Eli Shechtman

We propose a novel method for adjusting luminance for multi-exposure image fusion. For the adjustment, two novel scene segmentation approaches based on luminance distribution are also proposed. Multi-exposure image fusion is a method for…

Multimedia · Computer Science 2019-04-23 Yuma Kinoshita , Hitoshi Kiya

High-precision controllable remote sensing image generation is both meaningful and challenging. Existing diffusion models often produce low-fidelity images due to their inability to adequately capture morphological details, which may affect…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Ziqi Ye , Shuran Ma , Jie Yang , Xiaoyi Yang , Yi Yang , Ziyang Gong , Xue Yang , Haipeng Wang

Personalized text-to-image generation aims to synthesize images of user-provided concepts in diverse contexts. Despite recent progress in multi-concept personalization, most are limited to object concepts and struggle to customize abstract…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Weizhi Zhong , Huan Yang , Zheng Liu , Huiguo He , Zijian He , Xuesong Niu , Di Zhang , Guanbin Li

Generating consistent multiple views for 3D reconstruction tasks is still a challenge to existing image-to-3D diffusion models. Generally, incorporating 3D representations into diffusion model decrease the model's speed as well as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Emmanuelle Bourigault , Pauline Bourigault

Unified image restoration is a significantly challenging task in low-level vision. Existing methods either make tailored designs for specific tasks, limiting their generalizability across various types of degradation, or rely on training…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Huaqiu Li , Yong Wang , Tongwen Huang , Hailang Huang , Haoqian Wang , Xiangxiang Chu

With the development of diffusion-based customization methods like DreamBooth, individuals now have access to train the models that can generate their personalized images. Despite the convenience, malicious users have misused these…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Yisu Liu , Jinyang An , Wanqian Zhang , Dayan Wu , Jingzi Gu , Zheng Lin , Weiping Wang

We address the task of multi-view image editing from sparse input views, where the inputs can be seen as a mix of images capturing the scene from different viewpoints. The goal is to modify the scene according to a textual instruction while…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Daniel Gilo , Or Litany

Recent advancements in personalizing text-to-image (T2I) diffusion models have shown the capability to generate images based on personalized visual concepts using a limited number of user-provided examples. However, these models often…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Yan Hong , Jianfu Zhang

Detecting visual anomalies in diverse, multi-class real-world images is a significant challenge. We introduce \ours, a novel unsupervised multi-class visual anomaly detection framework. It integrates a Latent Diffusion Model (LDM) with a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Samet Hicsonmez , Abd El Rahman Shabayek , Djamila Aouada

We present X-MDPT ($\underline{Cross}$-view $\underline{M}$asked $\underline{D}$iffusion $\underline{P}$rediction $\underline{T}$ransformers), a novel diffusion model designed for pose-guided human image generation. X-MDPT distinguishes…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Trung X. Pham , Zhang Kang , Chang D. Yoo

Recent advancements in image motion deblurring, driven by CNNs and transformers, have made significant progress. Large-scale pre-trained diffusion models, which are rich in real-world modeling, have shown great promise for high-quality…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Xiaoyang Liu , Zhengyan Zhou , Zihang Xu , Jiezhang Cao , Zheng Chen , Yulun Zhang

Recent advancements in Unified Multimodal Models (UMMs) have enabled remarkable image understanding and generation capabilities. However, while models like Gemini-2.5-Flash-Image show emerging abilities to reason over multiple related…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Mingrui Wu , Hang Liu , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji