English
Related papers

Related papers: Assessing Open-world Forgetting in Generative Imag…

200 papers

Recent progress in personalized image generation using diffusion models has been significant. However, development in the area of open-domain and non-fine-tuning personalized image generation is proceeding rather slowly. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Jian Ma , Junhao Liang , Chen Chen , Haonan Lu

Generative models such as diffusion have been employed as world models in offline reinforcement learning to generate synthetic data for more effective learning. Existing work either generates diffusion models one-time prior to training or…

Machine Learning · Computer Science 2024-05-31 Zeyu Fang , Tian Lan

Large text-to-image diffusion models have demonstrated remarkable image synthesis capabilities, but their indiscriminate training on Internet-scale data has led to learned concepts that enable harmful, copyrighted, or otherwise undesirable…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Finn Carter

Image generation in the fashion domain has predominantly focused on preserving body characteristics or following input prompts, but little attention has been paid to improving the inherent fashionability of the output images. This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Qice Qin , Yuki Hirakawa , Ryotaro Shimizu , Takuya Furusawa , Edgar Simo-Serra

Masked (or absorbing) diffusion is actively explored as an alternative to autoregressive models for generative modeling of discrete data. However, existing work in this area has been hindered by unnecessarily complex model formulations and…

Machine Learning · Computer Science 2025-01-17 Jiaxin Shi , Kehang Han , Zhe Wang , Arnaud Doucet , Michalis K. Titsias

Few-shot image classification remains challenging due to the scarcity of labeled training examples. Augmenting them with synthetic data has emerged as a promising way to alleviate this issue, but models trained on synthetic samples often…

Machine Learning · Computer Science 2025-06-26 Lan-Cuong Nguyen , Quan Nguyen-Tri , Bang Tran Khanh , Dung D. Le , Long Tran-Thanh , Khoat Than

Human body restoration plays a vital role in various applications related to the human body. Despite recent advances in general image restoration using generative models, their performance in human body restoration remains mediocre, often…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Yiming Zhang , Zhe Wang , Xinjie Li , Yunchen Yuan , Chengsong Zhang , Xiao Sun , Zhihang Zhong , Jian Wang

Text-to-image diffusion models sometimes depict blended concepts in the generated images. One promising use case of this effect would be the nonword-to-image generation task which attempts to generate images intuitively imaginable from a…

Multimedia · Computer Science 2024-11-07 Chihaya Matsuhira , Marc A. Kastner , Takahiro Komamizu , Takatsugu Hirayama , Ichiro Ide

Text-guided diffusion models have revolutionized generative tasks by producing high-fidelity content from text descriptions. They have also enabled an editing paradigm where concepts can be replaced through text conditioning (e.g., a dog to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Chao Huang , Susan Liang , Yunlong Tang , Yapeng Tian , Anurag Kumar , Chenliang Xu

As large-scale diffusion models continue to advance, they excel at producing high-quality images but often generate unwanted content, such as sexually explicit or violent content. Existing methods for concept removal generally guide the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Lingyun Zhang , Yu Xie , Yanwei Fu , Ping Chen

Novel view synthesis has observed tremendous developments since the arrival of NeRFs. However, Nerf models overfit on a single scene, lacking generalization to out of distribution objects. Recently, diffusion models have exhibited…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Rukhshanda Hussain , Hui Xian Grace Lim , Borchun Chen , Mubarak Shah , Ser Nam Lim

Recent advancements in large scale text-to-image models have opened new possibilities for guiding the creation of images through human-devised natural language. However, while prior literature has primarily focused on the generation of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Hyeonho Jeong , Gihyun Kwon , Jong Chul Ye

Recent breakthroughs in diffusion models have exhibited exceptional image-generation capabilities. However, studies show that some outputs are merely replications of training data. Such replications present potential legal challenges for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Yuxin Wen , Yuchen Liu , Chen Chen , Lingjuan Lyu

This paper's primary objective is to develop a robust generalist perception model capable of addressing multiple tasks under constraints of computational resources and limited training data. We leverage text-to-image diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Canyu Zhao , Yanlong Sun , Mingyu Liu , Huanyi Zheng , Muzhi Zhu , Zhiyue Zhao , Hao Chen , Tong He , Chunhua Shen

Deep learning models suffer from catastrophic forgetting when being fine-tuned with samples of new classes. This issue becomes even more pronounced when faced with the domain shift between training and testing data. In this paper, we study…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Can Peng , Piotr Koniusz , Kaiyu Guo , Brian C. Lovell , Peyman Moghadam

Deep learning-based image generation has seen significant advancements with diffusion models, notably improving the quality of generated images. Despite these developments, generating images with unseen characteristics beneficial for…

Test-time adaptation enables models to adapt to evolving domains. However, balancing the tradeoff between preserving knowledge and adapting to domain shifts remains challenging for model adaptation methods, since adapting to domain shifts…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Gabriel Tjio , Jie Zhang , Xulei Yang , Yun Xing , Nhat Chung , Xiaofeng Cao , Ivor W. Tsang , Chee Keong Kwoh , Qing Guo

In recent years, diffusion models have achieved tremendous success in the field of image generation, becoming the stateof-the-art technology for AI-based image processing applications. Despite the numerous benefits brought by recent…

Machine Learning · Computer Science 2023-08-08 Derui Zhu , Dingfan Chen , Jens Grossklags , Mario Fritz

Out-of-Domain (OOD) generalization is the ability of a model trained on one or more domains to generalize to unseen domains. In the ImageNet era of computer vision, evaluation sets for measuring a model's OOD performance were designed to be…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Prasanna Mayilvahanan , Roland S. Zimmermann , Thaddäus Wiedemer , Evgenia Rusak , Attila Juhos , Matthias Bethge , Wieland Brendel

Detecting out-of-distribution (OOD) inputs is pivotal for deploying safe vision systems in open-world environments. We revisit diffusion models, not as generators, but as universal perceptual templates for OOD detection. This research…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Lemar Abdi , Amaan Valiuddin , Francisco Caetano , Christiaan Viviers , Fons van der Sommen