English
Related papers

Related papers: FakeInversion: Learning to Detect Images from Unse…

200 papers

A dramatic influx of diffusion-generated images has marked recent years, posing unique challenges to current detection technologies. While the task of identifying these images falls under binary classification, a seemingly straightforward…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yewon Lim , Changyeon Lee , Aerin Kim , Oren Etzioni

Diffusion models demonstrate impressive image generation performance with text guidance. Inspired by the learning process of diffusion, existing images can be edited according to text by DDIM inversion. However, the vanilla DDIM inversion…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qi Qian , Haiyang Xu , Ming Yan , Juhua Hu

We fine-tuned a foundational stable diffusion model using X-ray scattering images and their corresponding descriptions to generate new scientific images from given prompts. However, some of the generated images exhibit significant…

Image and Video Processing · Electrical Eng. & Systems 2024-08-26 Zhuowen Zhao , Xiaoya Chong , Tanny Chavez , Alexander Hexemer

Diffusion models recently have been successfully applied for the visual synthesis of strikingly realistic appearing images. This raises strong concerns about their potential for malicious purposes. In this paper, we propose using the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Peter Lorenz , Ricard Durall , Janis Keuper

Despite recent advances in inversion-based editing, text-guided image manipulation remains challenging for diffusion models. The primary bottlenecks include 1) the time-consuming nature of the inversion process; 2) the struggle to balance…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Sihan Xu , Yidong Huang , Jiayi Pan , Ziqiao Ma , Joyce Chai

Diffusion-based generative models' impressive ability to create convincing images has garnered global attention. However, their complex internal structures and operations often pose challenges for non-experts to grasp. We introduce…

Human-Computer Interaction · Computer Science 2024-04-26 Seongmin Lee , Benjamin Hoover , Hendrik Strobelt , Zijie J. Wang , ShengYun Peng , Austin Wright , Kevin Li , Haekyu Park , Haoyang Yang , Polo Chau

We present a novel approach to leverage prior knowledge encapsulated in pre-trained text-to-image diffusion models for blind super-resolution (SR). Specifically, by employing our time-aware encoder, we can achieve promising restoration…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Jianyi Wang , Zongsheng Yue , Shangchen Zhou , Kelvin C. K. Chan , Chen Change Loy

Generative AI models have recently achieved astonishing results in quality and are consequently employed in a fast-growing number of applications. However, since they are highly data-driven, relying on billion-sized datasets randomly…

Diffusion models gain increasing popularity for their generative capabilities. Recently, there have been surging needs to generate customized images by inverting diffusion models from exemplar images, and existing inversion methods mainly…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Ziqi Huang , Tianxing Wu , Yuming Jiang , Kelvin C. K. Chan , Ziwei Liu

Image-to-image translation (I2I), and particularly its subfield of appearance transfer, which seeks to alter the visual appearance between images while maintaining structural coherence, presents formidable challenges. Despite significant…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Yuteng Ye , Guanwen Li , Hang Zhou , Cai Jiale , Junqing Yu , Yawei Luo , Zikai Song , Qilong Xing , Youjia Zhang , Wei Yang

Despite the remarkable success, recent reconstruction-based anomaly detection (AD) methods via diffusion modeling still involve fine-grained noise-strength tuning and computationally expensive multi-step denoising, leading to a fundamental…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Shunsuke Sakai , Xiangteng He , Chunzhi Gu , Leonid Sigal , Tatsuhito Hasegawa

As latent diffusion models (LDMs) democratize image generation capabilities, there is a growing need to detect fake images. A good detector should focus on the generative models fingerprints while ignoring image properties such as semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Anirudh Sundara Rajan , Utkarsh Ojha , Jedidiah Schloesser , Yong Jae Lee

Diffusion models have established new state of the art in a multitude of computer vision tasks, including image restoration. Diffusion-based inverse problem solvers generate reconstructions of exceptional visual quality from heavily…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Zalan Fabian , Berk Tinaz , Mahdi Soltanolkotabi

Detecting fake images is becoming a major goal of computer vision. This need is becoming more and more pressing with the continuous improvement of synthesis methods based on Generative Adversarial Networks (GAN), and even more with the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Riccardo Corvi , Davide Cozzolino , Giovanni Poggi , Koki Nagano , Luisa Verdoliva

Recent progress in text-to-image (TTI) systems, such as StableDiffusion, Imagen, and DALL-E 2, have made it possible to create realistic images with simple text prompts. It is tempting to use these systems to eliminate the manual task of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 David Marwood , Shumeet Baluja , Yair Alon

Recent text-to-image diffusion models have shown surprising performance in generating high-quality images. However, concerns have arisen regarding the unauthorized data usage during the training or fine-tuning process. One example is when a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Zhenting Wang , Chen Chen , Lingjuan Lyu , Dimitris N. Metaxas , Shiqing Ma

Large-scale text-to-image models have demonstrated amazing ability to synthesize diverse and high-fidelity images. However, these models are often violated by several limitations. Firstly, they require the user to provide precise and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yupei Lin , Sen Zhang , Xiaojun Yang , Xiao Wang , Yukai Shi

Driven by the new generation of multi-modal large models, such as Stable Diffusion (SD), image manipulation technologies have advanced rapidly, posing significant challenges to image forensics. However, existing image forgery localization…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yang Su , Shunquan Tan , Jiwu Huang

The remarkable progress in neural-network-driven visual data generation, especially with neural rendering techniques like Neural Radiance Fields and 3D Gaussian splatting, offers a powerful alternative to GANs and diffusion models. These…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Chengdong Dong , Vijayakumar Bhagavatula , Zhenyu Zhou , Ajay Kumar

The rapid development of text-to-image generation has brought rising ethical considerations, especially regarding gender bias. Given a text prompt as input, text-to-image models generate images according to the prompt. Pioneering models…

Computers and Society · Computer Science 2024-08-22 Yankun Wu , Yuta Nakashima , Noa Garcia