中文
相关论文

相关论文: FlexEdit: Flexible and Controllable Diffusion-base…

200 篇论文

While 2D diffusion models have achieved remarkable success in identity-preserving personalization, extending this capability to 3D assets remains a significant challenge due to the complexities of multi-view consistency and spatial control.…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Jinxin Ai , Matthias Nießner , Ziya Erkoç

In this work, we introduce FlexGen, a flexible framework designed to generate controllable and consistent multi-view images, conditioned on a single-view image, or a text prompt, or both. FlexGen tackles the challenges of controllable…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Xinli Xu , Wenhang Ge , Jiantao Lin , Jiawei Feng , Lie Xu , HanFeng Zhao , Shunsi Zhang , Ying-Cong Chen

Diffusion models have demonstrated outstanding performance in generative tasks, making them ideal candidates for image editing. Recent studies highlight their ability to apply desired edits effectively by following textual instructions, yet…

计算机视觉与模式识别 · 计算机科学 2024-12-18 Mohammadreza Samadi , Fred X. Han , Mohammad Salameh , Hao Wu , Fengyu Sun , Chunhua Zhou , Di Niu

Diffusion models emerged as a leading approach in text-to-image generation, producing high-quality images from textual descriptions. However, attempting to achieve detailed control to get a desired image solely through text remains a…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Pablo Domingo-Gregorio , Javier Ruiz-Hidalgo

Text-to-image diffusion models have proven effective for solving many image editing tasks. However, the seemingly straightforward task of seamlessly relocating objects within a scene remains surprisingly challenging. Existing methods…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Omri Avrahami , Rinon Gal , Gal Chechik , Ohad Fried , Dani Lischinski , Arash Vahdat , Weili Nie

A significant research effort is focused on exploiting the amazing capacities of pretrained diffusion models for the editing of images.They either finetune the model, or invert the image in the latent space of the pretrained model. However,…

计算机视觉与模式识别 · 计算机科学 2024-12-09 Senmao Li , Joost van de Weijer , Taihang Hu , Fahad Shahbaz Khan , Qibin Hou , Yaxing Wang , Jian Yang , Ming-Ming Cheng

Building on the success of text-to-image diffusion models (DPMs), image editing is an important application to enable human interaction with AI-generated content. Among various editing methods, editing within the prompt space gains more…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Aosong Feng , Weikang Qiu , Jinbin Bai , Xiao Zhang , Zhen Dong , Kaicheng Zhou , Rex Ying , Leandros Tassiulas

Diffusion models have demonstrated their ability to generate diverse and high-quality images, sparking considerable interest in their potential for real image editing applications. However, existing diffusion-based approaches for local…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Wenjing Huang , Shikui Tu , Lei Xu

Traditional point-based image editing methods rely on iterative latent optimization or geometric transformations, which are either inefficient in their processing or fail to capture the semantic relationships within the image. These methods…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Biao Yang , Muqi Huang , Yuhui Zhang , Yun Xiong , Kun Zhou , Xi Chen , Shiyang Zhou , Huishuai Bao , Chuan Li , Feng Shi , Hualei Liu

Generative image editing has recently witnessed extremely fast-paced growth. Some works use high-level conditioning such as text, while others use low-level conditioning. Nevertheless, most of them lack fine-grained control over the…

计算机视觉与模式识别 · 计算机科学 2024-04-10 Vidit Goel , Elia Peruzzo , Yifan Jiang , Dejia Xu , Xingqian Xu , Nicu Sebe , Trevor Darrell , Zhangyang Wang , Humphrey Shi

Recent advancements in large-scale text-to-image diffusion models have enabled many applications in image editing. However, none of these methods have been able to edit the layout of single existing images. To address this gap, we propose…

计算机视觉与模式识别 · 计算机科学 2023-06-23 Zhiyuan Zhang , Zhitong Huang , Jing Liao

Due to lack of fully publicly available text-to-video models, current video editing methods tend to build on pre-trained text-to-image generation models, however, they still face grand challenges in dealing with the local editing of video…

计算机视觉与模式识别 · 计算机科学 2024-09-06 Deyin Liu , Lin Yuanbo Wu , Xianghua Xie

Face personalization aims to insert specific faces, taken from images, into pretrained text-to-image diffusion models. However, it is still challenging for previous methods to preserve both the identity similarity and editability due to…

计算机视觉与模式识别 · 计算机科学 2024-03-11 Kaede Shiohara , Toshihiko Yamasaki

Text-to-image diffusion models have recently received increasing interest for their astonishing ability to produce high-fidelity images from solely text inputs. Subsequent research efforts aim to exploit and apply their capabilities to real…

计算机视觉与模式识别 · 计算机科学 2024-06-27 Manuel Brack , Felix Friedrich , Katharina Kornmeier , Linoy Tsaban , Patrick Schramowski , Kristian Kersting , Apolinário Passos

Current instruction-based editing methods, such as InstructPix2Pix, often fail to produce satisfactory results in complex scenarios due to their dependence on the simple CLIP text encoder in diffusion models. To rectify this, this paper…

计算机视觉与模式识别 · 计算机科学 2023-12-13 Yuzhou Huang , Liangbin Xie , Xintao Wang , Ziyang Yuan , Xiaodong Cun , Yixiao Ge , Jiantao Zhou , Chao Dong , Rui Huang , Ruimao Zhang , Ying Shan

This paper presents UltraEdit, a large-scale (approximately 4 million editing samples), automatically generated dataset for instruction-based image editing. Our key idea is to address the drawbacks in existing image editing datasets like…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Haozhe Zhao , Xiaojian Ma , Liang Chen , Shuzheng Si , Rujie Wu , Kaikai An , Peiyu Yu , Minjia Zhang , Qing Li , Baobao Chang

Recent works have explored text-guided image editing using diffusion models and generated edited images based on text prompts. However, the models struggle to accurately locate the regions to be edited and faithfully perform precise edits.…

计算机视觉与模式识别 · 计算机科学 2023-05-30 Qian Wang , Biao Zhang , Michael Birsak , Peter Wonka

This paper presents a novel approach to improving text-guided image editing using diffusion-based models. Text-guided image editing task poses key challenge of precisly locate and edit the target semantic, and previous methods fall shorts…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Yihan Hu , Jianing Peng , Yiheng Lin , Ting Liu , Xiaochao Qu , Luoqi Liu , Yao Zhao , Yunchao Wei

Currently, instruction-based image editing methods have made significant progress by leveraging the powerful cross-modal understanding capabilities of vision language models (VLMs). However, they still face challenges in three key areas: 1)…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Jun Zhou , Jiahao Li , Zunnan Xu , Hanhui Li , Yiji Cheng , Fa-Ting Hong , Qin Lin , Qinglin Lu , Xiaodan Liang

Recently, several point-based image editing methods (e.g., DragDiffusion, FreeDrag, DragNoise) have emerged, yielding precise and high-quality results based on user instructions. However, these methods often make insufficient use of…

计算机视觉与模式识别 · 计算机科学 2024-12-04 DuoSheng Chen , Binghui Chen , Yifeng Geng , Liefeng Bo