中文
相关论文

相关论文: Taming Rectified Flow for Inversion and Editing

200 篇论文

Image diffusion models, trained on massive image collections, have emerged as the most versatile image generator model in terms of quality and diversity. They support inverting real images and conditional (e.g., text) generation, making…

计算机视觉与模式识别 · 计算机科学 2023-03-23 Duygu Ceylan , Chun-Hao Paul Huang , Niloy J. Mitra

Recent advancements in text-guided diffusion models have unlocked powerful image manipulation capabilities. However, applying these methods to real images necessitates the inversion of the images into the domain of the pretrained diffusion…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Daniel Garibi , Or Patashnik , Andrey Voynov , Hadar Averbuch-Elor , Daniel Cohen-Or

Drag-based editing within pretrained diffusion model provides a precise and flexible way to manipulate foreground objects. Traditional methods optimize the input feature obtained from DDIM inversion directly, adjusting them iteratively to…

计算机视觉与模式识别 · 计算机科学 2025-05-21 Siwei Xia , Li Sun , Tiantian Sun , Qingli Li

Multi-modal image fusion aims to consolidate complementary information from diverse source images into a unified representation. The fused image is expected to preserve fine details and maintain high visual fidelity. While diffusion models…

计算机视觉与模式识别 · 计算机科学 2026-01-29 Xingxin Xu , Bing Cao , DongDong Li , Qinghua Hu , Pengfei Zhu

Video restoration aims to reconstruct high quality video sequences from low quality inputs, addressing tasks such as super resolution, denoising, and deblurring. Traditional regression based methods often produce unrealistic details and…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Sicheng Gao , Nancy Mehta , Zongwei Wu , Radu Timofte

The remarkable generative capabilities of diffusion models have motivated extensive research in both image and video editing. Compared to video editing which faces additional challenges in the time dimension, image editing has witnessed the…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Wenqi Ouyang , Yi Dong , Lei Yang , Jianlou Si , Xingang Pan

Diffusion-based inverse algorithms have shown remarkable performance across various inverse problems, yet their reliance on numerous denoising steps incurs high computational costs. While recent developments of fast diffusion ODE solvers…

计算机视觉与模式识别 · 计算机科学 2025-10-22 Jiawei Zhang , Ziyuan Liu , Leon Yan , Gen Li , Yuantao Gu

Generative flow models offer powerful priors learned from large-scale natural images, but directly adapting them to restoration tasks such as motion deblurring causes severe fidelity degradation, as their training objective is inherently…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Insoo Kim , Jinwoo Shin

Diffusion models (DMs) have significantly advanced the development of real-world image super-resolution (Real-ISR), but the computational cost of multi-step diffusion models limits their application. One-step diffusion models generate…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Jianze Li , Jiezhang Cao , Yong Guo , Wenbo Li , Yulun Zhang

Diffusion models have demonstrated remarkable generation quality but at the cost of numerous function evaluations. Recently, advanced ODE-based solvers have been developed to mitigate the substantial computational demands of…

计算机视觉与模式识别 · 计算机科学 2025-05-28 Shuai Wang , Zexian Li , Qipeng zhang , Tianhui Song , Xubin Li , Tiezheng Ge , Bo Zheng , Limin Wang

Current video diffusion models achieve impressive generation quality but struggle in interactive applications due to bidirectional attention dependencies. The generation of a single frame requires the model to process the entire sequence,…

计算机视觉与模式识别 · 计算机科学 2025-09-25 Tianwei Yin , Qiang Zhang , Richard Zhang , William T. Freeman , Fredo Durand , Eli Shechtman , Xun Huang

Image watermarking supports authenticity and provenance, yet many schemes are still easy to bypass with various distortions and powerful generative edits. Deep learning-based watermarking has improved robustness to diffusion-based image…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Utae Jeong , Sumin In , Hyunju Ryu , Jaewan Choi , Feng Yang , Jongheon Jeong , Seungryong Kim , Sangpil Kim

The Reflow operation aims to straighten the inference trajectories of the rectified flow during training by constructing deterministic couplings between noises and images, thereby improving the quality of generated images in single-step or…

计算机视觉与模式识别 · 计算机科学 2025-07-15 Jimin Dai , Jiexi Yan , Jian Yang , Lei Luo

Score-based or diffusion models generate high-quality tabular data, surpassing GAN-based and VAE-based models. However, these methods require substantial training time. In this paper, we introduce RecTable, which uses the rectified flow…

机器学习 · 计算机科学 2025-03-27 Masane Fuchi , Tomohiro Takagi

We introduce MelodyFlow, an efficient text-controllable high-fidelity music generation and editing model. It operates on continuous latent representations from a low frame rate 48 kHz stereo variational auto encoder codec. Based on a…

音频与语音处理 · 电气工程与系统科学 2024-10-17 Gael Le Lan , Bowen Shi , Zhaoheng Ni , Sidd Srinivasan , Anurag Kumar , Brian Ellis , David Kant , Varun Nagaraja , Ernie Chang , Wei-Ning Hsu , Yangyang Shi , Vikas Chandra

Recent advances in diffusion transformers have shown remarkable generalization in visual synthesis, yet most dense perception methods still rely on text-to-image (T2I) generators designed for stochastic generation. We revisit this paradigm…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Yiqing Shi , Yiren Song , Mike Zheng Shou

Achieving precise alignment between textual instructions and generated images in text-to-image generation is a significant challenge, particularly in rendering written text within images. Sate-of-the-art models like Stable Diffusion 3…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Xixi Hu , Keyang Xu , Bo Liu , Qiang Liu , Hongliang Fei

Modern text-to-image diffusion models encode rich visual priors, but expose them only through one-way text-conditioned generation. Existing unified vision--language models derived from them recover bidirectional capability through…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Eric Tillmann Bill , Enis Simsar , Alessio Tonioni , Thomas Hofmann

Generative diffusion models have advanced image editing with high-quality results and intuitive interfaces such as prompts and semantic drawing. However, these interfaces lack precise control, and the associated methods typically specialize…

Diffusion models (DMs) and flow-matching models have demonstrated remarkable performance in image and video generation. However, such models require a significant number of function evaluations (NFEs) during sampling, leading to costly…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Zheng Tan , Weizhen Wang , Andrea L. Bertozzi , Ernest K. Ryu