English
Related papers

Related papers: SteerFlow: Steering Rectified Flows for Faithful I…

200 papers

Learning permutations is fundamental to sorting, ranking, and matching, but existing differentiable methods based on entropy-regularized Sinkhorn produce a single softened solution and collapse under ambiguity. We present PermFlow, a…

Machine Learning · Computer Science 2026-05-19 Yimeng Min , Carla P. Gomes

Inversion-free image editing using flow-based generative models challenges the prevailing inversion-based pipelines. However, existing approaches rely on fixed Gaussian noise to construct the source trajectory, leading to biased trajectory…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Lifan Jiang , Boxi Wu , Yuhang Pei , Tianrun Wu , Yongyuan Chen , Yan Zhao , Shiyu Yu , Deng Cai

Image restoration aims to recover high-quality (HQ) images from degraded low-quality (LQ) ones by reversing the effects of degradation. Existing generative models for image restoration, including diffusion and score-based models, often…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Haina Qin , Wenyang Luo , Libin Wang , Dandan Zheng , Jingdong Chen , Ming Yang , Bing Li , Weiming Hu

Inversion-based image editing in flow matching models has emerged as a powerful paradigm for training-free, text-guided image manipulation. A central challenge in this paradigm is the injection dilemma: injecting source features during…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Guandong Li , Zhaobin Chu

We introduce RewardFlow, an inversion-free framework that steers pretrained diffusion and flow-matching models at inference time through multi-reward Langevin dynamics. RewardFlow unifies complementary differentiable rewards for semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Onkar Susladkar , Dong-Hwan Jang , Tushar Prakash , Adheesh Juvekar , Vedant Shah , Ayush Barik , Nabeel Bashir , Muntasir Wahed , Ritish Shrirao , Ismini Lourentzou

Large-scale pre-trained diffusion models empower users to edit images through text guidance. However, existing methods often over-align with target prompts while inadequately preserving source image semantics. Such approaches generate…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Jianda Mao , Kaibo Wang , Yang Xiang , Kani Chen

Scene text editing seeks to modify textual content in natural images while maintaining visual realism and semantic consistency. Existing methods often require task-specific training or paired data, limiting their scalability and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yubo Li , Xugong Qin , Peng Zhang , Hailun Lin , Gangyan Zeng , Kexin Zhang

Although image editing techniques have advanced significantly, video editing, which aims to manipulate videos according to user intent, remains an emerging challenge. Most existing image-conditioned video editing methods either require…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Xianghao Kong , Hansheng Chen , Yuwei Guo , Lvmin Zhang , Gordon Wetzstein , Maneesh Agrawala , Anyi Rao

Image-to-SVG reconstruction aims to produce vector graphics that are faithful to raster inputs and easy to edit. Existing methods face a structural trade-off in how vector structure is parameterized, including how many paths represent an…

Graphics · Computer Science 2026-05-20 Mengnan Jiang , Christian Franke , Michele Franco Adesso , Antonio Haas , Grace Li Zhang

Although diffusion models in text-to-speech have become a popular choice due to their strong generative ability, the intrinsic complexity of sampling from diffusion models harms their efficiency. Alternatively, we propose VoiceFlow, an…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-04 Yiwei Guo , Chenpeng Du , Ziyang Ma , Xie Chen , Kai Yu

Flow-matching models deliver state-of-the-art fidelity in image and video generation, but the inherent sequential denoising process renders them slower. Existing acceleration methods like distillation, trajectory truncation, and consistency…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Divya Jyoti Bajpai , Dhruv Bhardwaj , Soumya Roy , Tejas Duseja , Harsh Agarwal , Aashay Sandansing , Manjesh Kumar Hanawal

Diffusion models have greatly improved visual generation but are hindered by slow generation speed due to the computationally intensive nature of solving generative ODEs. Rectified flow, a widely recognized solution, improves generation…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Fu-Yun Wang , Ling Yang , Zhaoyang Huang , Mengdi Wang , Hongsheng Li

Drag-based image editing has long suffered from distortions in the target region, largely because the priors of earlier base models, Stable Diffusion, are insufficient to project optimized latents back onto the natural image manifold. With…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zihan Zhou , Shilin Lu , Shuli Leng , Shaocong Zhang , Zhuming Lian , Xinlei Yu , Adams Wai-Kin Kong

Text-based generation and editing of 3D scenes hold significant potential for streamlining content creation through intuitive user interactions. While recent advances leverage 3D Gaussian Splatting (3DGS) for high-fidelity and real-time…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Hyojun Go , Byeongjun Park , Jiho Jang , Jin-Young Kim , Soonwoo Kwon , Changick Kim

With the prosper of video diffusion models, down-stream applications like video editing have been significantly promoted without consuming much computational cost. One particular challenge in this task lies at the motion transfer process…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Ge Wang , Songlin Fan , Hangxu Liu , Quanjian Song , Hewei Wang , Jinfeng Xu

Despite recent advances in inversion-based editing, text-guided image manipulation remains challenging for diffusion models. The primary bottlenecks include 1) the time-consuming nature of the inversion process; 2) the struggle to balance…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Sihan Xu , Yidong Huang , Jiayi Pan , Ziqiao Ma , Joyce Chai

Training-free video object editing aims to achieve precise object-level manipulation, including object insertion, swapping, and deletion. However, it faces significant challenges in maintaining fidelity and temporal consistency. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yiyang Chen , Xuanhua He , Xiujun Ma , Yue Ma

Recent methods in flow-based diffusion editing have enabled direct transformations between source and target image distribution without explicit inversion. However, the latent trajectories in these methods often exhibit accumulated velocity…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Zixiang Li , Yue Song , Jianing Peng , Ting Liu , Jun Huang , Xiaochao Qu , Luoqi Liu , Wei Wang , Yao Zhao , Yunchao Wei

Motion transfer from the driving to the source portrait remains a key challenge in the portrait animation. Current diffusion-based approaches condition only on the driving motion, which fails to capture source-to-driving correspondences and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yating Xu , Yunqi Miao , Evangelos Ververas , Jiankang Deng , Jifei Song

Current approaches for restoration of degraded images face a trade-off: high-performance models are slow for practical use, while fast models produce poor results. Knowledge distillation transfers teacher knowledge to students, but existing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Shourya Verma , Mengbo Wang , Nadia Atallah Lanman , Ananth Grama