English
Related papers

Related papers: Edit Flows: Flow Matching with Edit Operations

200 papers

Normalizing Flows (NFs) are a class of generative models distinguished by a mathematically invertible architecture, where the forward pass transforms data into a latent space for density estimation, and the reverse pass generates new…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Yang Chen , Xiaowei Xu , Shuai Wang , Chenhui Zhu , Ruxue Wen , Xubin Li , Tiezheng Ge , Limin Wang

We posit that autoregressive flow models are well-suited to performing a range of causal inference tasks - ranging from causal discovery to making interventional and counterfactual predictions. In particular, we exploit the fact that…

Machine Learning · Statistics 2020-07-28 Ricardo Pio Monti , Ilyes Khemakhem , Aapo Hyvarinen

With the prosper of video diffusion models, down-stream applications like video editing have been significantly promoted without consuming much computational cost. One particular challenge in this task lies at the motion transfer process…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Ge Wang , Songlin Fan , Hangxu Liu , Quanjian Song , Hewei Wang , Jinfeng Xu

Autoregressive models have driven remarkable progress in language modeling. Their foundational reliance on discrete tokens, unidirectional context, and single-pass decoding, while central to their success, also inspires the exploration of a…

Autoregressive and diffusion models represent two complementary generative paradigms. Autoregressive models excel at sequential planning and constraint composition, yet struggle with tasks that require explicit spatial or physical…

Artificial Intelligence · Computer Science 2026-02-03 Mu Yuan , Liekang Zeng , Guoliang Xing , Lan Zhang , Yunhao Liu

Rectified flow models have become a de facto standard in image generation due to their stable sampling trajectories and high-fidelity outputs. Despite their strong generative capabilities, they face critical limitations in image editing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Sung-Hoon Yoon , Minghan Li , Gaspard Beaudouin , Congcong Wen , Muhammad Rafay Azhar , Mengyu Wang

Recent work has witnessed a paradigm shift from Seq2Seq to Seq2Edit in the field of text editing, with the aim of addressing the slow autoregressive inference problem posed by the former. Despite promising results, Seq2Edit approaches still…

Computation and Language · Computer Science 2023-10-13 Yu Zhang , Yue Zhang , Leyang Cui , Guohong Fu

While most neural generative models generate outputs in a single pass, the human creative process is usually one of iterative building and refinement. Recent work has proposed models of editing processes, but these mostly focus on editing…

Machine Learning · Computer Science 2021-03-08 Ziyu Yao , Frank F. Xu , Pengcheng Yin , Huan Sun , Graham Neubig

Diffusion language models have recently emerged as a competitive alternative to autoregressive language models. Beyond next-token generation, they are more efficient and flexible by enabling parallel and any-order token generation. However,…

Machine Learning · Computer Science 2025-11-18 Chenxiao Yang , Cai Zhou , David Wipf , Zhiyuan Li

Scaling up autoregressive models in vision has not proven as beneficial as in large language models. In this work, we investigate this scaling problem in the context of text-to-image generation, focusing on two critical factors: whether…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Lijie Fan , Tianhong Li , Siyang Qin , Yuanzhen Li , Chen Sun , Michael Rubinstein , Deqing Sun , Kaiming He , Yonglong Tian

Diffusion language models (DLMs) promise parallel, order-agnostic generation, but on standard benchmarks they have historically lagged behind autoregressive models in sample quality and diversity. Recent continuous flow and diffusion…

Computation and Language · Computer Science 2026-05-11 Georgios Batzolis , Mark Girolami , Luca Ambrogioni

Flow-based generative models have shown remarkable success in text-to-image generation, yet fine-tuning them with intermediate feedback remains challenging, especially for continuous-time flow matching models. Most existing approaches…

Machine Learning · Computer Science 2025-10-22 Jiajun Fan , Chaoran Cheng , Shuaike Shen , Xiangxin Zhou , Ge Liu

This paper strives for image editing via generative models. Flow Matching is an emerging generative modeling technique that offers the advantage of simple and efficient training. Simultaneously, a new transformer-based U-ViT has recently…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Vincent Tao Hu , David W Zhang , Pascal Mettes , Meng Tang , Deli Zhao , Cees G. M. Snoek

Existing 3D editing methods rely on computationally intensive scene-by-scene iterative optimization and suffer from multi-view inconsistency. We propose an effective and feed-forward 3D editing framework based on the TRELLIS generative…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Shimin Hu , Yuanyi Wei , Fei Zha , Yudong Guo , Juyong Zhang

Existing captioning models often adopt the encoder-decoder architecture, where the decoder uses autoregressive decoding to generate captions, such that each token is generated sequentially given the preceding generated tokens. However,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Junlong Gao , Xi Meng , Shiqi Wang , Xia Li , Shanshe Wang , Siwei Ma , Wen Gao

Existing rectified flow models are based on linear trajectories between data and noise distributions. This linearity enforces zero curvature, which can inadvertently force the image generation process through low-probability regions of the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Yan Luo , Drake Du , Hao Huang , Yi Fang , Mengyu Wang

Normalizing Flows (NFs) are likelihood-based models for continuous inputs. They have demonstrated promising results on both density estimation and generative modeling tasks, but have received relatively little attention in recent years. In…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Shuangfei Zhai , Ruixiang Zhang , Preetum Nakkiran , David Berthelot , Jiatao Gu , Huangjie Zheng , Tianrong Chen , Miguel Angel Bautista , Navdeep Jaitly , Josh Susskind

Inversion-based image editing in flow matching models has emerged as a powerful paradigm for training-free, text-guided image manipulation. A central challenge in this paradigm is the injection dilemma: injecting source features during…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Guandong Li , Zhaobin Chu

While recent machine learning research has revealed connections between deep generative models such as VAEs and rate-distortion losses used in learned compression, most of this work has focused on images. In a similar spirit, we view…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Ruihan Yang , Yibo Yang , Joseph Marino , Stephan Mandt

Diffusion and flow matching approaches to generative modeling have shown promise in domains where the state space is continuous, such as image generation or protein folding & design, and discrete, exemplified by diffusion large language…