English
Related papers

Related papers: GMFlow: Learning Optical Flow via Global Matching

200 papers

Flow matching has shown state-of-the-art performance in various generative tasks, ranging from image generation to decision-making, where generation under energy guidance (abbreviated as guidance in the following) is pivotal. However, the…

Machine Learning · Computer Science 2025-05-27 Ruiqi Feng , Chenglei Yu , Wenhao Deng , Peiyan Hu , Tailin Wu

Flow models are effective at progressively generating realistic images, but they generally struggle to capture long-range dependencies during the generation process as they compress all the information from previous time steps into a single…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mude Hui , Rui-Jie Zhu , Songlin Yang , Yu Zhang , Zirui Wang , Yuyin Zhou , Jason Eshraghian , Cihang Xie

Transferring appearance to 3D assets using different representations of the appearance object - such as images or text - has garnered interest due to its wide range of applications in industries like gaming, augmented reality, and digital…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Sayan Deb Sarkar , Sinisa Stekovic , Vincent Lepetit , Iro Armeni

Efficient and accurate motion prediction is crucial for ensuring safety and informed decision-making in autonomous driving, particularly under dynamic real-world conditions that necessitate multi-modal forecasts. We introduce TrajFlow, a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Qi Yan , Brian Zhang , Yutong Zhang , Daniel Yang , Joshua White , Di Chen , Jiachao Liu , Langechuan Liu , Binnan Zhuang , Shaoshuai Shi , Renjie Liao

Modern large displacement optical flow algorithms usually use an initialization by either sparse descriptor matching techniques or dense approximate nearest neighbor fields. While the latter have the advantage of being dense, they have the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Christian Bailer , Bertram Taetz , Didier Stricker

We propose ReinFlow, a simple yet effective online reinforcement learning (RL) framework that fine-tunes a family of flow matching policies for continuous robotic control. Derived from rigorous RL theory, ReinFlow injects learnable noise…

Robotics · Computer Science 2026-01-09 Tonghe Zhang , Chao Yu , Sichang Su , Yu Wang

Reinforcement learning (RL) has become a standard technique for post-training diffusion-based image synthesis models, as it enables learning from reward signals to explicitly improve desirable aspects such as image quality and prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 David McAllister , Miika Aittala , Tero Karras , Janne Hellsten , Angjoo Kanazawa , Timo Aila , Samuli Laine

Flow Matching (FM) models achieve remarkable results in generative tasks. Building upon diffusion models, FM's simulation-free training paradigm enables simplicity and efficiency but introduces a train-inference gap: model outputs cannot be…

Machine Learning · Computer Science 2026-01-30 Zhaoyi Li , Jingtao Ding , Yong Li , Shihua Li

Optical flow estimation aims to find the 2D motion field by identifying corresponding pixels between two images. Despite the tremendous progress of deep learning-based optical flow methods, it remains a challenge to accurately estimate…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Xiuchao Sui , Shaohua Li , Xue Geng , Yan Wu , Xinxing Xu , Yong Liu , Rick Goh , Hongyuan Zhu

Over the several recent years, there has been a boom in development of Flow Matching (FM) methods for generative modeling. One intriguing property pursued by the community is the ability to learn flows with straight trajectories which…

Machine Learning · Statistics 2024-11-11 Nikita Kornilov , Petr Mokrov , Alexander Gasnikov , Alexander Korotin

Consistency Guided Scene Flow Estimation (CGSF) is a self-supervised framework for the joint reconstruction of 3D scene structure and motion from stereo video. The model takes two temporal stereo pairs as input, and predicts disparity and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Yuhua Chen , Luc Van Gool , Cordelia Schmid , Cristian Sminchisescu

Accurate polyp segmentation remains challenging due to irregular lesion morphologies, ambiguous boundaries, and heterogeneous imaging conditions. While U-Net variants excel at local feature fusion, they often lack explicit mechanisms to…

Image and Video Processing · Electrical Eng. & Systems 2025-02-27 Pu Wang , Huaizhi Ma , Zhihua Zhang , Zhuoran Zheng

Conventional physically based rendering (PBR) pipelines generate photorealistic images through computationally intensive light transport simulations. Although recent deep learning approaches leverage diffusion model priors with geometry…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Shenghao Zhang , Runtao Liu , Christopher Schroers , Yang Zhang

Unsupervised optical flow methods typically lack reliable uncertainty estimation, limiting their robustness and interpretability. We propose U$^{2}$Flow, the first recurrent unsupervised framework that jointly estimates optical flow and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Xunpei Sun , Wenwei Lin , Yi Chang , Gang Chen

Flow-based Generative Models (FGMs) effectively transform noise into complex data distributions. Incorporating Optimal Transport (OT) to couple noise and data during FGM training has been shown to improve the straightness of flow…

Machine Learning · Computer Science 2025-10-20 Lingkai Kong , Molei Tao , Yang Liu , Bryan Wang , Jinmiao Fu , Chien-Chih Wang , Huidong Liu

The growing demand for text-to-image generation has led to rapid advances in generative modeling. Recently, text-to-image diffusion models trained with flow matching algorithms, such as FLUX, have achieved remarkable progress and emerged as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zikai Zhou , Muyao Wang , Shitong Shao , Lichen Bai , Haoyi Xiong , Bo Han , Zeke Xie

Robust robotic manipulation requires not only predicting how the scene evolves over time, but also recognizing task-relevant objects in complex scenes. However, existing VLA models face two limitations. They typically act only on the…

Robotics · Computer Science 2026-04-21 Kuanning Wang , Ke Fan , Chenhao Qiu , Zeyu Shangguan , Yuqian Fu , Yanwei Fu , Daniel Seita , Xiangyang Xue

While methods exist for aligning flow matching models--a popular and effective class of generative models--with human preferences, existing approaches fail to achieve both adaptation efficiency and probabilistically sound prior…

Machine Learning · Computer Science 2026-03-04 Zhen Liu , Tim Z. Xiao , Carles Domingo-Enrich , Weiyang Liu , Dinghuai Zhang

Fine-grained urban flow inference is crucial for urban planning and intelligent transportation systems, enabling precise traffic management and resource allocation. However, the practical deployment of existing methods is hindered by two…

Artificial Intelligence · Computer Science 2025-11-11 Yuanshao Zhu , Xiangyu Zhao , Zijian Zhang , Xuetao Wei , James Jianqiao Yu

Generative Flow Networks (GFlowNets) learn to sample diverse candidates in proportion to a reward function, making them well-suited for scientific discovery, where exploring multiple promising solutions is crucial. Further extending…

Machine Learning · Computer Science 2026-05-29 Seokwon Yoon , Youngbin Choi , Seunghyuk Cho , Seungbeom Lee , MoonJeong Park , Dongwoo Kim