English
Related papers

Related papers: GMFlow: Learning Optical Flow via Global Matching

200 papers

The performance of flow matching and diffusion models can be greatly improved at inference time using reward alignment algorithms, yet efficiency remains a major limitation. While several algorithms were proposed, we demonstrate that a…

Machine Learning · Computer Science 2026-02-12 Peter Holderrieth , Uriel Singer , Tommi Jaakkola , Ricky T. Q. Chen , Yaron Lipman , Brian Karrer

Optical flow estimation is a classical yet challenging task in computer vision. One of the essential factors in accurately predicting optical flow is to alleviate occlusions between frames. However, it is still a thorny problem for current…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Shangkun Sun , Yuanqi Chen , Yu Zhu , Guodong Guo , Ge Li

MeanFlow (MF) has recently been established as a framework for one-step generative modeling. However, its ``fastforward'' nature introduces key challenges in both the training objective and the guidance mechanism. First, the original MF's…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhengyang Geng , Yiyang Lu , Zongze Wu , Eli Shechtman , J. Zico Kolter , Kaiming He

Diffusion models have revolutionized generative tasks through high-fidelity outputs, yet flow matching (FM) offers faster inference and empirical performance gains. However, current foundation FM models are computationally prohibitive for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Johannes Schusterbauer , Ming Gui , Frank Fundel , Björn Ommer

Many classical and learning-based optical flow methods rely on hierarchical concepts to improve both accuracy and robustness. However, one of the currently most successful approaches -- RAFT -- hardly exploits such concepts. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Azin Jahedi , Lukas Mehl , Marc Rivinius , Andrés Bruhn

Optical flow provides information on relative motion that is an important component in many computer vision pipelines. Neural networks provide high accuracy optical flow, yet their complexity is often prohibitive for application at the edge…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Yannick Schnider , Stanislaw Wozniak , Mathias Gehrig , Jules Lecomte , Axel von Arnim , Luca Benini , Davide Scaramuzza , Angeliki Pantazi

Diffusion models approximate the denoising distribution as a Gaussian and predict its mean, whereas flow matching models reparameterize the Gaussian mean as flow velocity. However, they underperform in few-step sampling due to…

Machine Learning · Computer Science 2025-09-03 Hansheng Chen , Kai Zhang , Hao Tan , Zexiang Xu , Fujun Luan , Leonidas Guibas , Gordon Wetzstein , Sai Bi

Fine-tuning flow matching models is a central challenge in settings with limited data, evolving distributions, or strict efficiency demands, where unconstrained fine-tuning can erode the accuracy and efficiency gains learned during…

Machine Learning · Computer Science 2026-02-02 Gudrun Thorkelsdottir , Arindam Banerjee

Diffusion and flow-matching models achieve remarkable generative performance but at the cost of many sampling steps, this slows inference and limits applicability to time-critical tasks. The ReFlow procedure can accelerate sampling by…

Machine Learning · Computer Science 2024-10-11 Beomsu Kim , Yu-Guan Hsieh , Michal Klein , Marco Cuturi , Jong Chul Ye , Bahjat Kawar , James Thornton

Optical flow estimation is a crucial subfield of computer vision, serving as a foundation for video tasks. However, the real-world robustness is limited by animated synthetic datasets for training. This introduces domain gaps when applied…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yingping Liang , Ying Fu , Yutao Hu , Wenqi Shao , Jiaming Liu , Debing Zhang

Optical flow estimation is one of the fundamental tasks in low-level computer vision, which describes the pixel-wise displacement and can be used in many other tasks. From the apparent aspect, the optical flow can be viewed as the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Yuhao Cheng , Siru Zhang , Yiqiang Yan

The occlusion problem remains a crucial challenge in optical flow estimation (OFE). Despite the recent significant progress brought about by deep learning, most existing deep learning OFE methods still struggle to handle occlusions; in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Bo Wang , Yifan Zhang , Jian Li , Yang Yu , Zhenping Sun , Li Liu , Dewen Hu

We introduce Recurrent All-Pairs Field Transforms (RAFT), a new deep network architecture for optical flow. RAFT extracts per-pixel features, builds multi-scale 4D correlation volumes for all pairs of pixels, and iteratively updates a flow…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Zachary Teed , Jia Deng

Modern optical flow methods make use of salient scene feature points detected and matched within the scene as a basis for sparse-to-dense optical flow estimation. Current feature detectors however either give sparse, non uniform point…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Felix Stephenson , Toby Breckon , Ioannis Katramados

Optical flow is an indispensable building block for various important computer vision tasks, including motion estimation, object tracking, and disparity measurement. In this work, we propose TransFlow, a pure transformer architecture for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yawen Lu , Qifan Wang , Siqi Ma , Tong Geng , Yingjie Victor Chen , Huaijin Chen , Dongfang Liu

Optimal power flow (OPF) has been used for real-time grid operations. Prior efforts demonstrated that utilizing flexibility from dynamic topologies will improve grid efficiency. However, this will convert the linear OPF into a mixed-integer…

Systems and Control · Electrical Eng. & Systems 2024-10-24 Thuan Pham , Xingpeng Li

We present CompactFlowNet, the first real-time mobile neural network for optical flow prediction, which involves determining the displacement of each pixel in an initial frame relative to the corresponding pixel in a subsequent frame.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Andrei Znobishchev , Valerii Filev , Oleg Kudashev , Nikita Orlov , Humphrey Shi

Over four decades, the majority addresses the problem of optical flow estimation using variational methods. With the advance of machine learning, some recent works have attempted to address the problem using convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Tak-Wai Hui , Xiaoou Tang , Chen Change Loy

Object pose estimation is a fundamental problem in computer vision and plays a critical role in virtual reality and embodied intelligence, where agents must understand and interact with objects in 3D space. Recently, score based generative…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Diya He , Qingchen Liu , Cong Zhang , Jiahu Qin

Flow matching models have emerged as a powerful framework for realistic image generation by learning to reverse a corruption process that progressively adds Gaussian noise. However, because noise is injected in the latent domain, its impact…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Sucheng Ren , Qihang Yu , Ju He , Xiaohui Shen , Alan Yuille , Liang-Chieh Chen