English
Related papers

Related papers: GMFlow: Learning Optical Flow via Global Matching

200 papers

This paper concerns the problem of multi-object tracking based on the min-cost flow (MCF) formulation, which is conventionally studied as an instance of linear program. Given its computationally tractable inference, the success of MCF…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Shuai Li , Yu Kong , Hamid Rezatofighi

This paper studies optical flow estimation, a critical task in motion analysis with applications in autonomous navigation, action recognition, and film production. Traditional optical flow methods require consecutive frames, which are often…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Mo Zhou , Jianwei Wang , Xuanmeng Zhang , Dylan Campbell , Kai Wang , Long Yuan , Wenjie Zhang , Xuemin Lin

The FlowNet demonstrated that optical flow estimation can be cast as a learning problem. However, the state of the art with regard to the quality of the flow has still been defined by traditional methods. Particularly on small displacements…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Eddy Ilg , Nikolaus Mayer , Tonmoy Saikia , Margret Keuper , Alexey Dosovitskiy , Thomas Brox

Despite the progress of learning-based methods for 6D object pose estimation, the trade-off between accuracy and scalability for novel objects still exists. Specifically, previous methods for novel objects do not make good use of the target…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Sungphill Moon , Hyeontae Son , Dongcheol Hur , Sangwook Kim

Recent advances in optical flow estimation have prioritized accuracy at the cost of growing GPU memory consumption, particularly for high-resolution (FullHD) inputs. We introduce MEMFOF, a memory-efficient multi-frame optical flow method…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Vladislav Bargatin , Egor Chistov , Alexander Yakovenko , Dmitriy Vatolin

Occlusions between consecutive frames have long posed a significant challenge in optical flow estimation. The inherent ambiguity introduced by occlusions directly violates the brightness constancy constraint and considerably hinders…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Shangkun Sun , Jiaming Liu , Thomas H. Li , Huaxia Li , Guoqing Liu , Wei Gao

We introduce a new paradigm for generative modeling built on Continuous Normalizing Flows (CNFs), allowing us to train CNFs at unprecedented scale. Specifically, we present the notion of Flow Matching (FM), a simulation-free approach for…

Machine Learning · Computer Science 2023-02-09 Yaron Lipman , Ricky T. Q. Chen , Heli Ben-Hamu , Maximilian Nickel , Matt Le

Flow Matching has emerged as a powerful framework for learning continuous transformations between distributions, enabling high-fidelity generative modeling. This work introduces Symmetrical Flow Matching (SymmFlow), a new formulation that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Francisco Caetano , Christiaan Viviers , Peter H. N. De With , Fons van der Sommen

To date, top-performing optical flow estimation methods only take pairs of consecutive frames into account. While elegant and appealing, the idea of using more than two frames has not yet produced state-of-the-art results. We present a…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Zhile Ren , Orazio Gallo , Deqing Sun , Ming-Hsuan Yang , Erik B. Sudderth , Jan Kautz

Significant progress has been made for estimating optical flow using deep neural networks. Advanced deep models achieve accurate flow estimation often with a considerable computation complexity and time-consuming training processes. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Lingtong Kong , Jie Yang

Monocular scene flow estimation aims to recover dense 3D motion from image sequences, yet most existing methods are limited to two-frame inputs, restricting temporal modeling and robustness to occlusions. We propose RAFT-MSF++, a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xunpei Sun , Zuoxun Hou , Yi Chang , Gang Chen , Wei-Shi Zheng

Training deep neural networks remains computationally intensive due to the itera2 tive nature of gradient-based optimization. We propose Gradient Flow Matching (GFM), a continuous-time modeling framework that treats neural network training…

Machine Learning · Computer Science 2025-05-27 Xiao Shou , Yanna Ding , Jianxi Gao

Recently, the dense correlation volume method achieves state-of-the-art performance in optical flow. However, the correlation volume computation requires a lot of memory, which makes prediction difficult on high-resolution images. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Zihua Zheng , Ni Nie , Zhi Ling , Pengfei Xiong , Jiangyu Liu , Hao Wang , Jiankun Li

Recent advances in inverse problem solving have increasingly adopted flow priors over diffusion models due to their ability to construct straight probability paths from noise to data, thereby enhancing efficiency in both training and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Hossein Askari , Yadan Luo , Hongfu Sun , Fred Roosta

Deep learning approaches have achieved great success in addressing the problem of optical flow estimation. The keys to success lie in the use of cost volume and coarse-to-fine flow inference. However, the matching problem becomes ill-posed…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Tak-Wai Hui , Chen Change Loy

We present a global optimization approach to optical flow estimation. The approach optimizes a classical optical flow objective over the full space of mappings between discrete grids. No descriptor matching is used. The highly regular…

Computer Vision and Pattern Recognition · Computer Science 2016-04-13 Qifeng Chen , Vladlen Koltun

Optical flow estimation with occlusion or large displacement is a problematic challenge due to the lost of corresponding pixels between consecutive frames. In this paper, we discover that the lost information is related to a large quantity…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Yang Jiao , Guangming Shi , Trac D. Tran

Traditional discriminative computer vision relies predominantly on static projections, mapping input features to outputs in a single computational step. Although efficient, this paradigm lacks the iterative refinement and robustness…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Om Govind Jha , Manoj Bamniya , Ayon Borthakur

Real-time high-accuracy optical flow estimation is a crucial component in various applications, including localization and mapping in robotics, object tracking, and activity recognition in computer vision. While recent learning-based…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Zhiyong Zhang , Huaizu Jiang , Hanumant Singh

The full 4D cost volume in Recurrent All-Pairs Field Transforms (RAFT) or global matching by Transformer achieves impressive performance for optical flow estimation. However, their memory consumption increases quadratically with input…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Gangwei Xu , Shujun Chen , Hao Jia , Miaojie Feng , Xin Yang