English
Related papers

Related papers: UPFlow: Upsampling Pyramid for Unsupervised Optica…

200 papers

We present an unsupervised optical flow estimation method by proposing an adaptive pyramid sampling in the deep pyramid network. Specifically, in the pyramid downsampling, we propose an Content Aware Pooling (CAP) module, which promotes…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Kunming Luo , Ao Luo , Chuan Wang , Haoqiang Fan , Shuaicheng Liu

We present a self-supervised learning approach for optical flow. Our method distills reliable flow estimations from non-occluded pixels, and uses these predictions as ground truth to learn optical flow for hallucinated occlusions. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-22 Pengpeng Liu , Michael Lyu , Irwin King , Jia Xu

We present DistillFlow, a knowledge distillation approach to learning optical flow. DistillFlow trains multiple teacher models and a student model, where challenging transformations are applied to the input of the student model to generate…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Pengpeng Liu , Michael R. Lyu , Irwin King , Jia Xu

In this work we review the coarse-to-fine spatial feature pyramid concept, which is used in state-of-the-art optical flow estimation networks to make exploration of the pixel flow search space computationally tractable and efficient. Within…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Markus Hofinger , Samuel Rota Bulò , Lorenzo Porzi , Arno Knapitsch , Thomas Pock , Peter Kontschieder

Both optical flow and stereo disparities are image matches and can therefore benefit from joint training. Depth and 3D motion provide geometric rather than photometric information and can further improve optical flow. Accordingly, we design…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Shuai Yuan , Carlo Tomasi

Recent works have shown that optical flow can be learned by deep networks from unlabelled image pairs based on brightness constancy assumption and smoothness prior. Current approaches additionally impose an augmentation regularization term…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Lingtong Kong , Jie Yang

We present DDFlow, a data distillation approach to learning optical flow estimation from unlabeled data. The approach distills reliable predictions from a teacher network, and uses these predictions as annotations to guide a student network…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Pengpeng Liu , Irwin King , Michael R. Lyu , Jia Xu

In the era of end-to-end deep learning, many advances in computer vision are driven by large amounts of labeled data. In the optical flow setting, however, obtaining dense per-pixel ground truth for real scenes is difficult and thus such…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Simon Meister , Junhwa Hur , Stefan Roth

Traditional unsupervised optical flow methods are vulnerable to occlusions and motion boundaries due to lack of object-level information. Therefore, we propose UnSAMFlow, an unsupervised flow network that also leverages object information…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Shuai Yuan , Lei Luo , Zhuo Hui , Can Pu , Xiaoyu Xiang , Rakesh Ranjan , Denis Demandolx

Unsupervised optical flow methods typically lack reliable uncertainty estimation, limiting their robustness and interpretability. We propose U$^{2}$Flow, the first recurrent unsupervised framework that jointly estimates optical flow and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Xunpei Sun , Wenwei Lin , Yi Chang , Gang Chen

Unsupervised optical flow estimation is especially hard near occlusions and motion boundaries and in low-texture regions. We show that additional information such as semantics and domain knowledge can help better constrain this problem. We…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Shuai Yuan , Shuzhi Yu , Hannah Kim , Carlo Tomasi

In this paper, we propose a unified method to jointly learn optical flow and stereo matching. Our first intuition is stereo matching can be modeled as a special case of optical flow, and we can leverage 3D geometry behind stereoscopic…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Pengpeng Liu , Irwin King , Michael Lyu , Jia Xu

Unsupervised deep learning for optical flow computation has achieved promising results. Most existing deep-net based methods rely on image brightness consistency and local smoothness constraint to train the networks. Their performance…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Yiran Zhong , Pan Ji , Jianyuan Wang , Yuchao Dai , Hongdong Li

We systematically compare and analyze a set of key components in unsupervised optical flow to identify which photometric loss, occlusion handling, and smoothness regularization is most effective. Alongside this investigation we construct a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Rico Jonschkowski , Austin Stone , Jonathan T. Barron , Ariel Gordon , Kurt Konolige , Anelia Angelova

For visual estimation of optical flow, a crucial function for many vision tasks, unsupervised learning, using the supervision of view synthesis has emerged as a promising alternative to supervised methods, since ground-truth flow is not…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Zitang Sun , Shin'ya Nishida , Zhengbo Luo

We learn to compute optical flow by combining a classical spatial-pyramid formulation with deep learning. This estimates large motions in a coarse-to-fine approach by warping one image of a pair at each pyramid level by the current flow…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Anurag Ranjan , Michael J. Black

Despite the significant progress that has been made on estimating optical flow recently, most estimation methods, including classical and deep learning approaches, still have difficulty with multi-scale estimation, real-time computation,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 Yi Zhu , Shawn Newsam

Optical flow estimation is a fundamental problem in computer vision, yet the reliance on expensive ground-truth annotations limits the scalability of supervised approaches. Although unsupervised and semi-supervised methods alleviate this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yixuan Luo , Feng Qiao , Zhexiao Xiong , Yanjing Li , Nathan Jacobs

The scarcity of ground-truth labels poses one major challenge in developing optical flow estimation models that are both generalizable and robust. While current methods rely on data augmentation, they have yet to fully exploit the rich…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jisoo Jeong , Hong Cai , Risheek Garrepalli , Jamie Menjay Lin , Munawar Hayat , Fatih Porikli

We propose to modify the common training protocols of optical flow, leading to sizable accuracy improvements without adding to the computational complexity of the training process. The improvement is based on observing the bias in sampling…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Aviram Bar-Haim , Lior Wolf
‹ Prev 1 2 3 10 Next ›