English
Related papers

Related papers: UnFlow: Unsupervised Learning of Optical Flow with…

200 papers

Recent attempts to use deep learning for super-resolution reconstruction of turbulent flows have used supervised learning, which requires paired data for training. This limitation hinders more practical applications of super-resolution…

Fluid Dynamics · Physics 2021-02-03 Hyojin Kim , Junhyuk Kim , Sungjin Won , Changghoon Lee

This paper studies optical flow estimation, a critical task in motion analysis with applications in autonomous navigation, action recognition, and film production. Traditional optical flow methods require consecutive frames, which are often…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Mo Zhou , Jianwei Wang , Xuanmeng Zhang , Dylan Campbell , Kai Wang , Long Yuan , Wenjie Zhang , Xuemin Lin

Learning-based optical flow estimation has been dominated with the pipeline of cost volume with convolutions for flow regression, which is inherently limited to local correlations and thus is hard to address the long-standing challenge of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Haofei Xu , Jing Zhang , Jianfei Cai , Hamid Rezatofighi , Dacheng Tao

The optical flow of humans is well known to be useful for the analysis of human action. Recent optical flow methods focus on training deep networks to approach the problem. However, the training data used by them does not cover the domain…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Anurag Ranjan , David T. Hoffmann , Dimitrios Tzionas , Siyu Tang , Javier Romero , Michael J. Black

Self-supervised learning for inverse problems allows to train a reconstruction network from noise and/or incomplete data alone. These methods have the potential of enabling learning-based solutions when obtaining ground-truth references for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Victor Sechaud , Jérémy Scanvic , Quentin Barthélemy , Patrice Abry , Julián Tachella

We address the challenging problem of jointly inferring the 3D flow and volumetric densities moving in a fluid from a monocular input video with a deep neural network. Despite the complexity of this task, we show that it is possible to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Aleksandra Franz , Barbara Solenthaler , Nils Thuerey

We describe a method to infer dense depth from camera motion and sparse depth as estimated using a visual-inertial odometry system. Unlike other scenarios using point clouds from lidar or structured light sensors, we have few hundreds to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-22 Alex Wong , Xiaohan Fei , Stephanie Tsuei , Stefano Soatto

Recent work has shown that optical flow estimation can be formulated as a supervised learning task and can be successfully solved with convolutional networks. Training of the so-called FlowNet was enabled by a large synthetically generated…

Computer Vision and Pattern Recognition · Computer Science 2018-01-18 Nikolaus Mayer , Eddy Ilg , Philip Häusser , Philipp Fischer , Daniel Cremers , Alexey Dosovitskiy , Thomas Brox

Discriminative correlation filters (DCF) with deep convolutional features have achieved favorable performance in recent tracking benchmarks. However, most of existing DCF trackers only consider appearance features of current frame, and…

Computer Vision and Pattern Recognition · Computer Science 2018-02-28 Zheng Zhu , Wei Wu , Wei Zou , Junjie Yan

Modern large displacement optical flow algorithms usually use an initialization by either sparse descriptor matching techniques or dense approximate nearest neighbor fields. While the latter have the advantage of being dense, they have the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Christian Bailer , Bertram Taetz , Didier Stricker

This work proposes an unsupervised fusion framework based on deep convolutional transform learning. The great learning ability of convolutional filters for data analysis is well acknowledged. The success of convolutive features owes to…

Machine Learning · Computer Science 2020-11-10 Pooja Gupta , Jyoti Maggu , Angshul Majumdar , Emilie Chouzenoux , Giovanni Chierchia

Optical flow estimation is a well-studied topic for automated driving applications. Many outstanding optical flow estimation methods have been proposed, but they become erroneous when tested in challenging scenarios that are commonly…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Shihao Shen , Louis Kerofsky , Senthil Yogamani

To realize the full potential of deep learning for medical imaging, large annotated datasets are required for training. Such datasets are difficult to acquire because labeled medical images are not usually available due to privacy issues,…

Computer Vision and Pattern Recognition · Computer Science 2018-06-29 Faisal Mahmood , Richard Chen , Nicholas J. Durr

Unsupervised video object segmentation (VOS), also known as video salient object detection, aims to detect the most prominent object in a video at the pixel level. Recently, two-stream approaches that leverage both RGB images and optical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Suhwan Cho , Minhyeok Lee , Jungho Lee , Donghyeong Kim , Seunghoon Lee , Sungmin Woo , Sangyoun Lee

Collecting real-world optical flow datasets is a formidable challenge due to the high cost of labeling. A shortage of datasets significantly constrains the real-world performance of optical flow models. Building virtual datasets that…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Miaojie Feng , Longliang Liu , Hao Jia , Gangwei Xu , Xin Yang

Over four decades, the majority addresses the problem of optical flow estimation using variational methods. With the advance of machine learning, some recent works have attempted to address the problem using convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Tak-Wai Hui , Xiaoou Tang , Chen Change Loy

Optical flow estimation can be formulated as an end-to-end supervised learning problem, which yields estimates with a superior accuracy-runtime tradeoff compared to alternative methodology. In this paper, we make such networks estimate…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Eddy Ilg , Özgün Çiçek , Silvio Galesso , Aaron Klein , Osama Makansi , Frank Hutter , Thomas Brox

While the deep learning-based image deraining methods have made great progress in recent years, there are two major shortcomings in their application in real-world situations. Firstly, the gap between the low-level vision task represented…

Computer Vision and Pattern Recognition · Computer Science 2022-02-24 Kaige Wang , Tianming Wang , Jianchuang Qu , Huatao Jiang , Qing Li , Lin Chang

Optical flow is a regression task where convolutional neural networks (CNNs) have led to major breakthroughs. However, this comes at major computational demands due to the use of cost-volumes and pyramidal representations. This was…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Abdelrahman Eldesokey , Michael Felsberg

In Continual Learning (CL) contexts, concept drift typically refers to the analysis of changes in data distribution. A drift in the input data can have negative consequences on a learning predictor and the system's stability. The majority…

Machine Learning · Computer Science 2024-10-23 Sebastian Basterrech