中文
相关论文

相关论文: Flow2Stereo: Effective Self-Supervised Learning of…

200 篇论文

Imposing consistency through proxy tasks has been shown to enhance data-driven learning and enable self-supervision in various tasks. This paper introduces novel and effective consistency strategies for optical flow estimation, a problem…

计算机视觉与模式识别 · 计算机科学 2022-05-25 Jisoo Jeong , Jamie Menjay Lin , Fatih Porikli , Nojun Kwak

We present a method for decomposing the 3D scene flow observed from a moving stereo rig into stationary scene elements and dynamic object motion. Our unsupervised learning framework jointly reasons about the camera motion, optical flow, and…

计算机视觉与模式识别 · 计算机科学 2019-09-17 Seokju Lee , Sunghoon Im , Stephen Lin , In So Kweon

Scene flow is a description of real world motion in 3D that contains more information than optical flow. Because of its complexity there exists no applicable variant for real-time scene flow estimation in an automotive or commercial vehicle…

计算机视觉与模式识别 · 计算机科学 2018-06-22 René Schuster , Christian Bailer , Oliver Wasenmüller , Didier Stricker

For visual estimation of optical flow, a crucial function for many vision tasks, unsupervised learning, using the supervision of view synthesis has emerged as a promising alternative to supervised methods, since ground-truth flow is not…

计算机视觉与模式识别 · 计算机科学 2023-04-17 Zitang Sun , Shin'ya Nishida , Zhengbo Luo

Optical flow estimation is crucial for various applications in vision and robotics. As the difficulty of collecting ground truth optical flow in real-world scenarios, most of the existing methods of learning optical flow still adopt…

计算机视觉与模式识别 · 计算机科学 2023-10-04 Sheng-Chi Huang , Wei-Chen Chiu

Recently unsupervised learning of depth from videos has made remarkable progress and the results are comparable to fully supervised methods in outdoor scenes like KITTI. However, there still exist great challenges when directly applying…

计算机视觉与模式识别 · 计算机科学 2019-10-22 Junsheng Zhou , Yuwang Wang , Kaihuai Qin , Wenjun Zeng

We propose a novel method for learning convolutional neural image representations without manual supervision. We use motion cues in the form of optical flow, to supervise representations of static images. The obvious approach of training a…

计算机视觉与模式识别 · 计算机科学 2018-07-17 Aravindh Mahendran , James Thewlis , Andrea Vedaldi

Recent works have shown that optical flow can be learned by deep networks from unlabelled image pairs based on brightness constancy assumption and smoothness prior. Current approaches additionally impose an augmentation regularization term…

计算机视觉与模式识别 · 计算机科学 2022-11-14 Lingtong Kong , Jie Yang

We present an unsupervised learning approach for optical flow estimation by improving the upsampling and learning of pyramid network. We design a self-guided upsample module to tackle the interpolation blur problem caused by bilinear…

计算机视觉与模式识别 · 计算机科学 2021-06-03 Kunming Luo , Chuan Wang , Shuaicheng Liu , Haoqiang Fan , Jue Wang , Jian Sun

We present a unified formulation and model for three motion and 3D perception tasks: optical flow, rectified stereo matching and unrectified stereo depth estimation from posed images. Unlike previous specialized architectures for each…

计算机视觉与模式识别 · 计算机科学 2023-07-27 Haofei Xu , Jing Zhang , Jianfei Cai , Hamid Rezatofighi , Fisher Yu , Dacheng Tao , Andreas Geiger

Instance-level contrastive learning techniques, which rely on data augmentation and a contrastive loss function, have found great success in the domain of visual representation learning. They are not suitable for exploiting the rich…

计算机视觉与模式识别 · 计算机科学 2021-10-22 Martine Toering , Ioannis Gatopoulos , Maarten Stol , Vincent Tao Hu

It has been recently shown that a convolutional neural network can learn optical flow estimation with unsupervised learning. However, the performance of the unsupervised methods still has a relatively large gap compared to its supervised…

计算机视觉与模式识别 · 计算机科学 2018-04-05 Yang Wang , Yi Yang , Zhenheng Yang , Liang Zhao , Peng Wang , Wei Xu

We propose a new self-supervised approach to image feature learning from motion cue. This new approach leverages recent advances in deep learning in two directions: 1) the success of training deep neural network in estimating optical flow…

计算机视觉与模式识别 · 计算机科学 2019-01-10 Bin Ma , Shubao Liu , Yingxuan Zhi , Qi Song

Scene flow represents the motion of points in the 3D space, which is the counterpart of the optical flow that represents the motion of pixels in the 2D image. However, it is difficult to obtain the ground truth of scene flow in the real…

计算机视觉与模式识别 · 计算机科学 2022-06-09 Guangming Wang , Xiaoyu Tian , Ruiqi Ding , Hesheng Wang

Unsupervised optical flow methods typically lack reliable uncertainty estimation, limiting their robustness and interpretability. We propose U$^{2}$Flow, the first recurrent unsupervised framework that jointly estimates optical flow and…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Xunpei Sun , Wenwei Lin , Yi Chang , Gang Chen

Previous monocular depth estimation methods take a single view and directly regress the expected results. Though recent advances are made by applying geometrically inspired loss functions during training, the inference procedure does not…

计算机视觉与模式识别 · 计算机科学 2018-03-12 Yue Luo , Jimmy Ren , Mude Lin , Jiahao Pang , Wenxiu Sun , Hongsheng Li , Liang Lin

Existing optical flow methods are erroneous in challenging scenes, such as fog, rain, and night because the basic optical flow assumptions such as brightness and gradient constancy are broken. To address this problem, we present an…

计算机视觉与模式识别 · 计算机科学 2023-06-13 Haipeng Li , Kunming Luo , Shuaicheng Liu

We propose a new multi-frame method for efficiently computing scene flow (dense depth and optical flow) and camera ego-motion for a dynamic scene observed from a moving stereo camera rig. Our technique also segments out moving objects from…

计算机视觉与模式识别 · 计算机科学 2017-11-29 Tatsunori Taniai , Sudipta N. Sinha , Yoichi Sato

Diffusion models can learn rich representations during data generation, showing potential for Self-Supervised Learning (SSL), but they face a trade-off between generative quality and discriminative performance. Their iterative sampling also…

机器学习 · 计算机科学 2025-12-24 Kosuke Ukita , Tsuyoshi Okita

We tackle the problem of estimating optical flow from a monocular camera in the context of autonomous driving. We build on the observation that the scene is typically composed of a static background, as well as a relatively small number of…

计算机视觉与模式识别 · 计算机科学 2016-08-24 Min Bai , Wenjie Luo , Kaustav Kundu , Raquel Urtasun