English
Related papers

Related papers: Unsupervised Learning of Dense Optical Flow, Depth…

200 papers

Monocular depth inference has gained tremendous attention from researchers in recent years and remains as a promising replacement for expensive time-of-flight sensors, but issues with scale acquisition and implementation overhead still…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Kenny Chen , Alexandra Pogue , Brett T. Lopez , Ali-akbar Agha-mohammadi , Ankur Mehta

Event cameras are neuromorphically inspired sensors that sparsely and asynchronously report brightness changes. Their unique characteristics of high temporal resolution, high dynamic range, and low power consumption make them well-suited…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Haitao Meng , Chonghao Zhong , Sheng Tang , Lian JunJia , Wenwei Lin , Zhenshan Bing , Yi Chang , Gang Chen , Alois Knoll

Event cameras offer promising properties, such as high temporal resolution and high dynamic range. These benefits have been utilized into many machine vision tasks, especially optical flow estimation. Currently, most existing event-based…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Hao Zhuang , Xinjie Huang , Kuanxu Hou , Delei Kong , Chenming Hu , Zheng Fang

This paper introduces a robust framework for motion segmentation and egomotion estimation using event-based normal flow, tailored specifically for neuromorphic vision sensors. In contrast to traditional methods that rely heavily on optical…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Zhiyuan Hua , Dehao Yuan , Cornelia Fermüller

Motion segmentation from a single moving camera presents a significant challenge in the field of computer vision. This challenge is compounded by the unknown camera movements and the lack of depth information of the scene. While deep…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yuxiang Huang , Yuhao Chen , John Zelek

Efficiently selecting an appropriate spike stream data length to extract precise information is the key to the spike vision tasks. To address this issue, we propose a dynamic timing representation for spike streams. Based on multi-layers…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Lujie Xia , Ziluo Ding , Rui Zhao , Jiyuan Zhang , Lei Ma , Zhaofei Yu , Tiejun Huang , Ruiqin Xiong

This paper introduces a self-supervised learning framework designed for pre-training neural networks tailored to dense prediction tasks using event camera data. Our approach utilizes solely event data for training. Transferring achievements…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Yan Yang , Liyuan Pan , Liu Liu

In this work, we propose a method that combines unsupervised deep learning predictions for optical flow and monocular disparity with a model based optimization procedure for instantaneous camera pose. Given the flow and disparity…

Computer Vision and Pattern Recognition · Computer Science 2019-02-14 Alex Zihao Zhu , Wenxin Liu , Ziyun Wang , Vijay Kumar , Kostas Daniilidis

Event cameras rely on motion to obtain information about scene appearance. This means that appearance and motion are inherently linked: either both are present and recorded in the event data, or neither is captured. Previous works treat the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Shuang Guo , Friedhelm Hamann , Guillermo Gallego

Event cameras provide an advantage over traditional frame-based cameras when capturing fast-moving objects without a motion blur. They achieve this by recording changes in light intensity (known as events), thus allowing them to operate at…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Wachirawit Ponghiran , Chamika Mihiranga Liyanagedera , Kaushik Roy

The estimation of optical flow and 6-DoF ego-motion, two fundamental tasks in 3D vision, has typically been addressed independently. For neuromorphic vision (e.g., event cameras), however, the lack of robust data association makes solving…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Wenpu Li , Bangyan Liao , Yi Zhou , Qi Xu , Pian Wan , Peidong Liu

Egomotion estimation is crucial for applications such as autonomous navigation and robotics, where accurate and real-time motion tracking is required. However, traditional methods relying on inertial sensors are highly sensitive to external…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Hugh Greatorex , Michele Mastella , Madison Cotteret , Ole Richter , Elisabetta Chicca

We present an unsupervised learning framework for simultaneously training single-view depth prediction and optical flow estimation models using unlabeled video sequences. Existing unsupervised methods often exploit brightness constancy and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Yuliang Zou , Zelun Luo , Jia-Bin Huang

We propose a semantics-driven unsupervised learning approach for monocular depth and ego-motion estimation from videos in this paper. Recent unsupervised learning methods employ photometric errors between synthetic view and actual image as…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Xiaobin Wei , Jianjiang Feng , Jie Zhou

We present an unsupervised learning framework for the task of monocular depth and camera motion estimation from unstructured video sequences. We achieve this by simultaneously training depth and camera pose estimation networks using the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Tinghui Zhou , Matthew Brown , Noah Snavely , David G. Lowe

Monocular depth reconstruction of complex and dynamic scenes is a highly challenging problem. While for rigid scenes learning-based methods have been offering promising results even in unsupervised cases, there exists little to no…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Ayça Takmaz , Danda Pani Paudel , Thomas Probst , Ajad Chhatkuli , Martin R. Oswald , Luc Van Gool

The field of neuromorphic computing promises extremely low-power and low-latency sensing and processing. Challenges in transferring learning algorithms from traditional artificial neural networks (ANNs) to spiking neural networks (SNNs)…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Jesse Hagenaars , Federico Paredes-Vallés , Guido de Croon

Recent work has shown that CNN-based depth and ego-motion estimators can be learned using unlabelled monocular videos. However, the performance is limited by unidentified moving objects that violate the underlying static scene assumption in…

Computer Vision and Pattern Recognition · Computer Science 2019-10-04 Jia-Wang Bian , Zhichao Li , Naiyan Wang , Huangying Zhan , Chunhua Shen , Ming-Ming Cheng , Ian Reid

Self-supervised monocular depth estimation enables robots to learn 3D perception from raw video streams. This scalable approach leverages projective geometry and ego-motion to learn via view synthesis, assuming the world is mostly static.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Vitor Guizilini , Kuan-Hui Lee , Rares Ambrus , Adrien Gaidon

Event-based cameras are raising interest within the computer vision community. These sensors operate with asynchronous pixels, emitting events, or "spikes", when the luminance change at a given pixel since the last event surpasses a certain…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Javier Cuadrado , Ulysse Rançon , Benoît Cottereau , Francisco Barranco , Timothée Masquelier