English
Related papers

Related papers: Learning Normal Flow Directly From Event Neighborh…

200 papers

Although supervised deep normal estimators have recently shown impressive results on synthetic benchmarks, their performance deteriorates significantly in real-world scenarios due to the domain gap between synthetic and real data. Building…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Jie Zhang , Minghui Nie , Changqing Zou , Jian Liu , Ligang Liu , Junjie Cao

We learn to compute optical flow by combining a classical spatial-pyramid formulation with deep learning. This estimates large motions in a coarse-to-fine approach by warping one image of a pair at each pyramid level by the current flow…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Anurag Ranjan , Michael J. Black

Event-based cameras record an asynchronous stream of per-pixel brightness changes. As such, they have numerous advantages over the standard frame-based cameras, including high temporal resolution, high dynamic range, and no motion blur. Due…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Dimche Kostadinov , Davide Scaramuzza

Event-based cameras display great potential for a variety of tasks such as high-speed motion detection and navigation in low-light environments where conventional frame-based cameras suffer critically. This is attributed to their high…

Neural and Evolutionary Computing · Computer Science 2020-09-16 Chankyu Lee , Adarsh Kumar Kosta , Alex Zihao Zhu , Kenneth Chaney , Kostas Daniilidis , Kaushik Roy

Unsupervised deep learning for optical flow computation has achieved promising results. Most existing deep-net based methods rely on image brightness consistency and local smoothness constraint to train the networks. Their performance…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Yiran Zhong , Pan Ji , Jianyuan Wang , Yuchao Dai , Hongdong Li

Event-based keypoint detection and matching holds significant potential, enabling the integration of event sensors into highly optimized Visual SLAM systems developed for frame cameras over decades of research. Unfortunately, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yannick Burkhardt , Simon Schaefer , Stefan Leutenegger

Convolutional neural networks (CNNs) have recently been very successful in a variety of computer vision tasks, especially on those linked to recognition. Optical flow estimation has not been among the tasks where CNNs were successful. In…

Computer Vision and Pattern Recognition · Computer Science 2015-06-18 Philipp Fischer , Alexey Dosovitskiy , Eddy Ilg , Philip Häusser , Caner Hazırbaş , Vladimir Golkov , Patrick van der Smagt , Daniel Cremers , Thomas Brox

Scene flow estimation determines a scene's 3D motion field, by predicting the motion of points in the scene, especially for aiding tasks in autonomous driving. Many networks with large-scale point clouds as input use voxelization to create…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Qingwen Zhang , Yi Yang , Heng Fang , Ruoyu Geng , Patric Jensfelt

In industrial and environmental monitoring, achieving real-time and precise fluid flow measurement remains a critical challenge. This study applies linear quantization in FPGA-based soft sensors for fluid flow estimation, significantly…

Machine Learning · Computer Science 2025-10-28 Tianheng Ling , Julian Hoever , Chao Qian , Gregor Schiele

Optical flow techniques are becoming increasingly performant and robust when estimating motion in a scene, but their performance has yet to be proven in the area of facial expression recognition. In this work, a variety of optical flow…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Benjamin Allaert , Isaac Ronald Ward , Ioan Marius Bilasco , Chaabane Djeraba , Mohammed Bennamoun

Making predictions of future frames is a critical challenge in autonomous driving research. Most of the existing methods for video prediction attempt to generate future frames in simple and fixed scenes. In this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2018-06-01 Henglai Wei , Xiaochuan Yin , Penghong Lin

Feature matching across video streams remains a cornerstone challenge in computer vision. Increasingly, robust multimodal matching has garnered interest in robotics, surveillance, remote sensing, and medical imaging. While traditional rely…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Jie Wang , Chen Ye Gan , Caoqi Wei , Jiangtao Wen , Yuxing Han

Many applications in robotics and human-computer interaction can benefit from understanding 3D motion of points in a dynamic environment, widely noted as scene flow. While most previous methods focus on stereo and RGB-D images as input, few…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Xingyu Liu , Charles R. Qi , Leonidas J. Guibas

We propose a novel approach to the problem of mutual information (MI) estimation via introducing a family of estimators based on normalizing flows. The estimator maps original data to the target distribution, for which MI is easier to…

Machine Learning · Computer Science 2024-05-28 Ivan Butakov , Alexander Tolmachev , Sofia Malanchuk , Anna Neopryatnaya , Alexey Frolov

We introduce a way to learn to estimate a scene representation from a single image by predicting a low-dimensional subspace of optical flow for each training example, which encompasses the variety of possible camera and object movement.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Richard Strong Bowen , Richard Tucker , Ramin Zabih , Noah Snavely

Spiking Neural Networks (SNNs) have emerged as a promising tool for event-based optical flow estimation tasks due to their ability to leverage spatio-temporal information and low-power capabilities. However, the performance of SNN models is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Hongze Sun , Jun Wang , Wuque Cai , Duo Chen , Qianqian Liao , Jiayi He , Yan Cui , Dezhong Yao , Daqing Guo

A generative model based on a continuous-time normalizing flow between any pair of base and target probability densities is proposed. The velocity field of this flow is inferred from the probability current of a time-dependent density that…

Machine Learning · Computer Science 2023-03-10 Michael S. Albergo , Eric Vanden-Eijnden

This paper proposes a self-supervised learned local detector and descriptor, called EventPoint, for event stream/camera tracking and registration. Event-based cameras have grown in popularity because of their biological inspiration and low…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Ze Huang , Li Sun , Cheng Zhao , Song Li , Songzhi Su

Most of current Convolution Neural Network (CNN) based methods for optical flow estimation focus on learning optical flow on synthetic datasets with groundtruth, which is not practical. In this paper, we propose an unsupervised optical flow…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Shuosen Guan , Haoxin Li , Wei-Shi Zheng

Capsule networks (CapsNets) have recently shown promise to excel in most computer vision tasks, especially pertaining to scene understanding. In this paper, we explore CapsNet's capabilities in optical flow estimation, a task at which…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Vinoj Jayasundara , Debaditya Roy , Basura Fernando