English
Related papers

Related papers: Neuromorphic Optical Flow and Real-time Implementa…

200 papers

Event-based cameras can overpass frame-based cameras limitations for important tasks such as high-speed motion detection during self-driving cars navigation in low illumination conditions. The event cameras' high temporal resolution and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-31 Haixin Sun , Minh-Quan Dao , Vincent Fremont

With the advent of neuromorphic vision sensors such as event-based cameras, a paradigm shift is required for most computer vision algorithms. Among these algorithms, optical flow estimation is a prime candidate for this process considering…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Mahmoud Z. Khairallah , Fabien Bonardi , David Roussel , Samia Bouchafa

Akin to many subareas of computer vision, the recent advances in deep learning have also significantly influenced the literature on optical flow. Previously, the literature had been dominated by classical energy-based models, which…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Junhwa Hur , Stefan Roth

Event-based cameras have recently shown great potential for high-speed motion estimation owing to their ability to capture temporally rich information asynchronously. Spiking Neural Networks (SNNs), with their neuro-inspired event-driven…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Adarsh Kumar Kosta , Kaushik Roy

Optical Flow (OF) is the movement pattern of pixels or edges that is caused in a visual scene by the relative motion between an agent and a scene. OF is used in a wide range of computer vision algorithms and robotics applications. While the…

Image and Video Processing · Electrical Eng. & Systems 2023-09-25 Jonas Kühne , Michele Magno , Luca Benini

Event cameras rely on motion to obtain information about scene appearance. This means that appearance and motion are inherently linked: either both are present and recorded in the event data, or neither is captured. Previous works treat the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Shuang Guo , Friedhelm Hamann , Guillermo Gallego

We tackle the problem of estimating optical flow from a monocular camera in the context of autonomous driving. We build on the observation that the scene is typically composed of a static background, as well as a relatively small number of…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Min Bai , Wenjie Luo , Kaustav Kundu , Raquel Urtasun

Imaging flow cytometry systems aim to analyze a huge number of cells or micro-particles based on their physical characteristics. The vast majority of current systems acquire a large amount of images which are used to train deep artificial…

Neural and Evolutionary Computing · Computer Science 2023-03-21 Muhammed Gouda , Steven Abreu , Alessio Lugnan , Peter Bienstman

This paper deals with the scarcity of data for training optical flow networks, highlighting the limitations of existing sources such as labeled synthetic datasets or unlabeled real videos. Specifically, we introduce a framework to generate…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Filippo Aleotti , Matteo Poggi , Stefano Mattoccia

Event cameras provide an advantage over traditional frame-based cameras when capturing fast-moving objects without a motion blur. They achieve this by recording changes in light intensity (known as events), thus allowing them to operate at…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Wachirawit Ponghiran , Chamika Mihiranga Liyanagedera , Kaushik Roy

Optical flow is a classical task that is important to the vision community. Classical optical flow estimation uses two frames as input, whilst some recent methods consider multiple frames to explicitly model long-range information. The…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Qiaole Dong , Yanwei Fu

Standard frame-based cameras that sample light intensity frames are heavily impacted by motion blur for high-speed motion and fail to perceive scene accurately when the dynamic range is high. Event-based cameras, on the other hand, overcome…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Chankyu Lee , Adarsh Kumar Kosta , Kaushik Roy

The optical flow of humans is well known to be useful for the analysis of human action. Given this, we devise an optical flow algorithm specifically for human motion and show that it is superior to generic flow methods. Designing a method…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Anurag Ranjan , Javier Romero , Michael J. Black

Convolutional neural networks (CNNs) have recently been very successful in a variety of computer vision tasks, especially on those linked to recognition. Optical flow estimation has not been among the tasks where CNNs were successful. In…

Computer Vision and Pattern Recognition · Computer Science 2015-06-18 Philipp Fischer , Alexey Dosovitskiy , Eddy Ilg , Philip Häusser , Caner Hazırbaş , Vladimir Golkov , Patrick van der Smagt , Daniel Cremers , Thomas Brox

This paper describes a fully spike-based neural network for optical flow estimation from Dynamic Vision Sensor data. A low power embedded implementation of the method which combines the Asynchronous Time-based Image Sensor with IBM's…

Computer Vision and Pattern Recognition · Computer Science 2017-10-27 Germain Haessig , Andrew Cassidy , Rodrigo Alvarez , Ryad Benosman , Garrick Orchard

Event vision sensors (neuromorphic cameras) output sparse, asynchronous ON/OFF events triggered by log-intensity threshold crossings, enabling microsecond-scale sensing with high dynamic range and low data bandwidth. As a nonlinear system,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Nimrod Kruger , Nicholas Owen Ralph , Gregory Cohen , Paul Hurley

We present CompactFlowNet, the first real-time mobile neural network for optical flow prediction, which involves determining the displacement of each pixel in an initial frame relative to the corresponding pixel in a subsequent frame.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Andrei Znobishchev , Valerii Filev , Oleg Kudashev , Nikita Orlov , Humphrey Shi

Significant progress has been made for estimating optical flow using deep neural networks. Advanced deep models achieve accurate flow estimation often with a considerable computation complexity and time-consuming training processes. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Lingtong Kong , Jie Yang

Scene flow estimation is a crucial component in the development of autonomous driving and 3D robotics, providing valuable information for environment perception and navigation. Despite the advantages of learning-based scene flow estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Rahul Ahuja , Chris Baker , Wilko Schwarting

We propose DistSurf-OF, a novel optical flow method for neuromorphic cameras. Neuromorphic cameras (or event detection cameras) are an emerging sensor modality that makes use of dynamic vision sensors (DVS) to report asynchronously the…

Image and Video Processing · Electrical Eng. & Systems 2020-03-31 Mohammed Almatrafi , Raymond Baldwin , Kiyoharu Aizawa , Keigo Hirakawa