English
Related papers

Related papers: EventShiftFlow: Towards Hardware-efficient FPGA-ba…

200 papers

Event-based vision represents a paradigm shift in how vision information is captured and processed. By only responding to dynamic intensity changes in the scene, event-based sensing produces far less data than conventional frame-based…

Hardware Architecture · Computer Science 2024-04-09 Yizhao Gao , Baoheng Zhang , Yuhao Ding , Hayden Kwok-Hay So

Inspired by frame-based methods, state-of-the-art event-based optical flow networks rely on the explicit construction of correlation volumes, which are expensive to compute and store, rendering them unsuitable for robotic applications with…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Yilun Wu , Federico Paredes-Vallés , Guido C. H. E. de Croon

Soft sensors are crucial in bridging autonomous systems' physical and digital realms, enhancing sensor fusion and perception. Instead of deploying soft sensors on the Cloud, this study shift towards employing on-device soft sensors,…

Machine Learning · Computer Science 2024-10-15 Tianheng Ling , Chao Qian , Gregor Schiele

In this paper, we explore the problem of event-based meshflow estimation, a novel task that involves predicting a spatially smooth sparse motion field from event cameras. To start, we review the state-of-the-art in event-based flow…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Xinglong Luo , Ao Luo , Kunming Luo , Zhengning Wang , Ping Tan , Bing Zeng , Shuaicheng Liu

As an alternative sensing paradigm, dynamic vision sensors (DVS) have been recently explored to tackle scenarios where conventional sensors result in high data rate and processing time. This paper presents a hybrid event-frame approach for…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Vivek Mohan , Deepak Singla , Tarun Pulluri , Andres Ussa , Pradeep Kumar Gopalakrishnan , Pao-Sheng Sun , Bharath Ramesh , Arindam Basu

Occlusions between consecutive frames have long posed a significant challenge in optical flow estimation. The inherent ambiguity introduced by occlusions directly violates the brightness constancy constraint and considerably hinders…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Shangkun Sun , Jiaming Liu , Thomas H. Li , Huaxia Li , Guoqing Liu , Wei Gao

Flow boiling is an efficient heat transfer mechanism capable of dissipating high heat loads with minimal temperature variation, making it an ideal thermal management method. However, sudden shifts between flow regimes can disrupt thermal…

Contrary to conventional frame-based imaging, event-based vision (EBV) or dynamic vision sensing (DVS) asynchronously records binary signals of intensity changes for given pixels with microsecond resolution. The present work explores the…

Fluid Dynamics · Physics 2022-06-22 Christian Willert , Joachim Klinner

Dense optical flow estimation plays a key role in many robotic vision tasks. In the past few years, with the advent of deep learning, we have witnessed great progress in optical flow estimation. However, current networks often consist of a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Lingtong Kong , Chunhua Shen , Jie Yang

Event-based multimodal large language models (MLLMs) enable robust perception in high-speed and low-light scenarios, addressing key limitations of frame-based MLLMs. However, current event-based MLLMs often rely on dense image-like…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Shaoyu Liu , Jianing Li , Guanghui Zhao , Yunjian Zhang , Wen Jiang , Ming Li , Xiangyang Ji

Existing tracking algorithms typically rely on low-frame-rate RGB cameras coupled with computationally intensive deep neural network architectures to achieve effective tracking. However, such frame-based methods inherently face challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shiao Wang , Xiao Wang , Liye Jin , Bo Jiang , Lin Zhu , Lan Chen , Yonghong Tian , Bin Luo

Scene flow estimation is a crucial component in the development of autonomous driving and 3D robotics, providing valuable information for environment perception and navigation. Despite the advantages of learning-based scene flow estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Rahul Ahuja , Chris Baker , Wilko Schwarting

High-speed vision sensing is essential for real-time perception in applications such as robotics, autonomous vehicles, and industrial automation. Traditional frame-based vision systems suffer from motion blur, high latency, and redundant…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Riadul Islam , Joey Mulé , Dhandeep Challagundla , Shahmir Rizvi , Sean Carson

Lossy compression and rate-adaptive streaming are a mainstay in traditional video steams. However, a new class of neuromorphic ``event'' sensors records video with asynchronous pixel samples rather than image frames. These sensors are…

Image and Video Processing · Electrical Eng. & Systems 2025-08-22 Andrew C. Freeman

Event cameras are bio-inspired sensors that asynchronously report intensity changes in microsecond resolution. DAVIS can capture high dynamics of a scene and simultaneously output high temporal resolution events and low frame-rate intensity…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Liyuan Pan , Miaomiao Liu , Richard Hartley

Egomotion estimation is crucial for applications such as autonomous navigation and robotics, where accurate and real-time motion tracking is required. However, traditional methods relying on inertial sensors are highly sensitive to external…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Hugh Greatorex , Michele Mastella , Madison Cotteret , Ole Richter , Elisabetta Chicca

We present a method for estimating dense continuous-time optical flow from event data. Traditional dense optical flow methods compute the pixel displacement between two images. Due to missing information, these approaches cannot recover the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Mathias Gehrig , Manasi Muglikar , Davide Scaramuzza

Small flying robots can perform landing maneuvers using bio-inspired optical flow by maintaining a constant divergence. However, optical flow is typically estimated from frame sequences recorded by standard miniature cameras. This requires…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Bas J. Pijnacker Hordijk , Kirk Y. W. Scheper , Guido C. H. E. de Croon

Tracking motions of humans or objects in the surroundings of the robot is essential to improve safe robot motions and reactions. In this work, we present an approach for scene flow estimation from low-density and noisy point clouds acquired…

Robotics · Computer Science 2025-08-01 Jack Sander , Giammarco Caroleo , Alessandro Albini , Perla Maiolino

Event cameras are bio-inspired vision sensors that asynchronously represent pixel-level brightness changes as event streams. Event-based monocular multi-view stereo (EMVS) is a technique that exploits the event streams to estimate…

Hardware Architecture · Computer Science 2022-06-08 Mingjun Li , Jianlei Yang , Yingjie Qi , Meng Dong , Yuhao Yang , Runze Liu , Weitao Pan , Bei Yu , Weisheng Zhao