English
Related papers

Related papers: SSTM: Spatiotemporal Recurrent Transformers for Mu…

200 papers

Effective water resource management requires information on water availability, both in terms of quality and quantity, spatially and temporally. In this paper, we study the methodology behind Transfer Learning (TL) through fine-tuning and…

Machine Learning · Computer Science 2021-12-07 Roland Oruche , Lisa Egede , Tracy Baker , Fearghal O'Donncha

Optical flow estimation is very challenging in situations with transparent or occluded objects. In this work, we address these challenges at the task level by introducing Amodal Optical Flow, which integrates optical flow with amodal…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Maximilian Luz , Rohit Mohan , Ahmed Rida Sekkat , Oliver Sawade , Elmar Matthes , Thomas Brox , Abhinav Valada

Optical flow is a crucial component of the feature space for early visual processing of dynamic scenes especially in new applications such as self-driving vehicles, drones and autonomous robots. The dynamic vision sensors are well suited…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Himanshu Akolkar , SioHoi Ieng , Ryad Benosman

Optical flow estimation is an essential task in self-driving systems, which helps autonomous vehicles perceive temporal continuity information of surrounding scenes. The calculation of all-pair correlation plays an important role in many…

Computer Vision and Pattern Recognition · Computer Science 2022-02-03 Hao Shi , Yifan Zhou , Kailun Yang , Xiaoting Yin , Kaiwei Wang

We address unsupervised optical flow estimation for ego-centric motion. We argue that optical flow can be cast as a geometrical warping between two successive video frames and devise a deep architecture to estimate such transformation in…

Computer Vision and Pattern Recognition · Computer Science 2017-10-31 Stefano Alletto , Davide Abati , Simone Calderara , Rita Cucchiara , Luca Rigazio

The usage of neural networks (NNs) for flow reconstruction (FR) tasks from a limited number of sensors is attracting strong research interest, owing to NNs' ability to replicate high dimensional relationships. Trained on a single flow case…

Fluid Dynamics · Physics 2024-06-19 Ali Girayhan Özbay , Sylvain Laizet

Predicting future frames of a video is challenging because it is difficult to learn the uncertainty of the underlying factors influencing their contents. In this paper, we propose a novel video prediction model, which has…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Xi Ye , Guillaume-Alexandre Bilodeau

Predicting spatio-temporal traffic flow presents significant challenges due to complex interactions between spatial and temporal factors. Existing approaches often address these dimensions in isolation, neglecting their critical…

Artificial Intelligence · Computer Science 2024-11-15 Weilin Ruan , Wenzhuo Wang , Siru Zhong , Wei Chen , Li Liu , Yuxuan Liang

Event-based cameras are raising interest within the computer vision community. These sensors operate with asynchronous pixels, emitting events, or "spikes", when the luminance change at a given pixel since the last event surpasses a certain…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Javier Cuadrado , Ulysse Rançon , Benoît Cottereau , Francisco Barranco , Timothée Masquelier

Event cameras rely on motion to obtain information about scene appearance. This means that appearance and motion are inherently linked: either both are present and recorded in the event data, or neither is captured. Previous works treat the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Shuang Guo , Friedhelm Hamann , Guillermo Gallego

Event cameras are novel bio-inspired sensors that offer advantages over traditional cameras (low latency, high dynamic range, low power, etc.). Optical flow estimation methods that work on packets of events trade off speed for accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shintaro Shiba , Yoshimitsu Aoki , Guillermo Gallego

Learning-based optical flow estimation has been dominated with the pipeline of cost volume with convolutions for flow regression, which is inherently limited to local correlations and thus is hard to address the long-standing challenge of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Haofei Xu , Jing Zhang , Jianfei Cai , Hamid Rezatofighi , Dacheng Tao

3D occupancy and scene flow offer a detailed and dynamic representation of 3D scene. Recognizing the sparsity and complexity of 3D space, previous vision-centric methods have employed implicit learning-based approaches to model spatial and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Zhimin Liao , Ping Wei , Shuaijia Chen , Haoxuan Wang , Ziyang Ren

Neural Scene Flow Prior (NSFP) and Fast Neural Scene Flow (FNSF) have shown remarkable adaptability in the context of large out-of-distribution autonomous driving. Despite their success, the underlying reasons for their astonishing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Dongrui Liu , Daqi Liu , Xueqian Li , Sihao Lin , Hongwei xie , Bing Wang , Xiaojun Chang , Lei Chu

Over the past few decades, the hydrology community has witnessed notable advancements in streamflow prediction, particularly with the introduction of cutting-edge machine-learning algorithms. Recurrent neural networks, especially Long…

Machine Learning · Computer Science 2023-05-23 Sinan Rasiya Koya , Tirthankar Roy

We present an unsupervised learning framework for simultaneously training single-view depth prediction and optical flow estimation models using unlabeled video sequences. Existing unsupervised methods often exploit brightness constancy and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Yuliang Zou , Zelun Luo , Jia-Bin Huang

Accurate traffic flow prediction heavily relies on the spatio-temporal correlation of traffic flow data. Most current studies separately capture correlations in spatial and temporal dimensions, making it difficult to capture complex…

Machine Learning · Computer Science 2025-01-03 Ben-Ao Dai , Nengchao Lyu , Yongchao Miao

This paper proposes a two-stream flow-guided convolutional attention networks for action recognition in videos. The central idea is that optical flows, when properly compensated for the camera motion, can be used to guide attention to the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-31 An Tran , Loong-Fah Cheong

End-to-end trained convolutional neural networks have led to a breakthrough in optical flow estimation. The most recent advances focus on improving the optical flow estimation by improving the architecture and setting a new benchmark on the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-03 D. B. de Jong , F. Paredes-Vallés , G. C. H. E. de Croon

The FlowNet demonstrated that optical flow estimation can be cast as a learning problem. However, the state of the art with regard to the quality of the flow has still been defined by traditional methods. Particularly on small displacements…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Eddy Ilg , Nikolaus Mayer , Tonmoy Saikia , Margret Keuper , Alexey Dosovitskiy , Thomas Brox