English
Related papers

Related papers: FlowCaps: Optical Flow Estimation with Capsule Net…

200 papers

Existing optical flow estimators usually employ the network architectures typically designed for image classification as the encoder to extract per-pixel features. However, due to the natural difference between the tasks, the architectures…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Zhiwei Lin , Tingting Liang , Taihong Xiao , Yongtao Wang , Zhi Tang , Ming-Hsuan Yang

Akin to many subareas of computer vision, the recent advances in deep learning have also significantly influenced the literature on optical flow. Previously, the literature had been dominated by classical energy-based models, which…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Junhwa Hur , Stefan Roth

Capsule Network (CapsNet) classifier has several advantages over CNNs, including better detection of images containing overlapping categories and higher accuracy on transformed images. Despite the advantages, CapsNet is slow due to its…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Pouya Shiri , Amirali Baniasadi

Capsule networks aim to parse images into a hierarchy of objects, parts and relations. While promising, they remain limited by an inability to learn effective low level part descriptions. To address this issue we propose a way to learn…

Computer Vision and Pattern Recognition · Computer Science 2021-02-22 Sara Sabour , Andrea Tagliasacchi , Soroosh Yazdani , Geoffrey E. Hinton , David J. Fleet

Spiking Neural Networks (SNNs) have emerged as a promising tool for event-based optical flow estimation tasks due to their ability to leverage spatio-temporal information and low-power capabilities. However, the performance of SNN models is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Hongze Sun , Jun Wang , Wuque Cai , Duo Chen , Qianqian Liao , Jiayi He , Yan Cui , Dezhong Yao , Daqing Guo

Recent work has shown that optical flow estimation can be formulated as a supervised learning task and can be successfully solved with convolutional networks. Training of the so-called FlowNet was enabled by a large synthetically generated…

Computer Vision and Pattern Recognition · Computer Science 2018-01-18 Nikolaus Mayer , Eddy Ilg , Philip Häusser , Philipp Fischer , Daniel Cremers , Alexey Dosovitskiy , Thomas Brox

Convolutional Neural Networks (CNNs) have been successful in solving tasks in computer vision including medical image segmentation due to their ability to automatically extract features from unstructured data. However, CNNs are sensitive to…

Image and Video Processing · Electrical Eng. & Systems 2022-03-18 Minh Tran , Viet-Khoa Vo-Ho , Kyle Quinn , Hien Nguyen , Khoa Luu , Ngan Le

The recent advances in Deep Convolutional Neural Networks (DCNNs) have shown extremely good results for video human action classification, however, action detection is still a challenging problem. The current action detection approaches…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Kevin Duarte , Yogesh S Rawat , Mubarak Shah

In this paper, we propose a convolutional layer inspired by optical flow algorithms to learn motion representations. Our representation flow layer is a fully-differentiable layer designed to capture the `flow' of any representation channel…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 AJ Piergiovanni , Michael S. Ryoo

Event-based cameras can overpass frame-based cameras limitations for important tasks such as high-speed motion detection during self-driving cars navigation in low illumination conditions. The event cameras' high temporal resolution and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-31 Haixin Sun , Minh-Quan Dao , Vincent Fremont

This paper proposes a deep learning approach for traffic flow prediction in complex road networks. Traffic flow data from induction loop sensors are essentially a time series, which is also spatially related to traffic in different road…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Youngjoo Kim , Peng Wang , Yifei Zhu , Lyudmila Mihaylova

Standard frame-based cameras that sample light intensity frames are heavily impacted by motion blur for high-speed motion and fail to perceive scene accurately when the dynamic range is high. Event-based cameras, on the other hand, overcome…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Chankyu Lee , Adarsh Kumar Kosta , Kaushik Roy

Capsule Networks (CapsNets) are brand-new architectures that have shown ground-breaking results in certain areas of Computer Vision (CV). In 2017, Hinton and his team introduced CapsNets with routing-by-agreement in "Sabour et al" and in a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Moein Hasani , Amin Nasim Saravi , Hassan Khotanlou

Using a layered representation for motion estimation has the advantage of being able to cope with discontinuities and occlusions. In this paper, we learn to estimate optical flow by combining a layered motion representation with deep…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Xi Zhang , Di Ma , Xu Ouyang , Shanshan Jiang , Lin Gan , Gady Agam

Most of current Convolution Neural Network (CNN) based methods for optical flow estimation focus on learning optical flow on synthetic datasets with groundtruth, which is not practical. In this paper, we propose an unsupervised optical flow…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Shuosen Guan , Haoxin Li , Wei-Shi Zheng

Optical flow is an indispensable building block for various important computer vision tasks, including motion estimation, object tracking, and disparity measurement. In this work, we propose TransFlow, a pure transformer architecture for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yawen Lu , Qifan Wang , Siqi Ma , Tong Geng , Yingjie Victor Chen , Huaijin Chen , Dongfang Liu

Capsule Network is a promising concept in deep learning, yet its true potential is not fully realized thus far, providing sub-par performance on several key benchmark datasets with complex data. Drawing intuition from the success achieved…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Jathushan Rajasegaran , Vinoj Jayasundara , Sandaru Jayasekara , Hirunima Jayasekara , Suranga Seneviratne , Ranga Rodrigo

Deep convolutional neural networks (DCNN) have recently shown promising results in low-level computer vision problems such as optical flow and disparity estimation, but still, have much room to further improve their performance. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-10-12 Juan Luis Gonzalez , Muhammad Sarmad , Hyunjoo J. Lee , Munchurl Kim

Event-based cameras display great potential for a variety of tasks such as high-speed motion detection and navigation in low-light environments where conventional frame-based cameras suffer critically. This is attributed to their high…

Neural and Evolutionary Computing · Computer Science 2020-09-16 Chankyu Lee , Adarsh Kumar Kosta , Alex Zihao Zhu , Kenneth Chaney , Kostas Daniilidis , Kaushik Roy

Past few years have witnessed exponential growth of interest in deep learning methodologies with rapidly improving accuracies and reduced computational complexity. In particular, architectures using Convolutional Neural Networks (CNNs) have…

Computer Vision and Pattern Recognition · Computer Science 2018-05-11 Sai Samarth R Phaye , Apoorva Sikka , Abhinav Dhall , Deepti Bathula