English
Related papers

Related papers: CapsFlow: Optical Flow Estimation with Capsule Net…

200 papers

Capsule networks excel in understanding spatial relationships in 2D data for vision related tasks. Even though they are not designed to capture 1D temporal relationships, with TimeCaps we demonstrate that given the ability, capsule networks…

Convolutional Neural Networks need the construction of informative features, which are determined by channel-wise and spatial-wise information at the network's layers. In this research, we focus on bringing in a novel solution that uses…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Jerrin Bright , Suryaprakash Rajkumar , Arockia Selvakumar Arockia Doss

Temporal coherence is a valuable source of information in the context of optical flow estimation. However, finding a suitable motion model to leverage this information is a non-trivial task. In this paper we propose an unsupervised online…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Daniel Maurer , Andrés Bruhn

Large displacement optical flow is an integral part of many computer vision tasks. Variational optical flow techniques based on a coarse-to-fine scheme interpolate sparse matches and locally optimize an energy model conditioned on colour,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Qiao Chen , Charalambos Poullis

Deep learning approaches have achieved great success in addressing the problem of optical flow estimation. The keys to success lie in the use of cost volume and coarse-to-fine flow inference. However, the matching problem becomes ill-posed…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Tak-Wai Hui , Chen Change Loy

Current Deep Learning methods for environment segmentation and velocity estimation rely on Convolutional Recurrent Neural Networks to exploit spatio-temporal relationships within obtained sensor data. These approaches derive scene dynamics…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Marco Braun , Moritz Luszek , Mirko Meuter , Dominic Spata , Kevin Kollek , Anton Kummert

Motion representation plays a vital role in human action recognition in videos. In this study, we introduce a novel compact motion representation for video action recognition, named Optical Flow guided Feature (OFF), which enables the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Shuyang Sun , Zhanghui Kuang , Wanli Ouyang , Lu Sheng , Wei Zhang

In this paper, we deal with the problem to predict the future 3D motions of 3D object scans from previous two consecutive frames. Previous methods mostly focus on sparse motion prediction in the form of skeletons. While in this paper we…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Shuaihang Yuan , Xiang Li , Anthony Tzes , Yi Fang

Convolutional neural networks are the most widely used deep learning algorithms for traffic signal classification till date but they fail to capture pose, view, orientation of the images because of the intrinsic inability of max pooling…

Computer Vision and Pattern Recognition · Computer Science 2018-05-14 Amara Dinesh Kumar

Point cloud upsampling aims to generate dense point clouds from given sparse ones, which is a challenging task due to the irregular and unordered nature of point sets. To address this issue, we present a novel deep learning-based model,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Aihua Mao , Zihui Du , Junhui Hou , Yaqi Duan , Yong-jin Liu , Ying He

Recent deep learning-based optical flow estimators have exhibited impressive performance in generating local flows between consecutive frames. However, the estimation of long-range flows between distant frames, particularly under complex…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Guangyang Wu , Xiaohong Liu , Kunming Luo , Xi Liu , Qingqing Zheng , Shuaicheng Liu , Xinyang Jiang , Guangtao Zhai , Wenyi Wang

Video prediction is a fundamental task for various downstream applications, including robotics and world modeling. Although general video prediction models have achieved remarkable performance in standard scenarios, occlusion is still an…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Eliyas Suleyman , Paul Henderson , Eksan Firkat , Nicolas Pugeault

Foundational language models show a remarkable ability to learn new concepts during inference via context data. However, similar work for images lag behind. To address this challenge, we introduce FLoWN, a flow matching model that learns to…

Machine Learning · Computer Science 2025-04-22 Daniel Saragih , Deyu Cao , Tejas Balaji , Ashwin Santhosh

Next-generation radio surveys will yield an unprecedented amount of data, warranting analysis by use of machine learning techniques. Convolutional neural networks are the deep learning technique that has proven to be the most successful in…

Instrumentation and Methods for Astrophysics · Physics 2019-05-29 V. Lukic , M. Brüggen , B. Mingo , J. H. Croston , G. Kasieczka , P. N. Best

Human Activity Recognition (HAR) is a challenging problem that needs advanced solutions than using handcrafted features to achieve a desirable performance. Deep learning has been proposed as a solution to obtain more accurate HAR systems…

Machine Learning · Computer Science 2020-07-08 Hamed Damirchi , Rooholla Khorrambakht , Hamid Taghirad

Capsule Networks have emerged as a powerful class of deep learning architectures, known for robust performance with relatively few parameters compared to Convolutional Neural Networks (CNNs). However, their inherent efficiency is often…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Miles Everett , Mingjun Zhong , Georgios Leontidis

Underwater environments impose severe constraints on conventional imaging systems and demand solutions that balance high-quality sensing with strict resource efficiency. While emerging event cameras offer a promising alternative, their…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Pei Zhang , Yunkai Liang , Kaiqiang Wang

Optical flow models trained on high-quality data often degrade severely when confronted with real-world corruptions such as blur, noise, and compression artifacts. To overcome this limitation, we formulate Degradation-Aware Optical Flow, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jaewon Min , Jaeeun Lee , Yeji Choi , Paul Hyunbin Cho , Jin Hyeon Kim , Tae-Young Lee , Jongsik Ahn , Hwayeong Lee , Seonghyun Park , Seungryong Kim

In this paper, we develop and explore deep anomaly detection techniques based on the capsule network (CapsNet) for image data. Being able to encoding intrinsic spatial relationship between parts and a whole, CapsNet has been applied as both…

Machine Learning · Computer Science 2019-07-16 Xiaoyan Li , Iluju Kiringa , Tet Yeap , Xiaodan Zhu , Yifeng Li

The scarcity of ground-truth labels poses one major challenge in developing optical flow estimation models that are both generalizable and robust. While current methods rely on data augmentation, they have yet to fully exploit the rich…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jisoo Jeong , Hong Cai , Risheek Garrepalli , Jamie Menjay Lin , Munawar Hayat , Fatih Porikli