English
Related papers

Related papers: CNN-based Patch Matching for Optical Flow with Thr…

200 papers

Object trackers based on Convolution Neural Network (CNN) have achieved state-of-the-art performance on recent tracking benchmarks, while they suffer from slow computational speed. The high computational load arises from the extraction of…

Image and Video Processing · Electrical Eng. & Systems 2019-01-10 Al-Hussein A. El-Shafie , Mohamed Zaki , Serag El-Din Habib

Optical flow provides information on relative motion that is an important component in many computer vision pipelines. Neural networks provide high accuracy optical flow, yet their complexity is often prohibitive for application at the edge…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Yannick Schnider , Stanislaw Wozniak , Mathias Gehrig , Jules Lecomte , Axel von Arnim , Luca Benini , Davide Scaramuzza , Angeliki Pantazi

We propose a new self-supervised approach to image feature learning from motion cue. This new approach leverages recent advances in deep learning in two directions: 1) the success of training deep neural network in estimating optical flow…

Computer Vision and Pattern Recognition · Computer Science 2019-01-10 Bin Ma , Shubao Liu , Yingxuan Zhi , Qi Song

Convolutional neural networks (CNNs) have been widely used over many areas in compute vision. Especially in classification. Recently, FlowNet and several works on opti- cal estimation using CNNs shows the potential ability of CNNs in doing…

Computer Vision and Pattern Recognition · Computer Science 2017-10-05 Junxuan Li

Traditionally, CNN models possess hierarchical structures and utilize the feature mapping of the last layer to obtain the prediction output. However, it can be difficulty to settle the optimal network depth and make the middle layers learn…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Zhicheng Cai

Optical flow estimation is one of the fundamental tasks in low-level computer vision, which describes the pixel-wise displacement and can be used in many other tasks. From the apparent aspect, the optical flow can be viewed as the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Yuhao Cheng , Siru Zhang , Yiqiang Yan

In this paper, we study the challenging problem of multi-object tracking in a complex scene captured by a single camera. Different from the existing tracklet association-based tracking methods, we propose a novel and efficient way to obtain…

Computer Vision and Pattern Recognition · Computer Science 2016-09-27 Bing Wang , Li Wang , Bing Shuai , Zhen Zuo , Ting Liu , Kap Luk Chan , Gang Wang

In recent years, many publications showed that convolutional neural network based features can have a superior performance to engineered features. However, not much effort was taken so far to extract local features efficiently for a whole…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 Christian Bailer , Tewodros Habtegebrial , Kiran varanasi , Didier Stricker

Recent semi-dense image matching methods have achieved remarkable success, but two long-standing issues still impair their performance. At the coarse stage, the over-exclusion issue of their mutual nearest neighbor (MNN) matching layer…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Ke Jin , Jiming Chen , Qi Ye

Event cameras respond to scene dynamics and offer advantages to estimate motion. Following recent image-based deep-learning achievements, optical flow estimation methods for event cameras have rushed to combine those image-based methods…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shintaro Shiba , Yoshimitsu Aoki , Guillermo Gallego

Motion representation plays a vital role in human action recognition in videos. In this study, we introduce a novel compact motion representation for video action recognition, named Optical Flow guided Feature (OFF), which enables the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Shuyang Sun , Zhanghui Kuang , Wanli Ouyang , Lu Sheng , Wei Zhang

Recently, convolutional networks (convnets) have proven useful for predicting optical flow. Much of this success is predicated on the availability of large datasets that require expensive and involved data acquisition and laborious la-…

Computer Vision and Pattern Recognition · Computer Science 2016-08-23 Jason J. Yu , Adam W. Harley , Konstantinos G. Derpanis

In this work, we propose a novel Convolutional Neural Network (CNN) architecture for the joint detection and matching of feature points in images acquired by different sensors using a single forward pass. The resulting feature detector is…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Elad Ben Baruch , Yosi Keller

In recent years, deep learning-based point cloud normal estimation has made great progress. However, existing methods mainly rely on the PCPNet dataset, leading to overfitting. In addition, the correlation between point clouds with…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Wei Jin , Jun Zhou , Nannan Li , Haba Madeline , Xiuping Liu

Optical flow is an indispensable building block for various important computer vision tasks, including motion estimation, object tracking, and disparity measurement. In this work, we propose TransFlow, a pure transformer architecture for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yawen Lu , Qifan Wang , Siqi Ma , Tong Geng , Yingjie Victor Chen , Huaijin Chen , Dongfang Liu

3D scene flow estimation from point clouds is a low-level 3D motion perception task in computer vision. Flow embedding is a commonly used technique in scene flow estimation, and it encodes the point motion between two consecutive frames.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Guangming Wang , Yunzhe Hu , Zhe Liu , Yiyang Zhou , Masayoshi Tomizuka , Wei Zhan , Hesheng Wang

The FlowNet demonstrated that optical flow estimation can be cast as a learning problem. However, the state of the art with regard to the quality of the flow has still been defined by traditional methods. Particularly on small displacements…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Eddy Ilg , Nikolaus Mayer , Tonmoy Saikia , Margret Keuper , Alexey Dosovitskiy , Thomas Brox

We study the unsupervised learning of CNNs for optical flow estimation using proxy ground truth data. Supervised CNNs, due to their immense learning capacity, have shown superior performance on a range of computer vision problems including…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Yi Zhu , Zhenzhong Lan , Shawn Newsam , Alexander G. Hauptmann

Learning-based optical flow estimation has been dominated with the pipeline of cost volume with convolutions for flow regression, which is inherently limited to local correlations and thus is hard to address the long-standing challenge of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Haofei Xu , Jing Zhang , Jianfei Cai , Hamid Rezatofighi , Dacheng Tao

Although CNNs have gained the ability to transfer learned knowledge from source task to target task by virtue of large annotated datasets but consume huge processing time to fine-tune without GPU. In this paper, we propose a new…

Computer Vision and Pattern Recognition · Computer Science 2019-03-28 Tasfia Shermin , Manzur Murshed , Guojun Lu , Shyh Wei Teng