English
Related papers

Related papers: Self-Supervised Approach for Facial Movement Based…

200 papers

Convolutional Neural Networks (CNN) have been found to have great potential in optical flow problems thanks to an abundance of data available for training a deep network. The displacement estimation step in UltraSound Elastography (USE) can…

Image and Video Processing · Electrical Eng. & Systems 2020-07-06 Ali K. Z. Tehrani , Morteza Mirzaei , Hassan Rivaz

Recently, convolutional networks (convnets) have proven useful for predicting optical flow. Much of this success is predicated on the availability of large datasets that require expensive and involved data acquisition and laborious la-…

Computer Vision and Pattern Recognition · Computer Science 2016-08-23 Jason J. Yu , Adam W. Harley , Konstantinos G. Derpanis

Event-based cameras have shown great promise in a variety of situations where frame based cameras suffer, such as high speed motions and high dynamic range scenes. However, developing algorithms for event measurements requires a new class…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Alex Zihao Zhu , Liangzhe Yuan , Kenneth Chaney , Kostas Daniilidis

We propose a new self-supervised approach to image feature learning from motion cue. This new approach leverages recent advances in deep learning in two directions: 1) the success of training deep neural network in estimating optical flow…

Computer Vision and Pattern Recognition · Computer Science 2019-01-10 Bin Ma , Shubao Liu , Yingxuan Zhi , Qi Song

Even with the recent advances in convolutional neural networks (CNN) in various visual recognition tasks, the state-of-the-art action recognition system still relies on hand crafted motion feature such as optical flow to achieve the best…

Computer Vision and Pattern Recognition · Computer Science 2018-02-20 Joe Yue-Hei Ng , Jonghyun Choi , Jan Neumann , Larry S. Davis

In this paper, we explore how synthetically generated 3D face models can be used to construct a high accuracy ground truth for depth. This allows us to train the Convolutional Neural Networks (CNN) to solve facial depth estimation problems.…

Image and Video Processing · Electrical Eng. & Systems 2020-03-27 Faisal Khan , Shubhajit Basak , Hossein Javidnia , Michael Schukat , Peter Corcoran

Classical approaches for estimating optical flow have achieved rapid progress in the last decade. However, most of them are too slow to be applied in real-time video analysis. Due to the great success of deep learning, recent work has…

Computer Vision and Pattern Recognition · Computer Science 2017-07-21 Yi Zhu , Shawn Newsam

We present an unsupervised learning framework for simultaneously training single-view depth prediction and optical flow estimation models using unlabeled video sequences. Existing unsupervised methods often exploit brightness constancy and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Yuliang Zou , Zelun Luo , Jia-Bin Huang

Using a layered representation for motion estimation has the advantage of being able to cope with discontinuities and occlusions. In this paper, we learn to estimate optical flow by combining a layered motion representation with deep…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Xi Zhang , Di Ma , Xu Ouyang , Shanshan Jiang , Lin Gan , Gady Agam

In dense foggy scenes, existing optical flow methods are erroneous. This is due to the degradation caused by dense fog particles that break the optical flow basic assumptions such as brightness and gradient constancy. To address the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Wending Yan , Aashish Sharma , Robby T. Tan

Optical flow estimation is a crucial subfield of computer vision, serving as a foundation for video tasks. However, the real-world robustness is limited by animated synthetic datasets for training. This introduces domain gaps when applied…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yingping Liang , Ying Fu , Yutao Hu , Wenqi Shao , Jiaming Liu , Debing Zhang

Scene flow represents the motion of points in the 3D space, which is the counterpart of the optical flow that represents the motion of pixels in the 2D image. However, it is difficult to obtain the ground truth of scene flow in the real…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Guangming Wang , Xiaoyu Tian , Ruiqi Ding , Hesheng Wang

Optical flow estimation is crucial for various applications in vision and robotics. As the difficulty of collecting ground truth optical flow in real-world scenarios, most of the existing methods of learning optical flow still adopt…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Sheng-Chi Huang , Wei-Chen Chiu

Scene flow represents the 3D motion of each point in the scene, which explicitly describes the distance and the direction of each point's movement. Scene flow estimation is used in various applications such as autonomous driving fields,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Guangming Wang , Zhiheng Feng , Chaokang Jiang , Hesheng Wang

The FlowNet demonstrated that optical flow estimation can be cast as a learning problem. However, the state of the art with regard to the quality of the flow has still been defined by traditional methods. Particularly on small displacements…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Eddy Ilg , Nikolaus Mayer , Tonmoy Saikia , Margret Keuper , Alexey Dosovitskiy , Thomas Brox

When a person attempts to conceal an emotion, the genuine emotion is manifest as a micro-expression. Exploration of automatic facial micro-expression recognition systems is relatively new in the computer vision domain. This is due to the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Sze-Teng Liong , Y. S. Gan , Wei-Chuen Yau , Yen-Chang Huang , Tan Lit Ken

Scene flow estimation has been receiving increasing attention for 3D environment perception. Monocular scene flow estimation -- obtaining 3D structure and 3D motion from two temporally consecutive images -- is a highly ill-posed problem,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Junhwa Hur , Stefan Roth

Event cameras rely on motion to obtain information about scene appearance. This means that appearance and motion are inherently linked: either both are present and recorded in the event data, or neither is captured. Previous works treat the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Shuang Guo , Friedhelm Hamann , Guillermo Gallego

We present a self-supervised learning approach for optical flow. Our method distills reliable flow estimations from non-occluded pixels, and uses these predictions as ground truth to learn optical flow for hallucinated occlusions. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-22 Pengpeng Liu , Michael Lyu , Irwin King , Jia Xu

Various research studies indicate that action recognition performance highly depends on the types of motions being extracted and how accurate the human actions are represented. In this paper, we investigate different optical flow, and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Lei Wang , Piotr Koniusz