English
Related papers

Related papers: OCAI: Improving Optical Flow Estimation by Occlusi…

200 papers

Although many approaches for multi-human pose estimation in videos have shown profound results, they require densely annotated data which entails excessive man labor. Furthermore, there exists occlusion and motion blur that inevitably lead…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Kyung-Min Jin , Gun-Hee Lee , Seong-Whan Lee

Video frame interpolation can up-convert the frame rate and enhance the video quality. In recent years, although the interpolation performance has achieved great success, image blur usually occurs at the object boundaries owing to the large…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Bin Zhao , Xuelong Li

The problem of video frame interpolation is to increase the temporal resolution of a low frame-rate video, by interpolating novel frames between existing temporally sparse frames. This paper presents a self-supervised approach to video…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Ziang Cheng , Shihao Jiang , Hongdong Li

Video style transfer techniques inspire many exciting applications on mobile devices. However, their efficiency and stability are still far from satisfactory. To boost the transfer stability across frames, optical flow is widely adopted,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Xinghao Chen , Yiman Zhang , Yunhe Wang , Han Shu , Chunjing Xu , Chang Xu

We address the problem of motion estimation in images operating in the frequency domain. A method is presented which extends phase correlation to handle multiple motions present in an area. Our scheme is based on a novel Bilateral-Phase…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Vasileios Argyriou

Occlusions pose a significant challenge to optical flow algorithms that even rely on global evidences. We consider an occluded point to be one that is imaged in the reference frame but not in the next. Estimating the motion of these points…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Yu Jing , Tan Yujuan , Ren Ao , Liu Duo

Occlusions pose a significant challenge to optical flow algorithms that rely on local evidences. We consider an occluded point to be one that is imaged in the first frame but not in the next, a slight overloading of the standard definition…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Shihao Jiang , Dylan Campbell , Yao Lu , Hongdong Li , Richard Hartley

State-of-the-art frame interpolation methods generate intermediate frames by inferring object motions in the image from consecutive key-frames. In the absence of additional information, first-order approximations, i.e. optical flow, must be…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Stepan Tulyakov , Daniel Gehrig , Stamatios Georgoulis , Julius Erbach , Mathias Gehrig , Yuanyou Li , Davide Scaramuzza

In the era of end-to-end deep learning, many advances in computer vision are driven by large amounts of labeled data. In the optical flow setting, however, obtaining dense per-pixel ground truth for real scenes is difficult and thus such…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Simon Meister , Junhwa Hur , Stefan Roth

We present a framework to use recently introduced Capsule Networks for solving the problem of Optical Flow, one of the fundamental computer vision tasks. Most of the existing state of the art deep architectures either uses a correlation…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Rahul Chand , Rajat Arora , K Ram Prabhakar , R Venkatesh Babu

Optical flow estimation remains challenging due to untextured areas, motion boundaries, occlusions, and more. Thus, the estimated flow is not equally reliable across the image. To that end, post-hoc confidence measures have been introduced…

Computer Vision and Pattern Recognition · Computer Science 2017-08-23 Anne S. Wannenwetsch , Margret Keuper , Stefan Roth

We introduce VideoFlow, a novel optical flow estimation framework for videos. In contrast to previous methods that learn to estimate optical flow from two frames, VideoFlow concurrently estimates bi-directional optical flows for multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Xiaoyu Shi , Zhaoyang Huang , Weikang Bian , Dasong Li , Manyuan Zhang , Ka Chun Cheung , Simon See , Hongwei Qin , Jifeng Dai , Hongsheng Li

Flow-based frame interpolation methods ensure motion stability through estimated intermediate flow but often introduce severe artifacts in complex motion regions. Recent generative approaches, boosted by large-scale pre-trained video…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Guozhen Zhang , Yuhan Zhu , Yutao Cui , Xiaotong Zhao , Kai Ma , Limin Wang

In this paper, we present a new inpainting framework for recovering missing regions of video frames. Compared with image inpainting, performing this task on video presents new challenges such as how to preserving temporal consistency and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Yifan Ding , Chuan Wang , Haibin Huang , Jiaming Liu , Jue Wang , Liqiang Wang

Event cameras respond to scene dynamics and offer advantages to estimate motion. Following recent image-based deep-learning achievements, optical flow estimation methods for event cameras have rushed to combine those image-based methods…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shintaro Shiba , Yoshimitsu Aoki , Guillermo Gallego

Existing optical flow methods make generic, spatially homogeneous, assumptions about the spatial structure of the flow. In reality, optical flow varies across an image depending on object class. Simply put, different objects move…

Computer Vision and Pattern Recognition · Computer Science 2016-04-12 Laura Sevilla-Lara , Deqing Sun , Varun Jampani , Michael J. Black

We propose a novel data augmentation approach, DistractFlow, for training optical flow estimation models by introducing realistic distractions to the input frames. Based on a mixing ratio, we combine one of the frames in the pair with a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Jisoo Jeong , Hong Cai , Risheek Garrepalli , Fatih Porikli

Optical flow techniques are becoming increasingly performant and robust when estimating motion in a scene, but their performance has yet to be proven in the area of facial expression recognition. In this work, a variety of optical flow…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Benjamin Allaert , Isaac Ronald Ward , Ioan Marius Bilasco , Chaabane Djeraba , Mohammed Bennamoun

Inaccurate optical flow estimates in and near occluded regions, and out-of-boundary regions are two of the current significant limitations of optical flow estimation algorithms. Recent state-of-the-art optical flow estimation algorithms are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Fisseha Admasu Ferede , Madhusudhanan Balasubramanian

Image enhancement holds extensive applications in real-world scenarios due to complex environments and limitations of imaging devices. Conventional methods are often constrained by their tailored models, resulting in diminished robustness…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yixuan Zhu , Wenliang Zhao , Ao Li , Yansong Tang , Jie Zhou , Jiwen Lu