English
Related papers

Related papers: Motion Inbetweening via Deep $\Delta$-Interpolator

200 papers

Markerless motion capture has become an active field of research in computer vision in recent years. Its extensive applications are known in a great variety of fields, including computer animation, human motion analysis, biomedical…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Doan Duy Vo , Russell Butler

State-of-the-art frame interpolation methods generate intermediate frames by inferring object motions in the image from consecutive key-frames. In the absence of additional information, first-order approximations, i.e. optical flow, must be…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Stepan Tulyakov , Daniel Gehrig , Stamatios Georgoulis , Julius Erbach , Mathias Gehrig , Yuanyou Li , Davide Scaramuzza

Inter prediction is an important module in video coding for temporal redundancy removal, where similar reference blocks are searched from previously coded frames and employed to predict the block to be coded. Although traditional video…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Jiaying Liu , Sifeng Xia , Wenhan Yang

Recent advances in high refresh rate displays as well as the increased interest in high rate of slow motion and frame up-conversion fuel the demand for efficient and cost-effective multi-frame video interpolation solutions. To that regard,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Zhixiang Chi , Rasoul Mohammadi Nasiri , Zheng Liu , Juwei Lu , Jin Tang , Konstantinos N Plataniotis

Standard video frame interpolation methods first estimate optical flow between input frames and then synthesize an intermediate frame guided by motion. Recent approaches merge these two steps into a single convolution process by convolving…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Simon Niklaus , Long Mai , Feng Liu

We present a data-driven modeling strategy to overcome improperly modeled dynamics for systems exhibiting complex spatio-temporal behaviors. We propose a Deep Learning framework to resolve the differences between the true dynamics of the…

Machine Learning · Computer Science 2020-10-28 Maan Qraitem , Dhanushka Kularatne , Eric Forgoston , M. Ani Hsieh

As Deep Neural Networks are becoming more popular, much of the attention is being devoted to Computer Vision problems that used to be solved with more traditional approaches. Video frame interpolation is one of such challenges that has seen…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Mart Kartašev , Carlo Rapisarda , Dominik Fay

We propose a data-driven control design method for nonlinear systems that builds on kernel-based interpolation. Under some assumptions on the system dynamics, kernel-based functions are built from data and a model of the system, along with…

Systems and Control · Electrical Eng. & Systems 2023-04-20 Zhongjie Hu , Claudio De Persis , Pietro Tesi

Latent-space interpolation is commonly used to demonstrate the generalization ability of deep latent variable models. Various algorithms have been proposed to calculate the best trajectory between two encodings in the latent space. In this…

Machine Learning · Computer Science 2021-10-14 Lu Mi , Tianxing He , Core Francisco Park , Hao Wang , Yue Wang , Nir Shavit

Data-driven modeling of human motions is ubiquitous in computer graphics and computer vision applications, such as synthesizing realistic motions or recognizing actions. Recent research has shown that such problems can be approached by…

Graphics · Computer Science 2019-08-21 He Wang , Edmond S. L. Ho , Hubert P. H. Shum , Zhanxing Zhu

Video frame interpolation task has recently become more and more prevalent in the computer vision field. At present, a number of researches based on deep learning have achieved great success. Most of them are either based on optical flow…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Haoyue Tian , Pan Gao , Xiaojiang Peng

In recent years, visual SLAM has achieved great progress and development in different scenes, however, there are still many problems to be solved. The SLAM system is not only restricted by the external scenes but is also affected by its…

Robotics · Computer Science 2021-10-25 Zhenkun Zhu , Jikai Wang

Video frame interpolation is a classic and challenging low-level computer vision task. Recently, deep learning based methods have achieved impressive results, and it has been proven that optical flow based methods can synthesize frames with…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jinfeng Liu , Lingtong Kong , Jie Yang

This paper proposes a data-driven motion-planning framework for nonlinear systems that constructs a sequence of overlapping invariant polytopes. Around each randomly sampled waypoint, the algorithm identifies a convex admissible region and…

Systems and Control · Electrical Eng. & Systems 2025-08-04 Babak Esmaeili , Hamidreza Modares , Stefano Di Cairano

We propose a physics-based regularization technique for function learning, inspired by statistical mechanics. By drawing an analogy between optimizing the parameters of an interpolator and minimizing the energy of a system, we introduce…

Machine Learning · Computer Science 2025-08-20 Abhisek Ganguly , Alessandro Gabbana , Vybhav Rao , Sauro Succi , Santosh Ansumali

Pedestrian trajectory prediction plays an important role in autonomous driving systems and robotics. Recent work utilizing prominent deep learning models for pedestrian motion prediction makes limited a priori assumptions about human…

Robotics · Computer Science 2024-03-12 Honghui Wang , Weiming Zhi , Gustavo Batista , Rohitash Chandra

Time series data, defined by equally spaced points over time, is essential in fields like medicine, telecommunications, and energy. Analyzing it involves tasks such as classification, clustering, prototyping, and regression. Classification…

Machine Learning · Computer Science 2025-02-27 Ali Ismail-Fawaz

The accurate tracking of live cells using video microscopy recordings remains a challenging task for popular state-of-the-art image processing based object tracking methods. In recent years, several existing and new applications have…

Image and Video Processing · Electrical Eng. & Systems 2025-02-03 Gergely Szabó , Paolo Bonaiuti , Andrea Ciliberto , András Horváth

This paper investigates a variational model for splines in the image metamorphosis model for the smooth interpolation of key frames in the space of images. The Riemannian manifold of images based on the metamorphosis model defines shortest…

Numerical Analysis · Mathematics 2024-02-28 Jorge Justiniano , Marko Rajković , Martin Rumpf

Motion estimation (ME) and motion compensation (MC) have been widely used for classical video frame interpolation systems over the past decades. Recently, a number of data-driven frame interpolation methods based on convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Wenbo Bao , Wei-Sheng Lai , Xiaoyun Zhang , Zhiyong Gao , Ming-Hsuan Yang