Related papers: Natural Reference Frames within Video Analysis
Frame sampling is a fundamental problem in video action recognition due to the essential redundancy in time and limited computation resources. The existing sampling strategy often employs a fixed frame selection and lacks the flexibility to…
We present Motion Marionette, a zero-shot framework for rigid motion transfer from monocular source videos to single-view target images. Previous works typically employ geometric, generative, or simulation priors to guide the transfer…
We introduce a method to generate videos of dynamic virtual objects plausibly interacting via collisions with a still image's environment. Given a starting trajectory, physically simulated with the estimated geometry of a single, static…
Video anomaly detection is a challenging task in the computer vision community. Most single task-based methods do not consider the independence of unique spatial and temporal patterns, while two-stream structures lack the exploration of the…
In the extensive literature dealing with the relativistic phenomenon of Thomas rotation several methods have been developed for calculating the Thomas rotation angle of a gyroscope along a circular world line. One of the most appealing…
Choosing an appropriate set of stimuli is essential to characterize the response of a sensory system to a particular functional dimension, such as the eye movement following the motion of a visual scene. Here, we describe a framework to…
In Rindler's model of a uniformly accelerated reference frame we analyze the apparent shape of rods and marked light rays for the case that the observers as well as the rods and the sources of light are at rest with respect to the Rindler…
Motion is an important cue for video prediction and often utilized by separating video content into static and dynamic components. Most of the previous work utilizing motion is deterministic but there are stochastic methods that can model…
Physics of non-inertial reference frames is a generalizing of Newton's laws to any reference frames. The first, Law of Kinematic in non-inertial reference frames reads: the kinematic state of a body free of forces conserves and determinates…
Existing conditional video prediction approaches train a network from large databases and generalize to previously unseen data. We take the opposite stance, and introduce a model that learns from the first frames of a given video and…
In this paper, we tackle the problem of video alignment, the process of matching the frames of a pair of videos containing similar actions. The main challenge in video alignment is that accurate correspondence should be established despite…
Event cameras provide a natural and data efficient representation of visual information, motivating novel computational strategies towards extracting visual information. Inspired by the biological vision system, we propose a behavior driven…
The integration of manipulator robots in household environments suggests a need for more predictable and human-like robot motion. This holds especially true for wheelchair-mounted assistive robots that can support the independence of people…
We explore the application of the reference map technique, originally developed for the Eulerian simulation of solid mechanics, in Lagrangian kinematics of fluid flows. Unlike traditional methods based on explicit particle tracking, the…
We present a novel approach to estimating physical properties of objects from video. Our approach consists of a physics engine and a correction estimator. Starting from the initial observed state, object behavior is simulated forward in…
Abnormality detection in video poses particular challenges due to the infinite size of the class of all irregular objects and behaviors. Thus no (or by far not enough) abnormal training samples are available and we need to find…
A classic problem of the motion of a projectile thrown at an angle to the horizon is studied. Air resistance force and Magnus force are taken into account with the use of the quadratic laws. We consider the asymptotic motion of the…
In this paper, we are interested in self-supervised learning the motion cues in videos using dynamic motion filters for a better motion representation to finally boost human action recognition in particular. Thus far, the vision community…
Reference frame optimization is a generic framework to calculate a spatially-varying observer field that views an unsteady fluid flow in a reference frame that is as-steady-as-possible. In this paper, we show that the optimized vector field…
We propose an attention-based networks for transferring motions between arbitrary objects. Given a source image(s) and a driving video, our networks animate the subject in the source images according to the motion in the driving video. In…