English
Related papers

Related papers: Neural Kinematic Networks for Unsupervised Motion …

200 papers

As an agent moves through the world, the apparent motion of scene elements is (usually) inversely proportional to their depth. It is natural for a learning agent to associate image patterns with the magnitude of their displacement over…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Huaizu Jiang , Erik Learned-Miller , Gustav Larsson , Michael Maire , Greg Shakhnarovich

Learning general image representations has proven key to the success of many computer vision tasks. For example, many approaches to image understanding problems rely on deep networks that were initially trained on ImageNet, mostly because…

Computer Vision and Pattern Recognition · Computer Science 2019-03-15 Helge Rhodin , Victor Constantin , Isinsu Katircioglu , Mathieu Salzmann , Pascal Fua

We introduce InverseFaceNet, a deep convolutional inverse rendering framework for faces that jointly estimates facial pose, shape, expression, reflectance and illumination from a single input image. By estimating all parameters from just a…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Hyeongwoo Kim , Michael Zollhöfer , Ayush Tewari , Justus Thies , Christian Richardt , Christian Theobalt

Given a 3D object, kinematic motion prediction aims to identify the mobile parts as well as the corresponding motion parameters. Due to the large variations in both topological structure and geometric details of 3D objects, this remains a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Gengxin Liu , Qian Sun , Haibin Huang , Chongyang Ma , Yulan Guo , Li Yi , Hui Huang , Ruizhen Hu

An unsupervised human action modeling framework can provide useful pose-sequence representation, which can be utilized in a variety of pose analysis applications. In this work we propose a novel temporal pose-sequence modeling framework,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Jogendra Nath Kundu , Maharshi Gor , Phani Krishna Uppala , R. Venkatesh Babu

In motor neuroscience, artificial recurrent neural networks models often complement animal studies. However, most modeling efforts are limited to data-fitting, and the few that examine virtual embodied agents in a reinforcement learning…

Neurons and Cognition · Quantitative Biology 2023-05-19 Eugene R. Rush , Kaushik Jayaram , J. Sean Humbert

Recently, motion generation by machine learning has been actively researched to automate various tasks. Imitation learning is one such method that learns motions from data collected in advance. However, executing long-term tasks remains…

Robotics · Computer Science 2022-03-17 Kazuki Hayashi , Sho Sakaino , Toshiaki Tsuji

We propose an attention-based networks for transferring motions between arbitrary objects. Given a source image(s) and a driving video, our networks animate the subject in the source images according to the motion in the driving video. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Subin Jeon , Seonghyeon Nam , Seoung Wug Oh , Seon Joo Kim

Most recent view-invariant action recognition and performance assessment approaches rely on a large amount of annotated 3D skeleton data to extract view-invariant features. However, acquiring 3D skeleton data can be cumbersome, if not…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Faegheh Sardari , Björn Ommer , Majid Mirmehdi

This work presents an unsupervised learning based approach to the ubiquitous computer vision problem of image matching. We start from the insight that the problem of frame-interpolation implicitly solves for inter-frame correspondences.…

Computer Vision and Pattern Recognition · Computer Science 2016-03-30 Gucan Long , Laurent Kneip , Jose M. Alvarez , Hongdong Li

We propose a novel video object segmentation algorithm based on pixel-level matching using Convolutional Neural Networks (CNN). Our network aims to distinguish the target area from the background on the basis of the pixel-level similarity…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Jae Shin Yoon , Francois Rameau , Junsik Kim , Seokju Lee , Seunghak Shin , In So Kweon

We present recursive cascaded networks, a general architecture that enables learning deep cascades, for deformable image registration. The proposed architecture is simple in design and can be built on any base network. The moving image is…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Shengyu Zhao , Yue Dong , Eric I-Chao Chang , Yan Xu

3D human pose and shape estimation from monocular images has been an active research area in computer vision. Existing deep learning methods for this task rely on high-resolution input, which however, is not always available in many…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Xiangyu Xu , Hao Chen , Francesc Moreno-Noguer , Laszlo A. Jeni , Fernando De la Torre

We present a novel unsupervised method for face identity learning from video sequences. The method exploits the ResNet deep network for face detection and VGGface fc7 face descriptors together with a smart learning mechanism that exploits…

Computer Vision and Pattern Recognition · Computer Science 2017-08-14 Federico Pernici , Alberto Del Bimbo

We present a lightweight video motion retargeting approach TransMoMo that is capable of transferring motion of a person in a source video realistically to another video of a target person. Without using any paired data for supervision, the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Zhuoqian Yang , Wentao Zhu , Wayne Wu , Chen Qian , Qiang Zhou , Bolei Zhou , Chen Change Loy

Recent works on dynamic 3D neural field reconstruction assume the input from synchronized multi-view videos whose poses are known. The input constraints are often not satisfied in real-world setups, making the approach impractical. We show…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Changwoon Choi , Jeongjun Kim , Geonho Cha , Minkwan Kim , Dongyoon Wee , Young Min Kim

Humans learn continually throughout their lifespan by accumulating diverse knowledge and fine-tuning it for future tasks. When presented with a similar goal, neural networks suffer from catastrophic forgetting if data distributions across…

Machine Learning · Computer Science 2022-09-19 Dupati Srikar Chandra , Sakshi Varshney , P. K. Srijith , Sunil Gupta

Previous video-based human pose estimation methods have shown promising results by leveraging aggregated features of consecutive frames. However, most approaches compromise accuracy to mitigate jitter or do not sufficiently comprehend the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Kyung-Min Jin , Byoung-Sung Lim , Gun-Hee Lee , Tae-Kyung Kang , Seong-Whan Lee

Due to the problem of performance constraints of unsupervised video object detection, its large-scale application is limited. In response to this pain point, we propose another excellent method to solve this problematic point. By…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Chao Hu , Liqiang Zhu

It is widely believed that the backpropagation algorithm is essential for learning good feature detectors in early layers of artificial neural networks, so that these detectors are useful for the task performed by the higher layers of that…

Machine Learning · Computer Science 2019-08-30 Dmitry Krotov , John Hopfield