English
Related papers

Related papers: Procedural Generation of Videos to Train Deep Acti…

200 papers

Estimating human pose, shape, and motion from images and videos are fundamental challenges with many applications. Recent advances in 2D human pose estimation use large amounts of manually-labeled training data for learning convolutional…

Computer Vision and Pattern Recognition · Computer Science 2018-01-22 Gül Varol , Javier Romero , Xavier Martin , Naureen Mahmood , Michael J. Black , Ivan Laptev , Cordelia Schmid

Learning image representations using synthetic data allows training neural networks without some of the concerns associated with real images, such as privacy and bias. Existing work focuses on a handful of curated generative processes which…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Manel Baradad , Chun-Fu Chen , Jonas Wulff , Tongzhou Wang , Rogerio Feris , Antonio Torralba , Phillip Isola

Human image animation involves generating videos from a character photo, allowing user control and unlocking the potential for video and movie production. While recent approaches yield impressive results using high-quality training data,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Zhenzhi Wang , Yixuan Li , Yanhong Zeng , Youqing Fang , Yuwei Guo , Wenran Liu , Jing Tan , Kai Chen , Tianfan Xue , Bo Dai , Dahua Lin

We propose a method for generating video-realistic animations of real humans under user control. In contrast to conventional human character rendering, we do not require the availability of a production-quality photo-realistic 3D model of…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Lingjie Liu , Weipeng Xu , Michael Zollhoefer , Hyeongwoo Kim , Florian Bernard , Marc Habermann , Wenping Wang , Christian Theobalt

We show that useful video representations can be learned from synthetic videos and natural images, without incorporating natural videos in the training. We propose a progression of video datasets synthesized by simple generative processes,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Xueyang Yu , Xinlei Chen , Yossi Gandelsman

Human video generation is a dynamic and rapidly evolving task that aims to synthesize 2D human body video sequences with generative models given control conditions such as text, audio, and pose. With the potential for wide-ranging…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Wentao Lei , Jinting Wang , Fengji Ma , Guanjie Huang , Li Liu

We aim to tackle the interesting yet challenging problem of generating videos of diverse and natural human motions from prescribed action categories. The key issue lies in the ability to synthesize multiple distinct motion sequences that…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Chuan Guo , Xinxin Zuo , Sen Wang , Xinshuang Liu , Shihao Zou , Minglun Gong , Li Cheng

Currently, video behavior recognition is one of the most foundational tasks of computer vision. The 2D neural networks of deep learning are built for recognizing pixel-level information such as images with RGB, RGB-D, or optical flow…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Zihan Wang , Yang Yang , Zhi Liu , Yifan Zheng

In this paper, we address the challenge of generating realistic 3D human motions for action classes that were never seen during the training phase. Our approach involves decomposing complex actions into simpler movements, specifically those…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Lorenzo Mandelli , Stefano Berretti

Human action recognition in videos is a critical task with significant implications for numerous applications, including surveillance, sports analytics, and healthcare. The challenge lies in creating models that are both precise in their…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yufei Xie

We introduce Programmatic Motion Concepts, a hierarchical motion representation for human actions that captures both low-level motion and high-level description as motion concepts. This representation enables human motion description,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Sumith Kulal , Jiayuan Mao , Alex Aiken , Jiajun Wu

Action parsing in videos with complex scenes is an interesting but challenging task in computer vision. In this paper, we propose a generic 3D convolutional neural network in a multi-task learning manner for effective Deep Action Parsing…

Computer Vision and Pattern Recognition · Computer Science 2016-02-11 Li Liu , Yi Zhou , Ling Shao

Human action recognition has become one of the most active field of research in computer vision due to its wide range of applications, like surveillance, medical, industrial environments, smart homes, among others. Recently, deep learning…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Samuel Felipe dos Santos , Jurandy Almeida

Although synthetic training data has been shown to be beneficial for tasks such as human pose estimation, its use for RGB human action recognition is relatively unexplored. Our goal in this work is to answer the question whether synthetic…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Gül Varol , Ivan Laptev , Cordelia Schmid , Andrew Zisserman

Video matting has traditionally been limited by the lack of high-quality ground-truth data. Most existing video matting datasets provide only human-annotated imperfect alpha and foreground annotations, which must be composited to background…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Yongtao Ge , Kangyang Xie , Guangkai Xu , Mingyu Liu , Li Ke , Longtao Huang , Hui Xue , Hao Chen , Chunhua Shen

The paucity of videos in current action classification datasets (UCF-101 and HMDB-51) has made it difficult to identify good video architectures, as most methods obtain similar performance on existing small-scale benchmarks. This paper…

Computer Vision and Pattern Recognition · Computer Science 2018-02-13 Joao Carreira , Andrew Zisserman

Drones are enabling new forms of human actions surveillance due to their low cost and fast mobility. However, using deep neural networks for automatic aerial action recognition is difficult due to the need for a large number of training…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Waqas Sultani , Mubarak Shah

Distilling knowledge from human demonstrations is a promising way for robots to learn and act. Existing methods, which often rely on coarsely-aligned video pairs, are typically constrained to learning global or task-level features. As a…

Robotics · Computer Science 2025-11-18 Sicheng Xie , Haidong Cao , Zejia Weng , Zhen Xing , Haoran Chen , Shiwei Shen , Jiaqi Leng , Zuxuan Wu , Yu-Gang Jiang

Automated human action recognition is one of the most attractive and practical research fields in computer vision, in spite of its high computational costs. In such systems, the human action labelling is based on the appearance and patterns…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Fatemeh Serpush , Mahdi Rezaei

We present an overview and evaluation of a new, systematic approach for generation of highly realistic, annotated synthetic data for training of deep neural networks in computer vision tasks. The main contribution is a procedural world…

Computer Vision and Pattern Recognition · Computer Science 2017-10-19 Apostolia Tsirikoglou , Joel Kronander , Magnus Wrenninge , Jonas Unger