English
Related papers

Related papers: Adversarial Synthesis of Human Pose from Text

200 papers

Generating realistic human videos remains a challenging task, with the most effective methods currently relying on a human motion sequence as a control signal. Existing approaches often use existing motion extracted from other videos, which…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Hsin-Ping Huang , Yang Zhou , Jui-Hsien Wang , Difan Liu , Feng Liu , Ming-Hsuan Yang , Zhan Xu

For human pose estimation in monocular images, joint occlusions and overlapping upon human bodies often result in deviated pose predictions. Under these circumstances, biologically implausible pose predictions may be produced. In contrast,…

Computer Vision and Pattern Recognition · Computer Science 2017-05-03 Yu Chen , Chunhua Shen , Xiu-Shen Wei , Lingqiao Liu , Jian Yang

This paper provides a comprehensive and exhaustive study of adversarial attacks on human pose estimation models and the evaluation of their robustness. Besides highlighting the important differences between well-studied classification and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Sahil Shah , Naman Jain , Abhishek Sharma , Arjun Jain

We focus on the problem of novel-view human action synthesis. Given an action video, the goal is to generate the same action from an unseen viewpoint. Naturally, novel view video synthesis is more challenging than image synthesis. It…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Xianhang Li , Junhao Zhang , Kunchang Li , Shruti Vyas , Yogesh S Rawat

3D human pose estimation is a challenging task because of the difficulty to acquire ground-truth data outside of controlled environments. A number of further issues have been hindering progress in building a universal and robust model for…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Yue Zhu , David Picard

Landmark/pose estimation in single monocular images have received much effort in computer vision due to its important applications. It remains a challenging task when input images severe occlusions caused by, e.g., adverse camera views.…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Yu Chen , Chunhua Shen , Hao Chen , Xiu-Shen Wei , Lingqiao Liu , Jian Yang

Human motion synthesis is an important problem with applications in graphics, gaming and simulation environments for robotics. Existing methods require accurate motion capture data for training, which is costly to obtain. Instead, we…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Kevin Xie , Tingwu Wang , Umar Iqbal , Yunrong Guo , Sanja Fidler , Florian Shkurti

In this paper, an adversarial architecture for facial depth map estimation from monocular intensity images is presented. By following an image-to-image approach, we combine the advantages of supervised learning and adversarial training,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Stefano Pini , Filippo Grazioli , Guido Borghi , Roberto Vezzani , Rita Cucchiara

We propose a novel approach for generating unrestricted adversarial examples by manipulating fine-grained aspects of image generation. Unlike existing unrestricted attacks that typically hand-craft geometric transformations, we learn…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Omid Poursaeed , Tianxing Jiang , Yordanos Goshu , Harry Yang , Serge Belongie , Ser-Nam Lim

Our work focuses on the development of a learnable neural representation of human pose for advanced AI assisted animation tooling. Specifically, we tackle the problem of constructing a full static human pose based on sparse and variable…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Boris N. Oreshkin , Florent Bocquelet , Félix G. Harvey , Bay Raitt , Dominic Laflamme

When speakers describe an image, they tend to look at objects before mentioning them. In this paper, we investigate such sequential cross-modal alignment by modelling the image description generation process computationally. We take as our…

Computation and Language · Computer Science 2020-11-10 Ece Takmaz , Sandro Pezzelle , Lisa Beinborn , Raquel Fernández

Text-conditioned image generation models have recently achieved astonishing image quality and alignment results. Consequently, they are employed in a fast-growing number of applications. Since they are highly data-driven, relying on…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Manuel Brack , Patrick Schramowski , Kristian Kersting

Inspired by the strong ties between vision and language, the two intimate human sensing and communication modalities, our paper aims to explore the generation of 3D human full-body motions from texts, as well as its reciprocal task,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Chuan Guo , Xinxin Zuo , Sen Wang , Li Cheng

As 3D human pose estimation can now be achieved with very high accuracy in the supervised learning scenario, tackling the case where 3D pose annotations are not available has received increasing attention. In particular, several methods…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Krishna Kanth Nakka , Mathieu Salzmann

In this paper, we present a novel approach to synthesize realistic images based on their semantic layouts. It hypothesizes that for objects with similar appearance, they share similar representation. Our method establishes dependencies…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Yi Wang , Lu Qi , Ying-Cong Chen , Xiangyu Zhang , Jiaya Jia

Deep generative modelling for human body analysis is an emerging problem with many interesting applications. However, the latent space learned by such approaches is typically not interpretable, resulting in less flexibility. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Rodrigo de Bem , Arnab Ghosh , Thalaiyasingam Ajanthan , Ondrej Miksik , Adnane Boukhayma , N. Siddharth , Philip Torr

Human pose estimation aims at localizing human anatomical keypoints or body parts in the input data (e.g., images, videos, or signals). It forms a crucial component in enabling machines to have an insightful understanding of the behaviors…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Haoming Chen , Runyang Feng , Sifan Wu , Hao Xu , Fengcheng Zhou , Zhenguang Liu

Given an arbitrary face image and an arbitrary speech clip, the proposed work attempts to generating the talking face video with accurate lip synchronization while maintaining smooth transition of both lip and facial movement over the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Yang Song , Jingwen Zhu , Dawei Li , Xiaolong Wang , Hairong Qi

Due to their complex nature, it is hard to characterize the ways in which machine learning models can misbehave or be exploited when deployed. Recent work on adversarial examples, i.e. inputs with minor perturbations that result in…

Machine Learning · Computer Science 2018-02-27 Zhengli Zhao , Dheeru Dua , Sameer Singh

Synthetic data generation has emerged as a promising solution to the data scarcity issue in aerial-view human detection. However, creating datasets that accurately reflect varying real-world human appearances, particularly diverse poses,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Yi-Ting Shen , Hyungtae Lee , Heesung Kwon , Shuvra S. Bhattacharyya