English
Related papers

Related papers: Adversarial Synthesis of Human Pose from Text

200 papers

We present 3DHumanGAN, a 3D-aware generative adversarial network that synthesizes photorealistic images of full-body humans with consistent appearances under different view-angles and body-poses. To tackle the representational and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Zhuoqian Yang , Shikai Li , Wayne Wu , Bo Dai

This paper develops a deep-learning framework to synthesize a ground-level view of a location given an overhead image. We propose a novel conditional generative adversarial network (cGAN) in which the trained generator generates realistic…

Computer Vision and Pattern Recognition · Computer Science 2019-02-21 Xueqing Deng , Yi Zhu , Shawn Newsam

Generating relevant responses in a dialog is challenging, and requires not only proper modeling of context in the conversation but also being able to generate fluent sentences during inference. In this paper, we propose a two-step framework…

Computation and Language · Computer Science 2020-11-04 Kashif Khan , Gaurav Sahu , Vikash Balasubramanian , Lili Mou , Olga Vechtomova

Multi-person pose estimation from a 2D image is an essential technique for human behavior understanding. In this paper, we propose a human pose refinement network that estimates a refined pose from a tuple of an input image and input pose.…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Gyeongsik Moon , Ju Yong Chang , Kyoung Mu Lee

This work aims to generate natural and diverse group motions of multiple humans from textual descriptions. While single-person text-to-motion generation is extensively studied, it remains challenging to synthesize motions for more than one…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Mengyi Shan , Lu Dong , Yutao Han , Yuan Yao , Tao Liu , Ifeoma Nwogu , Guo-Jun Qi , Mitch Hill

This paper proposes the novel Pose Guided Person Generation Network (PG$^2$) that allows to synthesize person images in arbitrary poses, based on an image of that person and a novel pose. Our generation framework PG$^2$ utilizes the pose…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Liqian Ma , Xu Jia , Qianru Sun , Bernt Schiele , Tinne Tuytelaars , Luc Van Gool

Generating and representing human behavior are of major importance for various computer vision applications. Commonly, human video synthesis represents behavior as sequences of postures while directly predicting their likely progressions or…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Andreas Blattmann , Timo Milbich , Michael Dorkenwald , Björn Ommer

We present a new approach for synthesizing novel views of people in new poses. Our novel differentiable renderer enables the synthesis of highly realistic images from any viewpoint. Rather than operating over mesh-based structures, our…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Guillaume Rochette , Chris Russell , Richard Bowden

Humans can imagine a scene from a sound. We want machines to do so by using conditional generative adversarial networks (GANs). By applying the techniques including spectral norm, projection discriminator and auxiliary classifier, compared…

Computation and Language · Computer Science 2018-08-14 Chia-Hung Wan , Shun-Po Chuang , Hung-Yi Lee

Synthesizing images from a given text description involves engaging two types of information: the content, which includes information explicitly described in the text (e.g., color, composition, etc.), and the style, which is usually not…

Computer Vision and Pattern Recognition · Computer Science 2019-08-16 Qicheng Lao , Mohammad Havaei , Ahmad Pesaranghader , Francis Dutil , Lisa Di Jorio , Thomas Fevens

We propose Human Pose Models that represent RGB and depth images of human poses independent of clothing textures, backgrounds, lighting conditions, body shapes and camera viewpoints. Learning such universal models requires training images…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Jian Liu , Naveed Akhtar , Ajmal Mian

Generative Adversarial Networks (GANs) can produce images of remarkable complexity and realism but are generally structured to sample from a single latent source ignoring the explicit spatial interaction between multiple entities that could…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Samaneh Azadi , Deepak Pathak , Sayna Ebrahimi , Trevor Darrell

Recently, methods based on deep learning have dominated the field of text recognition. With a large number of training data, most of them can achieve the state-of-the-art performances. However, it is hard to harvest and label sufficient…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Yanxiang Gong , Linjie Deng , Zheng Ma , Mei Xie

In this paper, we propose a pose grammar to tackle the problem of 3D human pose estimation. Our model directly takes 2D pose as input and learns a generalized 2D-3D mapping function. The proposed model consists of a base network which…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Haoshu Fang , Yuanlu Xu , Wenguan Wang , Xiaobai Liu , Song-Chun Zhu

Generating a photorealistic image with intended human pose is a promising yet challenging research topic for many applications such as smart photo editing, movie making, virtual try-on, and fashion display. In this paper, we present a novel…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Wei Sun , Jawadul H. Bappy , Shanglin Yang , Yi Xu , Tianfu Wu , Hui Zhou

This paper proposes a statistical approach to 2D pose estimation from human images. The main problems with the standard supervised approach, which is based on a deep recognition (image-to-pose) model, are that it often yields anatomically…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Takayuki Nakatsuka , Kazuyoshi Yoshii , Yuki Koyama , Satoru Fukayama , Masataka Goto , Shigeo Morishima

Synthesising the spatial and temporal dynamics of the human body skeleton remains a challenging task, not only in terms of the quality of the generated shapes, but also of their diversity, particularly to synthesise realistic body movements…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Bruno Degardin , João Neves , Vasco Lopes , João Brito , Ehsan Yaghoubi , Hugo Proença

This paper presents a generative adversarial learning-based human upper body video synthesis approach to generate an upper body video of target person that is consistent with the body motion, face expression, and pose of the person in…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Zhaoxiang Liu , Huan Hu , Zipeng Wang , Kai Wang , Jinqiang Bai , Shiguo Lian

In this paper, we address the problem of generating person images conditioned on both pose and appearance information. Specifically, given an image xa of a person and a target pose P(xb), extracted from a different image xb, we synthesize a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Aliaksandr Siarohin , Stéphane Lathuilière , Enver Sangineto , Nicu Sebe

Numerous fields, such as ecology, biology, and neuroscience, use animal recordings to track and measure animal behaviour. Over time, a significant volume of such data has been produced, but some computer vision techniques cannot explore it…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Jose Sosa , Sharn Perry , Jane Alty , David Hogg