English
Related papers

Related papers: TIPS: Text-Induced Pose Synthesis

200 papers

In video understanding tasks, particularly those involving human motion, synthetic data generation often suffers from uncanny features, diminishing its effectiveness for training. Tasks such as sign language translation, gesture…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Vaclav Knapp , Matyas Bohacek

Pairwise pose estimation from images with little or no overlap is an open challenge in computer vision. Existing methods, even those trained on large-scale datasets, struggle in these scenarios due to the lack of identifiable…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Ruojin Cai , Jason Y. Zhang , Philipp Henzler , Zhengqi Li , Noah Snavely , Ricardo Martin-Brualla

We present DreamPose, a diffusion-based method for generating animated fashion videos from still images. Given an image and a sequence of human body poses, our method synthesizes a video containing both human and fabric motion. To achieve…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Johanna Karras , Aleksander Holynski , Ting-Chun Wang , Ira Kemelmacher-Shlizerman

This paper introduces the Attribute-Decomposed GAN, a novel generative model for controllable person image synthesis, which can produce realistic person images with desired human attributes (e.g., pose, head, upper clothes and pants)…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Yifang Men , Yiming Mao , Yuning Jiang , Wei-Ying Ma , Zhouhui Lian

Generating high-quality and diverse human images is an important yet challenging task in vision and graphics. However, existing generative models often fall short under the high diversity of clothing shapes and textures. Furthermore, the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Yuming Jiang , Shuai Yang , Haonan Qiu , Wayne Wu , Chen Change Loy , Ziwei Liu

The goal of 3D pose transfer is to transfer the pose from the source mesh to the target mesh while preserving the identity information (e.g., face, body shape) of the target mesh. Deep learning-based methods improved the efficiency and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Chaoyue Song , Jiacheng Wei , Ruibo Li , Fayao Liu , Guosheng Lin

There has been tremendous progress in large-scale text-to-image synthesis driven by diffusion models enabling versatile downstream applications such as 3D object synthesis from texts, image editing, and customized generation. We present a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Ting-Hsuan Liao , Songwei Ge , Yiran Xu , Yao-Chih Lee , Badour AlBahar , Jia-Bin Huang

Recent text-to-image generation methods provide a simple yet exciting conversion capability between text and image domains. While these methods have incrementally improved the generated image fidelity and text relevancy, several pivotal…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Oran Gafni , Adam Polyak , Oron Ashual , Shelly Sheynin , Devi Parikh , Yaniv Taigman

Synthesizing 3D faces that give certain personality impressions is commonly needed in computer games, animations, and virtual world applications for producing realistic virtual characters. In this paper, we propose a novel approach to…

Graphics · Computer Science 2018-09-28 Yining Lang , Wei Liang , Yujia Wang , Lap-Fai Yu

This work focuses on synthesizing human poses from human-level text descriptions. We propose a model that is based on a conditional generative adversarial network. It is designed to generate 2D human poses conditioned on human-written text…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Yifei Zhang , Rania Briq , Julian Tanke , Juergen Gall

Pose transfer has been studied for decades, in which the pose of a source mesh is applied to a target mesh. Particularly in this paper, we are interested in transferring the pose of source human mesh to deform the target human mesh, while…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Jiashun Wang , Chao Wen , Yanwei Fu , Haitao Lin , Tianyun Zou , Xiangyang Xue , Yinda Zhang

This paper proposes a statistical approach to 2D pose estimation from human images. The main problems with the standard supervised approach, which is based on a deep recognition (image-to-pose) model, are that it often yields anatomically…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Takayuki Nakatsuka , Kazuyoshi Yoshii , Yuki Koyama , Satoru Fukayama , Masataka Goto , Shigeo Morishima

Human pose analysis has garnered significant attention within both the research community and practical applications, owing to its expanding array of uses, including gaming, video surveillance, sports performance analysis, and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Lijuan Zhou , Xiang Meng , Zhihuan Liu , Mengqi Wu , Zhimin Gao , Pichao Wang

We propose a method for human pose estimation based on Deep Neural Networks (DNNs). The pose estimation is formulated as a DNN-based regression problem towards body joints. We present a cascade of such DNN regressors which results in high…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Alexander Toshev , Christian Szegedy

Human face synthesis involves transferring knowledge about the identity and identity-dependent face shape (IDFS) of a human face to target face images where the context (e.g., facial expressions, head poses, and other background factors)…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Gege Gao , Huaibo Huang , Chaoyou Fu , Ran He

Image extrapolation aims at expanding the narrow field of view of a given image patch. Existing models mainly deal with natural scene images of homogeneous regions and have no control of the content generation process. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Yijun Li , Lu Jiang , Ming-Hsuan Yang

Human pose estimation aims to locate the human body parts and build human body representation (e.g., body skeleton) from input data such as images and videos. It has drawn increasing attention during the past decade and has been utilized in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Ce Zheng , Wenhan Wu , Chen Chen , Taojiannan Yang , Sijie Zhu , Ju Shen , Nasser Kehtarnavaz , Mubarak Shah

We present an algorithm for re-rendering a person from a single image under arbitrary poses. Existing methods often have difficulties in hallucinating occluded contents photo-realistically while preserving the identity and fine details in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Badour AlBahar , Jingwan Lu , Jimei Yang , Zhixin Shu , Eli Shechtman , Jia-Bin Huang

Currently, personalized image generation methods mostly require considerable time to finetune and often overfit the concept resulting in generated images that are similar to custom concepts but difficult to edit by prompts. We propose an…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yuxuan Zhang , Yiren Song , Jinpeng Yu , Han Pan , Zhongliang Jing

Generating text-editable and pose-controllable character videos have an imperious demand in creating various digital human. Nevertheless, this task has been restricted by the absence of a comprehensive dataset featuring paired video-pose…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Yue Ma , Yingqing He , Xiaodong Cun , Xintao Wang , Siran Chen , Ying Shan , Xiu Li , Qifeng Chen