English
Related papers

Related papers: Interaction Mix and Match: Synthesizing Close Inte…

200 papers

Recent advances in deep learning have enabled the generation of videos from textual descriptions as well as the prediction of future sequences from input videos. Similarly, in human motion modeling, motions can be generated from text or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Masato Soga , Ryuki Takebayashi

To coordinate actions with an interaction partner requires a constant exchange of sensorimotor signals. Humans acquire these skills in infancy and early childhood mostly by imitation learning and active engagement with a skilled partner.…

Machine Learning · Computer Science 2019-10-15 Judith Bütepage , Ali Ghadirzadeh , Özge Öztimur Karadag , Mårten Björkman , Danica Kragic

Animating human-scene interactions such as pick-and-place tasks in cluttered, complex layouts is a challenging task, with objects of a wide variation of geometries and articulation under scenarios with various obstacles. The main difficulty…

Graphics · Computer Science 2025-10-07 Jintao Lu , He Zhang , Yuting Ye , Takaaki Shiratori , Sebastian Starke , Taku Komura

Producing realistic character animations is one of the essential tasks in human-AI interactions. Considered as a sequence of poses of a humanoid, the task can be considered as a sequence generation problem with spatiotemporal smoothness and…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Maryam Sadat Mirzaei , Kourosh Meshgi , Etienne Frigo , Toyoaki Nishida

Interactive applications demand believable characters that respond naturally to dynamic environments. Traditional character animation techniques often struggle to handle arbitrary situations, leading to a growing trend of dynamically…

Graphics · Computer Science 2025-10-28 Jose Luis Ponton , Sheldon Andrews , Carlos Andujar , Nuria Pelechano

We propose a new method for realistic human motion transfer using a generative adversarial network (GAN), which generates a motion video of a target character imitating actions of a source character, while maintaining high authenticity of…

Graphics · Computer Science 2023-05-09 Yang-Tian Sun , Qian-Cheng Fu , Yue-Ren Jiang , Zitao Liu , Yu-Kun Lai , Hongbo Fu , Lin Gao

Human activity videos involve rich, varied interactions between people and objects. In this paper we develop methods for generating such videos -- making progress toward addressing the important, open problem of video generation in complex…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Megha Nawhal , Mengyao Zhai , Andreas Lehrmann , Leonid Sigal , Greg Mori

Humans constantly interact with their surrounding environments. Current human-centric generative models mainly focus on synthesizing humans plausibly interacting with static scenes and objects, while the dynamic human action-reaction…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Liang Xu , Yizhou Zhou , Yichao Yan , Xin Jin , Wenhan Zhu , Fengyun Rao , Xiaokang Yang , Wenjun Zeng

Human motion synthesis conditioned on textual input has gained significant attention in recent years due to its potential applications in various domains such as gaming, film production, and virtual reality. Conditioned Motion synthesis…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Avinash Amballa , Gayathri Akkinapalli , Vinitra Muralikrishnan

Synthesising the spatial and temporal dynamics of the human body skeleton remains a challenging task, not only in terms of the quality of the generated shapes, but also of their diversity, particularly to synthesise realistic body movements…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Bruno Degardin , João Neves , Vasco Lopes , João Brito , Ehsan Yaghoubi , Hugo Proença

In this paper, we propose a generative model which learns the relationship between language and human action in order to generate a human action sequence given a sentence describing human behavior. The proposed generative model is a…

Machine Learning · Computer Science 2017-10-25 Hyemin Ahn , Timothy Ha , Yunho Choi , Hwiyeon Yoo , Songhwai Oh

"How can we animate 3D-characters from a movie script or move robots by simply telling them what we would like them to do?" "How unstructured and complex can we make a sentence and still generate plausible movements from it?" These are…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Anindita Ghosh , Noshaba Cheema , Cennet Oguz , Christian Theobalt , Philipp Slusallek

Synthesizing natural interactions between virtual humans and their 3D environments is critical for numerous applications, such as computer games and AR/VR experiences. Our goal is to synthesize humans interacting with a given 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Kaifeng Zhao , Shaofei Wang , Yan Zhang , Thabo Beeler , Siyu Tang

Modeling human-human interactions from text remains challenging because it requires not only realistic individual dynamics but also precise, text-consistent spatiotemporal coupling between agents. Currently, progress is hindered by 1)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Qingxuan Wu , Zhiyang Dou , Chuan Guo , Yiming Huang , Qiao Feng , Bing Zhou , Jian Wang , Lingjie Liu

Recent success with large language models has sparked a new wave of verbal human-AI interaction. While such models support users in a variety of creative tasks, they lack the embodied nature of human interaction. Dance, as a primal form of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Alexander Okupnik , Johannes Schneider , Kyriakos Flouris

We address the computational problem of novel human pose synthesis. Given an image of a person and a desired pose, we produce a depiction of that person in that pose, retaining the appearance of both the person and background. We present a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-23 Guha Balakrishnan , Amy Zhao , Adrian V. Dalca , Fredo Durand , John Guttag

Synthesizing graceful and life-like behaviors for physically simulated characters has been a fundamental challenge in computer animation. Data-driven methods that leverage motion tracking are a prominent class of techniques for producing…

Graphics · Computer Science 2022-05-13 Xue Bin Peng , Ze Ma , Pieter Abbeel , Sergey Levine , Angjoo Kanazawa

We revisit human motion synthesis, a task useful in various real world applications, in this paper. Whereas a number of methods have been developed previously for this task, they are often limited in two aspects: focusing on the poses while…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Jingbo Wang , Sijie Yan , Bo Dai , Dahua LIn

Realistic fine-grained multi-agent simulation of real-world complex systems is crucial for many downstream tasks such as reinforcement learning. Recent work has used generative models (GANs in particular) for providing high-fidelity…

Machine Learning · Computer Science 2022-02-25 Changyu Chen , Avinandan Bose , Shih-Fen Cheng , Arunesh Sinha

Synthesizing 3D human motion plays an important role in many graphics applications as well as understanding human activity. While many efforts have been made on generating realistic and natural human motion, most approaches neglect the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Jiashun Wang , Huazhe Xu , Jingwei Xu , Sifei Liu , Xiaolong Wang