English
Related papers

Related papers: NEURAL MARIONETTE: A Transformer-based Multi-actio…

200 papers

Text-guided human motion generation has drawn significant interest because of its impactful applications spanning animation and robotics. Recently, application of diffusion models for motion generation has enabled improvements in the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Samaneh Azadi , Akbar Shah , Thomas Hayes , Devi Parikh , Sonal Gupta

Recent advances in generative modeling have led to promising progress on synthesizing 3D human motion from text, with methods that can generate character animations from short prompts and specified durations. However, using a single text…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Mathis Petrovich , Or Litany , Umar Iqbal , Michael J. Black , Gül Varol , Xue Bin Peng , Davis Rempe

Creating believable motions for various characters has long been a goal in computer graphics. Current learning-based motion synthesis methods depend on extensive motion datasets, which are often challenging, if not impossible, to obtain. On…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Qingqing Zhao , Peizhuo Li , Wang Yifan , Olga Sorkine-Hornung , Gordon Wetzstein

Humans constantly interact with their surrounding environments. Current human-centric generative models mainly focus on synthesizing humans plausibly interacting with static scenes and objects, while the dynamic human action-reaction…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Liang Xu , Yizhou Zhou , Yichao Yan , Xin Jin , Wenhan Zhu , Fengyun Rao , Xiaokang Yang , Wenjun Zeng

This paper tackles the problem of physics-aware human motion synthesis in a dynamic scene. Unlike existing works which mainly tend to generate physically unrealistic motions due to limited contact modeling, typically restricted to hands, in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Chaoyue Xing , Wei Mao , Miaomiao Liu

Current datasets for action recognition tasks face limitations stemming from traditional collection and generation methods, including the constrained range of action classes, absence of multi-viewpoint recordings, limited diversity, poor…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Xingyu Song , Zhan Li , Shi Chen , Kazuyuki Demachi

The ability to synthesize long-term human motion sequences in real-world scenes can facilitate numerous applications. Previous approaches for scene-aware motion synthesis are constrained by pre-defined target objects or positions and thus…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Jingbo Wang , Yu Rong , Jingyuan Liu , Sijie Yan , Dahua Lin , Bo Dai

Upsampling videos of human activity is an interesting yet challenging task with many potential applications ranging from gaming to entertainment and sports broadcasting. The main difficulty in synthesizing video frames in this setting stems…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Hsuan-I Ho , Xu Chen , Jie Song , Otmar Hilliges

Data-driven modeling of human motions is ubiquitous in computer graphics and computer vision applications, such as synthesizing realistic motions or recognizing actions. Recent research has shown that such problems can be approached by…

Graphics · Computer Science 2019-08-21 He Wang , Edmond S. L. Ho , Hubert P. H. Shum , Zhanxing Zhu

We present a novel task, i.e., animating a target 3D object through the motion of a raw driving sequence. In previous works, extra auxiliary correlations between source and target meshes or intermedia factors are inevitable to capture the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Haoyu Chen , Hao Tang , Nicu Sebe , Guoying Zhao

We have recently seen tremendous progress in diffusion advances for generating realistic human motions. Yet, they largely disregard the multi-human interactions. In this paper, we present InterGen, an effective diffusion-based approach that…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Han Liang , Wenqian Zhang , Wenxuan Li , Jingyi Yu , Lan Xu

Lightweight, controllable, and physically plausible human motion synthesis is crucial for animation, virtual reality, robotics, and human-computer interaction applications. Existing methods often compromise between computational efficiency,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Arvin Tashakori , Arash Tashakori , Gongbo Yang , Z. Jane Wang , Peyman Servati

Human motion generation is a significant pursuit in generative computer vision with widespread applications in film-making, video games, AR/VR, and human-robot interaction. Current methods mainly utilize either diffusion-based generative…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Canxuan Gang

Human motion synthesis is a fundamental task in computer animation. Despite recent progress in this field utilizing deep learning and motion capture data, existing methods are always limited to specific motion categories, environments, and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Zhikai Zhang , Yitang Li , Haofeng Huang , Mingxian Lin , Li Yi

Human motion generation aims to produce plausible human motion sequences according to various conditional inputs, such as text or audio. Despite the feasibility of existing methods in generating motion based on short prompts and simple…

Multimedia · Computer Science 2024-11-12 Bo Han , Hao Peng , Minjing Dong , Yi Ren , Yixuan Shen , Chang Xu

We present a GAN-based Transformer for general action-conditioned 3D human motion generation, including not only single-person actions but also multi-person interactive actions. Our approach consists of a powerful Action-conditioned motion…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Liang Xu , Ziyang Song , Dongliang Wang , Jing Su , Zhicheng Fang , Chenjing Ding , Weihao Gan , Yichao Yan , Xin Jin , Xiaokang Yang , Wenjun Zeng , Wei Wu

The ability of intelligent systems to predict human behaviors is crucial, particularly in fields such as autonomous vehicle navigation and social robotics. However, the complexity of human motion have prevented the development of a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Yang Gao , Po-Chien Luan , Alexandre Alahi

Text-to-motion synthesis is a crucial task in computer vision. Existing methods are limited in their universality, as they are tailored for single-person or two-person scenarios and can not be applied to generate motions for more…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Ke Fan , Junshu Tang , Weijian Cao , Ran Yi , Moran Li , Jingyu Gong , Jiangning Zhang , Yabiao Wang , Chengjie Wang , Lizhuang Ma

Text-to-motion generation has gained increasing attention, but most existing methods are limited to generating short-term motions that correspond to a single sentence describing a single action. However, when a text stream describes a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Zhao Yang , Bing Su , Ji-Rong Wen

Novel-View Human Action Synthesis aims to synthesize the movement of a body from a virtual viewpoint, given a video from a real viewpoint. We present a novel 3D reasoning to synthesize the target viewpoint. We first estimate the 3D mesh of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-09 Mohamed Ilyes Lakhal , Davide Boscaini , Fabio Poiesi , Oswald Lanz , Andrea Cavallaro