中文
相关论文

相关论文: NEURAL MARIONETTE: A Transformer-based Multi-actio…

200 篇论文

Text-guided human motion generation has drawn significant interest because of its impactful applications spanning animation and robotics. Recently, application of diffusion models for motion generation has enabled improvements in the…

计算机视觉与模式识别 · 计算机科学 2023-05-17 Samaneh Azadi , Akbar Shah , Thomas Hayes , Devi Parikh , Sonal Gupta

Recent advances in generative modeling have led to promising progress on synthesizing 3D human motion from text, with methods that can generate character animations from short prompts and specified durations. However, using a single text…

计算机视觉与模式识别 · 计算机科学 2024-05-27 Mathis Petrovich , Or Litany , Umar Iqbal , Michael J. Black , Gül Varol , Xue Bin Peng , Davis Rempe

Creating believable motions for various characters has long been a goal in computer graphics. Current learning-based motion synthesis methods depend on extensive motion datasets, which are often challenging, if not impossible, to obtain. On…

计算机视觉与模式识别 · 计算机科学 2023-11-01 Qingqing Zhao , Peizhuo Li , Wang Yifan , Olga Sorkine-Hornung , Gordon Wetzstein

Humans constantly interact with their surrounding environments. Current human-centric generative models mainly focus on synthesizing humans plausibly interacting with static scenes and objects, while the dynamic human action-reaction…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Liang Xu , Yizhou Zhou , Yichao Yan , Xin Jin , Wenhan Zhu , Fengyun Rao , Xiaokang Yang , Wenjun Zeng

This paper tackles the problem of physics-aware human motion synthesis in a dynamic scene. Unlike existing works which mainly tend to generate physically unrealistic motions due to limited contact modeling, typically restricted to hands, in…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Chaoyue Xing , Wei Mao , Miaomiao Liu

Current datasets for action recognition tasks face limitations stemming from traditional collection and generation methods, including the constrained range of action classes, absence of multi-viewpoint recordings, limited diversity, poor…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Xingyu Song , Zhan Li , Shi Chen , Kazuyuki Demachi

The ability to synthesize long-term human motion sequences in real-world scenes can facilitate numerous applications. Previous approaches for scene-aware motion synthesis are constrained by pre-defined target objects or positions and thus…

计算机视觉与模式识别 · 计算机科学 2022-05-27 Jingbo Wang , Yu Rong , Jingyuan Liu , Sijie Yan , Dahua Lin , Bo Dai

Upsampling videos of human activity is an interesting yet challenging task with many potential applications ranging from gaming to entertainment and sports broadcasting. The main difficulty in synthesizing video frames in this setting stems…

计算机视觉与模式识别 · 计算机科学 2021-11-02 Hsuan-I Ho , Xu Chen , Jie Song , Otmar Hilliges

Data-driven modeling of human motions is ubiquitous in computer graphics and computer vision applications, such as synthesizing realistic motions or recognizing actions. Recent research has shown that such problems can be approached by…

图形学 · 计算机科学 2019-08-21 He Wang , Edmond S. L. Ho , Hubert P. H. Shum , Zhanxing Zhu

We present a novel task, i.e., animating a target 3D object through the motion of a raw driving sequence. In previous works, extra auxiliary correlations between source and target meshes or intermedia factors are inevitable to capture the…

计算机视觉与模式识别 · 计算机科学 2021-10-22 Haoyu Chen , Hao Tang , Nicu Sebe , Guoying Zhao

We have recently seen tremendous progress in diffusion advances for generating realistic human motions. Yet, they largely disregard the multi-human interactions. In this paper, we present InterGen, an effective diffusion-based approach that…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Han Liang , Wenqian Zhang , Wenxuan Li , Jingyi Yu , Lan Xu

Lightweight, controllable, and physically plausible human motion synthesis is crucial for animation, virtual reality, robotics, and human-computer interaction applications. Existing methods often compromise between computational efficiency,…

计算机视觉与模式识别 · 计算机科学 2025-01-29 Arvin Tashakori , Arash Tashakori , Gongbo Yang , Z. Jane Wang , Peyman Servati

Human motion generation is a significant pursuit in generative computer vision with widespread applications in film-making, video games, AR/VR, and human-robot interaction. Current methods mainly utilize either diffusion-based generative…

计算机视觉与模式识别 · 计算机科学 2025-02-03 Canxuan Gang

Human motion synthesis is a fundamental task in computer animation. Despite recent progress in this field utilizing deep learning and motion capture data, existing methods are always limited to specific motion categories, environments, and…

计算机视觉与模式识别 · 计算机科学 2024-11-12 Zhikai Zhang , Yitang Li , Haofeng Huang , Mingxian Lin , Li Yi

Human motion generation aims to produce plausible human motion sequences according to various conditional inputs, such as text or audio. Despite the feasibility of existing methods in generating motion based on short prompts and simple…

多媒体 · 计算机科学 2024-11-12 Bo Han , Hao Peng , Minjing Dong , Yi Ren , Yixuan Shen , Chang Xu

We present a GAN-based Transformer for general action-conditioned 3D human motion generation, including not only single-person actions but also multi-person interactive actions. Our approach consists of a powerful Action-conditioned motion…

计算机视觉与模式识别 · 计算机科学 2022-11-24 Liang Xu , Ziyang Song , Dongliang Wang , Jing Su , Zhicheng Fang , Chenjing Ding , Weihao Gan , Yichao Yan , Xin Jin , Xiaokang Yang , Wenjun Zeng , Wei Wu

The ability of intelligent systems to predict human behaviors is crucial, particularly in fields such as autonomous vehicle navigation and social robotics. However, the complexity of human motion have prevented the development of a…

计算机视觉与模式识别 · 计算机科学 2024-11-06 Yang Gao , Po-Chien Luan , Alexandre Alahi

Text-to-motion synthesis is a crucial task in computer vision. Existing methods are limited in their universality, as they are tailored for single-person or two-person scenarios and can not be applied to generate motions for more…

计算机视觉与模式识别 · 计算机科学 2024-05-27 Ke Fan , Junshu Tang , Weijian Cao , Ran Yi , Moran Li , Jingyu Gong , Jiangning Zhang , Yabiao Wang , Chengjie Wang , Lizhuang Ma

Text-to-motion generation has gained increasing attention, but most existing methods are limited to generating short-term motions that correspond to a single sentence describing a single action. However, when a text stream describes a…

计算机视觉与模式识别 · 计算机科学 2023-08-04 Zhao Yang , Bing Su , Ji-Rong Wen

Novel-View Human Action Synthesis aims to synthesize the movement of a body from a virtual viewpoint, given a video from a real viewpoint. We present a novel 3D reasoning to synthesize the target viewpoint. We first estimate the 3D mesh of…

计算机视觉与模式识别 · 计算机科学 2020-10-09 Mohamed Ilyes Lakhal , Davide Boscaini , Fabio Poiesi , Oswald Lanz , Andrea Cavallaro