中文
相关论文

相关论文: Sitcom-Crafter: A Plot-Driven Human Motion Generat…

200 篇论文

We address the problem of generating realistic 3D motions of humans interacting with objects in a scene. Our key idea is to create a neural interaction field attached to a specific object, which outputs the distance to the valid interaction…

计算机视觉与模式识别 · 计算机科学 2023-07-17 Nilesh Kulkarni , Davis Rempe , Kyle Genova , Abhijit Kundu , Justin Johnson , David Fouhey , Leonidas Guibas

We present Uni-Inter, a unified framework for human motion generation that supports a wide range of interaction scenarios: including human-human, human-object, and human-scene-within a single, task-agnostic architecture. In contrast to…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Sheng Liu , Yuanzhi Liang , Jiepeng Wang , Sidan Du , Chi Zhang , Xuelong Li

Recent advancements in personalized Text-to-Video (T2V) generation have made significant strides in synthesizing character-specific content. However, these methods face a critical limitation: the inability to perform fine-grained control…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Haopeng Fang , Di Qiu , Binjie Mao , He Tang

Well-designed indoor scenes should prioritize how people can act within a space rather than merely what objects to place. However, existing 3D scene generation methods emphasize visual and semantic plausibility, while insufficiently…

人机交互 · 计算机科学 2026-03-04 Semin Jin , Donghyuk Kim , Jeongmin Ryu , Kyung Hoon Hyun

We present En3D, an enhanced generative scheme for sculpting high-quality 3D human avatars. Unlike previous works that rely on scarce 3D datasets or limited 2D collections with imbalanced viewing angles and imprecise pose priors, our…

计算机视觉与模式识别 · 计算机科学 2024-01-03 Yifang Men , Biwen Lei , Yuan Yao , Miaomiao Cui , Zhouhui Lian , Xuansong Xie

Recent advances in 3D scene reconstruction and 4D human animation have broadened adoption, but integrating the two remains difficult. Key challenges include placing humans at plausible locations and scales without interpenetration, aligning…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Qingyang Liu , Bingjie Gao , Weiheng Huang , Jun Zhang , Zhongqian Sun , Yang Wei , Fengrui Liu , Zelin Peng , Qianli Ma , Shuai Yang , Zhaohe Liao , Haonan Zhao , Li Niu

Text-to-motion generation, which translates textual descriptions into human motions, has been challenging in accurately capturing detailed user-imagined motions from simple text inputs. This paper introduces StickMotion, an efficient…

计算机视觉与模式识别 · 计算机科学 2025-03-10 Tao Wang , Zhihua Wu , Qiaozhi He , Jiaming Chu , Ling Qian , Yu Cheng , Junliang Xing , Jian Zhao , Lei Jin

Recent advancements in character video synthesis still depend on extensive fine-tuning or complex 3D modeling processes, which can restrict accessibility and hinder real-time applicability. To address these challenges, we propose a simple…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Di Qiu , Zheng Chen , Rui Wang , Mingyuan Fan , Changqian Yu , Junshi Huang , Xiang Wen

Video data is more cost-effective than motion capture data for learning 3D character motion controllers, yet synthesizing realistic and diverse behaviors directly from videos remains challenging. Previous approaches typically rely on…

图形学 · 计算机科学 2025-12-10 Jianan Li , Xiao Chen , Tao Huang , Tien-Tsin Wong

Humans interact with an object in many different ways by making contact at different locations, creating a highly complex motion space that can be difficult to learn, particularly when synthesizing such human interactions in a controllable…

计算机视觉与模式识别 · 计算机科学 2022-05-03 Xiaohan Zhang , Bharat Lal Bhatnagar , Vladimir Guzov , Sebastian Starke , Gerard Pons-Moll

Human motion synthesis is a fundamental task in computer animation. Recent methods based on diffusion models or GPT structure demonstrate commendable performance but exhibit drawbacks in terms of slow sampling speeds and error accumulation.…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Vincent Tao Hu , Wenzhe Yin , Pingchuan Ma , Yunlu Chen , Basura Fernando , Yuki M Asano , Efstratios Gavves , Pascal Mettes , Bjorn Ommer , Cees G. M. Snoek

Human motion synthesis aims to generate plausible human motion sequences, which has raised widespread attention in computer animation. Recent score-based generative models (SGMs) have demonstrated impressive results on this task. However,…

计算机视觉与模式识别 · 计算机科学 2025-05-05 Yu Hua , Weiming Liu , Gui Xu , Yaqing Hou , Yew-Soon Ong , Qiang Zhang

Existing automatic approaches for 3D virtual character motion synthesis supporting scene interactions do not generalise well to new objects outside training distributions, even when trained on extensive motion capture datasets with diverse…

计算机视觉与模式识别 · 计算机科学 2024-02-16 Wanyue Zhang , Rishabh Dabral , Thomas Leimkühler , Vladislav Golyanik , Marc Habermann , Christian Theobalt

Generating sequences of human-like motions for humanoid robots presents challenges in collecting and analyzing reference human motions, synthesizing new motions based on these reference motions, and mapping the generated motion onto…

机器人学 · 计算机科学 2025-08-19 Rhea Malhotra , William Chong , Catie Cuan , Oussama Khatib

Synthesizing realistic human-object interaction motions is a critical problem in VR/AR and human animation. Unlike the commonly studied scenarios involving a single human or hand interacting with one object, we address a more generic…

计算机视觉与模式识别 · 计算机科学 2025-07-31 Wenkun He , Yun Liu , Ruitao Liu , Li Yi

The ability to generate complex and realistic human body animations at scale, while following specific artistic constraints, has been a fundamental goal for the game and animation industry for decades. Popular techniques include…

计算机视觉与模式识别 · 计算机科学 2020-05-29 Yi Zhou , Jingwan Lu , Connelly Barnes , Jimei Yang , Sitao Xiang , Hao li

Generating 3D human motion based on textual descriptions has been a research focus in recent years. It requires the generated motion to be diverse, natural, and conform to the textual description. Due to the complex spatio-temporal nature…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Chongyang Zhong , Lei Hu , Zihao Zhang , Shihong Xia

Human-Scene Interaction (HSI) seeks to generate realistic human behaviors within complex environments, yet it faces significant challenges in handling long-horizon, high-level tasks and generalizing to unseen scenes. To address these…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Lingzhou Mu , Qiang Wang , Fan Jiang , Mengchao Wang , Yaqi Fan , Mu Xu , Kai Zhang

We introduce Drag4D, an interactive framework that integrates object motion control within text-driven 3D scene generation. This framework enables users to define 3D trajectories for the 3D objects generated from a single image, seamlessly…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Minjun Kang , Inkyu Shin , Taeyeop Lee , In So Kweon , Kuk-Jin Yoon

Recent advancements in language models have demonstrated their adeptness in conducting multi-turn dialogues and retaining conversational context. However, this proficiency remains largely unexplored in other multimodal generative models,…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Biao Jiang , Xin Chen , Chi Zhang , Fukun Yin , Zhuoyuan Li , Gang YU , Jiayuan Fan