中文
相关论文

相关论文: Controllable Long-term Motion Generation with Exte…

200 篇论文

Learning long-horizon embodied behaviors from synthetic data remains challenging because generated scenes are often physically implausible, language-driven programs frequently "succeed" without satisfying task semantics, and high-level…

机器人学 · 计算机科学 2026-01-22 Yaru Liu , Ao-bo Wang , Nanyang Ye

Motion generation is a cornerstone of computer graphics, animation, gaming, and robotics, enabling the creation of realistic and varied character movements. A significant limitation of existing methods is their reliance on specific skeletal…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Aliasghar Khani , Arianna Rampini , Evan Atherton , Bruno Roy

We present Chain-of-Action (CoA), a novel visuo-motor policy paradigm built upon Trajectory Autoregressive Modeling. Unlike conventional approaches that predict next step action(s) forward, CoA generates an entire trajectory by explicit…

机器人学 · 计算机科学 2026-01-07 Wenbo Zhang , Tianrun Hu , Hanbo Zhang , Yanyuan Qiao , Yuchu Qin , Yang Li , Jiajun Liu , Tao Kong , Lingqiao Liu , Xiao Ma

Co-manipulation requires multiple humans to synchronize their motions with a shared object while ensuring reasonable interactions, maintaining natural poses, and preserving stable states. However, most existing motion generation approaches…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Jiahao Xu , Xiaohan Yuan , Xingchen Wu , Chongyang Xu , Kun Li , Buzhen Huang

Controllable video generation has attracted significant attention, largely due to advances in video diffusion models. In domains such as autonomous driving, it is essential to develop highly accurate predictions for object motions. This…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Ge Ya Luo , Zhi Hao Luo , Anthony Gosselin , Alexia Jolicoeur-Martineau , Christopher Pal

With the increasing integration of intelligent driving functions into serial-produced vehicles, ensuring their functionality and robustness poses greater challenges. Compared to traditional road testing, scenario-based virtual testing…

机器人学 · 计算机科学 2025-10-29 Li Li , Tobias Brinkmann , Till Temmen , Markus Eisenbarth , Jakob Andert

To generate accurate videos, algorithms have to understand the spatial and temporal dependencies in the world. Current algorithms enable accurate predictions over short horizons but tend to suffer from temporal inconsistencies. When…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Wilson Yan , Danijar Hafner , Stephen James , Pieter Abbeel

Existing vector quantization (VQ) based autoregressive models follow a two-stage generation paradigm that first learns a codebook to encode images as discrete codes, and then completes generation based on the learned codebook. However, they…

计算机视觉与模式识别 · 计算机科学 2023-05-22 Mengqi Huang , Zhendong Mao , Zhuowei Chen , Yongdong Zhang

Generating natural human motion from a story has the potential to transform the landscape of animation, gaming, and film industries. A new and challenging task, Story-to-Motion, arises when characters are required to move to various…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Zhongfei Qing , Zhongang Cai , Zhitao Yang , Lei Yang

We devise a new accelerated gradient-based estimating sequence technique for solving large-scale optimization problems with composite structure. More specifically, we introduce a new class of estimating functions, which are obtained by…

最优化与控制 · 数学 2021-11-15 Endrit Dosti , Sergiy A. Vorobyov , Themistoklis Charalambous

Keyframes are a standard representation for kinematic motion specification. Recent learned motion-inbetweening methods use keyframes as a way to control generative motion models, and are trained to generate life-like motion that matches the…

图形学 · 计算机科学 2025-03-04 Purvi Goel , Haotian Zhang , C. Karen Liu , Kayvon Fatahalian

The automatic generation of high-quality mathematical problems is practically valuable in many educational scenarios. Large multimodal model provides a novel technical approach for the mathematical problem generation because of its wide…

人工智能 · 计算机科学 2024-07-17 Sannyuya Liu , Jintian Feng , Zongkai Yang , Yawei Luo , Qian Wan , Xiaoxuan Shen , Jianwen Sun

The creation of plausible and controllable 3D human motion animations is a long-standing problem that requires a manual intervention of skilled artists. Current machine learning approaches can semi-automate the process, however, they are…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Kacper Kania , Marek Kowalski , Tomasz Trzciński

Linear models for control and motion generation of humanoid robots have received significant attention in the past years, not only due to their well known theoretical guarantees, but also because of practical computational advantages.…

机器人学 · 计算机科学 2016-08-01 Brahayam Ponton , Alexander Herzog , Stefan Schaal , Ludovic Righetti

Synthesizing semantic-aware, long-horizon, human-object interaction is critical to simulate realistic human behaviors. In this work, we address the challenging problem of generating synchronized object motion and human motion guided by…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Jiaman Li , Alexander Clegg , Roozbeh Mottaghi , Jiajun Wu , Xavier Puig , C. Karen Liu

Current autoregressive video diffusion models are constrained by three core bottlenecks: (i) the finite temporal horizon imposed by the base model's 3D Rotary Positional Embedding (3D-RoPE), (ii) slow prompt responsiveness in maintaining…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Hidir Yesiltepe , Tuna Han Salih Meral , Adil Kaan Akan , Kaan Oktay , Pinar Yanardag

Predicting diverse object motions from a single static image remains challenging, as current video generation models often entangle object movement with camera motion and other scene changes. While recent methods can predict specific…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Karran Pandey , Matheus Gadelha , Yannick Hold-Geoffroy , Karan Singh , Niloy J. Mitra , Paul Guerrero

World models allow agents to simulate the consequences of actions in imagined environments for planning, control, and long-horizon decision-making. However, existing autoregressive world models struggle with visually coherent predictions…

计算机视觉与模式识别 · 计算机科学 2025-10-22 Sen Wang , Jingyi Tian , Le Wang , Zhimin Liao , Jiayi Li , Huaiyi Dong , Kun Xia , Sanping Zhou , Wei Tang , Hua Gang

Human pose, action, and motion generation are critical for applications in digital humans, character animation, and humanoid robotics. However, many existing methods struggle to produce physically plausible movements that are consistent…

计算机视觉与模式识别 · 计算机科学 2025-07-16 Zixi Kang , Xinghan Wang , Yadong Mu

Legibility of robot motion is critical in human-robot interaction, as it allows humans to quickly infer a robot's intended goal. Although traditional trajectory generation methods typically prioritize efficiency, they often fail to make the…

机器人学 · 计算机科学 2025-10-15 Wenli Shi , Clemence Grislain , Olivier Sigaud , Mohamed Chetouani