English
Related papers

Related papers: Real-time and Controllable Reactive Motion Synthes…

200 papers

Data-driven and controllable human motion synthesis and prediction are active research areas with various applications in interactive media and social robotics. Challenges remain in these fields for generating diverse motions given past…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Wenjie Yin , Ruibo Tu , Hang Yin , Danica Kragic , Hedvig Kjellström , Mårten Björkman

We tackle the novel problem of predicting 3D hand motion and contact maps (or Interaction Trajectories) given a single RGB view, action text, and a 3D contact point on the object as input. Our approach consists of (1) Interaction Codebook:…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Aditya Prakash , Benjamin Lundell , Dmitry Andreychuk , David Forsyth , Saurabh Gupta , Harpreet Sawhney

We present Interleaved Learning for Motion Synthesis (InterSyn), a novel framework that targets the generation of realistic interaction motions by learning from integrated motions that consider both solo and multi-person dynamics. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Yiyi Ma , Yuanzhi Liang , Xiu Li , Chi Zhang , Xuelong Li

Text-driven motion generation offers a powerful and intuitive way to create human movements directly from natural language. By removing the need for predefined motion inputs, it provides a flexible and accessible approach to controlling…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Ali Rida Sahili , Najett Neji , Hedi Tabia

Text-conditioned motion synthesis has made remarkable progress with the emergence of diffusion models. However, the majority of these motion diffusion models are primarily designed for a single character and overlook multi-human…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Zhenzhi Wang , Jingbo Wang , Yixuan Li , Dahua Lin , Bo Dai

In mobile robot shared control, effectively understanding human motion intention is critical for seamless human-robot collaboration. This paper presents a novel shared control framework featuring planning-level intention prediction. A path…

Robotics · Computer Science 2025-11-13 Jinyu Zhang , Lijun Han , Feng Jian , Lingxi Zhang , Hesheng Wang

Text-to-motion generation requires not only grounding local actions in language but also seamlessly blending these individual actions to synthesize diverse and realistic global motions. However, existing motion generation methods primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Peng Jin , Hao Li , Zesen Cheng , Kehan Li , Runyi Yu , Chang Liu , Xiangyang Ji , Li Yuan , Jie Chen

We consider the problem of synthesizing multi-action human motion sequences of arbitrary lengths. Existing approaches have mastered motion sequence generation in single action scenarios, but fail to generalize to multi-action and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Rania Briq , Chuhang Zou , Leonid Pishchulin , Chris Broaddus , Juergen Gall

A long-standing goal in computer vision is to capture, model, and realistically synthesize human behavior. Specifically, by learning from data, our goal is to enable virtual humans to navigate within cluttered indoor scenes and naturally…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Mohamed Hassan , Duygu Ceylan , Ruben Villegas , Jun Saito , Jimei Yang , Yi Zhou , Michael Black

Accurately predicting the possible behaviors of traffic participants is an essential capability for future autonomous vehicles. The majority of current researches fix the number of driving intentions by considering only a specific scenario.…

Machine Learning · Computer Science 2018-04-11 Yeping Hu , Wei Zhan , Masayoshi Tomizuka

We present an integrated planning framework for quadrupedal locomotion over dynamically changing, unforeseen terrains. Existing methods often depend on heuristics for real-time foothold selection-limiting robustness and adaptability-or rely…

Robotics · Computer Science 2025-09-30 Ziyi Zhou , Qian Meng , Hadas Kress-Gazit , Ye Zhao

We address the problem of generating realistic 3D motions of humans interacting with objects in a scene. Our key idea is to create a neural interaction field attached to a specific object, which outputs the distance to the valid interaction…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Nilesh Kulkarni , Davis Rempe , Kyle Genova , Abhijit Kundu , Justin Johnson , David Fouhey , Leonidas Guibas

In this paper, we address the new problem of the prediction of human intents. There is neuro-psychological evidence that actions performed by humans are anticipated by peculiar motor acts which are discriminant of the type of action going…

Computer Vision and Pattern Recognition · Computer Science 2017-09-07 Andrea Zunino , Jacopo Cavazza , Atesh Koul , Andrea Cavallo , Cristina Becchio , Vittorio Murino

Synthesis of long-term human motion skeleton sequences is essential to aid human-centric video generation with potential applications in Augmented Reality, 3D character animations, pedestrian trajectory prediction, etc. Long-term human…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Neeraj Battan , Yudhik Agrawal , Veeravalli Saisooryarao , Aman Goel , Avinash Sharma

How to build AI that understands human intentions, and uses this knowledge to collaborate with people? We describe a computational framework for evaluating models of goal inference in the domain of 3D motor actions, which receives as input…

Artificial Intelligence · Computer Science 2021-12-03 Yingdong Qian , Marta Kryven , Tao Gao , Hanbyul Joo , Josh Tenenbaum

We propose a real-time 3D human pose estimation and motion analysis method termed RePose for rehabilitation training. It is capable of real-time monitoring and evaluation of patients'motion during rehabilitation, providing immediate…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Junxiao Xue , Pavel Smirnov , Ziao Li , Yunyun Shi , Shi Chen , Xinyi Yin , Xiaohan Yue , Lei Wang , Yiduo Wang , Feng Lin , Yijia Chen , Xiao Ma , Xiaoran Yan , Qing Zhang , Fengjian Xue , Xuecheng Wu

Game-theoretic motion planners are a potent solution for controlling systems of multiple highly interactive robots. Most existing game-theoretic planners unrealistically assume a priori objective function knowledge is available to all…

Robotics · Computer Science 2024-10-28 Makram Chahine , Roya Firoozi , Wei Xiao , Mac Schwager , Daniela Rus

Human motion synthesis conditioned on textual input has gained significant attention in recent years due to its potential applications in various domains such as gaming, film production, and virtual reality. Conditioned Motion synthesis…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Avinash Amballa , Gayathri Akkinapalli , Vinitra Muralikrishnan

In mixed-traffic environments, autonomous vehicles (AVs) must interact with heterogeneous human-driven vehicles (HVs) whose intentions and driving styles vary across individuals and scenarios. Such variability introduces uncertainty into…

Robotics · Computer Science 2026-03-18 Xiaoyun Qiu , Haichao Liu , Yue Pan , Jun Ma , Xinhu Zheng

Real-time synthesis of physically plausible human interactions remains a critical challenge for immersive VR/AR systems and humanoid robotics. While existing methods demonstrate progress in kinematic motion generation, they often fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Kaiyang Ji , Ye Shi , Zichen Jin , Kangyi Chen , Lan Xu , Yuexin Ma , Jingyi Yu , Jingya Wang