English
Related papers

Related papers: ActivityEditor: Learning to Synthesize Physically …

200 papers

Evaluating recommender systems remains challenging due to the gap between offline metrics and real user behavior, as well as the scarcity of interaction data. Recent work explores large language model (LLM) agents as synthetic users, yet…

Information Retrieval · Computer Science 2026-01-06 Nicolas Bougie , Gian Maria Marconi , Tony Yip , Narimasa Watanabe

In this work, we propose TextIM, a novel framework for synthesizing TEXT-driven human Interactive Motions, with a focus on the precise alignment of part-level semantics. Existing methods often overlook the critical roles of interactive body…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Siyuan Fan , Bo Du , Xiantao Cai , Bo Peng , Longling Sun

Controllable cooperative humanoid manipulation is a fundamental yet challenging problem for embodied intelligence, due to severe data scarcity, complexities in multi-agent coordination, and limited generalization across objects. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Wei Yao , Haohan Ma , Hongwen Zhang , Yunlian Sun , Liangjun Xing , Zhile Yang , Yuanjun Guo , Yebin Liu , Jinhui Tang

Human mobility prediction is vital for urban services, but often fails to account for abrupt changes from external events. Existing spatiotemporal models struggle to leverage textual descriptions detailing these events. We propose SeMob, an…

Computation and Language · Computer Science 2025-10-03 Runfei Chen , Shuyang Jiang , Wei Huang

In this paper, a novel hybrid multi-robot motion planner that can be applied under non-communication and local observable conditions is presented. The planner is model-free and can realize the end-to-end mapping of multi-robot state and…

Robotics · Computer Science 2021-12-14 Zichen He , Lu Dong , Chunwei Song , Changyin Sun

Modelling pedestrian-driver interactions is critical for understanding human road user behaviour and developing safe autonomous vehicle systems. Existing approaches often rely on rule-based logic, game-theoretic models, or 'black-box'…

Artificial Intelligence · Computer Science 2025-11-03 Yueyang Wang , Mehmet Dogar , Gustav Markkula

The pursuit of autonomous agents capable of temporally coherent planning is hindered by a fundamental flaw in current vision-language models (VLMs): they lack cognitive inertia. Operating on isolated snapshots, these models cannot form a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Pei Liu , Qingtian Ning , Xinyan Lu , Haipeng Liu , Weiliang Ma , Dangen She , Peng Jia , Xianpeng Lang , Jun Ma

In this paper we address the multi-agent collaborative object transportation problem in a partially known environment with obstacles under a specified goal condition. We propose a leader follower approach for two mobile manipulators…

Robotics · Computer Science 2023-05-03 Sumanta Ghosh , Subhajit Nath , Sarvesh Sortee , Lokesh Kumar , Titas Bera

Current validation methods often rely on recorded data and basic functional checks, which may not be sufficient to encompass the scenarios an autonomous vehicle might encounter. In addition, there is a growing need for complex scenarios…

Robotics · Computer Science 2024-02-08 Marc Kaufeld , Rainer Trauth , Johannes Betz

Traffic intersections are important scenes that can be seen almost everywhere in the traffic system. Currently, most simulation methods perform well at highways and urban traffic networks. In intersection scenarios, the challenge lies in…

Robotics · Computer Science 2023-04-06 Pei Lv , Xinming Pei , Xinyu Ren , Yuzhen Zhang , Chaochao Li , Mingliang Xu

Although highly valuable for a variety of applications, urban mobility data is rarely made openly available as it contains sensitive personal information. Synthetic data aims to solve this issue by generating artificial data that resembles…

Cryptography and Security · Computer Science 2024-07-15 Alexandra Kapp , Julia Hansmeyer , Helena Mihaljević

Text-to-motion generation requires not only grounding local actions in language but also seamlessly blending these individual actions to synthesize diverse and realistic global motions. However, existing motion generation methods primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Peng Jin , Hao Li , Zesen Cheng , Kehan Li , Runyi Yu , Chang Liu , Xiangyang Ji , Li Yuan , Jie Chen

Realistic scene-level multi-agent motion simulations are crucial for developing and evaluating self-driving algorithms. However, most existing works focus on generating trajectories for a certain single agent type, and typically ignore the…

Robotics · Computer Science 2023-11-28 Zhiming Guo , Xing Gao , Jianlan Zhou , Xinyu Cai , Botian Shi

We present a novel approach to automatically synthesize "wayfinding instructions" for an embodied robot agent. In contrast to prior approaches that are heavily reliant on human-annotated datasets designed exclusively for specific simulation…

Robotics · Computer Science 2024-04-03 Vishnu Sashank Dorbala , Sanjoy Chowdhury , Dinesh Manocha

Synthesizing interactive 3D scenes from text is essential for gaming, virtual reality, and embodied AI. However, existing methods face several challenges. Learning-based approaches depend on small-scale indoor datasets, limiting the scene…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Lu Ling , Chen-Hsuan Lin , Tsung-Yi Lin , Yifan Ding , Yu Zeng , Yichen Sheng , Yunhao Ge , Ming-Yu Liu , Aniket Bera , Zhaoshuo Li

Equipping humanoid robots with versatile interaction skills typically requires either extensive policy training or explicit human-to-robot motion retargeting. However, learning-based policies face prohibitive data collection costs.…

The acquisition of agentic capabilities has transformed LLMs from "knowledge providers" to "action executors", a trend that while expanding LLMs' capability boundaries, significantly increases their susceptibility to malicious use. Previous…

Cryptography and Security · Computer Science 2025-05-30 Jinchuan Zhang , Lu Yin , Yan Zhou , Songlin Hu

Synthesizing interaction-involved human motions has been challenging due to the high complexity of 3D environments and the diversity of possible human behaviors within. We present LAMA, Locomotion-Action-MAnipulation, to synthesize natural…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Jiye Lee , Hanbyul Joo

Understanding and modeling human mobility is central to challenges in transport planning, sustainable urban design, and public health. Despite decades of effort, simulating individual mobility remains challenging because of its complex,…

Physics and Society · Physics 2026-02-10 Ye Hong , Yatao Zhang , Konrad Schindler , Martin Raubal

We introduce AgentWorld, an interactive simulation platform for developing household mobile manipulation capabilities. Our platform combines automated scene construction that encompasses layout generation, semantic asset placement, visual…

Robotics · Computer Science 2025-08-14 Yizheng Zhang , Zhenjun Yu , Jiaxin Lai , Cewu Lu , Lei Han