English
Related papers

Related papers: Being-M0.5: A Real-Time Controllable Vision-Langua…

200 papers

Despite rapid advances in video generative models, robust metrics for evaluating visual and temporal correctness of complex human actions remain elusive. Critically, existing pure-vision encoders and Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Xavier Thomas , Youngsun Lim , Ananya Srinivasan , Audrey Zheng , Deepti Ghadiyaram

Video generative models (VGMs) pretrained on large-scale internet data can produce temporally coherent rollout videos that capture rich object dynamics, offering a compelling foundation for zero-shot robotic manipulation. However, VGMs…

Robotics · Computer Science 2026-03-09 Gehao Zhang , Zhenyang Ni , Payal Mohapatra , Han Liu , Ruohan Zhang , Qi Zhu

Generating diverse and natural human motion sequences based on textual descriptions constitutes a fundamental and challenging research area within the domains of computer vision, graphics, and robotics. Despite significant advancements in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Ke Fan , Shunlin Lu , Minyue Dai , Runyi Yu , Lixing Xiao , Zhiyang Dou , Junting Dong , Lizhuang Ma , Jingbo Wang

Personalized driving refers to an autonomous vehicle's ability to adapt its driving behavior or control strategies to match individual users' preferences and driving styles while maintaining safety and comfort standards. However, existing…

Human motion generative modeling or synthesis aims to characterize complicated human motions of daily activities in diverse real-world environments. However, current research predominantly focuses on either low-level, short-period motions…

Robotics · Computer Science 2025-06-03 Jusheng Zhang , Jinzhou Tang , Sidi Liu , Mingyan Li , Sheng Zhang , Jian Wang , Keze Wang

Current methods for generating human motion videos rely on extracting pose sequences from reference videos, which restricts flexibility and control. Additionally, due to the limitations of pose detection techniques, the extracted pose…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Yuhang Zhang , Yuan Zhou , Zeyu Liu , Yuxuan Cai , Qiuyue Wang , Aidong Men , Huan Yang

Large language models (LLMs) are, by design, inherently capable of multi-task learning: through a unified next-token prediction paradigm, they can naturally address a wide variety of downstream tasks. Prior work in the motion domain has…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Zeyu Ling , Bo Han , Shiyang Li , Jikang Cheng , Hongdeng Shen , Changqing Zou

Despite transformative advances in generative motion synthesis, real-time interactive motion control remains dominated by traditional techniques. In this work, we identify two key challenges in bridging research and production: 1) Real-time…

Text-to-motion models excel at efficient human motion generation, but existing approaches lack fine-grained controllability over the generation process. Consequently, modifying subtle postures within a motion or inserting new actions at…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Yiming Huang , Weilin Wan , Yue Yang , Chris Callison-Burch , Mark Yatskar , Lingjie Liu

Text-to-motion (T2M) generation is becoming a practical tool for animation and interactive avatars. However, modifying specific body parts while maintaining overall motion coherence remains challenging. Existing methods typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Minyue Dai , Ke Fan , Anyi Rao , Jingbo Wang , Bo Dai

We present Wan-Move, a simple and scalable framework that brings motion control to video generative models. Existing motion-controllable methods typically suffer from coarse control granularity and limited scalability, leaving their outputs…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Ruihang Chu , Yefei He , Zhekai Chen , Shiwei Zhang , Xiaogang Xu , Bin Xia , Dingdong Wang , Hongwei Yi , Xihui Liu , Hengshuang Zhao , Yu Liu , Yingya Zhang , Yujiu Yang

Humanoid loco-manipulation in unstructured environments demands tight integration of egocentric perception and whole-body control. However, existing approaches either depend on external motion capture systems or fail to generalize across…

Robotics · Computer Science 2025-11-14 Shaofeng Yin , Yanjie Ze , Hong-Xing Yu , C. Karen Liu , Jiajun Wu

Human motion synthesis in complex scenes presents a fundamental challenge, extending beyond conventional Text-to-Motion tasks by requiring the integration of diverse modalities such as static environments, movable objects, natural language…

Graphics · Computer Science 2025-05-20 Zichen Geng , Zeeshan Hayder , Wei Liu , Ajmal Mian

Bimanual mobile manipulation requires a seamless integration between high-level semantic reasoning and safe, compliant physical interaction - a challenge that end-to-end models approach opaquely and classical controllers lack the context to…

Visual-Language-Action models (VLAs) have advanced generalist robot control by mapping multimodal observations and language instructions directly to actions, but sparse action supervision often encourages shortcut mappings rather than…

Robotics · Computer Science 2026-05-04 Hao Luo , Wanpeng Zhang , Yicheng Feng , Sipeng Zheng , Haiweng Xu , Chaoyi Xu , Ziheng Xi , Yuhui Fu , Zongqing Lu

Humanoid robots hold great potential to perform various human-level skills, involving unified locomotion and manipulation in real-world settings. Driven by advances in machine learning and the strength of existing model-based approaches,…

The remarkable progress of Multimodal Large Language Models (MLLMs) has attracted increasing attention to extend them to physical entities like legged robot. This typically requires MLLMs to not only grasp multimodal understanding…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Gen Luo , Ganlin Yang , Ziyang Gong , Guanzhou Chen , Haonan Duan , Erfei Cui , Ronglei Tong , Zhi Hou , Tianyi Zhang , Zhe Chen , Shenglong Ye , Lewei Lu , Jingbo Wang , Wenhai Wang , Jifeng Dai , Yu Qiao , Rongrong Ji , Xizhou Zhu

Despite recent advances in 3D human motion generation (MoGen) on standard benchmarks, existing text-to-motion models still face a fundamental bottleneck in their generalization capability. In contrast, adjacent generative fields, most…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jing Lin , Ruisi Wang , Junzhe Lu , Ziqi Huang , Guorui Song , Ailing Zeng , Xian Liu , Chen Wei , Wanqi Yin , Qingping Sun , Zhongang Cai , Lei Yang , Ziwei Liu

Human-scene vision-language tasks are increasingly prevalent in diverse social applications, yet recent advancements predominantly rely on models specifically tailored to individual tasks. Emerging research indicates that large…

Artificial Intelligence · Computer Science 2024-11-06 Dawei Dai , Xu Long , Li Yutang , Zhang Yuanhui , Shuyin Xia

Humanoid robots have achieved significant progress in motion generation and control, exhibiting movements that appear increasingly natural and human-like. Inspired by the Turing Test, we propose the Motion Turing Test, a framework that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Mingzhe Li , Mengyin Liu , Zekai Wu , Xincheng Lin , Junsheng Zhang , Ming Yan , Zengye Xie , Changwang Zhang , Chenglu Wen , Lan Xu , Siqi Shen , Cheng Wang