English
Related papers

Related papers: Think Before You Move: Latent Motion Reasoning for…

200 papers

The "Thinking with Text" and "Thinking with Images" paradigms significantly improve the reasoning abilities of large language models (LLMs) and Vision-Language Models (VLMs). However, these paradigms have inherent limitations. (1) Images…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Jingqi Tong , Yurong Mou , Hangcheng Li , Mingzhe Li , Yongzhuo Yang , Ming Zhang , Qiguang Chen , Tianyi Liang , Xiaomeng Hu , Yining Zheng , Xinchi Chen , Jun Zhao , Xuanjing Huang , Xipeng Qiu

Long-form video understanding, characterized by long-range temporal dependencies and multiple events, remains a challenge. Existing methods often rely on static reasoning or external visual-language models (VLMs), which face issues like…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yuan Xie , Tianshui Chen , Zheng Ge , Lionel Ni

Text-driven motion generation offers a powerful and intuitive way to create human movements directly from natural language. By removing the need for predefined motion inputs, it provides a flexible and accessible approach to controlling…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Ali Rida Sahili , Najett Neji , Hedi Tabia

While previous approaches to 3D human motion generation have achieved notable success, they often rely on extensive training and are limited to specific tasks. To address these challenges, we introduce Motion-Agent, an efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Qi Wu , Yubo Zhao , Yifan Wang , Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang

Text-to-motion generation has advanced with diffusion- and flow-based generative models, yet supervised pretraining remains insufficient to align models with high-level objectives such as semantic consistency, realism, and human preference.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Xiaofeng Tan , Wanjiang Weng , Hongsong Wang , Fang Zhao , Xin Geng , Liang Wang

Large language models (LLMs) are, by design, inherently capable of multi-task learning: through a unified next-token prediction paradigm, they can naturally address a wide variety of downstream tasks. Prior work in the motion domain has…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Zeyu Ling , Bo Han , Shiyang Li , Jikang Cheng , Hongdeng Shen , Changqing Zou

Recent works have sought to enhance the controllability and precision of text-driven motion generation. Some approaches leverage large language models (LLMs) to produce more detailed texts, while others incorporate global 3D coordinate…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Keming Shen , Bizhu Wu , Junliang Chen , Xiaoqin Wang , Linlin Shen

Recent advancements in Large Language Models (LLMs) have significantly enhanced their ability to perform complex reasoning tasks, transitioning from fast and intuitive thinking (System 1) to slow and deep reasoning (System 2). While System…

Computation and Language · Computer Science 2025-04-01 Rui Wang , Hongru Wang , Boyang Xue , Jianhui Pang , Shudong Liu , Yi Chen , Jiahao Qiu , Derek Fai Wong , Heng Ji , Kam-Fai Wong

Human motion stylization aims to revise the style of an input motion while keeping its content unaltered. Unlike existing works that operate directly in pose space, we leverage the latent space of pretrained autoencoders as a more…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Chuan Guo , Yuxuan Mu , Xinxin Zuo , Peng Dai , Youliang Yan , Juwei Lu , Li Cheng

We present Lang2Motion, a framework for language-guided point trajectory generation by aligning motion manifolds with joint embedding spaces. Unlike prior work focusing on human motion or video synthesis, we generate explicit trajectories…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Bishoy Galoaa , Xiangyu Bai , Sarah Ostadabbas

While large language models (LLMs) have made significant strides in generating coherent and contextually relevant text, they often function as opaque black boxes, trained on vast unlabeled datasets with statistical objectives, lacking an…

Computation and Language · Computer Science 2025-03-03 Yingbing Huang , Deming Chen , Abhishek K. Umrawal

Large language models (LLMs) excel at complex reasoning, yet their efficiency is limited by the surging cognitive overhead of long thought traces. In this paper, we propose LightThinker, a method that enables LLMs to dynamically compress…

Computation and Language · Computer Science 2026-04-07 Yuqi Zhu , Jintian Zhang , Zhenjie Wan , Yujie Luo , Shuofei Qiao , Zhengke Gui , Da Zheng , Lei Liang , Huajun Chen , Ningyu Zhang

Multimodal Mathematical Reasoning (MMR) has recently attracted increasing attention for its capability to solve mathematical problems involving both textual and visual modalities. However, current models still face significant challenges in…

Artificial Intelligence · Computer Science 2026-04-15 Tianyu Yang , Sihong Wu , Yilun Zhao , Zhenwen Liang , Lisen Dai , Chen Zhao , Minhao Cheng , Arman Cohan , Xiangliang Zhang

Interleaved reasoning paradigms enhance Multimodal Large Language Models (MLLMs) with visual feedback but are hindered by the prohibitive computational cost of re-encoding pixel-dense images. A promising alternative, latent visual…

Computation and Language · Computer Science 2026-01-22 Shuai Dong , Siyuan Wang , Xingyu Liu , Chenglin Li , Haowen Hou , Zhongyu Wei

Recent advancements in text-to-image (T2I) generative models have shown remarkable capabilities in producing diverse and imaginative visuals based on text prompts. Despite the advancement, these diffusion models sometimes struggle to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiaohui Chen , Yongfei Liu , Yingxiang Yang , Jianbo Yuan , Quanzeng You , Li-Ping Liu , Hongxia Yang

Reasoning goes beyond language; the real world requires reasoning about space, time, affordances, and much more that words alone cannot convey. Existing multimodal models exploring the potential of reasoning with images are brittle and do…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Arijit Ray , Ahmed Abdelkader , Chengzhi Mao , Bryan A. Plummer , Kate Saenko , Ranjay Krishna , Leonidas Guibas , Wen-Sheng Chu

Recently, text-to-motion models have opened new possibilities for creating realistic human motion with greater efficiency and flexibility. However, aligning motion generation with event-level textual descriptions presents unique challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Haonan Han , Xiangzuo Wu , Huan Liao , Zunnan Xu , Zhongyuan Hu , Ronghui Li , Yachao Zhang , Xiu Li

Large-scale foundation models (LFMs) have recently made impressive progress in text-to-motion generation by learning strong generative priors from massive 3D human motion datasets and paired text descriptions. However, how to effectively…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Xiaoyan Cong , Zekun Li , Zhiyang Dou , Hongyu Li , Omid Taheri , Chuan Guo , Abhay Mittal , Sizhe An , Taku Komura , Wojciech Matusik , Michael J. Black , Srinath Sridhar

Text-to-motion generation has gained increasing attention, but most existing methods are limited to generating short-term motions that correspond to a single sentence describing a single action. However, when a text stream describes a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Zhao Yang , Bing Su , Ji-Rong Wen

Latent visual reasoning involves visual evidence more directly in multimodal reasoning by inserting continuous latent tokens before textual generation. However, the necessity of these latent tokens at inference remains ambiguous. We show…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Dongyao Zhu , Zhen Wang , Xi Xiao , Han Jiang , Saeed Vahidian , Wei-Lun Chao , Tanya Berger-Wolf , Yu Su , Raju Vatsavai , Jianyang Gu