中文
相关论文

相关论文: Unleashing Perception-Time Scaling to Multimodal R…

200 篇论文

In this work, we present the first study to explore inference-time scaling on table reasoning tasks. We develop and evaluate two post-training strategies to enable inference-time scaling: distillation from frontier model reasoning traces…

计算与语言 · 计算机科学 2025-09-29 Zheyuan Yang , Lyuhao Chen , Arman Cohan , Yilun Zhao

Outcome-reward reinforcement learning (RL) is a common and increasingly significant way to refine the step-by-step reasoning of multimodal large language models (MLLMs). In the multiple-choice setting - a dominant format for multimodal…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Jiahao Wang , Weiye Xu , Aijun Yang , Wengang Zhou , Lewei Lu , Houqiang Li , Xiaohua Wang , Jinguo Zhu

Large Reasoning Models (LRMs) achieve remarkable inference-time improvements through parallel thinking. However, existing methods rely on redundant sampling of reasoning trajectories, failing to effectively explore the reasoning space to…

Test-time scaling (TTS) has become an effective approach for improving large language model performance by allocating additional computation during inference. However, existing TTS strategies are largely hand-crafted: researchers manually…

Large language models (LLMs) have revolutionized the field of natural language processing, enabling remarkable progress in various tasks. Different from objective tasks such as commonsense reasoning and arithmetic question-answering, the…

计算与语言 · 计算机科学 2025-06-19 Xiaolong Wang , Yuanchi Zhang , Ziyue Wang , Yuzhuang Xu , Fuwen Luo , Yile Wang , Peng Li , Yang Liu

While Vision-Language Models (VLMs) have significantly advanced remote sensing interpretation, enabling them to perform complex, step-by-step reasoning remains highly challenging. Recent efforts to introduce Chain-of-Thought (CoT) reasoning…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Lang Sun , Ronghao Fu , Zhuoran Duan , Haoran Liu , Xueyan Liu , Bo Yang

Large language models (LLMs) have recently garnered significant interest. With in-context learning, LLMs achieve impressive results in various natural language tasks. However, the application of LLMs to sentence embeddings remains an area…

计算与语言 · 计算机科学 2023-08-01 Ting Jiang , Shaohan Huang , Zhongzhi Luan , Deqing Wang , Fuzhen Zhuang

Scaling test-time compute has driven the recent advances in the reasoning capabilities of large language models (LLMs), typically by allocating additional computation for more thorough exploration. However, increased compute often comes at…

Video Large Language Models (Video LLMs) have achieved significant success by adopting the paradigm of large-scale pre-training followed by supervised fine-tuning (SFT). However, existing approaches struggle with temporal reasoning due to…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Shicheng Li , Lei Li , Kun Ouyang , Shuhuai Ren , Yuanxin Liu , Yuanxing Zhang , Fuzheng Zhang , Lingpeng Kong , Qi Liu , Xu Sun

Test-time scaling (TTS) for large language models (LLMs) has thus far fallen into two largely separate paradigms: (1) reinforcement learning (RL) methods that optimize sparse outcome-based rewards, yet suffer from instability and low sample…

Recently, scaling test-time compute on Large Language Models (LLM) has garnered wide attention. However, there has been limited investigation of how various reasoning prompting strategies perform as scaling. In this paper, we focus on a…

人工智能 · 计算机科学 2025-08-18 Yexiang Liu , Zekun Li , Zhi Fang , Nan Xu , Ran He , Tieniu Tan

Video large language models have achieved remarkable performance in tasks such as video question answering, however, their temporal understanding remains suboptimal. To address this limitation, we curate a dedicated instruction fine-tuning…

计算机视觉与模式识别 · 计算机科学 2025-08-08 Yunxiao Wang , Meng Liu , Wenqi Liu , Xuemeng Song , Bin Wen , Fan Yang , Tingting Gao , Di Zhang , Guorui Zhou , Liqiang Nie

This paper introduces a simple and scalable approach to improve the data efficiency of large language model (LLM) training by augmenting existing text data with thinking trajectories. The compute for pre-training LLMs has been growing at an…

计算与语言 · 计算机科学 2025-10-20 Liang Wang , Nan Yang , Shaohan Huang , Li Dong , Furu Wei

In the time-series domain, an increasing number of works combine text with temporal data to leverage the reasoning capabilities of large language models (LLMs) for various downstream time-series understanding tasks. This enables a single…

计算与语言 · 计算机科学 2025-11-11 Zhirui Zhang , Changhua Pei , Tianyi Gao , Zhe Xie , Yibo Hao , Zhaoyang Yu , Longlong Xu , Tong Xiao , Jing Han , Dan Pei

Post-training with explicit reasoning traces is common to improve the reasoning capabilities of Multimodal Large Language Models (MLLMs). However, acquiring high-quality reasoning traces is often costly and time-consuming. Hence, the…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Qihuang Zhong , Liang Ding , Wenjie Xuan , Juhua Liu , Bo Du , Dacheng Tao

While Reinforcement Learning from Verifiable Rewards (RLVR) has advanced reasoning in Large Vision-Language Models (LVLMs), prevailing frameworks suffer from a foundational methodological flaw: by distributing identical advantages across…

人工智能 · 计算机科学 2026-04-09 Zekai Ye , Qiming Li , Xiaocheng Feng , Ruihan Chen , Ziming Li , Haoyu Ren , Kun Chen , Dandan Tu , Bing Qin

Many video reasoning tasks require tracking motion, temporal order, and evolving visual states across frames. Existing methods built on large vision-language models (LVLMs) often address this challenge by externalizing reasoning through…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Yiming Liang , Yixiao Chen , Yiyang Zhou , Yixuan Wang , Shoubin Yu , Andong Deng , Fuxiao Liu , Qin Zhang , Chen Chen , Mohit Bansal , Huaxiu Yao

Multimodal large language models (MLLMs) have demonstrated remarkable potential for enhancing scene understanding in autonomous driving systems through powerful logical reasoning capabilities. However, the deployment of these models faces…

计算机视觉与模式识别 · 计算机科学 2024-09-18 Yunsheng Ma , Amr Abdelraouf , Rohit Gupta , Ziran Wang , Kyungtae Han

Visual reasoning abilities play a crucial role in understanding complex multimodal data, advancing both domain-specific applications and artificial general intelligence (AGI). Existing methods enhance Vision-Language Models (VLMs) through…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Huajie Tan , Yuheng Ji , Xiaoshuai Hao , Xiansheng Chen , Pengwei Wang , Zhongyuan Wang , Shanghang Zhang

Scaling large language models (LLMs) has driven significant advancements, yet it faces diminishing returns and escalating energy demands. This work explores how test-time compute (TTC) can serve as an energy-efficient complement to…

机器学习 · 计算机科学 2025-11-11 Yunho Jin , Gu-Yeon Wei , David Brooks