中文
相关论文

相关论文: Unleashing Perception-Time Scaling to Multimodal R…

200 篇论文

Large Language Models (LLMs) now exhibit remarkable reasoning capabilities through test-time compute scaling (TTS), with impressive performance across math and coding benchmarks. In parallel, research in model compression has developed…

人工智能 · 计算机科学 2026-05-29 Ocean Monjur , Shahriar Kabir Nahin , Anshuman Chhabra

Test-Time Scaling (TTS) is an important method for improving the performance of Large Language Models (LLMs) by using additional computation during the inference phase. However, current studies do not systematically analyze how policy…

计算与语言 · 计算机科学 2025-02-11 Runze Liu , Junqi Gao , Jian Zhao , Kaiyan Zhang , Xiu Li , Biqing Qi , Wanli Ouyang , Bowen Zhou

As textual reasoning with large language models (LLMs) has advanced significantly, there has been growing interest in enhancing the multimodal reasoning capabilities of large vision-language models (LVLMs). However, existing methods…

计算机视觉与模式识别 · 计算机科学 2025-06-23 Junfei Wu , Jian Guan , Kaituo Feng , Qiang Liu , Shu Wu , Liang Wang , Wei Wu , Tieniu Tan

Video Large Language Models (VideoLLMs) face a critical bottleneck: increasing the number of input frames to capture fine-grained temporal detail leads to prohibitive computational costs and performance degradation from long context…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Hyungjin Chung , Hyelin Nam , Jiyeon Kim , Hyojun Go , Byeongjun Park , Junho Kim , Joonseok Lee , Seongsu Ha , Byung-Hoon Kim

Vision-Language Models (VLMs) have recently gained attention due to their competitive performance on multiple downstream tasks, achieved by following user-input instructions. However, VLMs still exhibit several limitations in visual…

计算机视觉与模式识别 · 计算机科学 2025-10-23 Simone Alghisi , Gabriel Roccabruna , Massimo Rizzoli , Seyed Mahed Mousavi , Giuseppe Riccardi

Progress on training and architecture strategies has enabled LLMs with millions of tokens in context length. However, empirical evidence suggests that such long-context LLMs can consume far more text than they can reliably use. On the other…

Test-time scaling (TTS) has been shown to improve the performance of large language models (LLMs) by sampling and aggregating diverse reasoning paths. However, existing research has overlooked a critical issue: selection bias of reasoning…

人工智能 · 计算机科学 2025-09-24 Zongqian Wu , Baoduo Xu , Tianyu Li , Zhu Sun , Xiaofeng Zhu , Lei Feng

Time series is a pervasive data type across various application domains, rendering the reasonable solving of diverse time series tasks a long-standing goal. Recent advances in large language models (LLMs), especially their reasoning…

人工智能 · 计算机科学 2026-05-08 Jiahui Zhou , Dan Li , Boxin Li , Xiao Zhang , Erli Meng , Lin Li , Zhuomin Chen , Jian Lou , See-Kiong Ng

Token pruning is essential for enhancing the computational efficiency of vision-language models (VLMs), particularly for video-based tasks where temporal redundancy is prevalent. Prior approaches typically prune tokens either (1) within the…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Jianrui Zhang , Yue Yang , Rohun Tripathi , Winson Han , Ranjay Krishna , Christopher Clark , Yong Jae Lee , Sangho Lee

Test-Time Scaling (TTS) has proven effective in improving the performance of Large Language Models (LLMs) during inference. However, existing research has overlooked the efficiency of TTS from a latency-sensitive perspective. Through a…

计算与语言 · 计算机科学 2025-09-15 Zili Wang , Tianyu Zhang , Haoli Bai , Lu Hou , Xianzhi Yu , Wulong Liu , Shiming Xiang , Lei Zhu

Chain-of-thought (CoT) reasoning is critical for improving the interpretability and reliability of Large Vision-Language Models (LVLMs). However, existing training algorithms such as SFT, PPO, and GRPO may not generalize well across unseen…

人工智能 · 计算机科学 2025-10-31 Guohao Sun , Hang Hua , Jian Wang , Jiebo Luo , Sohail Dianat , Majid Rabbani , Raghuveer Rao , Zhiqiang Tao

Large reasoning models (LRMs) have exhibited strong performance on complex reasoning tasks, with further gains achievable through increased computational budgets at inference. However, current test-time scaling methods predominantly rely on…

人工智能 · 计算机科学 2025-09-09 Jie Chen , Jinhao Jiang , Yingqian Min , Zican Dong , Shijie Wang , Wayne Xin Zhao , Ji-Rong Wen

Achieving precise alignment between user intent and generated visuals remains a central challenge in text-to-visual generation, as a single attempt often fails to produce the desired output. To handle this, prior approaches mainly scale the…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Subin Kim , Sangwoo Mo , Mamshad Nayeem Rizve , Yiran Xu , Difan Liu , Jinwoo Shin , Tobias Hinz

Large Vision-Language Models (LVLMs) have recently demonstrated strong multimodal understanding, yet their fine-grained visual perception is often constrained by low input resolutions. A common remedy is to partition high-resolution images…

计算机视觉与模式识别 · 计算机科学 2026-02-17 Yuxuan Liang , Xu Li , Xiaolei Chen , Yi Zheng , Haotian Chen , Bin Li , Xiangyang Xue

Text-prompted image segmentation enables fine-grained visual understanding and is critical for applications such as human-computer interaction and robotics. However, existing supervised fine-tuning methods typically ignore explicit…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Lianghui Zhu , Bin Ouyang , Yuxuan Zhang , Tianheng Cheng , Rui Hu , Haocheng Shen , Longjin Ran , Xiaoxin Chen , Li Yu , Wenyu Liu , Xinggang Wang

Scaling LLM-based embodied agents from text-only environments to complex multimodal settings remains a major challenge. Recent work identifies a perception-reasoning-decision gap in standalone Vision-Language Models (VLMs), which often…

As enthusiasm for scaling computation (data and parameters) in the pretraining era gradually diminished, test-time scaling (TTS), also referred to as ``test-time computing'' has emerged as a prominent research focus. Recent studies…

Recent advancements in reinforcement learning with verifiable rewards have pushed the boundaries of the visual reasoning capabilities in large vision-language models (LVLMs). However, training LVLMs with reinforcement fine-tuning (RFT) is…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Zilin Xiao , Jaywon Koo , Siru Ouyang , Jefferson Hernandez , Yu Meng , Vicente Ordonez

Test-Time Scaling (TTS) refers to approaches that improve reasoning performance by allocating extra computation during inference, without altering the model's parameters. While existing TTS methods operate in a discrete token space by…

计算与语言 · 计算机科学 2025-05-28 Yige Xu , Xu Guo , Zhiwei Zeng , Chunyan Miao

Recent advances in text-based large language models (LLMs), particularly in the GPT series and the o1 model, have demonstrated the effectiveness of scaling both training-time and inference-time compute. However, current state-of-the-art TTS…