English
Related papers

Related papers: Internalized Reasoning for Long-Context Visual Doc…

200 papers

Large language models (LLMs) have exhibited impressive reasoning abilities on a wide range of complex tasks. However, enhancing these capabilities through post-training remains resource intensive, particularly in terms of data and…

Artificial Intelligence · Computer Science 2025-08-13 Shuo Cai , Su Lu , Qi Zhou , Kejing Yang , Zhijie Sang , Congkai Xie , Hongxia Yang

Reasoning language models, which generate long chains of thought, dramatically outperform non-reasoning language models on abstract problems. However, the internal model mechanisms that allow this superior performance remain poorly…

Artificial Intelligence · Computer Science 2026-02-05 Dmitrii Kharlapenko , Alessandro Stolfo , Arthur Conmy , Mrinmaya Sachan , Zhijing Jin

Fully comprehending scientific papers by machines reflects a high level of Artificial General Intelligence, requiring the ability to reason across fragmented and heterogeneous sources of information, presenting a complex and practically…

Computation and Language · Computer Science 2025-06-30 Yang Tian , Zheng Lu , Mingqi Gao , Zheng Liu , Bo Zhao

Reasoning-oriented large language models (RLMs) achieve strong gains on tasks such as mathematics and coding by generating explicit intermediate reasoning. However, their impact on machine translation (MT) remains underexplored. We…

Computation and Language · Computer Science 2026-02-17 Sara Rajaee , Sebastian Vincent , Alexandre Berard , Marzieh Fadaee , Kelly Marchisio , Tom Kocmi

Large language models (LLMs) increasingly solve difficult problems by producing "reasoning traces" before emitting a final response. However, it remains unclear how accuracy and decision commitment evolve along a reasoning trajectory, and…

Machine Learning · Computer Science 2026-02-02 Marthe Ballon , Brecht Verbeken , Vincent Ginis , Andres Algaba

Vision-language models (VLMs) trained via reinforcement learning with verifiable reward (RLVR) have shown notable progress in scaling test-time compute effectively. In this work, we investigate how synthesized RL data can further improve…

Machine Learning · Computer Science 2025-06-04 Zijian Wu , Jinjie Ni , Xiangyan Liu , Zichen Liu , Hang Yan , Michael Qizhe Shieh

Large reasoning models exhibit remarkable reasoning capabilities via long, elaborate reasoning trajectories. Supervised fine-tuning on such reasoning traces, also known as distillation, can be a cost-effective way to boost reasoning…

We participated in the Fifth UNLP shared task on multi-domain document understanding, where systems must answer Ukrainian multiple-choice questions from PDF collections and localize the supporting document and page. We propose a…

Computation and Language · Computer Science 2026-05-12 Anton Bazdyrev , Ivan Bashtovyi , Ivan Havlytskyi , Oleksandr Kharytonov , Artur Khodakovskyi

Listwise reranking utilizing Large Language Models (LLMs) has achieved state-of-the-art retrieval effectiveness. Recently, reasoning-enhanced models have further pushed these boundaries by employing Chain-of-Thought (CoT) to perform deep…

Information Retrieval · Computer Science 2026-05-15 Danyang Liu , Kan Li

Training Large Language Models (LLMs) for chain-of-thought reasoning presents a significant challenge: supervised fine-tuning on a single "golden" rationale hurts generalization as it penalizes equally valid alternatives, whereas…

Computation and Language · Computer Science 2025-11-14 Mingye Zhu , Yi Liu , Zheren Fu , Quan Wang , Yongdong Zhang

Recent reasoning-focused language models achieve high accuracy by generating lengthy intermediate reasoning paths before producing final answers. While this approach is effective in solving problems that require logical thinking, long…

Computation and Language · Computer Science 2025-10-27 Jiwon Song , Dongwon Jo , Yulhwa Kim , Jae-Joon Kim

Recent advances in reasoning-enhanced Large Language Models such as OpenAI-o1/3 and DeepSeek-R1 have significantly improved performance on complex tasks. However, the quality and transparency of their internal reasoning processes remain…

Computation and Language · Computer Science 2025-06-04 Juncheng Wu , Sheng Liu , Haoqin Tu , Hang Yu , Xiaoke Huang , James Zou , Cihang Xie , Yuyin Zhou

The internalization of chain-of-thought processes into hidden states has emerged as a highly efficient paradigm for scaling test-time compute. However, existing activation steering methods rely on static control vectors that fail to adapt…

Machine Learning · Computer Science 2026-02-06 Zhenning Shi , Yijia Zhu , Junhan Shi , Xun Zhang , Lei Wang , Congcong Miao

Test-time thinking (that is, generating explicit intermediate reasoning chains) is known to boost performance in large language models and has recently shown strong gains for large vision language models (LVLMs). However, despite these…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jing Bi , Filippos Bellos , Junjia Guo , Yayuan Li , Chao Huang , Yolo Y. Tang , Luchuan Song , Susan Liang , Zhongfei Mark Zhang , Jason J. Corso , Chenliang Xu

Large language models (LLMs) excel at complex reasoning, yet their efficiency is limited by the surging cognitive overhead of long thought traces. In this paper, we propose LightThinker, a method that enables LLMs to dynamically compress…

Computation and Language · Computer Science 2026-04-07 Yuqi Zhu , Jintian Zhang , Zhenjie Wan , Yujie Luo , Shuofei Qiao , Zhengke Gui , Da Zheng , Lei Liang , Huajun Chen , Ningyu Zhang

Recent think-answer approaches in VLMs, such as Qwen3-VL-Thinking, boost reasoning performance by leveraging intermediate thinking steps before the final answer, but their computational cost becomes substantial, especially for larger VLMs.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Seonghoon Yu , Dongjun Nam , Byung-Kwan Lee , Jeany Son

Reasoning-centric large language models (LLMs) achieve strong performance by generating intermediate reasoning trajectories, but often incur excessive token usage and high inference-time decoding cost. We observe that, when solving the same…

Artificial Intelligence · Computer Science 2026-05-12 Han Yang , Mingyan Wu , Bailan He , Zeyu Cao , Sikuan Yan , Kevin Qinghong Lin , Zifeng Ding

Recent breakthroughs in generative reasoning have fundamentally reshaped how large language models (LLMs) address complex tasks, enabling them to dynamically retrieve, refine, and organize information into coherent multi-step reasoning…

Machine Learning · Computer Science 2026-01-06 Mohamed Amine Ferrag , Norbert Tihanyi , Merouane Debbah

Recent advances such as OpenAI-o1 and DeepSeek R1 have demonstrated the potential of Reinforcement Learning (RL) to enhance reasoning abilities in Large Language Models (LLMs). While open-source replication efforts have primarily focused on…

We introduce Qwen3-VL, the most capable vision-language model in the Qwen series to date, achieving superior performance across a broad range of multimodal benchmarks. It natively supports interleaved contexts of up to 256K tokens,…