English
Related papers

Related papers: SAGE-32B: Agentic Reasoning via Iterative Distilla…

200 papers

Although large language models (LLMs) have recently achieved remarkable performance on various complex reasoning benchmarks, the academic community still lacks an in-depth understanding of base model training processes and data quality. To…

Computation and Language · Computer Science 2025-05-14 Xiaoyu Tian , Sitong Zhao , Haotian Wang , Shuaiting Chen , Yiping Peng , Yunjie Ji , Han Zhao , Xiangang Li

As humans, we are natural any-horizon reasoners, i.e., we can decide whether to iteratively skim long videos or watch short ones in full when necessary for a given task. With this in mind, one would expect video reasoning models to reason…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jitesh Jain , Jialuo Li , Zixian Ma , Jieyu Zhang , Chris Dongjoo Kim , Sangho Lee , Rohun Tripathi , Tanmay Gupta , Christopher Clark , Humphrey Shi

Reasoning segmentation enables open-set object segmentation via implicit text queries, therefore serving as a foundation for embodied agents that should operate autonomously in real-world environments. However, existing methods for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yiqing Shen , Mathias Unberath

Large Reasoning Models (LRMs) excel at multi-step reasoning but often suffer from inefficient reasoning processes like overthinking and overshoot, where excessive or misdirected reasoning increases computational cost and degrades…

Artificial Intelligence · Computer Science 2026-01-19 Qianyue Wang , Jinwu Hu , Yufeng Wang , Huanxiang Lin , Bolin Chen , Zhiquan Wen , Yaofo Chen , Mingkui Tan

The AM-DeepSeek-R1-Distilled is a large-scale dataset with thinking traces for general reasoning tasks, composed of high-quality and challenging reasoning problems. These problems are collected from a multitude of open-source datasets,…

Computation and Language · Computer Science 2025-03-26 Han Zhao , Haotian Wang , Yiping Peng , Sitong Zhao , Xiaoyu Tian , Shuaiting Chen , Yunjie Ji , Xiangang Li

Our aim for the ML Contest for Chip Design with HLS 2024 was to predict the validity, running latency in the form of cycle counts, utilization rate of BRAM (util-BRAM), utilization rate of lookup tables (uti-LUT), utilization rate of flip…

Artificial Intelligence · Computer Science 2024-12-17 Ali Emre Oztas , Mahdi Jelodari

What does it mean to plan? Current agentic systems, whether scaffolded workflows or end-to-end policies, rely on reactive decision-making: selecting the next action via a fixed procedure with at most undifferentiated adaptive computation…

Artificial Intelligence · Computer Science 2026-05-22 Mingkai Deng , Jinyu Hou , Zhiting Hu , Eric Xing

With the growing adoption of large language model agents in persistent real-world roles, they naturally encounter continuous streams of tasks. A key limitation, however, is their failure to learn from the accumulated interaction history,…

The development of unbiased large language models is widely recognized as crucial, yet existing benchmarks fall short in detecting biases due to limited scope, contamination, and lack of a fairness baseline. SAGED(bias) is the first…

Computation and Language · Computer Science 2025-01-31 Xin Guan , Ze Wang , Nathaniel Demchak , Saloni Gupta , Ediz Ertekin , Adriano Koshiyama , Emre Kazim , Zekun Wu

Deep research agents have emerged as powerful systems for addressing complex queries. Meanwhile, LLM-based retrievers have demonstrated strong capability in following instructions or reasoning. This raises a critical question: can LLM-based…

Information Retrieval · Computer Science 2026-02-09 Tiansheng Hu , Yilun Zhao , Canyu Zhang , Arman Cohan , Chen Zhao

Test-time scaling has emerged as an effective way to improve language models on challenging reasoning tasks. However, most existing methods treat each problem in isolation and do not systematically reuse knowledge from prior reasoning…

Computation and Language · Computer Science 2026-04-21 Di Wu , Devendra Singh Sachan , Wen-tau Yih , Mingda Chen

We present MA-RAG, a Multi-Agent framework for Retrieval-Augmented Generation (RAG) that addresses the inherent ambiguities and reasoning challenges in complex information-seeking tasks. Unlike conventional RAG methods that rely on…

Computation and Language · Computer Science 2025-10-14 Thang Nguyen , Peter Chin , Yu-Wing Tai

In this report, we present HyperCLOVA X 32B Think, a vision-language model designed with particular emphasis on reasoning within the Korean linguistic and cultural context, as well as agentic ability. HyperCLOVA X 32B Think is pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 NAVER Cloud HyperCLOVA X Team

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

Diffusion models manifest evident benefits across diverse domains, yet their high sampling cost, requiring dozens of sequential model evaluations, remains a major limitation. Prior efforts mainly accelerate sampling via optimized solvers or…

Machine Learning · Computer Science 2025-09-22 Haoran Zhao , Tong Bai , Lei Huang , Xiaoyu Liang

Large language models have demonstrated remarkable capabilities across diverse reasoning tasks, yet their performance on algorithmic reasoning remains limited. To handle this limitation, we propose PRIME (Policy-Reinforced Iterative…

Computation and Language · Computer Science 2026-02-13 Jiawei Xu , Zhenyu Yu , Ziqian Bi , Minh Duc Pham , Xiaoyi Qu , Danyang Zhang

Large Language Models have evolved from single-round generators into long-horizon agents, capable of complex text synthesis scenarios. However, current evaluation frameworks lack the ability to assess the actual synthesis operations, such…

Computation and Language · Computer Science 2026-03-03 Andrew Zhuoer Feng , Cunxiang Wang , Yu Luo , Bosi Wen , Yidong Wang , Lin Fan , Yilin Zhou , Zikang Wang , Wenbo Yu , Lindong Wu , Hongning Wang , Minlie Huang

In this report, we introduce DASD-4B-Thinking, a lightweight yet highly capable, fully open-source reasoning model. It achieves SOTA performance among open-source models of comparable scale across challenging benchmarks in mathematics,…

Machine Learning · Computer Science 2026-01-15 Shaotian Yan , Kaiyuan Liu , Chen Shen , Bing Wang , Sinan Fan , Jun Zhang , Yue Wu , Zheng Wang , Jieping Ye

We study a novel language model architecture that is capable of scaling test-time computation by implicitly reasoning in latent space. Our model works by iterating a recurrent block, thereby unrolling to arbitrary depth at test-time. This…

We present EXAONE Deep series, which exhibits superior capabilities in various reasoning tasks, including math and coding benchmarks. We train our models mainly on the reasoning-specialized dataset that incorporates long streams of thought…