English
Related papers

Related papers: WebThinker: Empowering Large Reasoning Models with…

200 papers

Deep research agents, powered by Large Language Models (LLMs), are rapidly advancing; yet, their performance often plateaus when generating complex, long-form research reports using generic test-time scaling algorithms. Drawing inspiration…

Large Reasoning Models like DeepSeek-R1 mark a fundamental shift in how LLMs approach complex problems. Instead of directly producing an answer for a given input, DeepSeek-R1 creates detailed multi-step reasoning chains, seemingly…

Chain-of-thought has been proven essential for enhancing the complex reasoning abilities of Large Language Models (LLMs), but it also leads to high computational costs. Recent advances have explored the method to route queries among…

Computation and Language · Computer Science 2025-12-05 Chenyang Shao , Xinyang Liu , Yutang Lin , Fengli Xu , Yong Li

While recent advances in reasoning models have demonstrated cognitive behaviors through reinforcement learning, existing approaches struggle to invoke deep reasoning capabilities in multi-turn agents with long-horizon interactions. We…

Computation and Language · Computer Science 2025-10-10 Qiaoyu Tang , Hao Xiang , Le Yu , Bowen Yu , Yaojie Lu , Xianpei Han , Le Sun , WenJuan Zhang , Pengbo Wang , Shixuan Liu , Zhenru Zhang , Jianhong Tu , Hongyu Lin , Junyang Lin

Recent advancements in Large Language Models (LLMs) have leveraged increased test-time computation to enhance reasoning capabilities, a strategy that, while effective, incurs significant latency and resource costs, limiting their…

Machine Learning · Computer Science 2025-09-01 Hao Wen , Xinrui Wu , Yi Sun , Feifei Zhang , Liye Chen , Jie Wang , Yunxin Liu , Yunhao Liu , Ya-Qin Zhang , Yuanchun Li

Large language models (LLMs) excel at knowledge-intensive question answering and reasoning, yet their real-world deployment remains constrained by knowledge cutoff, hallucination, and limited interaction modalities. Augmenting LLMs with…

Computation and Language · Computer Science 2025-10-13 Daocheng Fu , Jianbiao Mei , Licheng Wen , Xuemeng Yang , Cheng Yang , Rong Wu , Tao Hu , Siqi Li , Yufan Shen , Xinyu Cai , Pinlong Cai , Botian Shi , Yong Liu , Yu Qiao

Large language models (LLMs) have notably progressed in multi-step and long-chain reasoning. However, extending their reasoning capabilities to encompass deep interactions with search remains a non-trivial challenge, as models often fail to…

Computation and Language · Computer Science 2025-06-05 Qingfei Zhao , Ruobing Wang , Dingling Xu , Daren Zha , Limin Liu

Large reasoning models (LRMs) have emerged as a significant advancement in artificial intelligence, representing a specialized class of large language models (LLMs) designed to tackle complex reasoning tasks. The defining characteristic of…

Computation and Language · Computer Science 2025-07-25 Biao Yi , Zekun Fei , Jianing Geng , Tong Li , Lihai Nie , Zheli Liu , Yiming Li

Expert-level scientific reasoning remains challenging for large language models, particularly on benchmarks such as Humanity's Last Exam (HLE), where rigid tool pipelines, brittle multi-agent coordination, and inefficient test-time scaling…

Artificial Intelligence · Computer Science 2026-02-05 Zhentao Tang , Yuqi Cui , Shixiong Kai , Wenqian Zhao , Ke Ye , Xing Li , Anxin Tian , Zehua Pei , Hui-Ling Zhen , Shoubo Hu , Xiaoguang Li , Yunhe Wang , Mingxuan Yuan

Deep Research Agents are a prominent category of LLM-based agents. By autonomously orchestrating multistep web exploration, targeted retrieval, and higher-order synthesis, they transform vast amounts of online information into…

Computation and Language · Computer Science 2025-06-16 Mingxuan Du , Benfeng Xu , Chiwei Zhu , Xiaorui Wang , Zhendong Mao

Deep Research systems based on web agents have shown strong potential in solving complex information-seeking tasks, yet their search efficiency remains underexplored. We observe that many state-of-the-art open-source web agents rely on long…

Artificial Intelligence · Computer Science 2026-05-11 Junjie Wang , Zequn Xie , Dan Yang , Jie Feng , Yue Shen , Duolin Sun , Meixiu Long , Yihan Jiao , Zhehao Tan , Jian Wang , Peng Wei , Jinjie Gu

Building on the success of text-based reasoning models like DeepSeek-R1, extending these capabilities to multimodal reasoning holds great promise. While recent works have attempted to adapt DeepSeek-R1-style reinforcement learning (RL)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jie Yang , Feipeng Ma , Zitian Wang , Dacheng Yin , Kang Rong , Fengyun Rao , Ruimao Zhang

DeepSeek-R1 is a cutting-edge open-source large language model (LLM) developed by DeepSeek, showcasing advanced reasoning capabilities through a hybrid architecture that integrates mixture of experts (MoE), chain of thought (CoT) reasoning,…

Computation and Language · Computer Science 2025-06-03 Jiancheng Ye , Sophie Bronstein , Jiarui Hai , Malak Abu Hashish

We present an open deep research system for long-form question answering, selected as a winning system in the text-to-text track of the MMU-RAG competition at NeurIPS 2025. The system combines an open-source large language model (LLM) with…

Computation and Language · Computer Science 2025-12-16 Ikuya Yamada , Wataru Ikeda , Ko Yoshida , Mengyu Ye , Hinata Sugimoto , Masatoshi Suzuki , Hisanori Ozaki , Jun Suzuki

Large language models (LLMs) excel at complex reasoning, yet their efficiency is limited by the surging cognitive overhead of long thought traces. In this paper, we propose LightThinker, a method that enables LLMs to dynamically compress…

Computation and Language · Computer Science 2026-04-07 Yuqi Zhu , Jintian Zhang , Zhenjie Wan , Yujie Luo , Shuofei Qiao , Zhengke Gui , Da Zheng , Lei Liang , Huajun Chen , Ningyu Zhang

Amongst the most common use cases of modern AI is LLM chat with web search enabled. However, no direct evaluations of the quality of web research agents exist that control for the continually-changing web. We introduce Deep Research Bench,…

Artificial Intelligence · Computer Science 2025-06-10 FutureSearch , : , Nikos I. Bosse , Jon Evans , Robert G. Gambee , Daniel Hnyk , Peter Mühlbacher , Lawrence Phillips , Dan Schwarz , Jack Wildman

The rapid growth of scientific literature imposes significant challenges for researchers endeavoring to stay updated with the latest advancements in their fields and delve into new areas. We introduce OpenResearcher, an innovative platform…

Large Reasoning Models (LRMs) significantly improve the reasoning ability of Large Language Models (LLMs) by learning to reason, exhibiting promising performance in solving complex tasks. However, their deliberative reasoning process leads…

Computation and Language · Computer Science 2025-08-14 Yue Liu , Jiaying Wu , Yufei He , Ruihan Gong , Jun Xia , Liang Li , Hongcheng Gao , Hongyu Chen , Baolong Bi , Jiaheng Zhang , Zhiqi Huang , Bryan Hooi , Stan Z. Li , Keqin Li

Pre-trained large language models (LLMs) have been demonstrated to possess intrinsic reasoning capabilities that can emerge naturally when expanding the response space. However, the neural representation mechanisms underlying these…

Computation and Language · Computer Science 2025-04-10 Zijian Wang , Chang Xu

Large Language Models (LLMs) are highly proficient in language-based tasks. Their language capabilities have positioned them at the forefront of the future AGI (Artificial General Intelligence) race. However, on closer inspection, Valmeekam…

Computation and Language · Computer Science 2025-03-17 Dibyanayan Bandyopadhyay , Soham Bhattacharjee , Asif Ekbal