中文
相关论文

相关论文: Enhancing LLM Reasoning with Reward-guided Tree Se…

200 篇论文

Large language models (LLMs) typically enhance their performance through either the retrieval of semantically similar information or the improvement of their reasoning capabilities. However, a significant challenge remains in effectively…

人工智能 · 计算机科学 2026-01-05 Shuqi Liu , Bowei He , Chen Ma , Linqi Song

Recent advancements in Large Reasoning Models (LRMs), such as OpenAI's o1/o3 and DeepSeek-R1, have demonstrated remarkable performance in specialized reasoning tasks through human-like deliberative thinking and long chain-of-thought…

人工智能 · 计算机科学 2025-11-20 Weixiang Zhao , Xingyu Sui , Jiahe Guo , Yulin Hu , Yang Deng , Yanyan Zhao , Xuda Zhi , Yongbo Huang , Hao He , Wanxiang Che , Ting Liu , Bing Qin

Large language models (LLMs) have demonstrated their remarkable capacity across a variety of tasks. However, reasoning remains a challenge for LLMs. To improve LLMs' reasoning ability, process supervision has proven to be better than…

人工智能 · 计算机科学 2025-01-06 Shuangtao Li , Shuaihao Dong , Kexin Luan , Xinhan Di , Chaofan Ding

Large language model (LLM)-based search agents have proven promising for addressing knowledge-intensive problems by incorporating information retrieval capabilities. Existing works largely focus on optimizing the reasoning paradigms of…

人工智能 · 计算机科学 2026-01-09 Tongyu Wen , Guanting Dong , Zhicheng Dou

Recent AI advancements, such as OpenAI's new models, are transforming LLMs into LRMs (Large Reasoning Models) that perform reasoning during inference, taking extra time and compute for higher-quality outputs. We aim to uncover the…

Reward models play a critical role in guiding large language models toward outputs that align with human expectations. However, an open challenge remains in effectively utilizing test-time compute to enhance reward model performance. In…

计算与语言 · 计算机科学 2025-05-21 Jiaxin Guo , Zewen Chi , Li Dong , Qingxiu Dong , Xun Wu , Shaohan Huang , Furu Wei

Large Reasoning Models (LRMs) such as DeepSeek-R1 and OpenAI o1 have demonstrated remarkable capabilities in various reasoning tasks. Their strong capability to generate and reason over intermediate thoughts has also led to arguments that…

计算与语言 · 计算机科学 2025-10-17 Saurabh Srivastava , Ziyu Yao

Legal Artificial Intelligence (LegalAI) has achieved notable advances in automating judicial decision-making with the support of Large Language Models (LLMs). However, existing legal LLMs still struggle to generate reliable and…

计算与语言 · 计算机科学 2026-02-10 Xin Dai , Buqiang Xu , Zhenghao Liu , Yukun Yan , Huiyuan Xie , Xiaoyuan Yi , Shuo Wang , Ge Yu

Large Language Models (LLMs) have revolutionized natural language processing through their state of art reasoning capabilities. This paper explores the convergence of LLM reasoning techniques and feature generation for machine learning…

计算与语言 · 计算机科学 2025-03-21 Dharani Chandra

Research on LLM technologies is rapidly emerging, with most of them employ a 'fast thinking' approach to inference. Most LLMs generate the final result based solely on a single query and LLM's reasoning capabilities. However, with the…

计算与语言 · 计算机科学 2025-11-14 Jianfeng Pan , Senyou Deng , Shaomang Huang

Existing large language models (LLMs) show exceptional problem-solving capabilities but might struggle with complex reasoning tasks. Despite the successes of chain-of-thought and tree-based search methods, they mainly depend on the internal…

计算与语言 · 计算机科学 2024-12-18 Jinhao Jiang , Jiayi Chen , Junyi Li , Ruiyang Ren , Shijie Wang , Wayne Xin Zhao , Yang Song , Tao Zhang

Large Language Models (LLMs) have emerged as powerful tools in artificial intelligence, especially in complex decision-making scenarios, but their static problem-solving strategies often limit their adaptability to dynamic environments. We…

计算与语言 · 计算机科学 2025-02-18 Chengkun Cai , Xu Zhao , Yucheng Du , Haoliang Liu , Lei Li

Table reasoning, which aims to generate the corresponding answer to the question following the user requirement according to the provided table, and optionally a text description of the table, effectively improving the efficiency of…

计算与语言 · 计算机科学 2024-02-14 Xuanliang Zhang , Dingzirui Wang , Longxu Dou , Qingfu Zhu , Wanxiang Che

Recent years have seen considerable advancements in multi-step reasoning with Large Language Models (LLMs). The previous studies have elucidated the merits of integrating feedback or search mechanisms during model inference to improve the…

计算与语言 · 计算机科学 2023-10-17 Qianli Ma , Haotian Zhou , Tingkai Liu , Jianbo Yuan , Pengfei Liu , Yang You , Hongxia Yang

The ubiquity and value of tables as semi-structured data across various domains necessitate advanced methods for understanding their complexity and vast amounts of information. Despite the impressive capabilities of large language models…

计算与语言 · 计算机科学 2024-11-14 Deyi Ji , Lanyun Zhu , Siqi Gao , Peng Xu , Hongtao Lu , Jieping Ye , Feng Zhao

Recent advancements in Large Vision Language Models (LVLMs) have significantly improved performance in Visual Question Answering (VQA) tasks through multimodal Retrieval-Augmented Generation (RAG). However, existing methods still face…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Qi Yang , Chenghao Zhang , Lubin Fan , Kun Ding , Jieping Ye , Shiming Xiang

Currently, many large language models (LLMs) are utilized for software engineering tasks such as code generation. The emergence of more advanced models known as large reasoning models (LRMs), such as OpenAI's o3, DeepSeek R1, and Qwen3.…

软件工程 · 计算机科学 2025-09-18 Kevin Halim , Sin G. Teo , Ruitao Feng , Zhenpeng Chen , Yang Gu , Chong Wang , Yang Liu

Recently, the number of off-the-shelf Large Language Models (LLMs) has exploded with many open-source options. This creates a diverse landscape regarding both serving options (e.g., inference on local hardware vs remote LLM APIs) and model…

机器学习 · 计算机科学 2024-12-18 Dimitrios Sikeridis , Dennis Ramdass , Pranay Pareek

Recent studies increasingly explore Large Language Models (LLMs) as a new paradigm for recommendation systems due to their scalability and world knowledge. However, existing work has three key limitations: (1) most efforts focus on…

Reward modeling is essential for aligning large language models with human preferences through reinforcement learning. To provide accurate reward signals, a reward model (RM) should stimulate deep thinking and conduct interpretable…

计算与语言 · 计算机科学 2026-03-09 Xiusi Chen , Gaotang Li , Ziqi Wang , Bowen Jin , Cheng Qian , Yu Wang , Hongru Wang , Yu Zhang , Denghui Zhang , Tong Zhang , Hanghang Tong , Heng Ji