中文
相关论文

相关论文: Recursive Language Models Meet Uncertainty: The Su…

200 篇论文

Large language models (LLMs) now solve multi-step problems by emitting extended chains of thought. During the process, they often re-derive the same intermediate steps across problems, inflating token usage and latency. This saturation of…

机器学习 · 计算机科学 2025-09-17 Aniket Didolkar , Nicolas Ballas , Sanjeev Arora , Anirudh Goyal

The development of reasoning capabilities represents a critical frontier in large language models (LLMs) research, where reinforcement learning (RL) and process reward models (PRMs) have emerged as predominant methodological frameworks.…

人工智能 · 计算机科学 2025-12-09 Zhangying Feng , Qianglong Chen , Ning Lu , Yongqian Li , Siqi Cheng , Shuangmu Peng , Duyu Tang , Shengcai Liu , Zhirui Zhang

Long-context language models (LCLMs) have the potential to revolutionize our approach to tasks traditionally reliant on external tools like retrieval systems or databases. Leveraging LCLMs' ability to natively ingest and process entire…

We investigate the potential of large language models (LLMs) to serve as efficient simulators for agentic search tasks in reinforcement learning (RL), thereby reducing dependence on costly interactions with external search engines. To this…

Large Language Models (LLMs) have shown strong capabilities in document re-ranking, a key component in modern Information Retrieval (IR) systems. However, existing LLM-based approaches face notable limitations, including ranking…

信息检索 · 计算机科学 2025-10-03 Pinhuan Wang , Zhiqiu Xia , Chunhua Liao , Feiyi Wang , Hang Liu

The rise of Large Language Models (LLMs) has sparked interest in their application to sequential recommendation tasks as they can provide supportive item information. However, due to the inherent complexities of sequential recommendation,…

信息检索 · 计算机科学 2023-12-19 Yu Wang , Zhiwei Liu , Jianguo Zhang , Weiran Yao , Shelby Heinecke , Philip S. Yu

Retrieval-Augmented Language Models (RALMs) face significant challenges in reducing factual errors, particularly in document relevance evaluation and knowledge integration. We introduce a framework for structured relevance assessment that…

人工智能 · 计算机科学 2025-07-30 Aryan Raj , Astitva Veer Garg , Anitha D

This study investigates the reasoning robustness of large language models (LLMs) on mathematical problem-solving tasks under systematically introduced input perturbations. Using the GSM8K dataset as a controlled testbed, we evaluate how…

人工智能 · 计算机科学 2025-04-04 Giannis Chatziveroglou , Richard Yun , Maura Kelleher

Self-reflection -- the ability of a large language model (LLM) to revisit, evaluate, and revise its own reasoning -- has recently emerged as a powerful behavior enabled by reinforcement learning with verifiable rewards (RLVR). While…

机器学习 · 计算机科学 2025-06-17 Xudong Zhu , Jiachen Jiang , Mohammad Mahdi Khalili , Zhihui Zhu

Progress in long-context reasoning for large language models (LLMs) has lagged behind other recent advances. This gap arises not only from the intrinsic difficulty of processing long texts, but also from the scarcity of reliable human…

计算与语言 · 计算机科学 2026-03-16 Ziyi Yang , Weizhou Shen , Chenliang Li , Ruijun Chen , Fanqi Wan , Ming Yan , Xiaojun Quan , Fei Huang

Large reasoning models (LRMs) have recently demonstrated impressive capabilities in complex reasoning tasks by leveraging increased test-time computation and exhibiting behaviors reminiscent of human-like self-reflection. While LRMs show a…

计算与语言 · 计算机科学 2025-10-21 Qingcheng Zeng , Weihao Xuan , Leyang Cui , Rob Voigt

While large language models (LLMs) are proficient at question-answering (QA), it is not always clear how (or even if) an answer follows from their latent "beliefs". This lack of interpretability is a growing impediment to widespread use of…

计算与语言 · 计算机科学 2023-10-31 Nora Kassner , Oyvind Tafjord , Ashish Sabharwal , Kyle Richardson , Hinrich Schuetze , Peter Clark

Reinforcement learning (RL) has increasingly become a pivotal technique in the post-training of large language models (LLMs). The effective exploration of the output space is essential for the success of RL. We observe that for complex…

机器学习 · 计算机科学 2025-07-08 Shihan Dou , Muling Wu , Jingwen Xu , Rui Zheng , Tao Gui , Qi Zhang , Xuanjing Huang

Multiple recent studies have documented large language models' (LLMs) performance on calling external tools/functions. Others focused on LLMs' abilities to handle longer context lengths. At the intersection of these areas lies another…

Symbolic regression (SR), the task of discovering mathematical expressions that best describe a given dataset, remains a fundamental challenge in scientific discovery. Traditional approaches, primarily based on genetic algorithms and…

人工智能 · 计算机科学 2026-05-06 Hao Liu , Xiao-Wen Yang , Atharva Sehgal , Yixin Wang , Lan-Zhe Guo , Yu-Feng Li , Yisong Yue

Sequential Recommendation (SR) task involves predicting the next item a user is likely to interact with, given their past interactions. The SR models examine the sequence of a user's actions to discern more complex behavioral patterns and…

信息检索 · 计算机科学 2025-04-22 Wujiang Xu , Qitian Wu , Zujie Liang , Jiaojiao Han , Xuying Ning , Yunxiao Shi , Wenfang Lin , Yongfeng Zhang

Large Language Models (LLMs) exhibit remarkable proficiency in addressing a diverse array of tasks within the Natural Language Processing (NLP) domain, with various prompt design strategies significantly augmenting their capabilities.…

计算与语言 · 计算机科学 2024-08-05 Xiangyu Zhao , Chengqian Ma

Neural language models (LMs) based on recurrent neural networks (RNN) are some of the most successful word and character-level LMs. Why do they work so well, in particular better than linear neural LMs? Possible explanations are that RNNs…

机器学习 · 统计学 2013-06-21 Marius Pachitariu , Maneesh Sahani

Large Language Models (LLMs) have emerged as a promising paradigm for next-generation recommender systems, offering strong semantic understanding and natural-language reasoning abilities. Despite recent progress, current LLM-based…

信息检索 · 计算机科学 2026-05-11 Shijun Li , Wooseong Yang , Yu Wang , Tianxin Wei , Joydeep Ghosh

Large language models (LLMs) exhibit strong semantic understanding, yet struggle when user instructions involve ambiguous or conceptually misaligned terms. We propose the Language Graph Model (LGM) to enhance conceptual clarity by…

计算与语言 · 计算机科学 2025-11-06 Wenchang Lei , Ping Zou , Yue Wang , Feng Sun , Lei Zhao