English
Related papers

Related papers: ReSum: Unlocking Long-Horizon Search Intelligence …

200 papers

Large language models (LLMs) are reshaping the recommender system paradigm by enabling users to express preferences and receive recommendations through conversations. Yet, aligning LLMs to the recommendation task remains challenging:…

Information Retrieval · Computer Science 2026-02-17 Yaochen Zhu , Harald Steck , Dawen Liang , Yinhan He , Vito Ostuni , Jundong Li , Nathan Kallus

Despite large language models (LLMs) have demonstrated impressive performance in various tasks, they are still suffering from the factual inconsistency problem called hallucinations. For instance, LLMs occasionally generate content that…

Computation and Language · Computer Science 2024-08-01 Taiji Li , Zhi Li , Yin Zhang

Large language models (LLMs) have revolutionized text-based code automation, but their potential in graph-oriented engineering workflows remains under-explored. We introduce SimuAgent, an LLM-powered modeling and simulation agent tailored…

Artificial Intelligence · Computer Science 2026-01-09 Yanchang Liang , Xiaowei Zhao

Large Language Models (LLMs) showcase remarkable abilities, yet they struggle with limitations such as hallucinations, outdated knowledge, opacity, and inexplicable reasoning. To address these challenges, Retrieval-Augmented Generation…

Computation and Language · Computer Science 2024-10-03 Sourav Verma

Large Language Models (LLMs) have shown remarkable capabilities in natural language tasks requiring complex reasoning, yet their application in agentic, multi-step reasoning within interactive environments remains a difficult challenge.…

Artificial Intelligence · Computer Science 2024-08-15 Pranav Putta , Edmund Mills , Naman Garg , Sumeet Motwani , Chelsea Finn , Divyansh Garg , Rafael Rafailov

Large Language Models (LLMs) can serve as world models to enhance agent decision-making in digital environments by simulating future states and predicting action outcomes, potentially eliminating costly trial-and-error exploration. However,…

Computation and Language · Computer Science 2026-03-10 Kai Mei , Jiang Guo , Shuaichen Chang , Mingwen Dong , Dongkyu Lee , Xing Niu , Jiarong Jiang

Large language models (LLMs) face significant challenges in handling long-context tasks because of their limited effective context window size during pretraining, which restricts their ability to generalize over extended sequences.…

Computation and Language · Computer Science 2024-09-05 Zhiyuan Hu , Yuliang Liu , Jinman Zhao , Suyuchen Wang , Yan Wang , Wei Shen , Qing Gu , Anh Tuan Luu , See-Kiong Ng , Zhiwei Jiang , Bryan Hooi

LongRoPE2 is a novel approach that extends the effective context window of pre-trained large language models (LLMs) to the target length, while preserving the performance on the original shorter context window. This is achieved by three…

Computation and Language · Computer Science 2025-02-28 Ning Shang , Li Lyna Zhang , Siyuan Wang , Gaokai Zhang , Gilsinia Lopez , Fan Yang , Weizhu Chen , Mao Yang

Large Language Models (LLMs) still struggle with natural language reasoning tasks. Motivated by the society of minds (Minsky, 1988), we propose ReConcile, a multi-model multi-agent framework designed as a round table conference among…

Computation and Language · Computer Science 2024-06-25 Justin Chih-Yao Chen , Swarnadeep Saha , Mohit Bansal

Existing large language models (LLMs) can only afford fix-sized inputs due to the input length limit, preventing them from utilizing rich long-context information from past inputs. To address this, we propose a framework, Language Models…

Computation and Language · Computer Science 2023-06-13 Weizhi Wang , Li Dong , Hao Cheng , Xiaodong Liu , Xifeng Yan , Jianfeng Gao , Furu Wei

While large language models (LLMs) have advanced the development of general-purpose agents, achieving robust generalization to unseen tasks remains a significant challenge. Current approaches typically rely on either fine-tuning or…

Artificial Intelligence · Computer Science 2026-03-20 Thomas Palmeira Ferraz , Romain Deffayet , Vassilina Nikoulina , Hervé Déjean , Stéphane Clinchant

Large language models (LLMs) are transforming web search by shifting from document ranking to synthesizing answers, and are increasingly deployed as autonomous agentic search systems that iteratively interact with external knowledge…

Computation and Language · Computer Science 2026-05-19 Guangzhi Xiong , Qiao Jin , Xiao Wang , Yin Fang , Haolin Liu , Yifan Yang , Fangyuan Chen , Zhixing Song , Dengyu Wang , Minjia Zhang , Zhiyong Lu , Aidong Zhang

Current Large Language Models (LLMs) are not only limited to some maximum context length, but also are not able to robustly consume long inputs. To address these limitations, we propose ReadAgent, an LLM agent system that increases…

Computation and Language · Computer Science 2024-07-23 Kuang-Huei Lee , Xinyun Chen , Hiroki Furuta , John Canny , Ian Fischer

Large Language Model (LLM) has exhibited strong reasoning ability in text-based contexts across various domains, yet the limitation of context window poses challenges for the model on long-range inference tasks and necessitates a memory…

Information Retrieval · Computer Science 2026-03-11 Mengwei Yuan , Jianan Liu , Jing Yang , Xianyou Li , Weiran Yan , Yichao Wu , Penghao Liang

Memory-augmented LLM agents tackle complex long-horizon tasks by recursively summarizing interaction trajectories into compact memory. However, existing approaches typically train these memory policies using outcome-based reinforcement…

Artificial Intelligence · Computer Science 2026-05-29 Ziyan Liu , Zhezheng Hao , Yeqiu Chen , Hong Wang , Jingren Hou , Ruiyi Ding , Yongkang Yang , Wence Ji , Wei Xia , Feng Liu

Search agents powered by Large Language Models (LLMs) have demonstrated significant potential in tackling knowledge-intensive tasks. Reinforcement learning (RL) has emerged as a powerful paradigm for training these agents to perform…

Computation and Language · Computer Science 2026-05-11 Shiyu Li , Yang Tang , Yifan Wang , Peiming Li , Xi Chen

Large language models (LLMs) have demonstrated remarkable potential in transforming recommender systems from implicit behavioral pattern matching to explicit intent reasoning. While RecGPT-V1 successfully pioneered this paradigm by…

Large Language Model (LLM) agents have shown stunning results in complex tasks, yet they often operate in isolation, failing to learn from past experiences. Existing memory-based methods primarily store raw trajectories, which are often…

Reward models (RMs) have become essential for aligning large language models (LLMs), serving as scalable proxies for human evaluation in both training and inference. However, existing RMs struggle on knowledge-intensive and long-form tasks,…

Computation and Language · Computer Science 2025-10-30 Ziyou Hu , Zhengliang Shi , Minghang Zhu , Haitao Li , Teng Sun , Pengjie Ren , Suzan Verberne , Zhaochun Ren

LLM-based search agents often concatenate the full interaction history into the context, producing long and noisy inputs, and increasing compute cost and GPU memory overhead. To address this issue, we propose MemSearcher, an agent framework…

Computation and Language · Computer Science 2026-05-11 Qianhao Yuan , Jie Lou , Zichao Li , Jiawei Chen , Yaojie Lu , Hongyu Lin , Le Sun , Debing Zhang , Xianpei Han