English
Related papers

Related papers: Beyond Experience Retrieval: Learning to Generate …

200 papers

Existing Large Language Models (LLMs) usually remain static after deployment, which might make it hard to inject new knowledge into the model. We aim to build models containing a considerable portion of self-updatable parameters, enabling…

Computation and Language · Computer Science 2024-05-28 Yu Wang , Yifan Gao , Xiusi Chen , Haoming Jiang , Shiyang Li , Jingfeng Yang , Qingyu Yin , Zheng Li , Xian Li , Bing Yin , Jingbo Shang , Julian McAuley

Large language models (LLMs) substantially enhance developer productivity in repository-level code generation through interactive collaboration. However, as interactions progress, repository context must be continuously preserved and…

Software Engineering · Computer Science 2026-01-07 Peiding Wang , Li Zhang , Fang Liu , Chongyang Tao , Yinghao Zhu

Despite their remarkable reasoning capabilities across diverse domains, large language models (LLMs) face fundamental challenges in natively functioning as generative reasoning recommendation models (GRRMs), where the intrinsic modeling gap…

Information Retrieval · Computer Science 2025-10-24 Minjie Hong , Zetong Zhou , Zirun Guo , Ziang Zhang , Ruofan Hu , Weinan Gan , Jieming Zhu , Zhou Zhao

Context: The emergence of Large Language Models (LLMs) has significantly transformed Software Engineering (SE) by providing innovative methods for analyzing software repositories. Objectives: Our objective is to establish a practical…

Software Engineering · Computer Science 2024-12-13 Vincenzo de Martino , Joel Castaño , Fabio Palomba , Xavier Franch , Silverio Martínez-Fernández

While model serving has unlocked unprecedented capabilities, the high cost of serving large-scale models continues to be a significant barrier to widespread accessibility and rapid innovation. Compiler optimizations have long driven…

Machine Learning · Computer Science 2026-02-05 Annabelle Sujun Tang , Christopher Priebe , Rohan Mahapatra , Lianhui Qin , Hadi Esmaeilzadeh

This work elaborates on a High performance computing (HPC) architecture based on Simple Linux Utility for Resource Management (SLURM) [1] for deploying heterogeneous Large Language Models (LLMs) into a scalable inference engine. Dynamic…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-26 Anderson de Lima Luiz , Shubham Vijay Kurlekar , Munir Georges

Structured representations, exemplified by Abstract Meaning Representation (AMR), have long been pivotal in computational linguistics. However, their role remains ambiguous in the Large Language Models (LLMs) era. Initial attempts to…

Computation and Language · Computer Science 2025-02-21 Jiahuan Zhang , Tianheng Wang , Hanqing Wu , Ziyi Huang , Yulong Wu , Dongbai Chen , Linfeng Song , Yue Zhang , Guozheng Rao , Kaicheng Yu

Large Language Model (LLM) agents are increasingly improved through interaction, yet most self-evolution methods adapt either the policy or the learning environment in isolation. We identify this structural gap as \emph{Agent-Environment…

Computation and Language · Computer Science 2026-05-26 Yihao Hu , Zhihao Wen , Xiujin Liu , Pan Wang , Xin Zhang , Wei Wu

The shift toward interacting with frozen, "black-box" Large Language Models (LLMs) has transformed prompt engineering from a heuristic exercise into a critical optimization challenge. We propose a Reinforcement Learning (RL) framework for…

Artificial Intelligence · Computer Science 2026-05-15 Krishna Sayana , Ketan Todi , Ambarish Jash

Large language models (LLMs) are used not only for problem solving but also for creative ideation; however, eliciting serendipitous insights that are both novel and internally coherent remains difficult. While stochastic sampling promotes…

Computation and Language · Computer Science 2026-01-13 Makoto Sato

Large Language Models (LLMs) have demonstrated profound impact on Natural Language Processing (NLP) tasks. However, their effective deployment across diverse domains often require domain-specific adaptation strategies, as generic models may…

Artificial Intelligence · Computer Science 2025-10-15 Jingyi Wang , Hongyuan Zhu , Ye Niu , Yunhui Deng

Large language models (LLMs) are increasingly deployed as intelligent agents that reason, plan, and interact with their environments. To effectively scale to long-horizon scenarios, a key capability for such agents is a memory mechanism…

Artificial Intelligence · Computer Science 2026-01-09 Yuyang Hu , Jiongnan Liu , Jiejun Tan , Yutao Zhu , Zhicheng Dou

Sequential recommender systems have achieved significant success in modeling temporal user behavior but remain limited in capturing rich user semantics beyond interaction patterns. Large Language Models (LLMs) present opportunities to…

Molecular design involves an enormous and irregular search space, where traditional optimizers such as Bayesian optimization, genetic algorithms, and generative models struggle to leverage expert knowledge or handle complex feedback.…

Machine Learning · Computer Science 2025-12-09 Nian Ran , Yue Wang , Xiaoyuan Zhang , Zhongzheng Li , Qingsong Ran , Wenhao Li , Richard Allmendinger

Existing memory systems enable Large Language Models (LLMs) to support long-horizon human-LLM interactions by persisting historical interactions beyond limited context windows. However, while recent approaches have succeeded in constructing…

Computation and Language · Computer Science 2026-04-21 Haidong Xin , Xinze Li , Zhenghao Liu , Yukun Yan , Shuo Wang , Cheng Yang , Yu Gu , Ge Yu , Maosong Sun

We present PEAM, a Parametric Embodied Agent Memory framework in Minecraft that transforms agent memory from inference-time retrieval into parameter-resident skills internalized through experience. PEAM pairs a slow deliberative LLM for…

Artificial Intelligence · Computer Science 2026-05-28 Yuchen Guo , Junli Gong , Hongmin Cai , Yiu-ming Cheung , Weifeng Su

Large language models (LLMs) have been widely adopted for synthetic data generation, significantly reducing annotation costs. However, most existing studies treat synthesis as a set of isolated tasks and overlook a more fundamental…

Artificial Intelligence · Computer Science 2026-05-29 Zhenlin Hu , Yan Wang , Zhen Bi , Zihao Xue , Bingyu Zhu , Longtao Huang , Xiongtao Zhang , Zeyu Yang , Zhixuan Chu , Jungang Lou

The integration of Large Language Models (LLMs) into data analytics has unlocked powerful capabilities for reasoning over bulk structured and unstructured data. However, existing systems typically rely on either DataFrame primitives, which…

Databases · Computer Science 2026-03-13 Kangkang Qi , Dongyang Xie , Wenbo Li , Hao Zhang , Yuanyuan Zhu , Jeffrey Xu Yu , Kangfei Zhao

Deploying large language model (LLM)-driven conversational agents in enterprise settings requires prompts that are simultaneously correct at launch and resilient to the non-deterministic behavioral drift that characterizes production LLM…

Artificial Intelligence · Computer Science 2026-05-18 Keshava Chaitanya , Jahnavi Gundakaram

Self-evolving memory serves as the trainable parameters for Large Language Models (LLMs)-based agents, where extraction (distilling insights from experience) and management (updating the memory bank) must be tightly coordinated. Existing…

Computation and Language · Computer Science 2026-02-12 Yongshi Ye , Hui Jiang , Feihu Jiang , Tian Lan , Yichao Du , Biao Fu , Xiaodong Shi , Qianghuai Jia , Longyue Wang , Weihua Luo