English
Related papers

Related papers: MAPLE: Multi-Agent Adaptive Planning with Long-Ter…

200 papers

The advent of large language models (LLMs) has sparked significant interest in using natural language for preference learning. However, existing methods often suffer from high computational burdens, taxing human supervision, and lack of…

Machine Learning · Computer Science 2024-12-23 Saaduddin Mahmud , Mason Nakamura , Shlomo Zilberstein

Training deep learning (DL) models across Graphics Processing Unit (GPU) clusters is technically challenging. One aspect is that users have to compose command lines to adapt to the heterogeneous launchers, schedulers, affinity options, DL…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-12 Molang Wu , Zhao Zhang

Large Language Models (LLMs) falter in multi-step interactions -- often hallucinating, repeating actions, or misinterpreting user corrections -- due to reliance on linear, unstructured context. This fragility stems from the lack of…

Artificial Intelligence · Computer Science 2025-05-27 Ye Ye

Effective memory management is essential for large language model (LLM) agents handling long-term interactions. Current memory frameworks typically treat agents as passive "recorders" and retrieve information without understanding its…

Computation and Language · Computer Science 2026-03-03 Xiaohui Zhang , Zequn Sun , Chengyuan Yang , Yaqin Jin , Yazhong Zhang , Wei Hu

LLM-based agents have been extensively applied across various domains, where memory stands out as one of their most essential capabilities. Previous memory mechanisms of LLM-based agents are manually predefined by human experts, leading to…

Machine Learning · Computer Science 2025-08-26 Zeyu Zhang , Quanyu Dai , Rui Li , Xiaohe Bo , Xu Chen , Zhenhua Dong

The widespread adoption of Large Language Models (LLMs) and LLM-powered agents in multi-user settings underscores the need for reliable, usable methods to accommodate diverse preferences and resolve conflicting directives. Drawing on…

Human-Computer Interaction · Computer Science 2025-03-20 Christine Lee , Jihye Choi , Bilge Mutlu

Recent Long-Context Language Models (LCLMs) can process hundreds of thousands of tokens in a single prompt, enabling new opportunities for knowledge-intensive multi-hop reasoning by integrating large sets of retrieved documents or, in some…

Computation and Language · Computer Science 2026-04-29 Soyeong Jeong , Taehee Jung , Sung Ju Hwang , Joo-Kyung Kim , Dongyeop Kang

Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of language tasks, yet complex multi-step reasoning remains a fundamental challenge. While Large Reasoning Models (LRMs) equipped with extended…

Artificial Intelligence · Computer Science 2026-03-17 Guangfu Hao , Yuming Dai , Xianzhe Qin , Shan Yu

We envision a continuous collaborative learning system where groups of LLM agents work together to solve reasoning problems, drawing on memory they collectively build to improve performance as they gain experience. This work establishes the…

Artificial Intelligence · Computer Science 2025-03-11 Julie Michelman , Nasrin Baratalipour , Matthew Abueg

The Explainable Recommendation task is designed to receive a pair of user and item and output explanations to justify why an item is recommended to a user. Many models approach review generation as a proxy for explainable recommendations.…

Machine Learning · Computer Science 2025-05-27 Ching-Wen Yang , Zhi-Quan Feng , Ying-Jia Lin , Che-Wei Chen , Kun-da Wu , Hao Xu , Jui-Feng Yao , Hung-Yu Kao

Large Language Models (LLMs) based agents excel at diverse tasks, yet they suffer from brittle procedural memory that is manually engineered or entangled in static parameters. In this work, we investigate strategies to endow agents with a…

Computation and Language · Computer Science 2026-04-16 Runnan Fang , Yuan Liang , Xiaobin Wang , Jialong Wu , Shuofei Qiao , Pengjun Xie , Fei Huang , Huajun Chen , Ningyu Zhang

In-Context Learning (ICL) empowers Large Language Models (LLMs) to tackle diverse tasks by incorporating multiple input-output examples, known as demonstrations, into the input of LLMs. More recently, advancements in the expanded context…

Artificial Intelligence · Computer Science 2025-05-27 Zihan Chen , Song Wang , Zhen Tan , Jundong Li , Cong Shen

Large language models (LLMs) have shown strong capabilities across diverse decision-making tasks. However, existing approaches often overlook the specialization differences among available models, treating all LLMs as uniformly applicable…

Artificial Intelligence · Computer Science 2026-02-02 Wei Zhu , Lixing Yu , Hao-Ren Yao , Zhiwen Tang , Kun Yue

Large Language Models (LLMs) have revolutionized Natural Language Processing but exhibit limitations, particularly in autonomously addressing novel challenges such as reasoning and problem-solving. Traditional techniques like…

Multiagent Systems · Computer Science 2024-01-03 Sumedh Rasal

We introduce a novel reinforcement learning framework of LLM agents named AGILE (AGent that Interacts and Learns from Environments) designed to perform complex conversational tasks with users, leveraging LLMs, memory, tools, and…

Machine Learning · Computer Science 2024-11-06 Peiyuan Feng , Yichen He , Guanhua Huang , Yuan Lin , Hanchong Zhang , Yuchen Zhang , Hang Li

This paper investigates the multi-agent cooperative exploration problem, which requires multiple agents to explore an unseen environment via sensory signals in a limited time. A popular approach to exploration tasks is to combine active…

Robotics · Computer Science 2023-11-02 Xinyi Yang , Yuxiang Yang , Chao Yu , Jiayu Chen , Jingchen Yu , Haibing Ren , Huazhong Yang , Yu Wang

LLM-based agents increasingly rely on long-term memory to support multi-session reasoning and interaction, yet current systems provide little control over what information is retained. In practice, agents either accumulate large volumes of…

Artificial Intelligence · Computer Science 2026-03-06 Guilin Zhang , Wei Jiang , Xiejiashan Wang , Aisha Behr , Kai Zhao , Jeffrey Friedman , Xu Chu , Amine Anoun

We present a novel approach for claim verification from tabular data documents. Recent LLM-based approaches either employ complex pretraining/fine-tuning or decompose verification into subtasks, often lacking comprehensive explanations and…

Computation and Language · Computer Science 2026-04-21 Rudra Ranajee Saha , Laks V. S. Lakshmanan , Raymond T. Ng

Large language models (LLMs) typically operate in a question-answering paradigm, where the quality of the input prompt critically affects the response. Automated Prompt Optimization (APO) aims to overcome the cognitive biases of manually…

Computation and Language · Computer Science 2025-11-13 Jian Zhang , Zhangqi Wang , Haiping Zhu , Kangda Cheng , Kai He , Bo Li , Qika Lin , Jun Liu , Erik Cambria

Memory-Augmented Generation (MAG) extends Large Language Models with external memory to support long-context reasoning, but existing approaches largely rely on semantic similarity over monolithic memory stores, entangling temporal, causal,…

Artificial Intelligence · Computer Science 2026-04-17 Dongming Jiang , Yi Li , Guanpeng Li , Bingzhe Li