English
Related papers

Related papers: Improving Coherence and Persistence in Agentic AI …

200 papers

As LLMs are increasingly deployed as agents, agentic reasoning - the ability to combine tool use, especially search, and reasoning - becomes a critical skill. However, it is hard to disentangle agentic reasoning when evaluated in complex…

Artificial Intelligence · Computer Science 2025-10-03 Hanlin Zhu , Tianyu Guo , Song Mei , Stuart Russell , Nikhil Ghosh , Alberto Bietti , Jiantao Jiao

The rapid evolution of neural architectures - from multilayer perceptrons to large-scale Transformer-based models - has enabled language models (LLMs) to exhibit emergent agentic behaviours when equipped with memory, planning, and external…

Artificial Intelligence · Computer Science 2025-09-22 Andrejs Sorstkins , Josh Bailey , Dr Alistair Baron

Research interest in autonomous agents is on the rise as an emerging topic. The notable achievements of Large Language Models (LLMs) have demonstrated the considerable potential to attain human-like intelligence in autonomous agents.…

Multiagent Systems · Computer Science 2025-01-30 Hung Du , Srikanth Thudumu , Rajesh Vasa , Kon Mouzakis

Large Language Model (LLM) agents exhibit remarkable conversational and reasoning capabilities but remain constrained by limited context windows and the lack of persistent memory. Recent efforts address these limitations via external memory…

Information Retrieval · Computer Science 2026-01-07 Zhengjun Huang , Zhoujin Tian , Qintian Guo , Fangyuan Zhang , Yingli Zhou , Di Jiang , Zeying Xie , Xiaofang Zhou

While large language model (LLM) agents can effectively use external tools for complex real-world tasks, they require memory systems to leverage historical experiences. Current memory systems enable basic storage and retrieval but lack…

Computation and Language · Computer Science 2025-10-09 Wujiang Xu , Zujie Liang , Kai Mei , Hang Gao , Juntao Tan , Yongfeng Zhang

Memory is critical for enabling large language model (LLM) based agents to maintain coherent behavior over long-horizon interactions. However, existing agent memory systems suffer from two key gaps: they rely on a one-size-fits-all memory…

Artificial Intelligence · Computer Science 2026-02-17 Mingfei Lu , Mengjia Wu , Feng Liu , Jiawei Xu , Weikai Li , Haoyang Wang , Zhengdong Hu , Ying Ding , Yizhou Sun , Jie Lu , Yi Zhang

The rapid proliferation of large language model (LLM)-based agentic systems raises critical concerns regarding digital sovereignty, environmental sustainability, regulatory compliance, and ethical alignment. Whilst existing frameworks…

Large Language Models~(LLMs) have demonstrated capabilities across various applications but face challenges such as hallucination, limited reasoning abilities, and factual inconsistencies, especially when tackling complex, domain-specific…

Large Language Models (LLMs) struggle with long-horizon tasks due to the "context bottleneck" and the "lost-in-the-middle" phenomenon, where accumulated noise from verbose environments degrades reasoning over multi-turn interactions. To…

Artificial Intelligence · Computer Science 2026-04-14 Xiaozhe Li , Tianyi Lyu , Yizhao Yang , Liang Shan , Siyi Yang , Ligao Zhang , Zhuoyi Huang , Qingwen Liu , Yang Li

Error attribution in Large Language Model (LLM) multi-agent systems presents a significant challenge in debugging and improving collaborative AI systems. Current approaches to pinpointing agent and step level failures in interaction traces…

Artificial Intelligence · Computer Science 2025-10-20 Adi Banerjee , Anirudh Nair , Tarik Borogovac

In the age of large language models (LLMs), autonomous agents have emerged as a powerful paradigm for achieving general intelligence. These agents dynamically leverage tools, memory, and reasoning capabilities to accomplish user-defined…

Artificial Intelligence · Computer Science 2025-08-05 Chaojia Yu , Zihan Cheng , Hanwen Cui , Yishuo Gao , Zexu Luo , Yijin Wang , Hangbin Zheng , Yong Zhao

Large language models (LLMs) have revolutionized the field of artificial intelligence, endowing it with sophisticated language understanding and generation capabilities. However, when faced with more complex and interconnected tasks that…

Artificial Intelligence · Computer Science 2023-10-06 Thorsten Händler

While large language model (LLM) agents have demonstrated impressive problem-solving capabilities, they typically operate as static systems, lacking the ability to evolve through lifelong interaction. Existing attempts to bridge this gap…

Machine Learning · Computer Science 2026-02-03 Hongzhuo Yu , Fei Zhu , Guo-Sen Xie , Ling Shao

Since the advent of Large Language Models a few years ago, they have often been considered the de facto solution for many AI problems. However, in addition to the many deficiencies of LLMs that prevent them from broad industry adoption,…

Artificial Intelligence · Computer Science 2024-02-14 Jennifer Chu-Carroll , Andrew Beck , Greg Burnham , David OS Melville , David Nachman , A. Erdem Özcan , David Ferrucci

Recent work explores agentic inference-time techniques to perform structured, multi-step reasoning. However, stateless inference often struggles on multi-step tasks due to the absence of persistent state. Moreover, task-specific fine-tuning…

Machine Learning · Computer Science 2025-10-09 Arshika Lalan , Rajat Ghosh , Aditya Kolsur , Debojyoti Dutta

The transition from static Large Language Models (LLMs) to self-improving agents is hindered by the lack of structured reasoning in traditional evolutionary approaches. Existing methods often struggle with premature convergence and…

Artificial Intelligence · Computer Science 2026-01-01 Chunhui Wan , Xunan Dai , Zhuo Wang , Minglei Li , Yanpeng Wang , Yinan Mao , Yu Lan , Zhiwen Xiao

The rapid evolution of Multi-modal Large Language Models (MLLMs) has advanced workflow automation; however, existing research mainly targets performance upper bounds in static environments, overlooking robustness for stochastic real-world…

Artificial Intelligence · Computer Science 2026-01-14 Daocheng Fu , Jianbiao Mei , Rong Wu , Xuemeng Yang , Jia Xu , Ding Wang , Pinlong Cai , Yong Liu , Licheng Wen , Botian Shi

Large Language Models (LLMs) have become foundational to modern AI agent systems, enabling autonomous agents to reason and plan. In most existing systems, inter-agent communication relies primarily on natural language. While this design…

Artificial Intelligence · Computer Science 2025-06-04 Pengcheng Zhou , Yinglun Feng , Halimulati Julaiti , Zhongliang Yang

Large Language Models (LLMs) have demonstrated impressive performance across diverse domains, yet they still encounter challenges such as insufficient domain-specific knowledge, biases, and hallucinations. This underscores the need for…

Computation and Language · Computer Science 2025-04-07 Hongliu Cao , Ilias Driouich , Robin Singh , Eoin Thomas

The potential of Large Language Model (LLM) as agents has been widely acknowledged recently. Thus, there is an urgent need to quantitatively \textit{evaluate LLMs as agents} on challenging tasks in interactive environments. We present…