English
Related papers

Related papers: AI Agents Need Memory Control Over More Context

200 papers

Memory replay may be key to learning in biological brains, which manage to learn new tasks continually without catastrophically interfering with previous knowledge. On the other hand, artificial neural networks suffer from catastrophic…

Machine Learning · Computer Science 2022-01-06 Haitz Sáez de Ocáriz Borde

Asynchronous Advantage Actor Critic (A3C) is an effective Reinforcement Learning (RL) algorithm for a wide range of tasks, such as Atari games and robot control. The agent learns policies and value function through trial-and-error…

Machine Learning · Computer Science 2019-12-03 Zhaoyuan Gu , Zhenzhong Jia , Howie Choset

The path to higher network autonomy in 6G lies beyond the mere optimization of key performance indicators (KPIs), requiring systems that perceive and reason over the network environment as it is. This can be achieved through agentic AI,…

Networking and Internet Architecture · Computer Science 2026-05-15 Hatim Chergui , Farhad Rezazadeh , Merouane Debbah , Christos Verikoukis

Reinforcement learning agents often forget details of the past, especially after delays or distractor tasks. Agents with common memory architectures struggle to recall and integrate across multiple timesteps of a past event, or even to…

Machine Learning · Computer Science 2021-12-09 Andrew Kyle Lampinen , Stephanie C. Y. Chan , Andrea Banino , Felix Hill

Continual learning (CL) empowers AI systems to progressively acquire knowledge from non-stationary data streams. However, catastrophic forgetting remains a critical challenge. In this work, we identify attention drift in Vision Transformers…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Yue Lu , Xiangyu Zhou , Shizhou Zhang , Yinghui Xing , Guoqiang Liang , Wencong Zhang

The increasingly complicated and diverse applications have distinct network performance demands, e.g., some desire high throughput while others require low latency. Traditional congestion controls (CC) have no perception of these demands.…

Networking and Internet Architecture · Computer Science 2021-07-20 Lei Zhang , Yong Cui , Mowei Wang , Kewei Zhu , Yibo Zhu , Yong Jiang

In artificial intelligence, multi agent systems constitute an interesting typology of society modeling, and have in this regard vast fields of application, which extend to the human sciences. Logic is often used to model such kind of…

Artificial Intelligence · Computer Science 2019-09-23 Valentina Pitoni

Large Language Models (LLMs) have shown remarkable performance in multi-turn dialogue. However, in multi-turn dialogue, models still struggle to stay aligned with what has been established earlier, follow dependencies across many turns, and…

Computation and Language · Computer Science 2026-01-12 Jiawei Shen , Jia Zhu , Hanghui Guo , Weijie Shi , Yue Cui , Qingyu Niu , Guoqing Ma , Yidan Liang , Jingjiang Liu , Yiling Wang , Shimin Di , Jiajie Xu

Imagine a world where AI can handle your work while you sleep - organizing your research materials, drafting a report, or creating a presentation you need for tomorrow. However, while current digital agents can perform simple tasks, they…

Artificial Intelligence · Computer Science 2024-12-24 Yanheng He , Jiahe Jin , Shijie Xia , Jiadi Su , Runze Fan , Haoyang Zou , Xiangkun Hu , Pengfei Liu

Continual learning needs to overcome catastrophic forgetting of the past. Memory replay of representative old training samples has been shown as an effective solution, and achieves the state-of-the-art (SOTA) performance. However, existing…

Machine Learning · Computer Science 2022-03-10 Liyuan Wang , Xingxing Zhang , Kuo Yang , Longhui Yu , Chongxuan Li , Lanqing Hong , Shifeng Zhang , Zhenguo Li , Yi Zhong , Jun Zhu

AI systems that learn through reward feedback about the actions they take are increasingly deployed in domains that have significant impact on our daily life. However, in many cases the online rewards should not be the only guiding…

Artificial Intelligence · Computer Science 2018-09-18 Avinash Balakrishnan , Djallel Bouneffouf , Nicholas Mattei , Francesca Rossi

Reinforcement learning in multi-agent scenarios is important for real-world applications but presents challenges beyond those seen in single-agent settings. We present an actor-critic algorithm that trains decentralized policies in…

Machine Learning · Computer Science 2019-05-29 Shariq Iqbal , Fei Sha

Continual lifelong learning is an machine learning framework inspired by human learning, where learners are trained to continuously acquire new knowledge in a sequential manner. However, the non-stationary nature of streaming training data…

Machine Learning · Computer Science 2024-05-14 Xingyu Li , Bo Tang , Haifeng Li

As generative artificial intelligence evolves, autonomous agent networks present a powerful paradigm for interactive covert communication. However, because agents dynamically update internal memories via environmental interactions, existing…

Artificial Intelligence · Computer Science 2026-04-10 Wansheng Wu , Kaibo Huang , Yukun Wei , Zhongliang Yang , Linna Zhou

Recent techniques such as retrieval-augmented generation or chain-of-thought reasoning have led to longer contexts and increased inference costs. Context compression techniques can reduce these costs, but the most effective approaches…

Computation and Language · Computer Science 2025-10-24 Hippolyte Pilchen , Edouard Grave , Patrick Pérez

Complex tasks are increasingly delegated to ensembles of specialized LLM-based agents that reason, communicate, and coordinate actions-both among themselves and through interactions with external tools, APIs, and databases. While persistent…

Multiagent Systems · Computer Science 2025-05-27 Alireza Rezazadeh , Zichao Li , Ange Lou , Yuying Zhao , Wei Wei , Yujia Bao

Mobile GUI agents excel at immediate reactive control but frequently fail in realistic, long-horizon tasks that require memory. This failure stems from a fundamental conflict between limited context windows and token-heavy screenshots. To…

Computation and Language · Computer Science 2026-05-29 Junyang Wang , Haiyang Xu , Xi Zhang , Zhaoqing Zhu , Ming Yan , Jieping Ye , Jitao Sang

High-precision control tasks present substantial challenges for reinforcement learning (RL) algorithms, frequently resulting in suboptimal performance attributed to network approximation inaccuracies and inadequate sample quality.These…

Machine Learning · Computer Science 2025-02-05 Donghe Chen , Yubin Peng , Tengjie Zheng , Han Wang , Chaoran Qu , Lin Cheng

Long-context inputs in large language models (LLMs) often suffer from the "lost in the middle" problem, where critical information becomes diluted or ignored due to excessive length. Context compression methods aim to address this by…

Computation and Language · Computer Science 2026-02-04 Xuancheng Li , Haitao Li , Yujia Zhou , Qingyao Ai , Yiqun Liu

Data agents, empowered by Large Language Models (LLMs), introduce a new paradigm in transaction processing. Unlike traditional applications with fixed patterns, data agents run online-generated workflows that repeatedly issue SQL…

Databases · Computer Science 2026-03-17 Weixing Zhou , Zhiyou Wang , Zeshun Peng , Hetian Chen , Yanfeng Zhang , Ge Yu
‹ Prev 1 3 4 5 6 7 10 Next ›