English
Related papers

Related papers: Forage V2: Knowledge Evolution and Transfer in Aut…

200 papers

This short paper provides a description of an architecture to acquisition and use of knowledge by intelligent agents over a restricted domain of the Internet Infrastructure. The proposed architecture is added to an intelligent agent…

Artificial Intelligence · Computer Science 2018-05-08 Juliao Braga , Nizam Omar , Luciana F. Thome

Autonomous 3D environment exploration is a fundamental task for various applications such as navigation. The goal of exploration is to investigate a new environment and build its occupancy map efficiently. In this paper, we propose a new…

Artificial Intelligence · Computer Science 2021-11-03 Liu Juncheng , McCane Brendan , Mills Steven

Federated learning encounters a critical challenge of data heterogeneity, adversely affecting the performance and convergence of the federated model. Various approaches have been proposed to address this issue, yet their effectiveness is…

Machine Learning · Computer Science 2023-12-06 Jinqian Chen , Jihua Zhu , Qinghai Zheng

A faster response with commendable accuracy in intelligent systems is essential for the reliability and smooth operations of industrial machines. Two main challenges affect the design of such intelligent systems: (i) the selection of a…

Signal Processing · Electrical Eng. & Systems 2025-03-24 Arun K. Sharma , Nishchal K. Verma

Intrinsically, driving is a Markov Decision Process which suits well the reinforcement learning paradigm. In this paper, we propose a novel agent which learns to drive a vehicle without any human assistance. We use the concept of…

Robotics · Computer Science 2019-04-30 Shashank Kotyan , Danilo Vasconcellos Vargas , Venkanna U

Transfer learning refers to the transfer of knowledge or information from a relevant source task to a target task. However, most existing works assume both tasks are sampled from a stationary task distribution, thereby leading to the…

Machine Learning · Computer Science 2022-07-06 Jun Wu , Jingrui He

Current vision-language-action (VLA) models, pre-trained on large-scale robotic data, exhibit strong multi-task capabilities and generalize well to variations in visual and language instructions for manipulation. However, their success rate…

Robotics · Computer Science 2025-10-17 Han Zhao , Jiaxuan Zhang , Wenxuan Song , Pengxiang Ding , Donglin Wang

An AI agent might surprisingly find she has reached an unknown state which she has never been aware of -- an unknown unknown. We mathematically ground this scenario in reinforcement learning: an agent, after taking an action calculated from…

Machine Learning · Computer Science 2025-09-04 Juntian Zhu , Miguel de Carvalho , Zhouwang Yang , Fengxiang He

Empirical claims about autonomous Kubernetes operations agents are largely unfalsifiable. Published work reports observational results without controlled comparisons against an agent-disabled baseline, selection bias is endemic,…

Software Engineering · Computer Science 2026-05-25 Joshua Odmark , Gideon Rubin , Deon van der Vyver

Coding agents are increasingly used as general-purpose problem solvers, but their flexibility does not by itself confer the domain expertise needed for specialized tasks. Recent work addresses this through \textit{agent skills}: reusable…

Artificial Intelligence · Computer Science 2026-03-04 Salaheddin Alzubi , Noah Provenzano , Jaydon Bingham , Weiyuan Chen , Tu Vu

This paper shows how a single mechanism allows knowledge to be constructed layer by layer directly from an agent's raw sensorimotor stream. This mechanism, the General Value Function (GVF) or "forecast," captures high-level, abstract…

Artificial Intelligence · Computer Science 2021-12-14 Mark Ring

Continual learning agents with finite capacity must balance acquiring new knowledge with retaining the old. This requires controlled forgetting of knowledge that is no longer needed, freeing up capacity to learn. Weight decay, viewed as a…

Machine Learning · Computer Science 2026-05-01 Aditya A. Ramesh , Alex Lewandowski , Jürgen Schmidhuber

Long-horizon conversational agents require persistent memory for coherent reasoning, yet uncontrolled accumulation causes temporal decay and false memory propagation. Benchmarks such as LOCOMO and LOCCO report performance degradation from…

Artificial Intelligence · Computer Science 2026-04-03 Payal Fofadiya , Sunil Tiwari

Modern retrieval-augmented generation (RAG) systems treat vector embeddings as static, context-free artifacts: an embedding has no notion of when it was created, how trustworthy its source is, or which other embeddings depend on it. This…

Information Retrieval · Computer Science 2026-04-23 Naizhong Xu

To fulfill user instructions, autonomous web agents must contend with the inherent complexity and volatile nature of real-world websites. Conventional paradigms predominantly rely on Supervised Fine-Tuning (SFT) or Offline Reinforcement…

Artificial Intelligence · Computer Science 2026-05-01 Yuyu Guo , Wenjie Yang , Siyuan Yang , Ziyang Liu , Cheng Chen , Yuan Wei , Yun Hu , Yang Huang , Guoliang Hao , Dongsheng Yuan , Jianming Wang , Xin Chen , Hang Yu , Lei Lei , Peng Di

Deep search capabilities have become an indispensable competency for frontier Large Language Model (LLM) agents, yet their development remains dominated by industrial giants. The typical industry recipe involves a highly resource-intensive…

Artificial Intelligence · Computer Science 2026-05-06 Yuwen Du , Rui Ye , Shuo Tang , Keduan Huang , Xinyu Zhu , Yuzhu Cai , Siheng Chen

The advancement of artificial intelligence toward agentic science is currently bottlenecked by the challenge of ultra-long-horizon autonomy, the ability to sustain strategic coherence and iterative correction over experimental cycles…

Artificial Intelligence · Computer Science 2026-03-26 Xinyu Zhu , Yuzhu Cai , Zexi Liu , Bingyang Zheng , Cheng Wang , Rui Ye , Yuzhi Zhang , Linfeng Zhang , Weinan E , Siheng Chen , Yanfeng Wang

Vision-language navigation (VLN) is the task of entailing an agent to carry out navigational instructions inside photo-realistic environments. One of the key challenges in VLN is how to conduct a robust navigation by mitigating the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Hanqing Wang , Wenguan Wang , Tianmin Shu , Wei Liang , Jianbing Shen

Continual learning studies how models can adapt to new tasks while retaining previously acquired knowledge. Although a broad spectrum of methods has been proposed to mitigate catastrophic forgetting, the field remains predominantly…

Machine Learning · Computer Science 2026-05-19 Katarzyna Filus , Kamil Faber , Roberto Corizzo , Christopher Kanan

Autonomous agents are able to draw on a wide variety of potential sources of task knowledge; however current approaches invariably focus on only one or two. Here we investigate the challenges and impact of exploiting diverse knowledge…

Artificial Intelligence · Computer Science 2023-05-16 James R. Kirk , Robert E. Wray , Peter Lindes , John E. Laird