English
Related papers

Related papers: Continual Harness: Online Adaptation for Self-Impr…

200 papers

Human expertise emerges through iterative cycles of interaction, reflection, and internal model updating, which are central to cognitive theories such as Kolb's experiential learning and Vygotsky's zone of proximal development. In contrast,…

Perception of artificial agents is one the grand challenges of AI research. Deep Learning and data-driven approaches are successful on constrained problems where perception can be learned using supervision, but do not scale to open-worlds.…

Artificial Intelligence · Computer Science 2021-02-01 Hugo Caselles-Dupré , Michael Garcia-Ortiz , David Filliat

We present PEAM, a Parametric Embodied Agent Memory framework in Minecraft that transforms agent memory from inference-time retrieval into parameter-resident skills internalized through experience. PEAM pairs a slow deliberative LLM for…

Artificial Intelligence · Computer Science 2026-05-28 Yuchen Guo , Junli Gong , Hongmin Cai , Yiu-ming Cheung , Weifeng Su

Recent advancements in Large Language Models (LLMs) have enhanced the reasoning capabilities of embodied agents, driving progress toward AGI-powered robotics. While LLMs have been applied to tasks like semantic reasoning and task…

Human-Computer Interaction · Computer Science 2024-12-31 Jia Liu , Min Chen

Procedural memory enables large language model (LLM) agents to internalize "how-to" knowledge, theoretically reducing redundant trial-and-error. However, existing frameworks predominantly suffer from a "passive accumulation" paradigm,…

Artificial Intelligence · Computer Science 2026-04-16 Zouying Cao , Jiaji Deng , Li Yu , Weikang Zhou , Zhaoyang Liu , Bolin Ding , Hai Zhao

Modern language model-based AI systems are remarkably powerful, yet their capabilities remain fundamentally capped by their human creators in three key ways. First, although a model's weights can be updated via fine-tuning, acquiring new…

Artificial Intelligence · Computer Science 2026-03-20 Zitong Yang

The ability to navigate and interact with complex environments is central to real-world embodied agents, yet navigation in unseen environments remains challenging due to "experiential amnesia," where existing trajectory-driven or reactive…

Adaptive chatbots that mimic a user's linguistic style can build rapport and engagement, yet unconstrained mimicry risks an agent that feels unstable or sycophantic. We present a computational evaluation framework that makes the core design…

Human-Computer Interaction · Computer Science 2025-10-02 T. James Brandt

Translating complex reinforcement learning (RL) environments into high-performance implementations has traditionally required months of specialized engineering. We present a closed-loop methodology that produces equivalent high-performance…

Machine Learning · Computer Science 2026-05-19 Seth Karten , Rahul Dev Appapogu , Chi Jin

Human intelligence's adaptability is remarkable, allowing us to adjust to new tasks and multi-modal environments swiftly. This skill is evident from a young age as we acquire new abilities and solve problems by imitating others or following…

Artificial Intelligence · Computer Science 2023-05-19 Shrestha Mohanty , Negar Arabzadeh , Julia Kiseleva , Artem Zholus , Milagro Teruel , Ahmed Awadallah , Yuxuan Sun , Kavya Srinet , Arthur Szlam

Current tool-using AI agents suffer from limited action space, context inefficiency, and probabilistic instability that makes them unsuitable for handling repetitive tasks which are otherwise reliably and efficiently tackled by agentic…

Software Engineering · Computer Science 2025-12-19 Nishant Gaurav , Adit Akarsh , Tejas Ravishankar , Manoj Bajaj

Despite rapid progress in large-scale language and vision models, AI agents still suffer from a fundamental limitation: they cannot remember. Without reliable memory, agents catastrophically forget past experiences, struggle with…

The rapid development of large language and multimodal models has sparked significant interest in using proprietary models, such as GPT-4o, to develop autonomous agents capable of handling real-world scenarios like web navigation. Although…

Computation and Language · Computer Science 2024-10-28 Hongliang He , Wenlin Yao , Kaixin Ma , Wenhao Yu , Hongming Zhang , Tianqing Fang , Zhenzhong Lan , Dong Yu

Large Language Model (LLM) agents are increasingly improved through interaction, yet most self-evolution methods adapt either the policy or the learning environment in isolation. We identify this structural gap as \emph{Agent-Environment…

Computation and Language · Computer Science 2026-05-26 Yihao Hu , Zhihao Wen , Xiujin Liu , Pan Wang , Xin Zhang , Wei Wu

Recent embodied agents are primarily built based on reinforcement learning (RL) or large language models (LLMs). Among them, RL agents are efficient for deployment but only perform very few tasks. By contrast, giant LLM agents (often more…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Zhuoling Li , Xiaogang Xu , Zhenhua Xu , SerNam Lim , Hengshuang Zhao

Grasping by a robot in unstructured environments is deemed a critical challenge because of the requirement for effective adaptation to a wide variation in object geometries, material properties, and other environmental factors. In this…

Robotics · Computer Science 2024-11-20 Leonidas Askianakis

Small language models are attractive for production deployment due to their low cost, fast inference, and ease of specialization. However, adapting them to a specific task remains a challenging engineering loop, driven not by training…

Artificial Intelligence · Computer Science 2026-04-14 Dhruv Atreja , Julia White , Nikhil Nayak , Kelton Zhang , Henrijs Princis , George Hurn-Maloney , Ash Lewis , Urchade Zaratiana

Proficient game agents with diverse play styles enrich the gaming experience and enhance the replay value of games. However, recent advancements in game AI based on reinforcement learning have predominantly focused on improving proficiency,…

Artificial Intelligence · Computer Science 2025-09-23 Lingfeng Li , Yunlong Lu , Yongyi Wang , Wenxin Li

Robot learning approaches such as behavior cloning and reinforcement learning have shown great promise in synthesizing robot skills from human demonstrations in specific environments. However, these approaches often require task-specific…

Robotics · Computer Science 2025-04-09 Arthur Bucker , Pablo Ortega-Kral , Jonathan Francis , Jean Oh

The rise of AI-native Low-Code/No-Code (LCNC) platforms enables autonomous agents capable of executing complex, long-duration business processes. However, a fundamental challenge remains: memory management. As agents operate over extended…

Artificial Intelligence · Computer Science 2025-10-01 Jiexi Xu