English
Related papers

Related papers: Continual Harness: Online Adaptation for Self-Impr…

200 papers

Scientific experimentation and manufacturing rely on prolonged protocol development and complex, multi-step implementation, which require continuous human expertise for precise execution and decision-making, limiting interpretability and…

Artificial Intelligence · Computer Science 2026-02-09 Xinyi Lin , Yuyang Zhang , Yuanhang Gan , Juntao Chen , Hao Shen , Yichun He , Lijun Li , Ze Yuan , Shuang Wang , Chaohao Wang , Rui Zhang , Na Li , Jia Liu

Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn…

Artificial Intelligence · Computer Science 2023-10-11 Noah Shinn , Federico Cassano , Edward Berman , Ashwin Gopinath , Karthik Narasimhan , Shunyu Yao

In this work we create agents that can perform well beyond a single, individual task, that exhibit much wider generalisation of behaviour to a massive, rich space of challenges. We define a universe of tasks within an environment domain and…

Developing general-purpose embodied agents is a core challenge in AI. Minecraft provides rich complexity and internet-scale data, but its slow speed and engineering overhead make it unsuitable for rapid prototyping. Crafter offers a…

Artificial Intelligence · Computer Science 2025-08-20 Junyeong Park , Hyeonseo Cho , Sungjin Ahn

Automated program repair has traditionally focused on single-hunk defects, overlooking multi-hunk bugs that are prevalent in real-world systems. Repairing these bugs requires coordinated edits across multiple, disjoint code regions, posing…

Software Engineering · Computer Science 2025-11-17 Noor Nashid , Daniel Ding , Keheliya Gallaba , Ahmed E. Hassan , Ali Mesbah

Autonomous agents powered by large language models (LLMs) show significant potential for achieving high autonomy in various scenarios such as software development. Recent research has shown that LLM agents can leverage past experiences to…

Computation and Language · Computer Science 2024-05-08 Chen Qian , Jiahao Li , Yufan Dang , Wei Liu , YiFei Wang , Zihao Xie , Weize Chen , Cheng Yang , Yingli Zhang , Zhiyuan Liu , Maosong Sun

Large language model-based AI agents are now able to autonomously execute substantial portions of a high energy physics (HEP) analysis pipeline with minimal expert-curated input. Given access to a HEP dataset, an execution framework, and a…

High Energy Physics - Experiment · Physics 2026-04-02 Eric A. Moreno , Samuel Bright-Thonney , Andrzej Novak , Dolores Garcia , Philip Harris

Pok\'emon Red, a classic Game Boy JRPG, presents significant challenges as a testbed for agents, including multi-tasking, long horizons of tens of thousands of steps, hard exploration, and a vast array of potential policies. We introduce a…

Machine Learning · Computer Science 2025-03-12 Marco Pleines , Daniel Addis , David Rubinstein , Frank Zimmer , Mike Preuss , Peter Whidden

Recently, large language models (LLMs) have achieved significant progress in automated code generation. Despite their strong instruction-following capabilities, these models frequently struggled to align with user intent in coding…

Machine Learning · Computer Science 2025-06-23 Zeyuan Li , Yangfan He , Lewei He , Jianhui Wang , Tianyu Shi , Bin Lei , Yuchen Li , Qiuwu Chen

Mobile GUI agents powered by large foundation models enable autonomous task execution, but frequent updates altering UI appearance and reorganizing workflows cause agents trained on historical data to fail. Despite surface changes,…

Artificial Intelligence · Computer Science 2026-02-03 Libo Sun , Jiwen Zhang , Siyuan Wang , Zhongyu Wei

Reinforcement Learning (RL) in games has gained significant momentum in recent years, enabling the creation of different agent behaviors that can transform a player's gaming experience. However, deploying RL agents in production…

Artificial Intelligence · Computer Science 2025-07-01 António Afonso , Iolanda Leite , Alessandro Sestini , Florian Fuchs , Konrad Tollmar , Linus Gisslén

Failure is inevitable for embodied navigation in complex environments. To enhance the resilience, replanning (RP) is a viable option, where the robot is allowed to fail, but is capable of adjusting plan until success. However, existing RP…

Robotics · Computer Science 2026-03-04 Guoliang Li , Ruihua Han , Chengyang Li , He Li , Shuai Wang , Wenchao Ding , Hong Zhang , Chengzhong Xu

Recent studies operationalize self-improvement through coding agents that edit their own codebases. They grow a tree of self-modifications through expansion strategies that favor higher software engineering benchmark performance, assuming…

Artificial Intelligence · Computer Science 2025-10-30 Wenyi Wang , Piotr Piękos , Li Nanbo , Firas Laakom , Yimeng Chen , Mateusz Ostaszewski , Mingchen Zhuge , Jürgen Schmidhuber

Harness engineering has emerged as an important inference-time technique for large language model (LLM) agents, aiming to improve long-term performance through task decomposition and guided execution. However, more elaborate harnesses are…

Machine Learning · Computer Science 2026-05-22 Boyuan Wang , Bochao Li , Minghan Wang , Yuxin Tao , Fang Kong

AI coding assistants have proliferated rapidly, yet structured pedagogical frameworks for learning these tools remain scarce. Developers face a gap between tool documentation and practical mastery, relying on fragmented resources such as…

Computers and Society · Computer Science 2026-05-01 Zain Naboulsi

Task planning for autonomous agents has typically been done using deep learning models and simulation-based reinforcement learning. This research proposes combining inductive learning techniques with goal-directed answer set programming to…

Logic in Computer Science · Computer Science 2025-02-14 Alexis R. Tudor

Digital collectible card games are not only a growing part of the video game industry, but also an interesting research area for the field of computational intelligence. This game genre allows researchers to deal with hidden information,…

Neural and Evolutionary Computing · Computer Science 2024-10-28 Pablo García-Sánchez , Alberto Tonda , Antonio J. Fernández-Leiva , Carlos Cotta

This paper introduces the first \emph{self-evolving} logic synthesis framework, which leverages Large Language Model (LLM) agents to autonomously improve the source code of \textsc{ABC}, the widely adopted logic synthesis system. Our…

Hardware Architecture · Computer Science 2026-04-17 Cunxi Yu , Haoxing Ren

Embodied agents struggle to generalize to new environments, even when those environments share similar underlying structures to their training settings. Most current approaches to generating these training environments follow an open-loop…

Robotics · Computer Science 2026-02-09 Teresa Yeo , Dulaj Weerakoon , Dulanga Weerakoon , Archan Misra

Reinforcement learning agents in complex game environments often suffer from sparse rewards, training instability, and poor sample efficiency. This paper presents a hybrid training approach that combines offline imitation learning with…

Machine Learning · Computer Science 2025-09-19 Thomas Ackermann , Moritz Spang , Hamza A. A. Gardi