English
Related papers

Related papers: Agent World Model: Infinity Synthetic Environments…

200 papers

Applying reinforcement learning (RL) to real-world tasks requires converting informal descriptions into a formal Markov decision process (MDP), implementing an executable environment, and training a policy agent. Automating this process is…

Artificial Intelligence · Computer Science 2025-12-15 Hong Je-Gal , Chan-Bin Yi , Hyun-Suk Lee

Training agents to act competently in complex 3D environments from high-dimensional visual information is challenging. Reinforcement learning is conventionally used to train such agents, but requires a carefully designed reward function,…

Machine Learning · Computer Science 2025-12-30 Adam Jelley , Yuhan Cao , Dave Bignell , Amos Storkey , Sam Devlin , Tabish Rashid

Recent advances in large language models (LLMs) have demonstrated potential for LLM agents. To facilitate the training for these agents with both linguistic feedback and non-linguistic reward signals, we introduce Learning through…

Computation and Language · Computer Science 2024-04-16 Kuan Wang , Yadong Lu , Michael Santacroce , Yeyun Gong , Chao Zhang , Yelong Shen

GUI agents that interact with graphical interfaces on behalf of users represent a promising direction for practical AI assistants. However, training such agents is hindered by the scarcity of suitable environments. We present InfiniteWeb, a…

Computation and Language · Computer Science 2026-01-09 Ziyun Zhang , Zezhou Wang , Xiaoyi Zhang , Zongyu Guo , Jiahao Li , Bin Li , Yan Lu

Large language models (LLMs) have recently gained much attention in building autonomous agents. However, the performance of current LLM-based web agents in long-horizon tasks is far from optimal, often yielding errors such as repeatedly…

Computation and Language · Computer Science 2025-04-01 Hyungjoo Chae , Namyoung Kim , Kai Tzu-iunn Ong , Minju Gwak , Gwanwoo Song , Jihoon Kim , Sunghwan Kim , Dongha Lee , Jinyoung Yeo

Autonomous agents powered by large language models (LLMs) have the potential to enhance human capabilities, assisting with digital tasks from sending emails to performing data analysis. The abilities of existing LLMs at such tasks are often…

Machine Learning · Computer Science 2025-01-22 Hongjin Su , Ruoxi Sun , Jinsung Yoon , Pengcheng Yin , Tao Yu , Sercan Ö. Arık

Simulated Students offer a valuable methodological framework for evaluating pedagogical approaches and modelling diverse learner profiles, tasks which are otherwise challenging to undertake systematically in real-world settings. Recent…

Computers and Society · Computer Science 2025-11-11 Luis Marquez-Carpintero , Alberto Lopez-Sellers , Miguel Cazorla

LLM agents excel in compact environments requiring deep reasoning but remain brittle when operating in broader, more complex contexts that demand robustness across diverse tools and schemas. Building bespoke environments for training is…

Artificial Intelligence · Computer Science 2025-11-04 Yuetai Li , Huseyin A Inan , Xiang Yue , Wei-Ning Chen , Lukas Wutschitz , Janardhan Kulkarni , Radha Poovendran , Robert Sim , Saravan Rajmohan

Autonomous agents powered by large language models (LLMs) have garnered significant research attention. However, fully harnessing the potential of LLMs for agent-based tasks presents inherent challenges due to the heterogeneous nature of…

We explore building generative neural network models of popular reinforcement learning environments. Our world model can be trained quickly in an unsupervised manner to learn a compressed spatial and temporal representation of the…

Machine Learning · Computer Science 2018-05-10 David Ha , Jürgen Schmidhuber

World models (WMs) represent the frontier of sample-efficient reinforcement learning, but their complexity leaves many promising improvements unrealized due to the significant expertise and effort required to identify and integrate them.…

Machine Learning · Computer Science 2026-05-12 Lior Cohen , Kaixin Wang , Bingyi Kang , Uri Gadot , Shie Mannor

Equipping LLMs with tool-use capabilities via Agentic Reinforcement Learning (Agentic RL) is bottlenecked by two challenges: the lack of scalable, robust execution environments and the scarcity of realistic training data that captures…

The rapid progress in embodied artificial intelligence has highlighted the necessity for more advanced and integrated models that can perceive, interpret, and predict environmental dynamics. In this context, World Models (WMs) have been…

The emergence of large language model (LLM)-based agents has significantly advanced the development of autonomous machine learning (ML) engineering. However, the dominant prompt-based paradigm exhibits limitations: smaller models lack the…

Computation and Language · Computer Science 2026-05-04 Zexi Liu , Jingyi Chai , Xinyu Zhu , Shuo Tang , Rui Ye , Bo Zhang , Lei Bai , Siheng Chen

Terminal agents extend Large Language Models with the ability to execute tasks directly in command-line environments, but their progress is bottlenecked by the scarcity of high-quality training data. Existing approaches bootstrap from…

Computation and Language · Computer Science 2026-05-21 Zihao Cheng , Hongru Wang , Zeming Liu , Xinyi Wang , Xiangrong Zhu , Yuhang Guo , Wei Lin , Jeff Z. Pan , Yunhong Wang

The emergence of Large Language Models (LLMs) has reshaped agent systems. Unlike traditional rule-based agents with limited task scope, LLM-powered agents offer greater flexibility, cross-domain reasoning, and natural language interaction.…

Artificial Intelligence · Computer Science 2026-05-05 Guannan Liang , Qianqian Tong

While reinforcement learning (RL) can empower autonomous agents by enabling self-improvement through interaction, its practical adoption remains challenging due to costly rollouts, limited task diversity, unreliable reward signals, and…

As Large Language Models (LLMs) become ubiquitous across various scientific domains, their lack of ability to perform complex tasks like running simulations or to make complex decisions limits their utility. LLM-based agents bridge this gap…

Computation and Language · Computer Science 2026-01-21 Anurag Acharya , Timothy Vega , Rizwan A. Ashraf , Anshu Sharma , Derek Parker , Robert Rallo

Agent-based modeling (ABM) is a well-established paradigm for simulating complex systems via interactions between constituent entities. Machine learning (ML) refers to approaches whereby statistical algorithms 'learn' from data on their…

Quantitative Methods · Quantitative Biology 2022-11-10 Nikita Sivakumar , Cameron Mura , Shayn M. Peirce