English
Related papers

Related papers: Web Agents with World Models: Learning and Leverag…

200 papers

Motion prediction is among the most fundamental tasks in autonomous driving. Traditional methods of motion forecasting primarily encode vector information of maps and historical trajectory data of traffic participants, lacking a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Xiaoji Zheng , Lixiu Wu , Zhijie Yan , Yuanrong Tang , Hao Zhao , Chen Zhong , Bokui Chen , Jiangtao Gong

As AI continues to advance, there is a growing demand for systems that go beyond language-based assistance and move toward intelligent agents capable of performing real-world actions. This evolution requires the transition from traditional…

Recent advances in vision-language models have enabled mobile GUI agents to perceive visual interfaces and execute user instructions, but reliable prediction of action consequences remains critical for long-horizon and high-risk…

Artificial Intelligence · Computer Science 2026-05-25 Weikai Xu , Kun Huang , Yunren Feng , Jiaxing Li , Yuhan Chen , Yuxuan Liu , Zhizheng Jiang , Heng Qu , Pengzhi Gao , Wei Liu , Jian Luan , Xiaolin Hu , Bo An

Large Language Model-based agents have garnered significant attention and are becoming increasingly popular. Furthermore, planning ability is a crucial component of an LLM-based agent, which generally entails achieving a desired goal from…

Computation and Language · Computer Science 2025-02-07 Mengkang Hu , Pu Zhao , Can Xu , Qingfeng Sun , Jianguang Lou , Qingwei Lin , Ping Luo , Saravan Rajmohan

A key challenge in training Vision-Language Model (VLM) agents, compared to Language Model (LLM) agents, lies in the shift from textual states to complex visual observations. This transition introduces partial observability and demands…

Despite rapid progress in autonomous web agents, human involvement remains essential for shaping preferences and correcting agent behavior as tasks unfold. However, current agentic systems lack a principled understanding of when and why…

Computation and Language · Computer Science 2026-03-02 Faria Huq , Zora Zhiruo Wang , Zhanqiu Guo , Venu Arvind Arangarajan , Tianyue Ou , Frank Xu , Shuyan Zhou , Graham Neubig , Jeffrey P. Bigham

Unlike reinforcement learning (RL) agents, humans remain capable multitaskers in changing environments. In spite of only experiencing the world through their own observations and interactions, people know how to balance focusing on tasks…

Artificial Intelligence · Computer Science 2024-07-02 Rishav Bhagat , Jonathan Balloch , Zhiyu Lin , Julia Kim , Mark Riedl

A burgeoning area within reinforcement learning (RL) is the design of sequential decision-making agents centered around large language models (LLMs). While autonomous decision-making agents powered by modern LLMs could facilitate numerous…

Machine Learning · Computer Science 2026-02-10 Dilip Arumugam , Thomas L. Griffiths

This paper introduces a novel approach using Large Language Models (LLMs) integrated into an agent framework for flexible and effective personal mobility generation. LLMs overcome the limitations of previous models by effectively processing…

Artificial Intelligence · Computer Science 2024-10-29 Jiawei Wang , Renhe Jiang , Chuang Yang , Zengqing Wu , Makoto Onizuka , Ryosuke Shibasaki , Noboru Koshizuka , Chuan Xiao

Developing robust world model reasoning is crucial for large language model (LLM) agents to plan and interact in complex environments. While multi-turn interaction offers a superior understanding of environmental dynamics via authentic…

Artificial Intelligence · Computer Science 2025-12-01 Bao Shu , Yan Cai , Jianjian Sun , Chunrui Han , En Yu , Liang Zhao , Jingcheng Hu , Yinmin Zhang , Haoran Lv , Yuang Peng , Zheng Ge , Xiangyu Zhang , Daxin Jiang , Xiangyu Yue

Large language models (LLMs) have recently demonstrated remarkable capabilities across domains, tasks, and languages (e.g., ChatGPT and GPT-4), reviving the research of general autonomous agents with human-like cognitive abilities. Such…

Artificial Intelligence · Computer Science 2025-03-07 Pengbo Hu , Xiang Ying

Recent months have seen the emergence of a powerful new trend in which large language models (LLMs) are augmented to become autonomous language agents capable of performing objective oriented multi-step tasks on their own, rather than…

Large Language Model (LLM) agents are rapidly improving to handle increasingly complex web-based tasks. Most of these agents rely on general-purpose, proprietary models like GPT-4 and focus on designing better prompts to improve their…

Computation and Language · Computer Science 2024-12-06 Junhong Shen , Atishay Jain , Zedian Xiao , Ishan Amlekar , Mouad Hadji , Aaron Podolny , Ameet Talwalkar

Simulated Students offer a valuable methodological framework for evaluating pedagogical approaches and modelling diverse learner profiles, tasks which are otherwise challenging to undertake systematically in real-world settings. Recent…

Computers and Society · Computer Science 2025-11-11 Luis Marquez-Carpintero , Alberto Lopez-Sellers , Miguel Cazorla

LLMs struggle with decision-making in high-stakes environments like MOBA games, primarily due to a lack of proactive reasoning and limited understanding of complex game dynamics. To address this, we propose What-if Analysis LLM (WiA-LLM), a…

Artificial Intelligence · Computer Science 2026-01-13 Yuan Sui , Yanming Zhang , Yi Liao , Yu Gu , Guohua Tang , Zhongqian Sun , Wei Yang , Bryan Hooi

Practical mechanisms often limit agent reports to constrained formats like trades or orderings, potentially limiting the information agents can express. We propose a novel class of mechanisms that elicit agent reports in natural language…

Computer Science and Game Theory · Computer Science 2024-07-11 Nicolas Della Penna

The rapid advancement of autonomous web navigation has significantly benefited from grounding pretrained Large Language Models (LLMs) as agents. However, current research has yet to fully leverage the redundancy of HTML elements for…

Computation and Language · Computer Science 2024-12-17 Jiarun Liu , Jia Hao , Chunhong Zhang , Zheng Hu

Agent-Based Modelling (ABM) has emerged as an essential tool for simulating social networks, encompassing diverse phenomena such as information dissemination, influence dynamics, and community formation. However, manually configuring varied…

Large language models (LLMs) are increasingly proposed as agents in strategic decision environments, yet their behavior in structured geopolitical simulations remains under-researched. We evaluate six popular state-of-the-art LLMs alongside…

Computation and Language · Computer Science 2026-03-03 Veronika Solopova , Viktoria Skorik , Maksym Tereshchenko , Alina Haidun , Ostap Vykhopen

Recent advances in large language model (LLM) have empowered autonomous agents to perform multi-turn interactions with tools and environments. However, scaling such agent training is limited by the lack of diverse and reliable environments.…

Artificial Intelligence · Computer Science 2026-05-26 Zhaoyang Wang , Canwen Xu , Boyi Liu , Yite Wang , Siwei Han , Zhewei Yao , Huaxiu Yao , Yuxiong He