English
Related papers

Related papers: Learning UI Navigation through Demonstrations comp…

200 papers

In artificial intelligence, we often specify tasks through a reward function. While this works well in some settings, many tasks are hard to specify this way. In deep reinforcement learning, for example, directly specifying a reward as a…

Machine Learning · Computer Science 2019-08-09 Matthew Rahtz , James Fang , Anca D. Dragan , Dylan Hadfield-Menell

When deployed, AI agents will encounter problems that are beyond their autonomous problem-solving capabilities. Leveraging human assistance can help agents overcome their inherent limitations and robustly cope with unfamiliar situations. We…

Machine Learning · Computer Science 2022-06-24 Khanh Nguyen , Yonatan Bisk , Hal Daumé

Much of the previous work towards digital agents for graphical user interfaces (GUIs) has relied on text-based representations (derived from HTML or other structured data sources), which are not always readily available. These input…

We present a novel Learning from Demonstration (LfD) method, Deformable Manipulation from Demonstrations (DMfD), to solve deformable manipulation tasks using states or images as inputs, given expert demonstrations. Our method uses…

Robotics · Computer Science 2022-07-22 Gautam Salhotra , I-Chun Arthur Liu , Marcus Dominguez-Kuhne , Gaurav S. Sukhatme

While much work on web agents emphasizes the promise of autonomously performing tasks on behalf of users, in reality, agents often fall short on complex tasks in real-world contexts and modeling user preference. This presents an opportunity…

Artificial Intelligence · Computer Science 2026-03-02 Faria Huq , Zora Zhiruo Wang , Frank F. Xu , Tianyue Ou , Shuyan Zhou , Jeffrey P. Bigham , Graham Neubig

In this paper we consider the problem of how a reinforcement learning agent tasked with solving a set of related Markov decision processes can use knowledge acquired early in its lifetime to improve its ability to more rapidly solve novel,…

Artificial Intelligence · Computer Science 2019-02-26 Francisco M. Garcia , Bruno C. da Silva , Philip S. Thomas

Building Graphical User Interface (GUI) assistants holds significant promise for enhancing human workflow productivity. While most agents are language-based, relying on closed-source API with text-rich meta-information (e.g., HTML or…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Kevin Qinghong Lin , Linjie Li , Difei Gao , Zhengyuan Yang , Shiwei Wu , Zechen Bai , Weixian Lei , Lijuan Wang , Mike Zheng Shou

We develop a new framework for multi-agent collision avoidance problem. The framework combined traditional pathfinding algorithm and reinforcement learning. In our approach, the agents learn whether to be navigated or to take simple actions…

Multiagent Systems · Computer Science 2020-12-17 Hongda Qiu

We introduce NNetNav, a method for unsupervised interaction with websites that generates synthetic demonstrations for training browser agents. Given any website, NNetNav produces these demonstrations by retroactively labeling action…

Computation and Language · Computer Science 2025-02-06 Shikhar Murty , Hao Zhu , Dzmitry Bahdanau , Christopher D. Manning

Navigating dynamic urban environments presents significant challenges for embodied agents, requiring advanced spatial reasoning and adherence to common-sense norms. Despite progress, existing visual navigation methods struggle in map-free…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Xinhao Liu , Jintong Li , Yicheng Jiang , Niranjan Sujay , Zhicheng Yang , Juexiao Zhang , John Abanes , Jing Zhang , Chen Feng

With the fast improvement of machine learning, reinforcement learning (RL) has been used to automate human tasks in different areas. However, training such agents is difficult and restricted to expert users. Moreover, it is mostly limited…

Machine Learning · Computer Science 2023-03-21 André Correia , Luís A. Alexandre

Developing and testing user interfaces (UIs) and training AI agents to interact with them are challenging due to the dynamic and diverse nature of real-world mobile environments. Existing methods often rely on cumbersome physical devices or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Jiannan Xiang , Yun Zhu , Lei Shu , Maria Wang , Lijun Yu , Gabriel Barcik , James Lyon , Srinivas Sunkara , Jindong Chen

Safe and efficient autonomous driving maneuvers in an interactive and complex environment can be considerably challenging due to the unpredictable actions of other surrounding agents that may be cooperative or adversarial in their…

Robotics · Computer Science 2019-01-28 Pin Wang , Ching-Yao Chan , Hanhan Li

In multi-agent based traffic simulation, agents are always supposed to move following existing instructions, and mechanically and unnaturally imitate human behavior. The human drivers perform acceleration or deceleration irregularly all the…

Multiagent Systems · Computer Science 2021-01-26 Junjie Zhong , Hiromitsu Hattori

Building a general-purpose intelligent home-assistant agent skilled in diverse tasks by human commands is a long-term blueprint of embodied AI research, which poses requirements on task planning, environment modeling, and object…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Xinyu Xu , Shengcheng Luo , Yanchao Yang , Yong-Lu Li , Cewu Lu

Autonomous agents must know how to explore user interfaces (UIs) for reliable task solving, yet systematic evaluation of this crucial phase is lacking. We introduce UIExplore-Bench, the first benchmark explicitly dedicated to UI…

Using touch devices to navigate in virtual 3D environments such as computer assisted design (CAD) models or geographical information systems (GIS) is inherently difficult for humans, as the 3D operations have to be performed by the user on…

Machine Learning · Computer Science 2019-08-29 Quentin Debard , Jilles Steeve Dibangoye , Stéphane Canu , Christian Wolf

Demonstration is an appealing way for humans to provide assistance to reinforcement-learning agents. Most approaches in this area view demonstrations primarily as sources of behavioral bias. But in sparse-reward tasks, humans seem to treat…

Machine Learning · Computer Science 2020-04-14 Lisa Torrey

The ability of modeling the other agents, such as understanding their intentions and skills, is essential to an agent's interactions with other agents. Conventional agent modeling relies on passive observation from demonstrations. In this…

Artificial Intelligence · Computer Science 2018-10-02 Tianmin Shu , Caiming Xiong , Ying Nian Wu , Song-Chun Zhu

Modeling agent behavior is central to understanding the emergence of complex phenomena in multiagent systems. Prior work in agent modeling has largely been task-specific and driven by hand-engineering domain-specific prior knowledge. We…

Multiagent Systems · Computer Science 2018-08-02 Aditya Grover , Maruan Al-Shedivat , Jayesh K. Gupta , Yura Burda , Harrison Edwards