English
Related papers

Related papers: Can Current Agents Close the Discovery-to-Applicat…

200 papers

The development of general-purpose agents requires a shift from executing simple instructions to completing complex, real-world productivity workflows. However, current tool-use benchmarks remain misaligned with real-world requirements,…

Computation and Language · Computer Science 2026-04-20 Jize Wang , Xuanxuan Liu , Yining Li , Songyang Zhang , Yijun Wang , Zifei Shan , Xinyi Le , Cailian Chen , Xinping Guan , Dacheng Tao

Computer-using agents have shown strong potential to boost human productivity and enable new application forms across platforms. While recent advances have led to usable applications, existing benchmarks fail to account for the internal…

Agent benchmarks have become the de facto measure of frontier AI competence, guiding model selection, investment, and deployment. However, reward hacking, where agents maximize a score without performing the intended task, emerges…

Artificial Intelligence · Computer Science 2026-05-14 Hao Wang , Hanchen Li , Qiuyang Mang , Alvin Cheung , Koushik Sen , Dawn Song

Artificial intelligence systems for scientific discovery have demonstrated remarkable potential, yet existing approaches remain largely proprietary and operate in batch-processing modes requiring hours per research cycle, precluding…

Artificial Intelligence · Computer Science 2026-01-28 Lukas Weidener , Marko Brkić , Mihailo Jovanović , Ritvik Singh , Chiara Baccin , Emre Ulgac , Alex Dobrin , Aakaash Meduri

We study building multi-task agents in open-world environments. Without human demonstrations, learning to accomplish long-horizon tasks in a large open-world environment with reinforcement learning (RL) is extremely inefficient. To tackle…

Machine Learning · Computer Science 2023-12-05 Haoqi Yuan , Chi Zhang , Hongcheng Wang , Feiyang Xie , Penglin Cai , Hao Dong , Zongqing Lu

The process of scientific discovery relies on an interplay of observations, analysis, and hypothesis generation. Machine learning is increasingly being adopted to address individual aspects of this process. However, it remains an open…

Artificial Intelligence · Computer Science 2026-05-26 Maximilian Nägele , Florian Marquardt

Significant focus has been placed on integrating large language models (LLMs) with various tools in developing general-purpose agents. This poses a challenge to LLMs' tool-use capabilities. However, there are evident gaps between existing…

Computation and Language · Computer Science 2024-11-25 Jize Wang , Zerun Ma , Yining Li , Songyang Zhang , Cailian Chen , Kai Chen , Xinyi Le

In long-horizon open-world multi-agent systems, existing methods often treat local anomalies as automatic triggers for communication. This default design introduces coordination noise, interrupts local execution, and overuses public…

Multiagent Systems · Computer Science 2026-04-22 HuaDong Jian , Chenghao Li , Haoyu Wang , Jiajia Shuai , Jinyu Guo , Yang Yang , Chaoning Zhang

Large Language Models (LLMs) have shown great promise in tool-making, yet existing frameworks often struggle to efficiently construct reliable toolsets and are limited to single-task settings. To address these challenges, we propose GATE…

Computation and Language · Computer Science 2025-02-21 Jianwen Luo , Yiming Huang , Jinxiang Meng , Fangyu Lei , Shizhu He , Xiao Liu , Shanshan Jiang , Bin Dong , Jun Zhao , Kang Liu

General-purpose agents perform tasks in unfamiliar environments without domain-specific manual customization. Yet no study has systematically measured how agent architecture shapes performance across heterogeneous protocols and diverse…

Collaborative tasks are ubiquitous activities where a form of communication is required in order to reach a joint goal. Collaborative building is one of such tasks. We wish to develop an intelligent builder agent in a simulated building…

Computation and Language · Computer Science 2022-04-22 Zhengxiang Shi , Yue Feng , Aldo Lipani

Sample inefficiency of deep reinforcement learning methods is a major obstacle for their use in real-world applications. In this work, we show how human demonstrations can improve final performance of agents on the Minecraft minigame…

Machine Learning · Computer Science 2020-03-16 Christian Scheller , Yanick Schraner , Manfred Vogel

In order for artificial agents to successfully perform tasks in changing environments, they must be able to both detect and adapt to novelty. However, visual novelty detection research often only evaluates on repurposed datasets such as…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Patrick Feeney , Sarah Schneider , Panagiotis Lymperopoulos , Li-Ping Liu , Matthias Scheutz , Michael C. Hughes

Recent studies have delved into constructing generalist agents for open-world environments like Minecraft. Despite the encouraging results, existing efforts mainly focus on solving basic programmatic tasks, e.g., material collection and…

Artificial Intelligence · Computer Science 2025-06-03 Shunyu Liu , Yaoru Li , Kongcheng Zhang , Zhenyu Cui , Wenkai Fang , Yuxuan Zheng , Tongya Zheng , Mingli Song

Production agentic systems make many model calls per user request, and most of those calls are short, structured, and routine. This raises a practical routing question that existing evaluations do not directly answer: which parts of an…

Artificial Intelligence · Computer Science 2026-05-04 Ranit Karmakar , Jayita Chatterjee

Developing generalist agents capable of solving open-ended tasks in visually rich, dynamic environments remains a core pursuit of embodied AI. While Minecraft has emerged as a compelling benchmark, existing agents often suffer from…

Artificial Intelligence · Computer Science 2026-02-11 Zaijing Li , Yuquan Xie , Rui Shao , Gongwei Chen , Weili Guan , Dongmei Jiang , Yaowei Wang , Liqiang Nie

The rapid advancement of artificial intelligence, particularly autonomous agentic systems based on Large Language Models (LLMs), presents new opportunities to accelerate drug discovery by improving in-silico modeling and reducing dependence…

Reinforcement learning agents must generalize beyond their training experience. Prior work has focused mostly on identical training and evaluation environments. Starting from the recently introduced Crafter benchmark, a 2D open world…

Machine Learning · Computer Science 2022-08-09 Aleksandar Stanić , Yujin Tang , David Ha , Jürgen Schmidhuber

Learning agents that are not only capable of taking tests, but also innovating is becoming a hot topic in AI. One of the most promising paths towards this vision is multi-agent learning, where agents act as the environment for each other,…

Multiagent Systems · Computer Science 2019-12-02 Yuhang Song , Andrzej Wojcicki , Thomas Lukasiewicz , Jianyi Wang , Abi Aryan , Zhenghua Xu , Mai Xu , Zihan Ding , Lianlong Wu

Constructing general knowledge by learning task-independent models of the world can help agents solve challenging problems. However, both constructing and evaluating such models remains an open challenge. The most common approaches to…

Artificial Intelligence · Computer Science 2021-04-15 Alex Kearney , Anna Koop , Patrick M. Pilarski