English
Related papers

Related papers: OS-MAP: How Far Can Computer-Using Agents Go in Br…

200 papers

Cybersecurity is a relentless arms race, with AI driven offensive systems evolving faster than traditional defenses can adapt. Research and tooling remain fragmented across isolated defensive functions, creating blind spots that adversaries…

Computation and Language · Computer Science 2025-10-03 Mudita Khurana , Raunak Jain

Deep reasoning is fundamental for solving complex tasks, especially in vision-centric scenarios that demand sequential, multimodal understanding. However, existing benchmarks typically evaluate agents with fully synthetic, single-turn…

Autonomous agents powered by large language models (LLMs) are increasingly deployed in real-world applications requiring complex, long-horizon workflows. However, existing benchmarks predominantly focus on atomic tasks that are…

Computation and Language · Computer Science 2025-08-13 Weixuan Wang , Dongge Han , Daniel Madrigal Diaz , Jin Xu , Victor Rühle , Saravan Rajmohan

Data science and engineering workflows often span multiple stages, from warehousing to orchestration, using tools like BigQuery, dbt, and Airbyte. As vision language models (VLMs) advance in multimodal understanding and code generation,…

General-purpose agents perform tasks in unfamiliar environments without domain-specific manual customization. Yet no study has systematically measured how agent architecture shapes performance across heterogeneous protocols and diverse…

Shortcuts such as APIs and deep-links have emerged as efficient complements to flexible GUI operations, fostering a promising hybrid paradigm for MLLM-based mobile automation. However, systematic evaluation of GUI-shortcut hybrid agents…

Existing AI benchmarks for software automation rarely combine cross-application coordination, autonomous API discovery, and policy adherence. Real business workflows demand all three: a single task may span a CRM, inbox, calendar, and…

Artificial Intelligence · Computer Science 2026-04-22 Daniel Shepard , Robin Salimans

Autonomous computer use agents that powered by multimodal large language models (MLLMs) are emerging as capable assistants for completing complex digital workflows. However, real-world execution environments are far from ideal: pop-ups,…

Artificial Intelligence · Computer Science 2026-05-26 Jingwei Sun , Jianing Zhu , Yuanyi Li , Tongliang Liu , Xia HU , Bo Han

Multi-agent systems (MAS) decompose complex tasks and delegate subtasks to different large language model (LLM) agents and tools. Prior studies have reported the superior accuracy performance of MAS across diverse domains, enabled by…

Multiagent Systems · Computer Science 2025-05-27 Mingyan Gao , Yanzi Li , Banruo Liu , Yifan Yu , Phillip Wang , Ching-Yu Lin , Fan Lai

AI agents have been developed for complex real-world tasks from coding to customer service. But AI agent evaluations suffer from many challenges that undermine our understanding of how well agents really work. We introduce the Holistic…

Recent advances in large language models (LLMs) have enabled a new class of AI agents that automate multiple stages of the data science workflow by integrating planning, tool use, and multimodal reasoning across text, code, tables, and…

Planning is central to agents and agentic AI. The ability to plan, e.g., creating travel itineraries within a budget, holds immense potential in both scientific and commercial contexts. Moreover, optimal plans tend to require fewer…

Artificial Intelligence · Computer Science 2025-04-22 Haoming Li , Zhaoliang Chen , Jonathan Zhang , Fei Liu

Large language model multi-agent systems (LLM-MAS) offer a promising paradigm for harnessing collective intelligence to achieve more advanced forms of AI behaviour. While recent studies suggest that LLM-MAS can outperform LLM single-agent…

Artificial Intelligence · Computer Science 2025-10-07 Bohan Tang , Huidong Liang , Keyue Jiang , Xiaowen Dong

Software robots have long been used in Robotic Process Automation (RPA) to automate mundane and repetitive computer tasks. With the advent of Large Language Models (LLMs) and their advanced reasoning capabilities, these agents are now able…

Artificial Intelligence · Computer Science 2024-12-30 Junhee Cho , Jihoon Kim , Daseul Bae , Jinho Choo , Youngjune Gwon , Yeong-Dae Kwon

Inpatient pathways demand complex clinical decision-making based on comprehensive patient information, posing critical challenges for clinicians. Despite advancements in large language models (LLMs) in medical applications, limited research…

Artificial Intelligence · Computer Science 2025-03-18 Zhen Chen , Zhihao Peng , Xusheng Liang , Cheng Wang , Peigan Liang , Linsheng Zeng , Minjie Ju , Yixuan Yuan

Large Language Models (LLMs) based agent systems have made great strides in real-world applications beyond traditional NLP tasks. This paper proposes a new LLM-based Multi-Agent System (LLM-MAS) benchmark, Collab-Overcooked, built on the…

Computation and Language · Computer Science 2025-12-02 Haochen Sun , Shuwen Zhang , Lujie Niu , Lei Ren , Hao Xu , Hao Fu , Fangkun Zhao , Caixia Yuan , Xiaojie Wang

Current interactive LLM agents rely on goal-conditioned stepwise planning, where environmental understanding is acquired reactively during execution rather than established beforehand. This temporal inversion leads to Delayed Environmental…

Artificial Intelligence · Computer Science 2026-05-14 Yuxin Liu , Ziang Ye , Yueqing Sun , Mingye Zhu , Jinwei Xiao , Zhuowen Han , Qi GU , Xunliang Cai , Lei Zhang

We interact with computers on an everyday basis, be it in everyday life or work, and many aspects of work can be done entirely with access to a computer and the Internet. At the same time, thanks to improvements in large language models…

Today's AI agents are built on large language models (LLMs) equipped with tools to access and modify external environments, such as corporate file systems, API-accessible platforms and websites. AI agents offer the promise of automating…

Computers and Society · Computer Science 2026-03-26 Merlin Stein

Proactive agents that anticipate user needs and autonomously execute tasks hold great promise as digital assistants, yet the lack of realistic user simulation frameworks hinders their development. Existing approaches model apps as flat…

Artificial Intelligence · Computer Science 2026-04-02 Deepak Nathani , Cheng Zhang , Chang Huan , Jiaming Shan , Yinfei Yang , Alkesh Patel , Zhe Gan , William Yang Wang , Michael Saxon , Xin Eric Wang
‹ Prev 1 3 4 5 6 7 10 Next ›