English
Related papers

Related papers: GAIA: A Data Flywheel System for Training GUI Test…

200 papers

Agentic AI (AAI), which extends Large Language Models with enhanced reasoning capabilities, has emerged as a promising paradigm for autonomous edge service scheduling. However, user mobility creates highly dynamic service demands in edge…

Networking and Internet Architecture · Computer Science 2026-01-21 Yan Sun , Yinqiu Liu , Shaoyong Guo , Ruichen Zhang , Feng Qi , Xuesong Qiu , Weifeng Gong , Dusit Niyato , Qihui Wu

Recent work has questioned whether large language models (LLMs) can perform genuine in-context learning (ICL) for scientific experimental design, with prior studies suggesting that LLM-based agents exhibit no sensitivity to experimental…

Graphical User Interface (GUI) grounding plays a crucial role in enhancing the capabilities of Vision-Language Model (VLM) agents. While general VLMs, such as GPT-4V, demonstrate strong performance across various tasks, their proficiency in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Anthony Nguyen

Large Language Model (LLM) agents deployed for real-world tasks face a fundamental dilemma: user requests are underspecified, yet agents must decide whether to act on incomplete information or interrupt users for clarification. Existing…

Computation and Language · Computer Science 2026-01-13 Yijiang River Dong , Tiancheng Hu , Zheng Hui , Caiqi Zhang , Ivan Vulić , Andreea Bobu , Nigel Collier

Current LLM-based agents demonstrate strong performance in episodic task execution but remain constrained by static toolsets and episodic amnesia, failing to accumulate experience across task boundaries. This paper formalizes the…

Artificial Intelligence · Computer Science 2026-05-26 Sihang Jiang , Lipeng Ma , Zhonghua Hong , Keyi Wang , Zhiyu Lu , Tengfei Wang , Shisong Chen , Jinghao Zhang , Tianjun Pan , Weijia Li , Jiaqing Liang , Yanghua Xiao

The rapid advancement of large vision language models (LVLMs) and agent systems has heightened interest in mobile GUI agents that can reliably translate natural language into interface operations. Existing single-agent approaches, however,…

Artificial Intelligence · Computer Science 2025-08-28 Quanfeng Lu , Zhantao Ma , Shuai Zhong , Jin Wang , Dahai Yu , Michael K. Ng , Ping Luo

Graphical User Interface (GUI) agents have gained substantial attention due to their impressive capabilities to complete tasks through multiple interactions within GUI environments. However, existing agents primarily focus on enhancing the…

Computation and Language · Computer Science 2025-05-28 Qinzhuo Wu , Pengzhi Gao , Wei Liu , Jian Luan

Recent years have witnessed a rapid development of mobile GUI agents powered by large language models (LLMs), which can autonomously execute diverse device-control tasks based on natural language instructions. The increasing accuracy of…

Cryptography and Security · Computer Science 2026-04-15 Guohong Liu , Jialei Ye , Jiacheng Liu , Yuanchun Li , Wei Liu , Pengzhi Gao , Jian Luan , Yunxin Liu

With the growing reliance on digital devices equipped with graphical user interfaces (GUIs), such as computers and smartphones, the need for effective automation tools has become increasingly important. While multimodal large language…

Human-Computer Interaction · Computer Science 2024-10-18 Jakub Hoscilowicz , Bartosz Maj , Bartosz Kozakiewicz , Oleksii Tymoshchuk , Artur Janicki

The learning from practice paradigm is crucial for developing capable Agentic AI systems, yet it is severely hampered by inefficient experience generation, a bottleneck especially pronounced in complex benchmarks like GAIA. To address this,…

We introduce LLaVA-Critic, the first open-source large multimodal model (LMM) designed as a generalist evaluator to assess performance across a wide range of multimodal tasks. LLaVA-Critic is trained using a high-quality critic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Tianyi Xiong , Xiyao Wang , Dong Guo , Qinghao Ye , Haoqi Fan , Quanquan Gu , Heng Huang , Chunyuan Li

Graphical user interface (GUI) agents are rapidly progressing toward autonomous interaction and reliable task execution across diverse applications. However, two central challenges remain unresolved: automating the evaluation of agent…

We introduce Gaia2, a benchmark for evaluating large language model agents in realistic, asynchronous environments. Unlike prior static or synchronous evaluations, Gaia2 introduces scenarios where environments evolve independently of agent…

Simulated Students offer a valuable methodological framework for evaluating pedagogical approaches and modelling diverse learner profiles, tasks which are otherwise challenging to undertake systematically in real-world settings. Recent…

Computers and Society · Computer Science 2025-11-11 Luis Marquez-Carpintero , Alberto Lopez-Sellers , Miguel Cazorla

Large language models (LLMs) exhibit strong reasoning and conversational abilities, but ensuring reliable behavior in multi-turn interactions remains challenging. In many real-world applications, agents must succeed in one-shot settings…

Computation and Language · Computer Science 2026-04-02 Shuli Jiang , Zhaoyang Zhang , Yi Zhang , Shuo Yang , Wei Xia , Stefano Soatto

Generative artificial intelligence (GAI), specifically large language models (LLMs), are increasingly used in software engineering, mainly for coding tasks. However, requirements engineering - particularly requirements validation - has seen…

Software Engineering · Computer Science 2026-02-10 Adam Trendowicz , Daniel Seifert , Andreas Jedlitschka , Marcus Ciolkowski , Anton Strahilov

Generative Artificial Intelligence (GAI) and the idea to use hierarchical models has been around for some years now. GAI has proved to be an extremely useful tool for Autonomous Vehicles (AVs). AVs need to perform robustly in their…

Systems and Control · Electrical Eng. & Systems 2025-01-22 Diomidis Katzourakis

Organizations are increasingly exploring delegation of screening and negotiation tasks to AI systems, yet deployment in high-stakes B2B settings is constrained by governance: preventing unauthorized commitments, ensuring sufficient…

Artificial Intelligence · Computer Science 2025-11-11 Siming Zhao , Qi Li

The growing volume of academic papers has made it increasingly difficult for researchers to efficiently extract key information. While large language models (LLMs) based agents are capable of automating question answering (QA) workflows for…

Computation and Language · Computer Science 2026-03-31 Tiancheng Huang , Ruisheng Cao , Yuxin Zhang , Zhangyi Kang , Zijian Wang , Chenrun Wang , Yijie Luo , Hang Zheng , Lirong Qian , Lu Chen , Kai Yu

Large Language Models are increasingly deployed as autonomous agents for complex real-world tasks, yet existing systems often focus on isolated improvements without a unifying design for robustness and adaptability. We propose a generalist…