中文
相关论文

相关论文: GAIA: A Data Flywheel System for Training GUI Test…

200 篇论文

Agentic AI (AAI), which extends Large Language Models with enhanced reasoning capabilities, has emerged as a promising paradigm for autonomous edge service scheduling. However, user mobility creates highly dynamic service demands in edge…

网络与互联网体系结构 · 计算机科学 2026-01-21 Yan Sun , Yinqiu Liu , Shaoyong Guo , Ruichen Zhang , Feng Qi , Xuesong Qiu , Weifeng Gong , Dusit Niyato , Qihui Wu

Recent work has questioned whether large language models (LLMs) can perform genuine in-context learning (ICL) for scientific experimental design, with prior studies suggesting that LLM-based agents exhibit no sensitivity to experimental…

Graphical User Interface (GUI) grounding plays a crucial role in enhancing the capabilities of Vision-Language Model (VLM) agents. While general VLMs, such as GPT-4V, demonstrate strong performance across various tasks, their proficiency in…

计算机视觉与模式识别 · 计算机科学 2025-09-12 Anthony Nguyen

Large Language Model (LLM) agents deployed for real-world tasks face a fundamental dilemma: user requests are underspecified, yet agents must decide whether to act on incomplete information or interrupt users for clarification. Existing…

计算与语言 · 计算机科学 2026-01-13 Yijiang River Dong , Tiancheng Hu , Zheng Hui , Caiqi Zhang , Ivan Vulić , Andreea Bobu , Nigel Collier

Current LLM-based agents demonstrate strong performance in episodic task execution but remain constrained by static toolsets and episodic amnesia, failing to accumulate experience across task boundaries. This paper formalizes the…

The rapid advancement of large vision language models (LVLMs) and agent systems has heightened interest in mobile GUI agents that can reliably translate natural language into interface operations. Existing single-agent approaches, however,…

人工智能 · 计算机科学 2025-08-28 Quanfeng Lu , Zhantao Ma , Shuai Zhong , Jin Wang , Dahai Yu , Michael K. Ng , Ping Luo

Graphical User Interface (GUI) agents have gained substantial attention due to their impressive capabilities to complete tasks through multiple interactions within GUI environments. However, existing agents primarily focus on enhancing the…

计算与语言 · 计算机科学 2025-05-28 Qinzhuo Wu , Pengzhi Gao , Wei Liu , Jian Luan

Recent years have witnessed a rapid development of mobile GUI agents powered by large language models (LLMs), which can autonomously execute diverse device-control tasks based on natural language instructions. The increasing accuracy of…

密码学与安全 · 计算机科学 2026-04-15 Guohong Liu , Jialei Ye , Jiacheng Liu , Yuanchun Li , Wei Liu , Pengzhi Gao , Jian Luan , Yunxin Liu

With the growing reliance on digital devices equipped with graphical user interfaces (GUIs), such as computers and smartphones, the need for effective automation tools has become increasingly important. While multimodal large language…

人机交互 · 计算机科学 2024-10-18 Jakub Hoscilowicz , Bartosz Maj , Bartosz Kozakiewicz , Oleksii Tymoshchuk , Artur Janicki

The learning from practice paradigm is crucial for developing capable Agentic AI systems, yet it is severely hampered by inefficient experience generation, a bottleneck especially pronounced in complex benchmarks like GAIA. To address this,…

We introduce LLaVA-Critic, the first open-source large multimodal model (LMM) designed as a generalist evaluator to assess performance across a wide range of multimodal tasks. LLaVA-Critic is trained using a high-quality critic…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Tianyi Xiong , Xiyao Wang , Dong Guo , Qinghao Ye , Haoqi Fan , Quanquan Gu , Heng Huang , Chunyuan Li

Graphical user interface (GUI) agents are rapidly progressing toward autonomous interaction and reliable task execution across diverse applications. However, two central challenges remain unresolved: automating the evaluation of agent…

We introduce Gaia2, a benchmark for evaluating large language model agents in realistic, asynchronous environments. Unlike prior static or synchronous evaluations, Gaia2 introduces scenarios where environments evolve independently of agent…

Simulated Students offer a valuable methodological framework for evaluating pedagogical approaches and modelling diverse learner profiles, tasks which are otherwise challenging to undertake systematically in real-world settings. Recent…

计算机与社会 · 计算机科学 2025-11-11 Luis Marquez-Carpintero , Alberto Lopez-Sellers , Miguel Cazorla

Large language models (LLMs) exhibit strong reasoning and conversational abilities, but ensuring reliable behavior in multi-turn interactions remains challenging. In many real-world applications, agents must succeed in one-shot settings…

计算与语言 · 计算机科学 2026-04-02 Shuli Jiang , Zhaoyang Zhang , Yi Zhang , Shuo Yang , Wei Xia , Stefano Soatto

Generative artificial intelligence (GAI), specifically large language models (LLMs), are increasingly used in software engineering, mainly for coding tasks. However, requirements engineering - particularly requirements validation - has seen…

软件工程 · 计算机科学 2026-02-10 Adam Trendowicz , Daniel Seifert , Andreas Jedlitschka , Marcus Ciolkowski , Anton Strahilov

Generative Artificial Intelligence (GAI) and the idea to use hierarchical models has been around for some years now. GAI has proved to be an extremely useful tool for Autonomous Vehicles (AVs). AVs need to perform robustly in their…

系统与控制 · 电气工程与系统科学 2025-01-22 Diomidis Katzourakis

Organizations are increasingly exploring delegation of screening and negotiation tasks to AI systems, yet deployment in high-stakes B2B settings is constrained by governance: preventing unauthorized commitments, ensuring sufficient…

人工智能 · 计算机科学 2025-11-11 Siming Zhao , Qi Li

The growing volume of academic papers has made it increasingly difficult for researchers to efficiently extract key information. While large language models (LLMs) based agents are capable of automating question answering (QA) workflows for…

计算与语言 · 计算机科学 2026-03-31 Tiancheng Huang , Ruisheng Cao , Yuxin Zhang , Zhangyi Kang , Zijian Wang , Chenrun Wang , Yijie Luo , Hang Zheng , Lirong Qian , Lu Chen , Kai Yu

Large Language Models are increasingly deployed as autonomous agents for complex real-world tasks, yet existing systems often focus on isolated improvements without a unifying design for robustness and adaptability. We propose a generalist…