中文
相关论文

相关论文: VeriSafe Agent: Safeguarding Mobile GUI Agent via …

200 篇论文

Visual analytics (VA) requires analysts to iteratively propose analysis tasks based on observations and execute tasks by creating visualizations and interactive exploration to gain insights. This process demands skills in programming, data…

人机交互 · 计算机科学 2025-06-24 Yuheng Zhao , Junjie Wang , Linbin Xiang , Xiaowen Zhang , Zifei Guo , Cagatay Turkay , Yu Zhang , Siming Chen

Automated planning is traditionally the domain of experts, utilized in fields like manufacturing and healthcare with the aid of expert planning tools. Recent advancements in LLMs have made planning more accessible to everyday users due to…

人机交互 · 计算机科学 2025-02-26 Christine Lee , David Porfirio , Xinyu Jessica Wang , Kevin Zhao , Bilge Mutlu

Software correctness is ensured mathematically through formal verification, which involves the resources of generating formal requirement specifications and having an implementation that must be verified. Tools such as model-checkers and…

软件工程 · 计算机科学 2025-08-29 Arshad Beg , Diarmuid O'Donoghue , Rosemary Monahan

Current safety alignment for Large Language Models (LLMs) implicitly optimizes for a "modal adult user," leaving models vulnerable to distributional shifts in user cognition. We present ChildSafe, a benchmark that quantifies alignment…

计算机与社会 · 计算机科学 2026-01-21 Abhejay Murali , Saleh Afroogh , Kevin Chen , David Atkinson , Amit Dhurandhar , Junfeng Jiao

Recent advances in Multimodal Large Language Models (MLLMs) have enabled the development of mobile agents that can understand visual inputs and follow user instructions, unlocking new possibilities for automating complex tasks on mobile…

机器人学 · 计算机科学 2025-07-24 Ning Li , Xiangmou Qu , Jiamu Zhou , Jun Wang , Muning Wen , Kounianhua Du , Xingyu Lou , Qiuying Peng , Jun Wang , Weinan Zhang

Automating a factory where robots are involved is neither trivial nor cheap. Engineering the factory automation process in such a way that return of interest is maximized and risk for workers and equipment is minimized, is hence of…

多智能体系统 · 计算机科学 2022-07-21 Andrea Gatti , Viviana Mascardi

The rapid advancement of Large Language Models (LLMs) has marked a significant breakthrough in Artificial Intelligence (AI), ushering in a new era of Human-centered Artificial Intelligence (HAI). HAI aims to better serve human welfare and…

机器人学 · 计算机科学 2025-10-29 Wenbin Ding , Jun Chen , Mingjia Chen , Fei Xie , Qi Mao , Philip Dames

The rapid adoption of mobile graphical user interface (GUI) agents, which autonomously control applications and operating systems (OS), exposes new system-level attack surfaces. Existing backdoors against web GUI agents and general GenAI…

密码学与安全 · 计算机科学 2026-03-25 Yutao Luo , Haotian Zhu , Shuchao Pang , Zhigang Lu , Tian Dong , Yongbin Zhou , Minhui Xue

Graphical User Interface (GUI) agents are autonomous systems that interpret and generate actions, enabling intelligent user assistance and automation. Effective training of these agent presents unique challenges, such as sparsity in…

计算与语言 · 计算机科学 2025-03-28 Yiqiao Jin , Stefano Petrangeli , Yu Shen , Gang Wu

Recent advances in AI agents capable of solving complex, everyday tasks, from scheduling to customer service, have enabled deployment in real-world settings, but their possibilities for unsafe behavior demands rigorous evaluation. While…

Recent advances in large language models and agentic frameworks have enabled virtual customer assistants (VCAs) for complex support. We present SecMate, a multi-agent VCA for cybersecurity troubleshooting that integrates device, user, and…

密码学与安全 · 计算机科学 2026-04-30 Yair Meidan , Omri Haller , Yulia Moshan , Shahaf David , Dudu Mimran , Yuval Elovici , Asaf Shabtai

Simulating high quality user behavior data has always been a fundamental problem in human-centered applications, where the major difficulty originates from the intricate mechanism of human decision process. Recently, substantial evidences…

Manual software beta testing is costly and time-consuming, while single-agent large language model (LLM) approaches suffer from hallucinations and inconsistent behavior. We propose a multi-agent committee framework in which diverse…

软件工程 · 计算机科学 2025-12-29 Sumanth Bharadwaj Hachalli Karanam , Dhiwahar Adhithya Kennady

In the current digital era, the rapid spread of misinformation on online platforms presents significant challenges to societal well-being, public trust, and democratic processes, influencing critical decision making and public opinion. To…

计算与语言 · 计算机科学 2024-05-06 Xinyi Li , Yongfeng Zhang , Edward C. Malthouse

Large Language Models (LLMs) are increasingly applied in healthcare, yet ensuring their ethical integrity and safety compliance remains a major barrier to clinical deployment. This work introduces a multi-agent refinement framework designed…

Computer-Use Agents (CUAs) are emerging as a new paradigm in human-computer interaction, enabling autonomous execution of tasks in desktop environment by perceiving high-level natural-language instructions. As such agents become…

人工智能 · 计算机科学 2026-03-13 Marta Sumyk , Oleksandr Kosovan

Graphical User Interface (GUI) agents offer cross-platform solutions for automating complex digital tasks, with significant potential to transform productivity workflows. However, their performance is often constrained by the scarcity of…

人工智能 · 计算机科学 2025-04-16 Junlei Zhang , Zichen Ding , Chang Ma , Zijie Chen , Qiushi Sun , Zhenzhong Lan , Junxian He

Recently, Multimodal Large Language Models (MLLMs) have been used as agents to control keyboard and mouse inputs by directly perceiving the Graphical User Interface (GUI) and generating corresponding commands. However, current agents…

Large language models (LLMs) show promise for healthcare question answering, but clinical use is limited by weak verification, insufficient evidence grounding, and unreliable confidence signalling. We propose a multi-agent medical QA…

计算与语言 · 计算机科学 2026-02-17 Naeimeh Nourmohammadi , Md Meem Hossain , The Anh Han , Safina Showkat Ara , Zia Ush Shamszaman

We introduce V-Agent, a novel multi-agent platform designed for advanced video search and interactive user-system conversations. By fine-tuning a vision-language model (VLM) with a small video preference dataset and enhancing it with a…

计算机视觉与模式识别 · 计算机科学 2026-01-08 SunYoung Park , Jong-Hyeon Lee , Youngjune Kim , Daegyu Sung , Younghyun Yu , Young-rok Cha , Jeongho Ju