English
Related papers

Related papers: Blind Gods and Broken Screens: Architecting a Secu…

200 papers

Mobile Graphical User Interface (GUI) agents have demonstrated strong capabilities in automating complex smartphone tasks by leveraging multimodal large language models (MLLMs) and system-level control interfaces. However, this paradigm…

Cryptography and Security · Computer Science 2026-04-28 Lepeng Zhao , Zhenhua Zou , Shuo Li , Zhuotao Liu

Next-generation (NextG) cellular networks are expected to manage dynamic traffic while sustaining high performance. Large language models (LLMs) provide strategic reasoning for 6G planning, but their computational cost and latency limit…

Networking and Internet Architecture · Computer Science 2025-11-25 Narjes Nourzad , Mingyu Zong , Bhaskar Krishnamachari

Large language model (LLM) agents have demonstrated remarkable capabilities in complex reasoning and decision-making by leveraging external tools. However, this tool-centric paradigm introduces a previously underexplored attack surface,…

Artificial Intelligence · Computer Science 2026-01-08 Kanghua Mo , Li Hu , Yucheng Long , Zhihao Li

Autonomous browsing agents powered by large language models (LLMs) are increasingly used to automate web-based tasks. However, their reliance on dynamic content, tool execution, and user-provided data exposes them to a broad attack surface.…

Cryptography and Security · Computer Science 2025-05-20 Mykyta Mudryi , Markiyan Chaklosh , Grzegorz Wójcik

Recent advances in Vision-Language Models (VLMs) have enabled mobile agents to perceive and interact with real-world mobile environments based on human instructions. However, the current fully autonomous paradigm poses potential safety…

Artificial Intelligence · Computer Science 2026-04-28 Qihang Ai , Pi Bu , Yue Cao , Yingyao Wang , Jihao Gu , Jingxuan Xing , Zekun Zhu , Wei Jiang , Zhicheng Zheng , Jun Song , Yuning Jiang

Large language models (LLMs) deployed as agents introduce significant safety risks in clinical settings due to their potential for error and single points of failure. We introduce Tiered Agentic Oversight (TAO), a hierarchical multi-agent…

With the rapid proliferation of large language models and vision-language models, AI agents have evolved from isolated, task-specific systems into autonomous, interactive entities capable of perceiving, reasoning, and acting without human…

Multiagent Systems · Computer Science 2025-10-20 Yuntao Wang , Shaolong Guo , Yanghe Pan , Zhou Su , Fahao Chen , Tom H. Luan , Peng Li , Jiawen Kang , Dusit Niyato

Large language model (LLM)-based mobile agents are increasingly popular due to their capability to interact directly with mobile phone Graphic User Interfaces (GUIs) and their potential to autonomously manage daily tasks. Despite their…

Artificial Intelligence · Computer Science 2024-06-13 Luyuan Wang , Yongyu Deng , Yiwei Zha , Guodong Mao , Qinmin Wang , Tianchen Min , Wei Chen , Shoufa Chen

Multimodal large language models (MLLMs) are transforming the capabilities of graphical user interface (GUI) agents, facilitating their transition from controlled simulations to complex, real-world applications across various platforms.…

Artificial Intelligence · Computer Science 2025-06-18 Boyu Gou , Ruohan Wang , Boyuan Zheng , Yanan Xie , Cheng Chang , Yiheng Shu , Huan Sun , Yu Su

The massive successes of large language models (LLMs) encourage the emerging exploration of LLM-augmented Autonomous Agents (LAAs). An LAA is able to generate actions with its core LLM and interact with environments, which facilitates the…

With the advancement of multimodal large language models (MLLMs), building GUI agent systems has become an increasingly promising direction--especially for mobile platforms, given their rich app ecosystems and intuitive touch interactions.…

Artificial Intelligence · Computer Science 2026-02-10 Yangqin Jiang , Chao Huang

Large Language Model-based Multi-Agent Systems (LLM-MAS) have revolutionized complex problem-solving capability by enabling sophisticated agent collaboration through message-based communications. While the communication framework is crucial…

Cryptography and Security · Computer Science 2025-06-03 Pengfei He , Yupin Lin , Shen Dong , Han Xu , Yue Xing , Hui Liu

Autonomous Large Language Model (LLM) agents, exemplified by OpenClaw, demonstrate remarkable capabilities in executing complex, long-horizon tasks. However, their tightly coupled instant-messaging interaction paradigm and high-privilege…

Recent advancements in Large Language Models (LLMs) have led to a rapid growth of agentic systems capable of handling a wide range of complex tasks. However, current research largely relies on manual, task-specific design, limiting their…

Computation and Language · Computer Science 2025-02-28 Yu Shang , Yu Li , Keyu Zhao , Likai Ma , Jiahe Liu , Fengli Xu , Yong Li

Automated GUI testing is crucial for ensuring the quality and reliability of Android apps. However, the efficacy of existing UI testing techniques is often limited, especially in terms of coverage. Recent studies, including the…

Software Engineering · Computer Science 2026-01-30 Wei Minn , Biniam Fisseha Demissie , Yan Naing Tun , Jiakun Liu , Mariano Ceccato , Lwin Khin Shar , David Lo

Large Language Models are being increasingly deployed as the decision-making core of autonomous agents capable of effecting change in external environments. Yet, in conversational benchmarks, which simulate real-world customer-centric issue…

Computation and Language · Computer Science 2026-04-29 Amir Saeidi , Venkatesh Mishra , Souradeep Mukhopadhyay , Gaowen Liu , Ali Payani , Jayanth Srinivasa , Chitta Baral

The rapid emergence of open-source, locally hosted intelligent agents marks a critical inflection point in human-computer interaction. Systems such as OpenClaw demonstrate that Large Language Model (LLM)-based agents can autonomously…

Artificial Intelligence · Computer Science 2026-03-13 Rui Liu , Tao Zhe , Dongjie Wang , Zijun Yao , Kunpeng Liu , Yanjie Fu , Huan Liu , Jian Pei

The growing dependence on mobile phones and their apps has made multi-user interactive features, like chat calls, live streaming, and video conferencing, indispensable for bridging the gaps in social connectivity caused by physical and…

Software Engineering · Computer Science 2025-09-17 Sidong Feng , Changhao Du , Huaxiao Liu , Qingnan Wang , Zhengwei Lv , Mengfei Wang , Chunyang Chen

Autonomous GUI agents face two fundamental challenges: early stopping, where agents prematurely declare success without verifiable evidence, and repetitive loops, where agents cycle through the same failing actions without recovery. We…

Computation and Language · Computer Science 2026-04-27 Qijun Han , Haoqin Tu , Zijun Wang , Haoyue Dai , Yiyang Zhou , Nancy Lau , Alvaro A. Cardenas , Yuhui Xu , Ran Xu , Caiming Xiong , Zeyu Zheng , Huaxiu Yao , Yuyin Zhou , Cihang Xie

The safe deployment of autonomous systems in safety-critical settings requires a paradigm that combines human expertise with AI-driven analysis, especially when anomalies are unforeseen. We introduce AURA (Autonomous Resilience Agent), a…

Robotics · Computer Science 2025-11-06 Markus Buchholz , Ignacio Carlucho , Yvan R. Petillot