English
Related papers

Related papers: AgentRAE: Remote Action Execution through Notifica…

200 papers

The widespread adoption of deep learning across various industries has introduced substantial challenges, particularly in terms of model explainability and security. The inherent complexity of deep learning models, while contributing to…

Cryptography and Security · Computer Science 2025-01-08 Kealan Dunnett , Reza Arablouei , Dimity Miller , Volkan Dedeoglu , Raja Jurdak

GUI agents that control desktop computers via screenshot-and-click loops introduce a new class of vulnerability: the observation-to-action gap (mean 6.51 s on real OSWorld workloads) creates a Time-Of-Check, Time-Of-Use (TOCTOU) window…

Cryptography and Security · Computer Science 2026-04-22 Wenpeng Xu

The importance of mobile application (app) quality insurance is increasing with the rapid development of the mobile Internet. Automated test generation approaches, as a dominant direction of app quality insurance, follow specific models or…

Software Engineering · Computer Science 2024-06-13 Shengcheng Yu , Chunrong Fang , Mingzhe Du , Zimin Ding , Zhenyu Chen , Zhendong Su

This paper presents MagicGUI, a foundational mobile GUI agent designed to address critical challenges in perception, grounding, and reasoning within real-world mobile GUI environments. The framework is underpinned by following six key…

In this paper we argue that a jailbroken GenAI model can cause substantial harm to GenAI-powered applications and facilitate PromptWare, a new type of attack that flips the GenAI model's behavior from serving an application to attacking it.…

Cryptography and Security · Computer Science 2024-08-12 Stav Cohen , Ron Bitton , Ben Nassi

World models are increasingly pivotal in interpreting and simulating the rules and actions of complex environments. Genie, a recent model, excels at learning from visually diverse environments but relies on costly human-collected data. We…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Naser Kazemi , Nedko Savov , Danda Paudel , Luc Van Gool

As AI agents automate critical workloads, they remain vulnerable to indirect prompt injection (IPI) attacks. Current defenses rely on monitoring protocols that jointly evaluate an agent's Chain-of-Thought (CoT) and tool-use actions to…

Cryptography and Security · Computer Science 2026-02-26 Jafar Isbarov , Murat Kantarcioglu

Mobile graphical user interface (GUI) agents enable AI models to autonomously operate smartphones on behalf of users. However, most existing systems focus primarily on optimizing task accuracy and rely on cloud-hosted models for inference,…

Artificial Intelligence · Computer Science 2026-05-27 Runxi Huang , Liyu Zhang , Shengzhong Liu , Xiaomin Ouyang

Vision-Language-Action (VLA) models have become foundational to modern embodied AI systems. By integrating visual perception, language understanding, and action planning, they enable general-purpose task execution across diverse…

Robotics · Computer Science 2026-02-03 Jianyi Zhou , Yujie Wei , Ruichen Zhen , Bo Zhao , Xiaobo Xia , Rui Shao , Xiu Su , Shuo Yang

Deep learning-based lane detection (LD) plays a critical role in autonomous driving systems, such as adaptive cruise control. However, it is vulnerable to backdoor attacks. Existing backdoor attack methods on LD exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Xinwei Zhang , Aishan Liu , Tianyuan Zhang , Siyuan Liang , Xianglong Liu

Retrieval-augmented generation (RAG) enhances factual grounding by integrating retrieval mechanisms with generative models but introduces new attack surfaces, particularly through backdoor attacks. While prior research has largely focused…

Information Retrieval · Computer Science 2025-09-29 Gaurav Bagwe , Saket S. Chaturvedi , Xiaolong Ma , Xiaoyong Yuan , Kuang-Ching Wang , Lan Zhang

As artificial intelligence becomes more prevalent in our lives, people are enjoying the convenience it brings, but they are also facing hidden threats, such as data poisoning and adversarial attacks. These threats can have disastrous…

Cryptography and Security · Computer Science 2025-02-21 Yong Li , Han Gao

Large-scale, high-quality interaction trajectories are essential for advancing mobile Graphical User Interface (GUI) agents. While existing methods typically rely on labor-intensive human demonstrations or automated model exploration to…

Artificial Intelligence · Computer Science 2026-02-02 Linjia Kang , Zhimin Wang , Yongkang Zhang , Duo Wu , Jinghe Wang , Ming Ma , Haopeng Yan , Zhi Wang

AI agents such as OpenClaw are increasingly deployed in local workflows with access to external tools. This creates indirect prompt-injection (IPI) risk: an agent may execute harmful instructions embedded in untrusted inputs such as email,…

Cryptography and Security · Computer Science 2026-05-26 Lei Zhao , Abhay Bhaskar , Edgar Dobriban

Machine learning systems are vulnerable to backdoor attacks, where attackers manipulate model behavior through data tampering or architectural modifications. Traditional backdoor attacks involve injecting malicious samples with specific…

Cryptography and Security · Computer Science 2025-09-24 Yuan Ma , Jiankang Wei , Yilun Lyu , Kehao Chen , Jingtong Huang

Recent advancements in Graphical User Interface (GUI) agents have predominantly focused on training paradigms like supervised fine-tuning (SFT) and reinforcement learning (RL). However, the challenge of high-dynamic GUI environments remains…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Enqi Liu , Liyuan Pan , Zhi Gao , Yan Yang , Chenrui Shi , Yang Liu , Jingrong Wu , Qing Li

Neural backdoors represent insidious cybersecurity loopholes that render learning machinery vulnerable to unauthorised manipulations, potentially enabling the weaponisation of artificial intelligence with catastrophic consequences. A…

Cryptography and Security · Computer Science 2026-05-01 Ching-Chun Chang , Kai Gao , Shuying Xu , Anastasia Kordoni , Christopher Leckie , Isao Echizen

Contemporary GUI agents, while increasingly capable due to advances in Large Vision-Language Models (VLMs), often operate with a critical limitation: they treat each task in isolation, lacking a mechanism to systematically learn from past…

Artificial Intelligence · Computer Science 2026-04-13 Runze Li , Yuwen Zhai , Bo Xu , LiWu Xu , Nian Shi , Wei Zhang , Ran Lin , Liang Wang

The rapid development of AI agent systems is leading to an emerging Internet of Agents, where specialized agents operate across local devices, edge nodes, private services, and cloud platforms. Although recent efforts have improved agent…

Artificial Intelligence · Computer Science 2026-04-09 Yujun Cheng , Enfang Cui , Hao Qin , Zhiyuan Liang , Qi Xu

Smartphones have become indispensable in people's daily lives, permeating nearly every aspect of modern society. With the continuous advancement of large language models (LLMs), numerous LLM-based mobile agents have emerged. These agents…

Computation and Language · Computer Science 2025-09-05 Gowen Loo , Chang Liu , Qinghong Yin , Xiang Chen , Jiawei Chen , Jingyuan Zhang , Yu Tian