English
Related papers

Related papers: EVA: Red-Teaming GUI Agents via Evolving Indirect …

200 papers

Online Reinforcement Learning (RL) offers a promising paradigm for enhancing GUI agents through direct environment interaction. However, its effectiveness is severely hindered by inefficient credit assignment in long-horizon tasks and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Han Xiao , Guozhi Wang , Hao Wang , Shilong Liu , Yuxiang Chai , Yue Pan , Yufeng Zhou , Xiaoxin Chen , Yafei Wen , Hongsheng Li

Large Language Models (LLMs), while powerful, are built and trained to process a single text input. In common applications, multiple inputs can be processed by concatenating them together into a single stream of text. However, the LLM is…

Cryptography and Security · Computer Science 2024-03-25 Keegan Hines , Gary Lopez , Matthew Hall , Federico Zarfati , Yonatan Zunger , Emre Kiciman

Textual prompt tuning has demonstrated significant performance improvements in adapting natural language processing models to a variety of downstream tasks by treating hand-engineered prompts as trainable parameters. Inspired by the success…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Jiachen Sun , Mark Ibrahim , Melissa Hall , Ivan Evtimov , Z. Morley Mao , Cristian Canton Ferrer , Caner Hazirbas

As LLMs are increasingly integrated into systems that browse, retrieve, summarize, and act on web content, webpages have become an untrusted input vector for downstream model behavior. This enables site owners, contributors, and adversaries…

Cryptography and Security · Computer Science 2026-05-01 Soheil Khodayari , Xuenan Zhang , Bhupendra Acharya , Giancarlo Pellegrino

The proliferation of agentic AI coding assistants, including Claude Code, GitHub Copilot, Cursor, and emerging skill-based architectures, has fundamentally transformed software development workflows. These systems leverage Large Language…

Cryptography and Security · Computer Science 2026-01-27 Narek Maloyan , Dmitry Namiot

Prompt injection is the most critical vulnerability in deployed AI agents. Despite recent progress, we show that the prevailing defense paradigm (data-instruction separation) both fails to detect attacks that operate through contextual…

Cryptography and Security · Computer Science 2026-05-19 Sahar Abdelnabi , Eugene Bagdasarian

Large Language Model (LLM) Agents are an emerging computing paradigm that blends generative machine learning with tools such as code interpreters, web browsing, email, and more generally, external resources. These agent-based systems…

Cryptography and Security · Computer Science 2024-10-23 Xiaohan Fu , Shuheng Li , Zihan Wang , Yihao Liu , Rajesh K. Gupta , Taylor Berg-Kirkpatrick , Earlence Fernandes

Visual explanation (attention)-guided learning uses not only labels but also explanations to guide model reasoning process. While visual attention-guided learning has shown promising results, it requires a large number of explanation…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Yifei Zhang , Siyi Gu , Bo Pan , Guangji Bai , Meikang Qiu , Xiaofeng Yang , Liang Zhao

Mixed-initiative visual analytics (VA) systems, where human and artificial intelligence (AI) agents collaborate as equal partners during analysis, represented a paradigm shift in human-computer interaction. With recent advances in AI, these…

Human-Computer Interaction · Computer Science 2025-12-30 Tobias Stähle , Matthijs Jansen op de Haar , Sophia Boyer , Rita Sevastjanova , Arpit Narechania , Mennatallah El-Assady

Autonomous web navigation agents, which translate natural language instructions into sequences of browser actions, are increasingly deployed for complex tasks across e-commerce, information retrieval, and content discovery. Due to the…

Cryptography and Security · Computer Science 2025-06-24 Atharv Singh Patlan , Ashwin Hebbar , Pramod Viswanath , Prateek Mittal

Autonomous agents powered by large vision and language models (VLM) have demonstrated significant potential in completing daily computer tasks, such as browsing the web to book travel and operating desktop software, which requires agents to…

Computation and Language · Computer Science 2025-05-27 Yanzhe Zhang , Tao Yu , Diyi Yang

The real-world deployment of Vision-Language-Action (VLA) models remains limited by the risk of unpredictable and irreversible physical harm. However, we currently lack effective mechanisms to proactively detect these physical safety risks…

Robotics · Computer Science 2026-04-27 Yuhao Zhang , Borong Zhang , Jiaming Fan , Jiachen Shen , Yishuai Cai , Yaodong Yang , Jiaming Ji

VLA architectures that pair a pretrained VLM with a flow-matching action expert have emerged as a strong paradigm for language-conditioned manipulation. Yet the VLM, optimized for semantic abstraction and typically conditioned on static…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Zezhou Zhang , Songxin Zhang , Xiao Xiong , Junjie Zhang , Zejian Xie , Jingyi Xi , Zunyao Mao , Zan Mao , Zhixin Mai , Zhuoyang Song , Jiaxing Zhang

The rapid integration of Generative AI (GenAI) into various applications necessitates robust risk management strategies which includes Red Teaming (RT) - an evaluation method for simulating adversarial attacks. Unfortunately, RT for GenAI…

Cryptography and Security · Computer Science 2025-05-01 Tam n. Nguyen

Activation probes are attractive monitors for AI systems due to low cost and latency, but their real-world robustness remains underexplored. We ask: What failure modes arise under realistic, black-box adversarial pressure, and how can we…

Machine Learning · Computer Science 2025-11-04 Phil Blandfort , Robert Graham

We present MUG, a novel interactive task for multimodal grounding where a user and an agent work collaboratively on an interface screen. Prior works modeled multimodal UI grounding in one round: the user gives a command and the agent…

Computation and Language · Computer Science 2022-10-03 Tao Li , Gang Li , Jingjie Zheng , Purple Wang , Yang Li

We present a novel perception model named Herd's Eye View (HEV) that adopts a global perspective derived from multiple agents to boost the decision-making capabilities of reinforcement learning (RL) agents in multi-agent environments,…

Multiagent Systems · Computer Science 2023-08-16 Andrew Nash , Andrew Vardy , David Churchill

LLM-based multi-agent systems (MAS) show promise on complex tasks but remain prone to coordination failures such as goal drift, error cascades, and misaligned behaviors. We propose Explicit Trait Inference (ETI), a psychologically grounded…

Artificial Intelligence · Computer Science 2026-04-23 Suhaib Abdurahman , Etsuko Ishii , Katerina Margatina , Divya Bhargavi , Monica Sunkara , Yi Zhang

The adoption of Vision-Language Models (VLMs) in embodied AI agents, while being effective, brings safety concerns such as jailbreaking. Prior work have explored the possibility of directly jailbreaking the embodied agents through…

Cryptography and Security · Computer Science 2025-11-21 Chunyang Li , Zifeng Kang , Junwei Zhang , Zhuo Ma , Anda Cheng , Xinghua Li , Jianfeng Ma

Web-based agents powered by large language models are increasingly used for tasks such as email management or professional networking. Their reliance on dynamic web content, however, makes them vulnerable to prompt injection attacks:…