English
Related papers

Related papers: Don't Click That: Teaching Web Agents to Resist De…

200 papers

Vision-Language-Action (VLA) models have achieved remarkable success in robotic manipulation. However, their robustness to linguistic nuances remains a critical, under-explored safety concern, posing a significant safety risk to real-world…

Robotics · Computer Science 2026-04-08 Baoshun Tong , Haoran He , Ling Pan , Yang Liu , Liang Lin

The rapid evolution of Large Language Models (LLMs) has transformed them from basic conversational tools into sophisticated entities capable of complex reasoning and decision-making. These advancements have led to the development of…

Networking and Internet Architecture · Computer Science 2025-06-13 Zahra Aminiranjbar , Jianan Tang , Qiudan Wang , Shubha Pant , Mahesh Viswanathan

We study adversarial robustness of open-source vision-language model (VLM) agents deployed in a self-contained e-commerce environment built to simulate realistic pre-deployment conditions. We evaluate two agents, LLaVA-v1.5-7B and…

Cryptography and Security · Computer Science 2026-03-24 Alejandro Paredes La Torre

Intelligent exploration remains a critical challenge in reinforcement learning (RL), especially in visual control tasks. Unlike low-dimensional state-based RL, visual RL must extract task-relevant structure from raw pixels, making…

Robotics · Computer Science 2026-03-10 Le Mao , Andrew H. Liu , Renos Zabounidis , Yanan Niu , Zachary Kingston , Joseph Campbell

The development of autonomous web agents, powered by Large Language Models (LLMs) and reinforcement learning (RL), represents a significant step towards general-purpose AI assistants. However, training these agents is severely hampered by…

Computation and Language · Computer Science 2026-04-21 Hang Ding , Peidong Liu , Junqiao Wang , Ziwei Ji , Meng Cao , Rongzhao Zhang , Lynn Ai , Eric Yang , Tianyu Shi , Lei Yu

Checks remain a foundational instrument in the financial ecosystem, facilitating substantial transaction volumes across institutions. However, their continued use also renders them a persistent target for fraud, underscoring the importance…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Sourav Halder , Jinjun Tong , Xinyu Wu

The rise of Large Language Model (LLM) agents, augmented with tool use, skills, and external knowledge, has introduced new security risks. Among them, prompt injection attacks, where adversaries embed malicious instructions into the agent…

Cryptography and Security · Computer Science 2026-05-06 Shihao Weng , Yang Feng , Jinrui Zhang , Xiaofei Xie , Jiongchi Yu , Jia Liu

Automatic deception detection is an important task that has gained momentum in computational linguistics due to its potential applications. In this paper, we propose a simple yet tough to beat multi-modal neural model for deception…

Computation and Language · Computer Science 2018-03-21 Gangeshwar Krishnamurthy , Navonil Majumder , Soujanya Poria , Erik Cambria

Phishing webpages are continuously polluting the Web. Plenty of countermeasures have been proposed and the most advanced techniques leverage machine-learning methods that infer whether a webpage is benign or not by inspecting its visual…

Cryptography and Security · Computer Science 2026-05-04 Ying Yuan , Cristiano Alex Rado , Giovanni Apruzzese , Mauro Conti , Luigi Vincenzo Mancini

Large Language Model (LLM) agents, which integrate planning, memory, reflection, and tool-use modules, have shown promise in solving complex, multi-step tasks. Yet their sophisticated architectures amplify vulnerability to cascading…

Vision-Language Models (VLMs) represent a significant breakthrough in artificial intelligence by integrating visual and textual modalities to achieve impressive zero-shot capabilities. However, VLMs are susceptible to catastrophic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Haoyuan Gao , Zicong Zhang , Yuqi Wei , Linglan Zhao , Guilin Li , Yexin Li , Bo Wang , Linghe Kong , Weiran Huang

Automated evidence-based misinformation detection systems, which evaluate the veracity of short claims against evidence, lack comprehensive analysis of their adversarial vulnerabilities. Existing black-box text-based adversarial attacks are…

Computation and Language · Computer Science 2025-05-06 Mazal Bethany , Nishant Vishwamitra , Cho-Yu Jason Chiang , Peyman Najafirad

Large language model (LLM) based web agents are increasingly deployed to automate complex online tasks by directly interacting with web sites and performing actions on users' behalf. While these agents offer powerful capabilities, their…

Cryptography and Security · Computer Science 2026-02-11 Georgios Syros , Evan Rose , Brian Grinstead , Christoph Kerschbaumer , William Robertson , Cristina Nita-Rotaru , Alina Oprea

Despite extensive alignment efforts, Large Vision-Language Models (LVLMs) remain vulnerable to jailbreak attacks. To mitigate these risks, existing detection methods are essential, yet they face two major challenges: generalization and…

Cryptography and Security · Computer Science 2026-01-28 Shuang Liang , Zhihao Xu , Jiaqi Weng , Jialing Tao , Hui Xue , Xiting Wang

GUI agents that control desktop computers via screenshot-and-click loops introduce a new class of vulnerability: the observation-to-action gap (mean 6.51 s on real OSWorld workloads) creates a Time-Of-Check, Time-Of-Use (TOCTOU) window…

Cryptography and Security · Computer Science 2026-04-22 Wenpeng Xu

Evaluating GUI agents presents a distinct challenge: trajectories are long, visually grounded, and open-ended, yet evaluation must be both accurate and interpretable. Existing approaches typically apply a single holistic judgment over the…

Artificial Intelligence · Computer Science 2026-04-07 Yuwen Zhai , Runze Li , Liang Wang , Nian Shi , Liwu Xu , Wei Zhang , Ran Lin , Bo Xu , Benlei Cui

Reinforcement learning (RL) agents improve through trial-and-error, but when reward is sparse and the agent cannot discover successful action sequences, learning stagnates. This has been a notable problem in training deep RL agents to…

Artificial Intelligence · Computer Science 2018-02-27 Evan Zheran Liu , Kelvin Guu , Panupong Pasupat , Tianlin Shi , Percy Liang

Detecting deception in an increasingly digital world is both a critical and challenging task. In this study, we present a comprehensive evaluation of the automated deception detection capabilities of Large Language Models (LLMs) and Large…

Computation and Language · Computer Science 2025-06-12 Md Messal Monem Miah , Adrita Anika , Xi Shi , Ruihong Huang

We present an optimised multi-modal dialogue agent for interactive learning of visually grounded word meanings from a human tutor, trained on real human-human tutoring data. Within a life-long interactive learning period, the agent, trained…

Computation and Language · Computer Science 2017-10-02 Yanchao Yu , Arash Eshghi , Oliver Lemon

The pursuit of real-time agentic interaction has driven interest in Diffusion-based Large Language Models (dLLMs) as alternatives to auto-regressive backbones, promising to break the sequential latency bottleneck. However, does such…

Computation and Language · Computer Science 2026-04-27 Qingyu Lu , Liang Ding , Kanjian Zhang , Jinxia Zhang , Dacheng Tao
‹ Prev 1 4 5 6 7 8 10 Next ›