中文
相关论文

相关论文: Digital Red Queen: Adversarial Program Evolution i…

200 篇论文

Large language models (LLMs) remain vulnerable to adversarial prompting despite advances in alignment and safety, often exhibiting harmful behaviors under novel attack strategies. While adversarial training can improve robustness, existing…

机器学习 · 计算机科学 2026-05-08 Yiwei Zhang , Jeremiah Birrell , Reza Ebrahimi , Rouzbeh Behnia , Jason Pacheco , Elisa Bertino

As large language model (LLM) agents increasingly automate complex web tasks, they boost productivity while simultaneously introducing new security risks. However, relevant studies on web agent attacks remain limited. Existing red-teaming…

人工智能 · 计算机科学 2026-04-02 Zheng Zhang , Jiarui He , Yuchen Cai , Deheng Ye , Peilin Zhao , Ruili Feng , Hao Wang

Large Language Models (LLMs) are powerful tools with profound societal impacts, yet their ability to generate responses to diverse and uncontrolled inputs leaves them vulnerable to adversarial attacks. While existing defenses often struggle…

计算与语言 · 计算机科学 2025-12-30 Samuel Simko , Mrinmaya Sachan , Bernhard Schölkopf , Zhijing Jin

Multimodal Large Language Model (MLLM) agents facilitate Graphical User Interface (GUI) automation but struggle with long-horizon, cross-application tasks due to limited context windows. While memory systems provide a viable solution,…

The security of Deep Reinforcement Learning (Deep RL) algorithms deployed in real life applications are of a primary concern. In particular, the robustness of RL agents in cyber-physical systems against adversarial attacks are especially…

机器学习 · 计算机科学 2019-07-01 Xian Yeow Lee , Aaron Havens , Girish Chowdhary , Soumik Sarkar

The quantum cloud computing paradigm presents unique challenges in task placement due to the dynamic and heterogeneous nature of quantum computation resources. Traditional heuristic approaches fall short in adapting to the rapidly evolving…

分布式、并行与集群计算 · 计算机科学 2024-07-04 Hoa T. Nguyen , Muhammad Usman , Rajkumar Buyya

Reinforcement Learning (RL) has traditionally focused on training specialized agents to optimize predefined reward functions within narrowly defined environments. However, the advent of powerful Large Language Models (LLMs) and increasingly…

人工智能 · 计算机科学 2026-05-18 Fangming Cui , Ruixiao Zhu , Cheng Fang , Sunan Li , Jiahong Li

The growing complexity of cyber attacks has necessitated the evolution of firewall technologies from static models to adaptive, machine learning-driven systems. This research introduces "Dynamically Retrainable Firewalls", which respond to…

密码学与安全 · 计算机科学 2025-01-17 Sina Ahmadi

As artificial intelligence (AI) assistants become more widely adopted in safety-critical domains, it becomes important to develop safeguards against potential failures or adversarial attacks. A key prerequisite to developing these…

人机交互 · 计算机科学 2025-04-04 Abed Kareem Musaffar , Anand Gokhale , Sirui Zeng , Rasta Tadayon , Xifeng Yan , Ambuj Singh , Francesco Bullo

Adversarial testing of large language models (LLMs) is crucial for their safe and responsible deployment. We introduce a novel approach for automated generation of adversarial evaluation datasets to test the safety of LLM generations on new…

软件工程 · 计算机科学 2023-12-01 Bhaktipriya Radharapu , Kevin Robinson , Lora Aroyo , Preethi Lahoti

Large language models (LLMs) have been increasingly applied to tasks in language understanding and interactive decision-making, with their impressive performance largely attributed to the extensive domain knowledge embedded within them.…

人工智能 · 计算机科学 2024-10-16 Zhiyuan Sun , Haochen Shi , Marc-Alexandre Côté , Glen Berseth , Xingdi Yuan , Bang Liu

The increasing device heterogeneity and decentralization requirements in the computing continuum (i.e., spanning edge, fog, and cloud) introduce new challenges in resource orchestration. In such environments, agents are often responsible…

分布式、并行与集群计算 · 计算机科学 2026-04-23 Vlad Popescu-Vifor , Ilir Murturi , Praveen Kumar Donta , Schahram Dustdar

In reinforcement learning, it is often difficult to automate high-dimensional, rapid decision-making in dynamic environments, especially when domains require real-time online interaction and adaptive strategies such as web-based games. This…

机器学习 · 计算机科学 2024-05-30 Prabhath Reddy Gujavarthy

Large Language Models (LLMs) are increasingly acting as autonomous agents, but their continuous interaction with the environment can lead to in-context reward hacking (ICRH), a phenomenon where LLMs iteratively optimize their behavior to…

计算与语言 · 计算机科学 2026-05-28 Jiayong Wan , Jiawei Chen , Zhaoxia Yin , Liu Shuyuan , Hang Su

Large Language Models (LLMs) have revolutionized natural language processing, but their robustness against adversarial attacks remains a critical concern. We presents a novel white-box style attack approach that exposes vulnerabilities in…

计算与语言 · 计算机科学 2024-09-16 Zeyu Yang , Zhao Meng , Xiaochen Zheng , Roger Wattenhofer

Large Language Models (LLMs) enable a new form of digital experimentation where treatments combine human and model-generated content in increasingly sophisticated ways. The main methodological challenge in this setting is representing these…

统计方法学 · 统计学 2025-10-27 Lei Shi , David Arbour , Raghavendra Addanki , Ritwik Sinha , Avi Feller

In this paper, we explore the potential of Large Language Models (LLMs) to reason about threats, generate information about tools, and automate cyber campaigns. We begin with a manual exploration of LLMs in supporting specific…

密码学与安全 · 计算机科学 2023-10-12 Stephen Moskal , Sam Laney , Erik Hemberg , Una-May O'Reilly

As autonomous agents become more prevalent, understanding their collective behaviour in strategic interactions is crucial. This study investigates the emergent cooperative tendencies of systems of Large Language Model (LLM) agents in a…

多智能体系统 · 计算机科学 2025-01-28 Richard Willis , Yali Du , Joel Z Leibo , Michael Luck

Large language models (LLMs) excel at complex reasoning tasks such as mathematics and coding, yet they frequently struggle with simple interactive tasks that young children perform effortlessly. This discrepancy highlights a critical gap…

人工智能 · 计算机科学 2025-09-01 Yi Liao , Yu Gu , Yuan Sui , Zining Zhu , Yifan Lu , Guohua Tang , Zhongqian Sun , Wei Yang

Large language models (LLMs) demonstrate strong reasoning abilities across mathematical, strategic, and linguistic tasks, yet little is known about how well they reason in dynamic, real-time, multi-agent scenarios, such as collaborative…

多智能体系统 · 计算机科学 2026-01-01 Shaurya Mallampati , Rashed Shelim , Walid Saad , Naren Ramakrishnan