中文
相关论文

相关论文: In-Context Defense in Computer Agents: An Empirica…

200 篇论文

Solving complex or long-horizon problems often requires large language models (LLMs) to use external tools and operate over a significantly longer context window. New LLMs enable longer context windows and support tool calling capabilities.…

机器学习 · 计算机科学 2025-12-03 Tsimur Hadeliya , Mohammad Ali Jauhar , Nidhi Sakpal , Diogo Cruz

Multi-agent systems built on Large Language Models (LLMs) show exceptional promise for complex collaborative problem-solving, yet they face fundamental challenges stemming from context window limitations that impair memory consistency, role…

人工智能 · 计算机科学 2026-01-13 Sizhe Yuen , Francisco Gomez Medina , Ting Su , Yali Du , Adam J. Sobey

Large Language Models (LLMs) have gained widespread popularity across diverse domains involving text generation, summarization, and various natural language processing tasks. Despite their inherent limitations, LLM-based designs have shown…

密码学与安全 · 计算机科学 2024-04-17 Maria Rigaki , Ondřej Lukáš , Carlos A. Catania , Sebastian Garcia

Textual adversarial attacks expose the vulnerabilities of text classifiers and can be used to improve their robustness. Existing context-aware methods solely consider the gold label probability and use the greedy search when searching an…

计算与语言 · 计算机科学 2022-08-18 Huijun Liu , Jie Yu , Shasha Li , Jun Ma , Bin Ji

Large language models (LLMs) have advanced in large strides due to the effectiveness of the self-attention mechanism that processes and compares all tokens at once. However, this mechanism comes with a fundamental issue -- the predetermined…

计算与语言 · 计算机科学 2023-10-10 Howard Chen , Ramakanth Pasunuru , Jason Weston , Asli Celikyilmaz

Large language models (LLMs) have recently shown strong potential in vulnerability detection (VD). However, accurately detecting vulnerabilities in real-world repositories requires reasoning over complex contextual interactions. Existing…

密码学与安全 · 计算机科学 2026-05-28 Youpeng Li , Fuxun Yu , Weiliang Qi , Xinda Wang

Large language models (LLMs) have become phenomenally surging, since 2018--two decades after introducing context-awareness into computing systems. Through taking into account the situations of ubiquitous devices, users and the societies,…

计算与语言 · 计算机科学 2023-12-27 Haoyi Xiong , Jiang Bian , Sijia Yang , Xiaofei Zhang , Linghe Kong , Daqing Zhang

Large language models (LLMs) are popular for high-quality text generation but can produce harmful content, even when aligned with human values through reinforcement learning. Adversarial prompts can bypass their safety measures. We propose…

计算与语言 · 计算机科学 2024-05-03 Mansi Phute , Alec Helbling , Matthew Hull , ShengYun Peng , Sebastian Szyller , Cory Cornelius , Duen Horng Chau

In-context learning (ICL) has emerged as a powerful paradigm leveraging LLMs for specific downstream tasks by utilizing labeled examples as demonstrations (demos) in the preconditioned prompts. Despite its promising performance, crafted…

机器学习 · 计算机科学 2025-05-30 Xiangyu Zhou , Yao Qiang , Saleh Zare Zade , Prashant Khanduri , Dongxiao Zhu

Text-to-image diffusion models have been widely adopted in real-world applications due to their ability to generate realistic images from textual descriptions. However, recent studies have shown that these methods are vulnerable to backdoor…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Oscar Chew , Po-Yi Lu , Jayden Lin , Hsuan-Tien Lin

While Large Language Models (LLMs) exhibit remarkable capabilities, they also introduce significant safety and privacy risks. Current mitigation strategies often fail to preserve contextual reasoning capabilities in risky scenarios.…

计算与语言 · 计算机科学 2025-09-05 Wenbin Hu , Haoran Li , Huihao Jing , Qi Hu , Ziqian Zeng , Sirui Han , Heli Xu , Tianshu Chu , Peizhao Hu , Yangqiu Song

LLM-based Software Engineering agents face a critical bottleneck: context length limitations cause failures on complex, long-horizon tasks. One promising solution is to encode context as continuous embeddings rather than discrete tokens,…

软件工程 · 计算机科学 2026-05-13 Kirill Gelvan , Igor Slinko , Felix Steinbauer , Egor Bogomolov , Florian Kofler , Yaroslav Zharov

Large Language Model (LLM) agents struggle with long-horizon software engineering tasks due to "Context Bloat." As interaction history grows, computational costs explode, latency increases, and reasoning capabilities degrade due to…

人工智能 · 计算机科学 2026-01-13 Nikhil Verma

Large Language Model (LLM) agents use memory to learn from past interactions, enabling autonomous planning and decision-making in complex environments. However, this reliance on memory introduces a critical security risk: an adversary can…

密码学与安全 · 计算机科学 2025-10-06 Qianshan Wei , Tengchao Yang , Yaochen Wang , Xinfeng Li , Lijun Li , Zhenfei Yin , Yi Zhan , Thorsten Holz , Zhiqiang Lin , XiaoFeng Wang

Large Language Model (LLM) applications are vulnerable to prompt injection and context manipulation attacks that traditional security models cannot prevent. We introduce two novel primitives--authenticated prompts and authenticated…

密码学与安全 · 计算机科学 2026-02-12 Mohan Rajagopalan , Vinay Rao

Vision-Language Models (VLMs) empower embodied agents to execute complex instructions, yet they remain vulnerable to contextual safety risks where benign commands become hazardous due to subtle environmental states. Existing safeguards…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Xiaoya Lu , Yijin Zhou , Zeren Chen , Ruocheng Wang , Bingrui Sima , Enshen Zhou , Lu Sheng , Dongrui Liu , Jing Shao

Text-based reinforcement learning involves an agent interacting with a fictional environment using observed text and admissible actions in natural language to complete a task. Previous works have shown that agents can succeed in text-based…

计算与语言 · 计算机科学 2024-04-17 Mauricio Gruppi , Soham Dan , Keerthiram Murugesan , Subhajit Chaudhury

Reinforcement learning (RL) with outcome-based rewards has achieved significant success in training large language model (LLM) agents for complex reasoning tasks. However, in active reasoning where agents need to strategically ask questions…

人工智能 · 计算机科学 2026-03-13 Deyu Zou , Yongqiang Chen , Fan Feng , Mufei Li , Pan Li , Yu Gong , James Cheng

Defenses against security threats have been an interest of recent studies. Recent works have shown that it is not difficult to attack a natural language processing (NLP) model while defending against them is still a cat-mouse game. Backdoor…

密码学与安全 · 计算机科学 2022-05-31 Sangeet Sagar , Abhinav Bhatt , Abhijith Srinivas Bidaralli

Recent advancements in large language models (LLMs) have revolutionized code intelligence by improving programming productivity and alleviating challenges faced by software developers. To further improve the performance of LLMs on specific…

密码学与安全 · 计算机科学 2024-10-07 Yifei Ge , Weisong Sun , Yihang Lou , Chunrong Fang , Yiran Zhang , Yiming Li , Xiaofang Zhang , Yang Liu , Zhihong Zhao , Zhenyu Chen