English
Related papers

Related papers: Abstractive Red-Teaming of Language Model Characte…

200 papers

Red-teaming, or identifying prompts that elicit harmful responses, is a critical step in ensuring the safe and responsible deployment of large language models (LLMs). Developing effective protection against many modes of attack prompts…

Computation and Language · Computer Science 2025-03-03 Seanie Lee , Minsu Kim , Lynn Cherif , David Dobre , Juho Lee , Sung Ju Hwang , Kenji Kawaguchi , Gauthier Gidel , Yoshua Bengio , Nikolay Malkin , Moksh Jain

Automatic search for Multi-Agent Systems has recently emerged as a key focus in agentic AI research. Several prior approaches have relied on LLM-based free-form search over the code space. In this work, we propose a more structured…

Users of Augmentative and Alternative Communication (AAC) may write letter-by-letter via an interface that uses a character language model. However, most state-of-the-art large pretrained language models predict subword tokens of variable…

Computation and Language · Computer Science 2025-10-03 Dylan Gaines , Keith Vertanen

Agentic language-model systems increasingly rely on mutable execution contexts, including files, memory, tools, skills, and auxiliary artifacts, creating security risks beyond explicit user prompts. This paper presents DeepTrap, an…

Cryptography and Security · Computer Science 2026-05-13 Hongwei Yao , Yiming Liu , Yiling He , Bingrun Yang

Strategic interaction in adversarial domains such as law, diplomacy, and negotiation is mediated by language, yet most game-theoretic models abstract away the mechanisms of persuasion that operate through discourse. We present the Strategic…

Multiagent Systems · Computer Science 2026-05-27 Philipp D. Siedler

Large Reasoning Models (LRMs) have emerged as a powerful advancement in multi-step reasoning tasks, offering enhanced transparency and logical consistency through explicit chains of thought (CoT). However, these models introduce novel…

Cryptography and Security · Computer Science 2026-04-15 Jiawei Chen , Yang Yang , Chao Yu , Yu Tian , Zhi Cao , Xue Yang , Linghao Li , Hang Su , Zhaoxia Yin

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts; however, their behavior is…

Machine Learning · Computer Science 2023-12-01 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

Pretrained large language models (LLMs) are becoming increasingly powerful and ubiquitous in mainstream applications such as being a personal assistant, a dialogue model, etc. As these models become proficient in deducing user preferences…

Computation and Language · Computer Science 2023-02-22 Varshini Subhash

Large language models (LLMs) have exploded in popularity in the past few years and have achieved undeniably impressive results on benchmarks as varied as question answering and text summarization. We provide a simple new prompting strategy…

Computation and Language · Computer Science 2022-12-14 Joshua Albrecht , Ellie Kitanidis , Abraham J. Fetterman

As Large Language Models (LLMs) are increasingly integrated into automated decision-making pipelines, specifically within Human Resources (HR), the security implications of Indirect Prompt Injection (IPI) become critical. While a prevailing…

Cryptography and Security · Computer Science 2026-02-24 Manuel Wirth

Designing effective auxiliary rewards for cooperative multi-agent systems remains challenging, as misaligned incentives can induce suboptimal coordination, particularly when sparse task rewards provide insufficient grounding for coordinated…

Machine Learning · Computer Science 2026-04-07 Dogan Urgun , Gokhan Gungor

People are relying on AI agents to assist them with various tasks. The human must know when to rely on the agent, collaborate with the agent, or ignore its suggestions. In this work, we propose to learn rules, grounded in data regions and…

Machine Learning · Computer Science 2023-11-09 Hussein Mozannar , Jimin J Lee , Dennis Wei , Prasanna Sattigeri , Subhro Das , David Sontag

Language Model (LM) agents are increasingly used in complex open-ended decision-making tasks, from AI coding to physical AI. A core requirement in these settings is the ability to both explore the problem space and exploit acquired…

Artificial Intelligence · Computer Science 2026-04-16 Jaden Park , Jungtaek Kim , Jongwon Jeong , Robert D. Nowak , Kangwook Lee , Yong Jae Lee

Natural and formal languages provide an effective mechanism for humans to specify instructions and reward functions. We investigate how to generate policies via RL when reward functions are specified in a symbolic language captured by…

Machine Learning · Computer Science 2022-11-24 Andrew C. Li , Zizhao Chen , Pashootan Vaezipoor , Toryn Q. Klassen , Rodrigo Toro Icarte , Sheila A. McIlraith

As Large Language Models (LLMs) are integrated into critical real-world applications, their strategic and logical reasoning abilities are increasingly crucial. This paper evaluates LLMs' reasoning abilities in competitive environments…

Computation and Language · Computer Science 2024-06-11 Jinhao Duan , Renming Zhang , James Diffenderfer , Bhavya Kailkhura , Lichao Sun , Elias Stengel-Eskin , Mohit Bansal , Tianlong Chen , Kaidi Xu

Generative language models (LMs) are increasingly used for document class-prediction tasks and promise enormous improvements in cost and efficiency. Existing research often examines simple classification tasks, but the capability of LMs to…

Computation and Language · Computer Science 2023-10-31 Rosamond Thalken , Edward H. Stiglitz , David Mimno , Matthew Wilkens

Effective communication is essential in collaborative tasks, so AI-equipped robots working alongside humans need to be able to explain their behaviour in order to cooperate effectively and earn trust. We analyse and classify communications…

Human-Computer Interaction · Computer Science 2024-11-20 Marc Roig Vilamala , Jack Furby , Julian de Gortari Briseno , Mani Srivastava , Alun Preece , Carolina Fuentes Toro

Qualitative coding, or content analysis, extracts meaning from text to discern quantitative patterns across a corpus of texts. Recently, advances in the interpretive abilities of large language models (LLMs) offer potential for automating…

Computation and Language · Computer Science 2024-02-14 Zackary Okun Dunivin

Cognitive systems generally require a human to translate a problem definition into some specification that the cognitive system can use to attempt to solve the problem or perform the task. In this paper, we illustrate that large language…

Artificial Intelligence · Computer Science 2024-06-12 Robert E. Wray , James R. Kirk , John E. Laird

Large language models (LLMs) are increasingly used in business dialogue systems but they pose security and ethical risks. Multi-turn conversations, where context influences the model's behavior, can be exploited to produce undesired…

Computation and Language · Computer Science 2024-09-10 George Kour , Naama Zwerdling , Marcel Zalmanovici , Ateret Anaby-Tavor , Ora Nova Fandina , Eitan Farchi