English
Related papers

Related papers: Athena: Safe Autonomous Agents with Verbal Contras…

200 papers

Large Language Models (LLMs) have recently gained attention due to their ability to understand and generate sophisticated human-like content. However, ensuring their safety is paramount as they might provide harmful and unsafe responses.…

Software Engineering · Computer Science 2025-01-29 Miriam Ugarte , Pablo Valle , José Antonio Parejo , Sergio Segura , Aitor Arrieta

Large language models (LLMs) are being integrated into socially assistive robots (SARs) and other conversational agents providing mental health and well-being support. These agents are often designed to sound empathic and supportive in…

Human-Computer Interaction · Computer Science 2026-02-05 Himanshi Lalwani , Hanan Salam

The rise of Large Language Model (LLM) agents, augmented with tool use, skills, and external knowledge, has introduced new security risks. Among them, prompt injection attacks, where adversaries embed malicious instructions into the agent…

Cryptography and Security · Computer Science 2026-05-06 Shihao Weng , Yang Feng , Jinrui Zhang , Xiaofei Xie , Jiongchi Yu , Jia Liu

Large language models (LLMs) are increasingly leveraged to empower autonomous agents to simulate human beings in various fields of behavioral research. However, evaluating their capacity to navigate complex social interactions remains a…

Computation and Language · Computer Science 2024-11-26 Xinyi Mou , Jingcong Liang , Jiayu Lin , Xinnong Zhang , Xiawei Liu , Shiyue Yang , Rong Ye , Lei Chen , Haoyu Kuang , Xuanjing Huang , Zhongyu Wei

As the strength of Large Language Models (LLMs) has grown over recent years, so too has interest in their use as the underlying models for autonomous agents. Although LLMs demonstrate emergent abilities and broad expertise across natural…

Artificial Intelligence · Computer Science 2024-12-06 Chris Sypherd , Vaishak Belle

The increasing deployment of large language models (LLMs) in safety-critical applications raises fundamental challenges in systematically evaluating robustness against adversarial behaviors. Existing red-teaming practices are largely manual…

LLM agents are increasingly deployed to plan, retrieve, and write with tools, yet evaluation still leans on static benchmarks and small human studies. We present the Agent-Testing Agent (ATA), a meta-agent that combines static code…

Computation and Language · Computer Science 2025-08-26 Sameer Komoravolu , Khalil Mrini

Large Language Models (LLMs) are increasingly used in agentic systems, where their interactions with diverse tools and environments create complex, multi-stage safety challenges. However, existing benchmarks mostly rely on static,…

Cryptography and Security · Computer Science 2026-02-03 Liming Lu , Xiang Gu , Junyu Huang , Jiawei Du , Xu Zheng , Yunhuai Liu , Yongbin Zhou , Shuchao Pang

This paper presents a novel approach to evaluating the security of large language models (LLMs) against prompt leakage-the exposure of system-level prompts or proprietary configurations. We define prompt leakage as a critical threat to…

Cryptography and Security · Computer Science 2025-02-19 Tvrtko Sternak , Davor Runje , Dorian Granoša , Chi Wang

Corpus linguistics has traditionally relied on human researchers to formulate hypotheses, construct queries, and interpret results - a process demanding specialized technical skills and considerable time. We propose Agent-Driven Corpus…

Computation and Language · Computer Science 2026-04-09 Jia Yu , Weiwei Yu , Pengfei Xiao , Fukun Xing

We introduce a dynamic benchmarking system for conversational agents that evaluates their performance through a single, simulated, and lengthy user$\leftrightarrow$agent interaction. The interaction is a conversation between the user and…

Computation and Language · Computer Science 2024-10-14 David Castillo-Bolado , Joseph Davidson , Finlay Gray , Marek Rosa

Communication is a powerful tool for coordination in multi-agent RL. But inducing an effective, common language is a difficult challenge, particularly in the decentralized setting. In this work, we introduce an alternative perspective where…

Artificial Intelligence · Computer Science 2024-02-05 Yat Long Lo , Biswa Sengupta , Jakob Foerster , Michael Noukhovitch

This scoping review examines the emerging field of Large Language Model (LLM)-based pedagogical agents in educational settings. While traditional pedagogical agents have been extensively studied, the integration of LLMs represents a…

Artificial Intelligence · Computer Science 2026-05-19 Shan Li , Juan Zheng

Leveraging multiple Large Language Models(LLMs) has proven effective for addressing complex, high-dimensional tasks, but current approaches often rely on static, manually engineered multi-agent configurations. To overcome these constraints,…

Machine Learning · Computer Science 2025-07-21 Xiaowen Ma , Chenyang Lin , Yao Zhang , Volker Tresp , Yunpu Ma

While Large Language Model (LLM)-based agents can be used to create highly engaging interactive applications through prompting personality traits and contextual data, effectively assessing their personalities has proven challenging. This…

Human-Computer Interaction · Computer Science 2025-10-29 Eswari Jayakumar , Niladri Sekhar Dash , Debasmita Mukherjee

This paper introduces a multi-agent framework guided by Large Language Models (LLMs) to assist in the early stages of engineering design, a phase often characterized by vast parameter spaces and inherent uncertainty. Operating under a…

Artificial Intelligence · Computer Science 2026-04-21 Varun Kumar , George Em Karniadakis

When we design and deploy an Reinforcement Learning (RL) agent, reward functions motivates agents to achieve an objective. An incorrect or incomplete specification of the objective can result in behavior that does not align with human…

Artificial Intelligence · Computer Science 2024-06-03 Zhaoyue Wang

Vision Language Models (VLMs) have become essential backbones for multimodal intelligence, yet significant safety challenges limit their real-world application. While textual inputs are often effectively safeguarded, adversarial visual…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yi Ding , Bolian Li , Ruqi Zhang

Large language models (LLMs) are becoming increasingly important for machine learning applications. However, it can be challenging to align LLMs with our intent, particularly when we want to generate content that is preferable over others…

Computation and Language · Computer Science 2024-04-09 Xiang Gao , Kamalika Das

Large language models (LLMs) are increasingly explored as general-purpose reasoners, particularly in agentic contexts. However, their outputs remain prone to mathematical and logical errors. This is especially challenging in open-ended…

Artificial Intelligence · Computer Science 2025-05-30 Agnieszka Mensfelt , Kostas Stathis , Vince Trencsenyi