English
Related papers

Related papers: We Should Identify and Mitigate Third-Party Safety…

200 papers

Large Language Model (LLM) agents increasingly act through external tools, making their safety contingent on tool-call workflows rather than text generation alone. While recent benchmarks evaluate agents across diverse environments and risk…

Software Engineering · Computer Science 2026-03-20 Xuan Chen , Lu Yan , Ruqi Zhang , Xiangyu Zhang

Large Language Models (LLMs) hold immense promise for revolutionizing financial analysis and decision-making, yet their direct application is often hampered by issues of data hallucination and lack of access to real-time, verifiable…

Computational Engineering, Finance, and Science · Computer Science 2025-06-13 Yifan Zeng

Large language models (LLMs) have exhibited great potential in autonomously completing tasks across real-world applications. Despite this, these LLM agents introduce unexpected safety risks when operating in interactive environments.…

Computation and Language · Computer Science 2024-10-08 Tongxin Yuan , Zhiwei He , Lingzhong Dong , Yiming Wang , Ruijie Zhao , Tian Xia , Lizhen Xu , Binglin Zhou , Fangqi Li , Zhuosheng Zhang , Rui Wang , Gongshen Liu

A high volume of recent ML security literature focuses on attacks against aligned large language models (LLMs). These attacks may extract private information or coerce the model into producing harmful outputs. In real-world deployments,…

Machine Learning · Computer Science 2025-02-13 Ang Li , Yin Zhou , Vethavikashini Chithrra Raghuram , Tom Goldstein , Micah Goldblum

Research interest in autonomous agents is on the rise as an emerging topic. The notable achievements of Large Language Models (LLMs) have demonstrated the considerable potential to attain human-like intelligence in autonomous agents.…

Multiagent Systems · Computer Science 2025-01-30 Hung Du , Srikanth Thudumu , Rajesh Vasa , Kon Mouzakis

ChatGPT embarks on a new era of artificial intelligence and will revolutionize the way we approach intelligent traffic safety systems. This paper begins with a brief introduction about the development of large language models (LLMs). Next,…

Computation and Language · Computer Science 2023-09-07 Ou Zheng , Mohamed Abdel-Aty , Dongdong Wang , Zijin Wang , Shengxuan Ding

Large Language Models (LLMs) still face challenges when dealing with complex reasoning tasks, often resulting in hallucinations, which limit the practical application of LLMs. To alleviate this issue, this paper proposes a new method that…

Artificial Intelligence · Computer Science 2024-11-26 Zhihua Duan , Jialin Wang

As Large Language Models (LLMs) continue to be increasingly applied across various domains, their widespread adoption necessitates rigorous monitoring to prevent unintended negative consequences and ensure robustness. Furthermore, LLMs must…

Computation and Language · Computer Science 2025-07-09 Seshu Tirupathi , Dhaval Salwala , Elizabeth Daly , Inge Vejsbjerg

Large language models (LLMs) have empowered nodes within multi-agent networks with intelligence, showing growing applications in both academia and industry. However, how to prevent these networks from generating malicious information…

Multiagent Systems · Computer Science 2024-10-22 Miao Yu , Shilong Wang , Guibin Zhang , Junyuan Mao , Chenlong Yin , Qijiong Liu , Qingsong Wen , Kun Wang , Yang Wang

The variety of data in data lakes presents significant challenges for data analytics, as data scientists must simultaneously analyze multi-modal data, including structured, semi-structured, and unstructured data. While Large Language Models…

Databases · Computer Science 2025-05-19 Chao Zhang , Shaolei Zhang , Quehuan Liu , Sibei Chen , Tong Li , Ju Fan

Solving complex or long-horizon problems often requires large language models (LLMs) to use external tools and operate over a significantly longer context window. New LLMs enable longer context windows and support tool calling capabilities.…

Machine Learning · Computer Science 2025-12-03 Tsimur Hadeliya , Mohammad Ali Jauhar , Nidhi Sakpal , Diogo Cruz

Large language models (LLMs) are evolving into autonomous decision-makers, raising concerns about catastrophic risks in high-stakes scenarios, particularly in Chemical, Biological, Radiological and Nuclear (CBRN) domains. Based on the…

Computation and Language · Computer Science 2025-03-25 Rongwu Xu , Xiaojian Li , Shuo Chen , Wei Xu

Advances in Large Language Models (LLMs) have enabled a new class of self-evolving agents that autonomously improve through interaction with the environment, demonstrating strong capabilities. However, self-evolution also introduces novel…

Artificial Intelligence · Computer Science 2026-03-10 Shuai Shao , Qihan Ren , Chen Qian , Boyi Wei , Dadi Guo , Jingyi Yang , Xinhao Song , Linfeng Zhang , Weinan Zhang , Dongrui Liu , Jing Shao

Conversational agents are increasingly woven into individuals' personal lives, yet users often underestimate the privacy risks associated with them. The moment users share information with these agents-such as large language models…

Cryptography and Security · Computer Science 2025-07-29 Ivoline Ngong , Swanand Kadhe , Hao Wang , Keerthiram Murugesan , Justin D. Weisz , Amit Dhurandhar , Karthikeyan Natesan Ramamurthy

The Model Context Protocol (MCP) plays a crucial role in extending the capabilities of Large Language Models (LLMs) by enabling integration with external tools and data sources. However, the standard MCP specification presents significant…

Cryptography and Security · Computer Science 2025-06-03 Manish Bhatt , Vineeth Sai Narajala , Idan Habler

The Model Context Protocol (MCP) introduces a standard specification that defines how Foundation Model (FM)-based agents should interact with external systems by invoking tools. However, to understand a tool's purpose and features, FMs rely…

Software Engineering · Computer Science 2026-02-24 Mohammed Mehedi Hasan , Hao Li , Gopi Krishnan Rajbahadur , Bram Adams , Ahmed E. Hassan

Large language models (LLMs) are increasingly being used in Metaverse environments to generate dynamic and realistic content and to control the behavior of non-player characters (NPCs). However, the cybersecurity concerns associated with…

Cryptography and Security · Computer Science 2023-12-25 Hongyin Zhu

Large Language Models (LLMs) have demonstrated strong capabilities as autonomous agents through tool use, planning, and decision-making abilities, leading to their widespread adoption across diverse tasks. As task complexity grows,…

Multiagent Systems · Computer Science 2025-11-10 Ishan Kavathekar , Hemang Jain , Ameya Rathod , Ponnurangam Kumaraguru , Tanuja Ganu

As AI agents increasingly operate in complex environments, ensuring reliable, context-aware privacy is critical for regulatory compliance. Traditional access controls are insufficient because privacy risks often arise after access is…

This study explores integrating large language models (LLMs) with situational awareness-based planning (SAP) to enhance the decision-making capabilities of AI agents in dynamic and uncertain environments. We employ a multi-agent reasoning…

Artificial Intelligence · Computer Science 2024-06-18 Liman Wang , Hanyang Zhong