中文
相关论文

相关论文: Agent-Facing Information Design in LLM Tool Regist…

200 篇论文

Agent Skills are structured packages of procedural knowledge that augment LLM agents at inference time. Despite rapid adoption, there is no standard way to measure whether they actually help. We present SkillsBench, a benchmark of 86 tasks…

The integration of Large Language Models (LLMs) into recommendation systems has introduced unprecedented capabilities for natural language understanding, explanation generation, and conversational interactions. However, existing evaluation…

信息检索 · 计算机科学 2026-01-28 Sushant Mehta

We introduce a comprehensive validation framework for LLM-based agentic systems that provides systematic diagnosis and improvement of reliability failures. The framework includes fifteen failure-detection tools and two root-cause analysis…

人工智能 · 计算机科学 2026-04-01 Hadar Mulian , Sergey Zeltyn , Ido Levy , Liane Galanti , Avi Yaeli , Segev Shlomov

Recent advances in large language models (LLMs) have stimulated growing interest in agent-based recommender systems, enabling language-driven interaction and reasoning for more expressive preference modeling. However, most existing agentic…

信息检索 · 计算机科学 2026-05-21 Yaxin Gong , Chongming Gao , Chenxiao Fan , Haoyan Liu , Wenjie Wang , Jianshan Sun , Yangyang Li , Fuli Feng , Xiangnan He

Defenses against indirect prompt injection (IPI) in tool-using LLM agents share two structural weaknesses. First, they all attempt to prevent attacks rather than detect the compromises that slip through. Second, they have only been…

密码学与安全 · 计算机科学 2026-05-13 Yassin H. Rassul , Tarik A. Rashid

Existing memory benchmarks for LLM agents evaluate explicit recall of facts, yet overlook implicit memory where experience becomes automated behavior without conscious retrieval. This gap is critical: effective assistants must automatically…

人工智能 · 计算机科学 2026-04-16 Chonghan Qin , Xiachong Feng , Weitao Ma , Xiaocheng Feng , Lingpeng Kong

Large language models deployed as agents increasingly interact with external systems through tool calls--actions with real-world consequences that text outputs alone do not carry. Safety evaluations, however, overwhelmingly measure…

人工智能 · 计算机科学 2026-02-20 Arnold Cartagena , Ariane Teixeira

Interleaved text-and-image generation represents a significant frontier for Multimodal Large Language Models (MLLMs), offering a more intuitive way to convey complex information. Current paradigms rely on either image generation or…

人工智能 · 计算机科学 2026-04-01 Yinuo Liu , Zi Qian , Heng Zhou , Jiahao Zhang , Yajie Zhang , Zhihang Li , Mengyu Zhou , Erchao Zhao , Xiaoxi Jiang , Guanjun Jiang

Agentic AI architectures augment LLMs with external tools, unlocking strong capabilities. However, tool use is not always beneficial; some calls may be redundant or even harmful. Effective tool use, therefore, hinges on a core LLM decision:…

Recent advances in Foundation Models such as Large Language Models (LLMs) have propelled them to the forefront of Recommender Systems (RS). Despite their utility, there is a growing concern that LLMs might inadvertently perpetuate societal…

信息检索 · 计算机科学 2024-05-30 Wenyue Hua , Yingqiang Ge , Shuyuan Xu , Jianchao Ji , Yongfeng Zhang

Users often interpret and select agent skills through their SKILL markdown specifications. To protect users, existing audits mainly focus on malicious or unsafe skills. We study the complementary question of whether specifications help…

人机交互 · 计算机科学 2026-05-21 Zikai Alex Wen

Tool-calling is essential for Large Language Model (LLM) agents to complete real-world tasks. While most existing benchmarks assume simple, perfectly documented tools, real-world tools (e.g., general "search" APIs) are often opaque, lacking…

We argue that LLM agent security is fundamentally an agent-human interaction (AHI) problem, not a purely algorithmic one. To substantiate this position, we conduct a systematic analysis of 59 academic papers, 21 production agent systems,…

密码学与安全 · 计算机科学 2026-05-26 Peiran Wang , Ying Li , Yuan Tian

The Model Context Protocol (MCP) introduces a standard specification that defines how Foundation Model (FM)-based agents should interact with external systems by invoking tools. However, to understand a tool's purpose and features, FMs rely…

软件工程 · 计算机科学 2026-02-24 Mohammed Mehedi Hasan , Hao Li , Gopi Krishnan Rajbahadur , Bram Adams , Ahmed E. Hassan

Recent work frames LLM consciousness via utilitarian proxy benchmarks; we instead present an ontological and mathematical account. We show the prevailing formulation collapses the agent into an unconscious policy-compliance drone,…

人工智能 · 计算机科学 2025-10-10 Jeffrey Camlin

Recent advances in ID-free recommender systems have attracted significant attention for effectively addressing the cold start problem. However, their vulnerability to malicious attacks remains largely unexplored. In this paper, we unveil a…

信息检索 · 计算机科学 2025-04-29 Zongwei Wang , Min Gao , Junliang Yu , Xinyi Gao , Quoc Viet Hung Nguyen , Shazia Sadiq , Hongzhi Yin

Deploying Large Language Model-based agents (LLM agents) in the public sector requires assuring that they meet the stringent legal, procedural, and structural requirements of public-sector institutions. Practitioners and researchers often…

计算机与社会 · 计算机科学 2026-01-29 Jonathan Rystrøm , Chris Schmitz , Karolina Korgul , Jan Batzner , Chris Russell

AI model documentation is fragmented across platforms and inconsistent in structure, preventing policymakers, auditors, and users from reliably assessing safety claims, data provenance, and version-level changes. We analyzed documentation…

人工智能 · 计算机科学 2025-12-16 Akhmadillo Mamirov , Faiaz Azmain , Hanyu Wang

Personalised text generation is essential for user-centric information systems, yet most evaluation methods overlook the individuality of users. We introduce \textbf{PREF}, a \textbf{P}ersonalised \textbf{R}eference-free \textbf{E}valuation…

计算与语言 · 计算机科学 2025-08-15 Xiao Fu , Hossein A. Rahmani , Bin Wu , Jerome Ramos , Emine Yilmaz , Aldo Lipani

Large language models (LLMs) have demonstrated remarkable capabilities across a range of text-generation tasks. However, LLMs still struggle with problems requiring multi-step decision-making and environmental feedback, such as online…

人工智能 · 计算机科学 2025-02-18 Zhenfang Chen , Delin Chen , Rui Sun , Wenjun Liu , Chuang Gan