中文
相关论文

相关论文: Knowledge Graph Guided Evaluation of Abstention Te…

200 篇论文

LLMs increasingly exhibit over-refusal behavior, where safety mechanisms cause models to reject benign instructions that seemingly resemble harmful content. This phenomenon diminishes utility in production applications that repeatedly rely…

计算与语言 · 计算机科学 2026-04-21 Utsav Maskey , Sumit Yadav , Mark Dras , Usman Naseem

In recent years, graph prompting has emerged as a promising research direction, enabling the learning of additional tokens or subgraphs appended to the original graphs without requiring retraining of pre-trained graph models across various…

机器学习 · 计算机科学 2025-05-28 Qunzhong Wang , Xiangguo Sun , Hong Cheng

As language models are increasingly deployed as autonomous agents in high-stakes settings, ensuring that they reliably follow user-defined rules has become a critical safety concern. To this end, we study whether language models exhibit…

机器学习 · 计算机科学 2025-08-28 Dylan Sam , Alexander Robey , Andy Zou , Matt Fredrikson , J. Zico Kolter

With the advance of language models, privacy protection is receiving more attention. Training data extraction is therefore of great importance, as it can serve as a potential tool to assess privacy leakage. However, due to the difficulty of…

计算与语言 · 计算机科学 2023-06-02 Weichen Yu , Tianyu Pang , Qian Liu , Chao Du , Bingyi Kang , Yan Huang , Min Lin , Shuicheng Yan

Large Language Models (LLMs) deployed in production environments face a fundamental safety-utility trade-off either a strict filtering mechanisms prevent harmful outputs but often block benign queries or a relaxed controls risk unsafe…

人工智能 · 计算机科学 2026-02-18 Ankit Sharma , Nachiket Tapas , Jyotiprakash Patra

Prediction with the possibility of abstention (or selective prediction) is an important problem for error-critical machine learning applications. While well-studied in the classification setup, selective approaches to regression are much…

机器学习 · 统计学 2023-09-29 Fedor Noskov , Alexander Fishkov , Maxim Panov

This paper designs and implements an explainable recommendation model that integrates knowledge graphs with structure-aware attention mechanisms. The model is built on graph neural networks and incorporates a multi-hop neighbor aggregation…

信息检索 · 计算机科学 2025-10-14 Shuangquan Lyu , Ming Wang , Huajun Zhang , Jiasen Zheng , Junjiang Lin , Xiaoxuan Sun

The use of knowledge graphs in recommender systems has become one of the common approaches to addressing data sparsity and cold start problems. Recent advances in large language models (LLMs) offer new possibilities for processing side and…

信息检索 · 计算机科学 2025-02-13 Minhye Jeon , Seokho Ahn , Young-Duk Seo

In recent years, knowledge graph embedding becomes a pretty hot research topic of artificial intelligence and plays increasingly vital roles in various downstream applications, such as recommendation and question answering. However,…

人工智能 · 计算机科学 2020-06-24 Wentao Xu , Shun Zheng , Liang He , Bin Shao , Jian Yin , Tie-Yan Liu

In this paper, we conduct an empirical investigation of neural query graph ranking approaches for the task of complex question answering over knowledge graphs. We experiment with six different ranking models and propose a novel…

Recently, there has been an increase in interest in evaluating large language models for emergent and dangerous capabilities. Importantly, agents could reason that in some scenarios their goal is better achieved if they are not turned off,…

计算与语言 · 计算机科学 2023-07-04 Teun van der Weij , Simon Lermen , Leon lang

Existing benchmarks of language-model refusal on malicious-coding tasks routinely conflate requests for executable malicious software with requests for harmful security knowledge. This conflation matters because the two request types…

密码学与安全 · 计算机科学 2026-05-06 Richard J. Young , Gregory D. Moody

We consider the problem of active learning on graphs, which has crucial applications in many real-world networks where labeling node responses is expensive. In this paper, we propose an offline active learning method that selects nodes to…

机器学习 · 统计学 2024-11-08 Yuanchen Wu , Yubai Yuan

Large language models require continuous adaptation to new tasks while preserving safety alignment. However, fine-tuning on even benign data often compromises safety behaviors, including refusal of harmful requests, truthfulness, and…

机器学习 · 计算机科学 2026-04-21 Thong Bach , Dung Nguyen , Thao Minh Le , Truyen Tran

In this work, we propose a new and general framework to defend against backdoor attacks, inspired by the fact that attack triggers usually follow a \textsc{specific} type of attacking pattern, and therefore, poisoned training examples have…

机器学习 · 计算机科学 2021-11-30 Xiaofei Sun , Jiwei Li , Xiaoya Li , Ziyao Wang , Tianwei Zhang , Han Qiu , Fei Wu , Chun Fan

The task of inductive knowledge graph completion requires models to learn inference patterns from a training graph, which can then be used to make predictions on a disjoint test graph. Rule-based methods seem like a natural fit for this…

人工智能 · 计算机科学 2024-03-26 Akash Anil , Víctor Gutiérrez-Basulto , Yazmín Ibañéz-García , Steven Schockaert

Previous literatures show that pre-trained masked language models (MLMs) such as BERT can achieve competitive factual knowledge extraction performance on some datasets, indicating that MLMs can potentially be a reliable knowledge source. In…

计算与语言 · 计算机科学 2021-06-18 Boxi Cao , Hongyu Lin , Xianpei Han , Le Sun , Lingyong Yan , Meng Liao , Tong Xue , Jin Xu

Safety alignment in large language models (LLMs) is primarily evaluated under open-ended generation, where models can mitigate risk by refusing to respond. In contrast, many real-world applications place LLMs in structured decision-making…

计算与语言 · 计算机科学 2026-04-21 Yuheng Chen , Zhiyu Wu , Bowen Cheng , Tetsuro Takahashi

The rapid growth of large language models has spurred significant interest in model compression as a means to enhance their accessibility and practicality. While extensive research has explored model compression through the lens of safety,…

计算与语言 · 计算机科学 2025-04-08 Vishnu Kabir Chhabra , Mohammad Mahdi Khalili

Access control is a cornerstone of secure computing, yet large language models often blur role boundaries by producing unrestricted responses. We study role-conditioned refusals, focusing on the LLM's ability to adhere to access control…

计算与语言 · 计算机科学 2025-10-10 Đorđe Klisura , Joseph Khoury , Ashish Kundu , Ram Krishnan , Anthony Rios