中文
相关论文

相关论文: Prefix Probing: Lightweight Harmful Content Detect…

200 篇论文

The generation of toxic content by large language models (LLMs) remains a critical challenge for the safe deployment of language technology. We propose a novel framework for implicit knowledge editing and controlled text generation by…

计算与语言 · 计算机科学 2025-06-02 Tassilo Klein , Moin Nabi

In safety-critical applications, language models should be able to characterize their uncertainty with meaningful probabilities. Many uncertainty quantification approaches require supervised data; however, finding suitable unseen…

计算与语言 · 计算机科学 2026-05-14 Sophia Hager , Simon Zeng , Nicholas Andrews

Natural language processing (NLP) models often replicate or amplify social bias from training data, raising concerns about fairness. At the same time, their black-box nature makes it difficult for users to recognize biased predictions and…

计算与语言 · 计算机科学 2026-02-12 Yifan Wang , Mayank Jobanputra , Ji-Ung Lee , Soyoung Oh , Isabel Valera , Vera Demberg

Reliably predicting the behavior of language models -- such as whether their outputs are correct or have been adversarially manipulated -- is a fundamentally challenging task. This is often made even more difficult as frontier language…

机器学习 · 计算机科学 2025-12-02 Dylan Sam , Marc Finzi , J. Zico Kolter

Latent Semantic Analysis is a method of matrix decomposition used for discovering topics and topic weights in natural language documents. This study uses Latent Semantic Analysis to analyze the composition of binaries of malicious programs.…

密码学与安全 · 计算机科学 2023-03-02 John Musgrave , Temesguen Messay-Kebede , David Kapp , Anca Ralescu

Recent studies have widely investigated backdoor attacks on Large Language Models (LLMs) by inserting harmful question-answer (QA) pairs into their training data. However, we revisit existing attacks and identify two critical limitations:…

计算与语言 · 计算机科学 2025-10-07 Jiawei Kong , Hao Fang , Xiaochen Yang , Kuofeng Gao , Bin Chen , Shu-Tao Xia , Ke Xu , Han Qiu

Large Language Models (LLMs) are gaining significant popularity in recent years for specialized tasks using prompts due to their low computational cost. Standard methods like prefix tuning utilize special, modifiable tokens that lack…

Previous insertion-based and paraphrase-based backdoors have achieved great success in attack efficacy, but they ignore the text quality and semantic consistency between poisoned and clean texts. Although recent studies introduce LLMs to…

计算与语言 · 计算机科学 2025-04-22 Zhengxian Wu , Juan Wen , Wanli Peng , Ziwei Zhang , Yinghan Zhou , Yiming Xue

Phishing websites pose a major cybersecurity threat, exploiting unsuspecting users and causing significant financial and organisational harm. Traditional machine learning approaches for phishing detection often require extensive feature…

密码学与安全 · 计算机科学 2025-11-20 Georg Goldenits , Philip Koenig , Sebastian Raubitzek , Andreas Ekelhart

There has been recently a growing interest in studying adversarial examples on natural language models in the black-box setting. These methods attack natural language classifiers by perturbing certain important words until the classifier…

机器学习 · 计算机科学 2021-05-04 Mahmoud Hossam , Trung Le , He Zhao , Viet Huynh , Dinh Phung

In recent years, there have been significant advancements in the development of Large Language Models (LLMs). While their practical applications are now widespread, their potential for misuse, such as generating fake news and committing…

人工智能 · 计算机科学 2024-04-01 Kaito Taguchi , Yujie Gu , Kouichi Sakurai

Image-classification datasets have been used to pretrain image recognition models. Recently, web-scale image-caption datasets have emerged as a source of powerful pretraining alternative. Image-caption datasets are more ``open-domain'',…

计算机视觉与模式识别 · 计算机科学 2023-05-17 Kuniaki Saito , Kihyuk Sohn , Xiang Zhang , Chun-Liang Li , Chen-Yu Lee , Kate Saenko , Tomas Pfister

Large language models (LLMs) are becoming a popular tool as they have significantly advanced in their capability to tackle a wide range of language-based tasks. However, LLMs applications are highly vulnerable to prompt injection attacks,…

计算与语言 · 计算机科学 2024-11-11 Md Abdur Rahman , Fan Wu , Alfredo Cuzzocrea , Sheikh Iqbal Ahamed

Toxicity detection algorithms, originally designed with reactive content moderation in mind, are increasingly being deployed into proactive end-user interventions to moderate content. Through a socio-technical lens and focusing on contexts…

人机交互 · 计算机科学 2025-02-25 Mark Warner , Angelika Strohmayer , Matthew Higgs , Lynne Coventry

Large Language Models (LLMs) are increasingly used to generate textual explanations of process models discovered from event logs. Producing explanations from large behavioral abstractions (e.g., directly-follows graphs or Petri nets) can be…

机器学习 · 计算机科学 2025-10-14 P. van Oerle , R. H. Bemthuis , F. A. Bukhsh

Discrete optimization-based jailbreaking attacks on large language models aim to generate short, nonsensical suffixes that, when appended onto input prompts, elicit disallowed content. Notably, these suffixes are often transferable --…

计算与语言 · 计算机科学 2025-10-28 Sarah Ball , Niki Hasrati , Alexander Robey , Avi Schwarzschild , Frauke Kreuter , Zico Kolter , Andrej Risteski

Unlocking the potential of Large Language Models (LLMs) in data classification represents a promising frontier in natural language processing. In this work, we evaluate the performance of different LLMs in comparison with state-of-the-art…

计算与语言 · 计算机科学 2025-01-16 Arina Kostina , Marios D. Dikaiakos , Dimosthenis Stefanidis , George Pallis

Large Language Models (LLMs) presents significant priority in text understanding and generation. However, LLMs suffer from the risk of generating harmful contents especially while being employed to applications. There are several black-box…

计算与语言 · 计算机科学 2023-12-11 Chengyuan Liu , Fubang Zhao , Lizhi Qing , Yangyang Kang , Changlong Sun , Kun Kuang , Fei Wu

Natural language generation tools are powerful and effective for generating content. However, language models are known to display bias and fairness issues, making them impractical to deploy for many use cases. We here focus on how fairness…

计算与语言 · 计算机科学 2024-05-03 Kevin Stowe , Benny Longwill , Alyssa Francis , Tatsuya Aoyama , Debanjan Ghosh , Swapna Somasundaran

Large language models (LLMs) have been applied in various applications due to their astonishing capabilities. With advancements in technologies such as chain-of-thought (CoT) prompting and in-context learning (ICL), the prompts fed to LLMs…

计算与语言 · 计算机科学 2023-12-07 Huiqiang Jiang , Qianhui Wu , Chin-Yew Lin , Yuqing Yang , Lili Qiu