中文
相关论文

相关论文: Distributional Surgery for Language Model Activati…

200 篇论文

We introduce the concept of deceptive diffusion -- training a generative AI model to produce adversarial images. Whereas a traditional adversarial attack algorithm aims to perturb an existing image to induce a misclassificaton, the…

机器学习 · 计算机科学 2024-07-01 Lucas Beerens , Catherine F. Higham , Desmond J. Higham

In reading comprehension, generating sentence-level distractors is a significant task, which requires a deep understanding of the article and question. The traditional entity-centered methods can only generate word-level or phrase-level…

计算与语言 · 计算机科学 2019-11-21 Xiaorui Zhou , Senlin Luo , Yunfang Wu

Activation steering is a method for controlling Large Language Model (LLM) behavior by intervening in its internal representations to increase the alignment with a specific target feature direction. However, standard interventions, such as…

机器学习 · 计算机科学 2026-05-05 Tam Nguyen , Tu Anh Nguyen , Sina Alemohammad , Richard G. Baraniuk

There is an increase in the proliferation of online hate commensurate with the rise in the usage of social media. In response, there is also a significant advancement in the creation of automated tools aimed at identifying harmful text…

计算与语言 · 计算机科学 2024-06-10 Rabiraj Bandyopadhyay , Dennis Assenmacher , Jose M. Alonso Moral , Claudia Wagner

We propose a method to control the attributes of Language Models (LMs) for the text generation task using Causal Average Treatment Effect (ATE) scores and counterfactual augmentation. We explore this method, in the context of LM…

计算与语言 · 计算机科学 2023-10-04 Rahul Madhavan , Rishabh Garg , Kahini Wadhawan , Sameep Mehta

Fine-tuning-based unlearning methods prevail for preventing targeted harmful, sensitive, or copyrighted information within large language models while preserving overall capabilities. However, the true effectiveness of these methods is…

计算与语言 · 计算机科学 2024-10-16 Yihuai Hong , Yuelin Zou , Lijie Hu , Ziqian Zeng , Di Wang , Haiqin Yang

Large Language Models (LLMs) can acquire unintended biases from seemingly benign training data even without explicit cues or malicious content. Existing methods struggle to detect such risks before fine-tuning, making post hoc evaluation…

机器学习 · 计算机科学 2026-02-05 Mengru Wang , Zhenqian Xu , Junfeng Fang , Yunzhi Yao , Shumin Deng , Huajun Chen , Ningyu Zhang

A significant challenge in automating hate speech detection on social media is distinguishing hate speech from regular and offensive language. These identify an essential category of content that web filters seek to remove. Only automated…

计算与语言 · 计算机科学 2024-11-12 Faria Naznin , Md Touhidur Rahman , Shahran Rahman Alve

Recent advances in linguistic steganalysis have successively applied CNN, RNN, GNN and other efficient deep models for detecting secret information in generative texts. These methods tend to seek stronger feature extractors to achieve…

计算与语言 · 计算机科学 2022-02-03 Biao Yi , Hanzhou Wu , Guorui Feng , Xinpeng Zhang

Recent work in activation steering has demonstrated the potential to better control the outputs of Large Language Models (LLMs), but it involves finding steering vectors. This is difficult because engineers do not typically know how…

计算与语言 · 计算机科学 2023-12-08 Ole Jorgensen , Dylan Cope , Nandi Schoots , Murray Shanahan

Large language models (LLMs) often inherit biases from vast amounts of training corpora. Traditional debiasing methods, while effective to some extent, do not completely eliminate memorized biases and toxicity in LLMs. In this paper, we…

计算与语言 · 计算机科学 2024-07-25 Huimin Lu , Masaru Isonuma , Junichiro Mori , Ichiro Sakata

The increasing capabilities of large generative models and their ever more widespread deployment have raised concerns about their reliability, safety, and potential misuse. To address these issues, recent works have proposed to control…

机器学习 · 计算机科学 2024-11-25 Pau Rodriguez , Arno Blaas , Michal Klein , Luca Zappella , Nicholas Apostoloff , Marco Cuturi , Xavier Suau

Deep learning methods have recently achieved great empirical success on machine translation, dialogue response generation, summarization, and other text generation tasks. At a high level, the technique has been to train end-to-end neural…

计算与语言 · 计算机科学 2017-11-28 Ziang Xie

With adversarial or otherwise normal prompts, existing large language models (LLM) can be pushed to generate toxic discourses. One way to reduce the risk of LLMs generating undesired discourses is to alter the training of the LLM. This can…

计算与语言 · 计算机科学 2023-02-28 Meng Cao , Mehdi Fatemi , Jackie Chi Kit Cheung , Samira Shabanian

Detecting manipulated images has become a significant emerging challenge. The advent of image sharing platforms and the easy availability of advanced photo editing software have resulted in a large quantities of manipulated images being…

计算机视觉与模式识别 · 计算机科学 2019-11-26 Peng Zhou , Bor-Chun Chen , Xintong Han , Mahyar Najibi , Abhinav Shrivastava , Ser Nam Lim , Larry S. Davis

An ever-increasing amount of social media content requires advanced AI-based computer programs capable of extracting useful information. Specifically, the extraction of health-related content from social media is useful for the development…

人工智能 · 计算机科学 2023-10-31 Pervaiz Iqbal Khan , Muhammad Nabeel Asim , Andreas Dengel , Sheraz Ahmed

The digital age has expanded social media and online forums, allowing free expression for nearly 45% of the global population. Yet, it has also fueled online harassment, bullying, and harmful behaviors like hate speech and toxic comments…

计算与语言 · 计算机科学 2026-03-12 Vuong M. Ngo , Cach N. Dang , Kien V. Nguyen , Mark Roantree

Online discussions, panels, talk page edits, etc., often contain harmful conversational content i.e., hate speech, death threats and offensive language, especially towards certain demographic groups. For example, individuals who identify as…

计算与语言 · 计算机科学 2022-07-21 Jamell Dacon , Harry Shomer , Shaylynn Crum-Dacon , Jiliang Tang

Though safety alignment has been applied to most large language models (LLMs), LLM service providers generally deploy a subsequent moderation as the external safety guardrail in real-world products. Existing moderators mainly practice a…

计算与语言 · 计算机科学 2025-09-23 Yang Li , Qiang Sheng , Yehan Yang , Xueyao Zhang , Juan Cao

In recent years, vulnerable hosts and maliciously registered domains have been frequently involved in mobile attacks. In this paper, we explore the feasibility of detecting malicious domains visited on a cellular network based solely on…

密码学与安全 · 计算机科学 2015-06-15 Wei Wang , Kenneth Shirley