English
Related papers

Related papers: Fine-Grained Detoxification via Instance-Level Pre…

200 papers

Pretrained neural language models (LMs) are prone to generating racist, sexist, or otherwise toxic language which hinders their safe deployment. We investigate the extent to which pretrained LMs can be prompted to generate toxic language,…

Computation and Language · Computer Science 2020-09-29 Samuel Gehman , Suchin Gururangan , Maarten Sap , Yejin Choi , Noah A. Smith

Pre-trained language models (LMs) are shown to easily generate toxic language. In this work, we systematically explore domain-adaptive training to reduce the toxicity of language models. We conduct this study on three dimensions: training…

Computation and Language · Computer Science 2022-10-25 Boxin Wang , Wei Ping , Chaowei Xiao , Peng Xu , Mostofa Patwary , Mohammad Shoeybi , Bo Li , Anima Anandkumar , Bryan Catanzaro

Large Language Models (LLMs) trained on web-scale corpora inherently absorb toxic patterns from their training data. This leads to toxic degeneration where even innocuous prompts can trigger harmful outputs. This phenomenon poses…

Computation and Language · Computer Science 2026-05-18 Mokshit Surana , Archit Rathod , Akshaj Satishkumar

This paper investigates the underlying mechanisms of toxicity generation in Large Language Models (LLMs) and proposes an effective detoxification approach. Prior work typically considers the Feed-Forward Network (FFN) as the main source of…

Computation and Language · Computer Science 2025-05-26 Zenghao Duan , Zhiyi Yin , Zhichao Shi , Liang Pang , Shaoling Jing , Jiayi Wu , Yu Yan , Huawei Shen , Xueqi Cheng

Transformer-based Large Language Models (LLMs) have shown exceptional language generation capabilities in response to text-based prompts. However, controlling the direction of generation via textual prompts has been challenging, especially…

Computation and Language · Computer Science 2024-04-09 Rohan Deepak Ajwani , Zining Zhu , Jonathan Rose , Frank Rudzicz

Large language models (LM) generate remarkably fluent text and can be efficiently adapted across NLP tasks. Measuring and guaranteeing the quality of generated text in terms of safety is imperative for deploying LMs in the real world; to…

Pre-trained Language Models (PLMs) have demonstrated impressive performance in various NLP tasks. However, traditional fine-tuning methods for leveraging PLMs for downstream tasks entail significant computational overhead. Prompt-tuning has…

Machine Learning · Computer Science 2025-07-29 Ali Shakeri , Wei Emma Zhang , Amin Beheshti , Weitong Chen , Jian Yang , Lishan Yang

Fine-Grained Named Entity Typing (FG-NET) is a key component in Natural Language Processing (NLP). It aims at classifying an entity mention into a wide range of entity types. Due to a large number of entity types, distant supervision is…

Computation and Language · Computer Science 2020-04-08 Muhammad Asif Ali , Yifang Sun , Bing Li , Wei Wang

Existing detoxification methods for large language models mainly focus on post-training stage or inference time, while few tackle the source of toxicity, namely, the dataset itself. Such training-based or controllable decoding approaches…

Computation and Language · Computer Science 2026-04-22 Wei Shao , Yihang Wang , Gaoyu Zhu , Ziqiang Cheng , Lei Yu , Jiafeng Guo , Xueqi Cheng

In recent years, the advent of the attention mechanism has significantly advanced the field of natural language processing (NLP), revolutionizing text processing and text generation. This has come about through transformer-based…

Computation and Language · Computer Science 2026-01-13 Zhiyao Zhang , Yazan Mash'Al , Yuhan Wu

Advanced reasoning typically requires Chain-of-Thought prompting, which is accurate but incurs prohibitive latency and substantial test-time inference costs. The standard alternative, fine-tuning smaller models, often sacrifices…

Computation and Language · Computer Science 2026-02-25 Sanket Badhe , Deep Shah

Transformer-based language models are able to generate fluent text and be efficiently adapted across various natural language generation tasks. However, language models that are pretrained on large unlabeled web text corpora have been shown…

Computation and Language · Computer Science 2022-07-28 Farshid Faal , Ketra Schmitt , Jia Yuan Yu

Large Language Models (LLMs) have demonstrated impressive performance across various tasks, yet they remain vulnerable to generating toxic content, necessitating detoxification strategies to ensure safe and responsible deployment. Test-time…

Computation and Language · Computer Science 2025-10-03 Yisong Xiao , Aishan Liu , Siyuan Liang , Zonghao Ying , Xianglong Liu , Dacheng Tao

Large Language Models (LLMs) and Vision Language Models (VLMs) have recently shown promising capabilities in various scientific domain. In particular, these advances have opened new opportunities in drug discovery, where the ability to…

Artificial Intelligence · Computer Science 2026-05-13 Jueon Park , Wonjune Jang , Jiwoo Lee , Yein Park , Jaewoo Kang

Backdoor attacks pose severe security threats to large language models (LLMs), where a model behaves normally under benign inputs but produces malicious outputs when a hidden trigger appears. Existing backdoor removal methods typically…

Cryptography and Security · Computer Science 2026-03-17 Jianwei Li , Jung-Eun Kim

Modern Large Language Models (LLMs) are excellent at generating synthetic data. However, their performance in sensitive domains such as text detoxification has not received proper attention from the scientific community. This paper explores…

Computation and Language · Computer Science 2025-09-11 Sergey Pletenev , Daniil Moskovskiy , Alexander Panchenko

Efficiently fine-tuning Large Language Models (LLMs) for specific tasks presents a considerable challenge in natural language processing. Traditional methods, like prompt or prefix tuning, typically rely on arbitrary tokens for training,…

Computation and Language · Computer Science 2024-04-16 Md. Kowsher , Md. Shohanur Islam Sobuj , Asif Mahmud , Nusrat Jahan Prottasha , Prakash Bhat

Text detoxification aims to minimize the risk of language models producing toxic content. Existing detoxification methods of directly constraining the model output or further training the model on the non-toxic corpus fail to achieve a…

Computation and Language · Computer Science 2024-10-14 Zecheng Tang , Keyan Zhou , Juntao Li , Yuyang Ding , Pinzheng Wang , Bowen Yan , Rejie Hua , Min Zhang

In prompt tuning, a prefix or suffix text is added to the prompt, and the embeddings (soft prompts) or token indices (hard prompts) of the prefix/suffix are optimized to gain more control over language models for specific tasks. This…

Computation and Language · Computer Science 2024-07-01 Shouchang Guo , Sonam Damani , Keng-hao Chang

Prior works on detoxification are scattered in the sense that they do not cover all aspects of detoxification needed in a real-world scenario. Notably, prior works restrict the task of developing detoxification models to only a seen subset…

Machine Learning · Computer Science 2024-10-07 Md Tawkat Islam Khondaker , Muhammad Abdul-Mageed , Laks V. S. Lakshmanan