English
Related papers

Related papers: GTA: Gated Toxicity Avoidance for LM Performance P…

200 papers

The rise of social networks has not only facilitated communication but also allowed the spread of harmful content. Although significant advances have been made in detecting toxic language in textual data, the exploration of concept-based…

Computation and Language · Computer Science 2025-12-16 Samarth Garg , Divya Singh , Deeksha Varshney , Mamta

Despite the success of Large Language Models (LLMs) on various tasks following human instructions, controlling model generation at inference time poses a persistent challenge. In this paper, we introduce Ctrl-G, an adaptable framework that…

Computation and Language · Computer Science 2024-08-20 Honghua Zhang , Po-Nien Kung , Masahiro Yoshida , Guy Van den Broeck , Nanyun Peng

The rapid adoption of generative language models has brought about substantial advancements in digital communication, while simultaneously raising concerns regarding the potential misuse of AI-generated content. Although numerous detection…

Computation and Language · Computer Science 2023-07-13 Weixin Liang , Mert Yuksekgonul , Yining Mao , Eric Wu , James Zou

Retrieval Augmented Generation (RAG) expands the capabilities of modern large language models (LLMs), by anchoring, adapting, and personalizing their responses to the most relevant knowledge sources. It is particularly useful in chatbot…

Controllable text generation (CTG) by large language models has a huge potential to transform education for teachers and students alike. Specifically, high quality and diverse question generation can dramatically reduce the load on teachers…

Computation and Language · Computer Science 2023-04-14 Sabina Elkins , Ekaterina Kochmar , Jackie C. K. Cheung , Iulian Serban

While large-scale language models (LMs) are able to imitate the distribution of natural language well enough to generate realistic text, it is difficult to control which regions of the distribution they generate. This is especially…

Computation and Language · Computer Science 2020-10-23 Ben Krause , Akhilesh Deepak Gotmare , Bryan McCann , Nitish Shirish Keskar , Shafiq Joty , Richard Socher , Nazneen Fatema Rajani

Employing language models to generate explanations for an incoming implicit hate post is an active area of research. The explanation is intended to make explicit the underlying stereotype and aid content moderators. The training often…

Computation and Language · Computer Science 2024-06-07 Neemesh Yadav , Sarah Masud , Vikram Goyal , Vikram Goyal , Md Shad Akhtar , Tanmoy Chakraborty

Harmful content is pervasive on social media, poisoning online communities and negatively impacting participation. A common approach to address this issue is to develop detection models that rely on human annotations. However, the tasks…

Computation and Language · Computer Science 2024-04-29 Lingyao Li , Lizhou Fan , Shubham Atreja , Libby Hemphill

The robustness of recent Large Language Models (LLMs) has become increasingly crucial as their applicability expands across various domains and real-world applications. Retrieval-Augmented Generation (RAG) is a promising solution for…

Computation and Language · Computer Science 2024-10-23 Sukmin Cho , Soyeong Jeong , Jeongyeon Seo , Taeho Hwang , Jong C. Park

Large Language Models (LLMs) are constrained by outdated information and a tendency to generate incorrect data, commonly referred to as "hallucinations." Retrieval-Augmented Generation (RAG) addresses these limitations by combining the…

Cryptography and Security · Computer Science 2024-06-07 Jiaqi Xue , Mengxin Zheng , Yebowen Hu , Fei Liu , Xun Chen , Qian Lou

In recent years, there has been a growing interest in the development of language models capable of generating text with controllable attributes. While several approaches have been proposed, many of these methods require condition-specific…

Computation and Language · Computer Science 2023-02-22 Shangda Wu , Maosong Sun

Retrieval-Augmented Generation (RAG) systems have emerged as a promising solution to mitigate LLM hallucinations and enhance their performance in knowledge-intensive domains. However, these systems are vulnerable to adversarial poisoning…

Information Retrieval · Computer Science 2025-07-29 Jinyan Su , Jin Peng Zhou , Zhengxin Zhang , Preslav Nakov , Claire Cardie

The generation of toxic content by large language models (LLMs) remains a critical challenge for the safe deployment of language technology. We propose a novel framework for implicit knowledge editing and controlled text generation by…

Computation and Language · Computer Science 2025-06-02 Tassilo Klein , Moin Nabi

Toxic text classification for online moderation remains challenging under extreme class imbalance, where rare but high-risk labels such as threat and severe_toxic are consistently underdetected by conventional models. We propose…

Computation and Language · Computer Science 2026-04-08 Noor Islam S. Mohammad

Toxicity mitigation consists in rephrasing text in order to remove offensive or harmful meaning. Neural natural language processing (NLP) models have been widely used to target and mitigate textual toxicity. However, existing methods fail…

Large pre-trained language models have repeatedly shown their ability to produce fluent text. Yet even when starting from a prompt, generation can continue in many plausible directions. Current decoding methods with the goal of controlling…

Computation and Language · Computer Science 2021-09-21 Damian Pascual , Beni Egressy , Clara Meister , Ryan Cotterell , Roger Wattenhofer

The proliferation of Large Language Models (LLMs), such as ChatGPT, has raised concerns about their potential impact on academic integrity, prompting the need for LLM-resistant exam designs. This article investigates the performance of LLMs…

Computation and Language · Computer Science 2023-04-25 Simon kaare Larsen

Large language models (LLMs) have shown incredible capabilities and transcended the natural language processing (NLP) community, with adoption throughout many services like healthcare, therapy, education, and customer service. Since users…

Computation and Language · Computer Science 2023-04-12 Ameet Deshpande , Vishvak Murahari , Tanmay Rajpurohit , Ashwin Kalyan , Karthik Narasimhan

With adversarial or otherwise normal prompts, existing large language models (LLM) can be pushed to generate toxic discourses. One way to reduce the risk of LLMs generating undesired discourses is to alter the training of the LLM. This can…

Computation and Language · Computer Science 2023-02-28 Meng Cao , Mehdi Fatemi , Jackie Chi Kit Cheung , Samira Shabanian

Generative AI models have shown impressive performance on many Natural Language Processing tasks such as language understanding, reasoning, and language generation. An important question being asked by the AI community today is about the…