English
Related papers

Related papers: Text Detoxification: Data Efficiency, Semantic Pre…

200 papers

Toxic speech, also known as hate speech, is regarded as one of the crucial issues plaguing online social media today. Most recent work on toxic speech detection is constrained to the modality of text and written conversations with very…

Computation and Language · Computer Science 2022-04-05 Sreyan Ghosh , Samden Lepcha , S Sakshi , Rajiv Ratn Shah , S. Umesh

Toxicity identification in online multimodal environments remains a challenging task due to the complexity of contextual connections across modalities (e.g., textual and visual). In this paper, we propose a novel framework that integrates…

Machine Learning · Computer Science 2026-02-18 Rahul Garg , Trilok Padhi , Hemang Jain , Ugur Kursuncu , Ponnurangam Kumaraguru

The effectiveness of large language models (LLMs) is often hindered by duplicated data in their extensive pre-training datasets. Current approaches primarily focus on detecting and removing duplicates, which risks the loss of valuable…

Computation and Language · Computer Science 2024-07-10 Nan He , Weichen Xiong , Hanwen Liu , Yi Liao , Lei Ding , Kai Zhang , Guohua Tang , Xiao Han , Wei Yang

Social media platforms have experienced a significant rise in toxic content, including abusive language and discriminatory remarks, presenting growing challenges for content moderation. Some users evade censorship by deliberately disguising…

Computation and Language · Computer Science 2025-06-06 Xuchen Ma , Jianxiang Yu , Wenming Shao , Bo Pang , Xiang Li

Data sanitization in the context of language modeling involves identifying sensitive content, such as personally identifiable information (PII), and redacting them from a dataset corpus. It is a common practice used in natural language…

Computation and Language · Computer Science 2024-11-12 Anwesan Pal , Radhika Bhargava , Kyle Hinsz , Jacques Esterhuizen , Sudipta Bhattacharya

To date, toxicity mitigation in language models has almost entirely been focused on single-language settings. As language models embrace multilingual capabilities, it's crucial our safety measures keep pace. Recognizing this research gap,…

Computation and Language · Computer Science 2024-05-31 Luiza Pozzobon , Patrick Lewis , Sara Hooker , Beyza Ermis

Machine learning-based classifiers have been used for text classification, such as sentiment analysis, news classification, and toxic comment classification. However, supervised machine learning models often require large amounts of labeled…

Computation and Language · Computer Science 2025-05-06 Yejian Zhang , Shingo Takada

Language is a deep-rooted means of perpetration of stereotypes and discrimination. Large Language Models (LLMs), now a pervasive technology in our everyday lives, can cause extensive harm when prone to generating toxic responses. The…

Software Engineering · Computer Science 2026-02-06 Simone Corbo , Luca Bancale , Valeria De Gennaro , Livia Lestingi , Vincenzo Scotti , Matteo Camilli

Considerable effort has been dedicated to mitigating toxicity, but existing methods often require drastic modifications to model parameters or the use of computationally intensive auxiliary models. Furthermore, previous approaches have…

Artificial Intelligence · Computer Science 2023-10-12 Luiza Pozzobon , Beyza Ermis , Patrick Lewis , Sara Hooker

Recent statements about the impressive capabilities of large language models (LLMs) are usually supported by evaluating on open-access benchmarks. Considering the vast size and wide-ranging sources of LLMs' training data, it could…

Computation and Language · Computer Science 2024-06-03 Yihong Dong , Xue Jiang , Huanyu Liu , Zhi Jin , Bin Gu , Mengfei Yang , Ge Li

Large language models are increasingly trained on all the data ever produced by humans. Many have raised concerns about the trustworthiness of public benchmarks due to potential contamination in pre-training or fine-tuning datasets. While…

Computation and Language · Computer Science 2023-11-14 Shuo Yang , Wei-Lin Chiang , Lianmin Zheng , Joseph E. Gonzalez , Ion Stoica

Interactions with online Large Language Models raise privacy issues where providers can gather sensitive information about users and their companies from the prompts. While textual prompts can be sanitized using Differential Privacy, we…

Cryptography and Security · Computer Science 2025-06-16 Robin Carpentier , Benjamin Zi Hao Zhao , Hassan Jameel Asghar , Dali Kaafar

Data contamination poses a significant challenge to the fairness of LLM evaluations in natural language processing tasks by inadvertently exposing models to test data during training. Current studies attempt to mitigate this issue by…

Computation and Language · Computer Science 2025-11-25 Jingqian Zhao , Bingbing Wang , Geng Tu , Yice Zhang , Qianlong Wang , Bin Liang , Jing Li , Ruifeng Xu

Large-scale generative models have shown impressive image-generation capabilities, propelled by massive data. However, this often inadvertently leads to the generation of harmful or inappropriate content and raises copyright concerns.…

Machine Learning · Computer Science 2025-03-11 Myeongseob Ko , Henry Li , Zhun Wang , Jonathan Patsenker , Jiachen T. Wang , Qinbin Li , Ming Jin , Dawn Song , Ruoxi Jia

Text summarization is crucial for mitigating information overload across domains like journalism, medicine, and business. This research evaluates summarization performance across 17 large language models (OpenAI, Google, Anthropic,…

Computation and Language · Computer Science 2025-04-08 Anantharaman Janakiraman , Behnaz Ghoraani

Toxicity detection algorithms, originally designed with reactive content moderation in mind, are increasingly being deployed into proactive end-user interventions to moderate content. Through a socio-technical lens and focusing on contexts…

Human-Computer Interaction · Computer Science 2025-02-25 Mark Warner , Angelika Strohmayer , Matthew Higgs , Lynne Coventry

Large language models (LLMs) have demonstrated remarkable success in NLP tasks. However, there is a paucity of studies that attempt to evaluate their performances on social media-based health-related natural language processing tasks, which…

Computation and Language · Computer Science 2024-03-29 Yuting Guo , Anthony Ovadje , Mohammed Ali Al-Garadi , Abeed Sarker

In recent years, fake news detection has received increasing attention in public debate and scientific research. Despite advances in detection techniques, the production and spread of false information have become more sophisticated, driven…

Computation and Language · Computer Science 2026-03-27 Pietro Dell'Oglio , Alessandro Bondielli , Francesco Marcelloni , Lucia C. Passaro

Mental disorders pose a global challenge, aggravated by the shortage of qualified mental health professionals. Mental disorder prediction from social media posts by current LLMs is challenging due to the complexities of sequential text data…

Computation and Language · Computer Science 2024-10-08 Raja Kumar , Kishan Maharaj , Ashita Saxena , Pushpak Bhattacharyya

Many popular machine learning techniques in natural language processing and data mining rely heavily on high-quality text sources. However real-world text datasets contain a significant amount of spelling errors and improperly punctuated…

Artificial Intelligence · Computer Science 2022-11-01 Nan Jiang , Chen Luo , Vihan Lakshman , Yesh Dattatreya , Yexiang Xue