English
Related papers

Related papers: Mitigating Covertly Unsafe Text within Natural Lan…

200 papers

As text generation systems' outputs are increasingly anthropomorphic -- perceived as human-like -- scholars have also increasingly raised concerns about how such outputs can lead to harmful outcomes, such as users over-relying or developing…

Computation and Language · Computer Science 2025-06-05 Myra Cheng , Su Lin Blodgett , Alicia DeVrio , Lisa Egede , Alexandra Olteanu

Security classifiers, designed to detect malicious content in computer systems and communications, can underperform when provided with insufficient training data. In the security domain, it is often easy to find samples of the negative…

Cryptography and Security · Computer Science 2023-10-24 Alexander P. Welsh , Matthew Edwards

Recent research demonstrates that the nascent fine-tuning-as-a-service business model exposes serious safety concerns: fine-tuning with a few harmful data uploaded from the users can compromise the safety alignment of the model. The attack,…

Cryptography and Security · Computer Science 2026-04-27 Tiansheng Huang , Sihao Hu , Fatih Ilhan , Selim Furkan Tekin , Ling Liu

We introduce the task of implicit offensive text detection in dialogues, where a statement may have either an offensive or non-offensive interpretation, depending on the listener and context. We argue that reasoning is crucial for…

Computation and Language · Computer Science 2022-04-25 Qiang Zhang , Jason Naradowsky , Yusuke Miyao

This demo paper presents UnScientify, an interactive system designed to detect scientific uncertainty in scholarly full text. The system utilizes a weakly supervised technique that employs a fine-grained annotation scheme to identify…

Computation and Language · Computer Science 2023-07-27 Panggih Kusuma Ningrum , Philipp Mayr , Iana Atanassova

Modern text-to-speech (TTS) systems, particularly those built on Large Audio-Language Models (LALMs), generate high-fidelity speech that faithfully reproduces input text and mimics specified speaker identities. While prior misuse studies…

Sound · Computer Science 2025-11-17 Guangke Chen , Yuhui Wang , Shouling Ji , Xiapu Luo , Ting Wang

Visual modifications to text are often used to obfuscate offensive comments in social media (e.g., "!d10t") or as a writing style ("1337" in "leet speak"), among other scenarios. We consider this as a new type of adversarial attack in NLP,…

Authorship identification has proven unsettlingly effective in inferring the identity of the author of an unsigned document, even when sensitive personal information has been carefully omitted. In the digital era, individuals leave a…

Computation and Language · Computer Science 2023-10-04 Haining Wang

The spread of fake news has emerged as a critical challenge, undermining trust and posing threats to society. In the era of Large Language Models (LLMs), the capability to generate believable fake content has intensified these concerns. In…

Computation and Language · Computer Science 2023-09-19 Jinyan Su , Terry Yue Zhuo , Jonibek Mansurov , Di Wang , Preslav Nakov

We present a holistic approach to building a robust and useful natural language classification system for real-world content moderation. The success of such a system relies on a chain of carefully designed and executed steps, including the…

Computation and Language · Computer Science 2023-02-16 Todor Markov , Chong Zhang , Sandhini Agarwal , Tyna Eloundou , Teddy Lee , Steven Adler , Angela Jiang , Lilian Weng

The rapid growth in user generated content on social media has resulted in a significant rise in demand for automated content moderation. Various methods and frameworks have been proposed for the tasks of hate speech detection and toxic…

Computation and Language · Computer Science 2024-09-27 Elizaveta Korotkova , Isaac Chung

Generative AI, including large language models (LLMs) have the potential -- and already are being used -- to increase the speed, scale, and types of unsafe conversations online. LLMs lower the barrier for entry for bad actors to create…

Human-Computer Interaction · Computer Science 2025-07-31 Owen Hoffman , Kangze Peng , Zehua You , Sajid Kamal , Sukrit Venkatagiri

The increase in active users on social networking sites (SNSs) has also observed an increase in harmful content on social media sites. Harmful content is described as an inappropriate activity to harm or deceive an individual or a group of…

Social and Information Networks · Computer Science 2024-03-05 Gautam Kishore Shahi

The purpose of the covert communication system is to implement the communication process without causing third party perception. In order to achieve complete covert communication, two aspects of security issues need to be considered. The…

Cryptography and Security · Computer Science 2019-11-13 Zhongliang Yang , Yuting Hu , Yongfeng Huang , Yujin Zhang

This paper outlines the ethical implications of text simplification within the framework of assistive systems. We argue that a distinction should be made between the technologies that perform text simplification and the realisation of these…

Computation and Language · Computer Science 2022-04-21 Sian Gooding

Generative language models have improved drastically, and can now produce realistic text outputs that are difficult to distinguish from human-written content. For malicious actors, these language models bring the promise of automating the…

Computers and Society · Computer Science 2023-01-12 Josh A. Goldstein , Girish Sastry , Micah Musser , Renee DiResta , Matthew Gentzel , Katerina Sedova

Advances in AI-generated content have led to wide adoption of large language models, diffusion-based visual generators, and synthetic audio tools. However, these developments raise critical concerns about misinformation, copyright…

Computation and Language · Computer Science 2025-09-30 Lele Cao

Recently, tampered text detection has attracted increasing attention due to its essential role in information security. Although existing methods can detect the tampered text region, the interpretation of such detection remains unclear,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Chenfan Qu , Jian Liu , Haoxing Chen , Baihan Yu , Jingjing Liu , Weiqiang Wang , Lianwen Jin

Combating fake news needs a variety of defense methods. Although rumor detection and various linguistic analysis techniques are common methods to detect false content in social media, there are other feasible mitigation approaches that…

Social and Information Networks · Computer Science 2019-04-08 Sina Mohseni , Eric Ragan , Xia Hu

Questions regarding implicitness, ambiguity and underspecification are crucial for understanding the task validity and ethical concerns of multimodal image+text systems, yet have received little attention to date. This position paper maps…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Ben Hutchinson , Jason Baldridge , Vinodkumar Prabhakaran