English
Related papers

Related papers: Using Pre-Trained Language Models for Producing Co…

200 papers

Hate speech on social media is a growing concern, and automated methods have so far been sub-par at reliably detecting it. A major challenge lies in the potentially evasive nature of hate speech due to the ambiguity and fast evolution of…

Computation and Language · Computer Science 2021-03-17 Maximilian Kupi , Michael Bodnar , Nikolas Schmidt , Carlos Eduardo Posada

Hate speech, offensive language, aggression, racism, sexism, and other abusive language are common phenomena in social media. There is a need for Artificial Intelligence(AI)based intervention which can filter hate content at scale. Most…

Computation and Language · Computer Science 2024-11-13 Prashant Kapil , Asif Ekbal

Hate speech in social media is a growing phenomenon, and detecting such toxic content has recently gained significant traction in the research community. Existing studies have explored fine-tuning language models (LMs) to perform hate…

Computation and Language · Computer Science 2023-03-07 Md Rabiul Awal , Roy Ka-Wei Lee , Eshaan Tanwar , Tanmay Garg , Tanmoy Chakraborty

Current adversarial attack algorithms, where an adversary changes a text to fool a victim model, have been repeatedly shown to be effective against text classifiers. These attacks, however, generally assume that the victim model is…

Computation and Language · Computer Science 2024-01-17 Tom Roth , Inigo Jauregi Unanue , Alsharif Abuadbba , Massimo Piccardi

Discriminative pre-trained language models (PLMs) learn to predict original texts from intentionally corrupted ones. Taking the former text as positive and the latter as negative samples, the PLM can be trained effectively for…

Computation and Language · Computer Science 2022-12-02 Zhuosheng Zhang , Hai Zhao , Masao Utiyama , Eiichiro Sumita

Hate speech is one of the main threats posed by the widespread use of social networks, despite efforts to limit it. Although attention has been devoted to this issue, the lack of datasets and case studies centered around scarcely…

Computation and Language · Computer Science 2024-10-11 Camilla Casula , Sara Tonelli

Biased news contributes to societal polarization and is often reinforced by hostile reader comments, constituting a vital yet often overlooked aspect of news dissemination. Our study reveals that offensive comments support biased content,…

Computation and Language · Computer Science 2025-08-25 Luyang Lin , Zijin Feng , Lingzhi Wang , Kam-Fai Wong

Most research on hate speech detection has focused on English where a sizeable amount of labeled training data is available. However, to expand hate speech detection into more languages, approaches that require minimal training data are…

Computation and Language · Computer Science 2023-06-13 Janis Goldzycher , Moritz Preisig , Chantal Amrhein , Gerold Schneider

Today text classification models have been widely used. However, these classifiers are found to be easily fooled by adversarial examples. Fortunately, standard attacking methods generate adversarial texts in a pair-wise way, that is, an…

Computation and Language · Computer Science 2020-03-24 Yankun Ren , Jianbin Lin , Siliang Tang , Jun Zhou , Shuang Yang , Yuan Qi , Xiang Ren

Advanced neural language models (NLMs) are widely used in sequence generation tasks because they are able to produce fluent and meaningful sentences. They can also be used to generate fake reviews, which can then be used to attack online…

Computation and Language · Computer Science 2019-12-04 David Ifeoluwa Adelani , Haotian Mai , Fuming Fang , Huy H. Nguyen , Junichi Yamagishi , Isao Echizen

Over the last few years, Contextualized Pre-trained Neural Language Models, such as BERT, GPT, have shown significant gains in various NLP tasks. To enhance the robustness of existing pre-trained models, one way is adversarial examples…

Computation and Language · Computer Science 2021-10-05 Wenqian Ye , Fei Xu , Yaojia Huang , Cassie Huang , Ji A

Pre-trained sequence-to-sequence language models have led to widespread success in many natural language generation tasks. However, there has been relatively less work on analyzing their ability to generate structured outputs such as…

Computation and Language · Computer Science 2022-04-12 Swarnadeep Saha , Prateek Yadav , Mohit Bansal

Counterspeech can be an effective method for battling hateful content on social media. Automated counterspeech generation can aid in this process. Generated counterspeech, however, can be viable only when grounded in the context of topic,…

Computation and Language · Computer Science 2023-12-01 Sabit Hassan , Malihe Alikhani

Generative Adversarial Networks (GANs) have shown great promise recently in image generation. Training GANs for language generation has proven to be more difficult, because of the non-differentiable nature of generating text with recurrent…

Computation and Language · Computer Science 2017-12-22 Ofir Press , Amir Bar , Ben Bogin , Jonathan Berant , Lior Wolf

Open-domain dialogue generation suffers from the data insufficiency problem due to the vast size of potential responses. In this paper, we propose to explore potential responses by counterfactual reasoning. Given an observed response, the…

Machine Learning · Computer Science 2020-10-12 Qingfu Zhu , Weinan Zhang , Ting Liu , William Yang Wang

Approaches for mitigating bias in supervised models are designed to reduce models' dependence on specific sensitive features of the input data, e.g., mentioned social groups. However, in the case of hate speech detection, it is not always…

Computation and Language · Computer Science 2020-10-27 Aida Mostafazadeh Davani , Ali Omrani , Brendan Kennedy , Mohammad Atari , Xiang Ren , Morteza Dehghani

Self-supervised pre-training, such as BERT, MASS and BART, has emerged as a powerful technique for natural language understanding and generation. Existing pre-training techniques employ autoencoding and/or autoregressive objectives to train…

Computation and Language · Computer Science 2020-09-22 Bin Bi , Chenliang Li , Chen Wu , Ming Yan , Wei Wang , Songfang Huang , Fei Huang , Luo Si

There have been remarkable breakthroughs in Machine Learning and Artificial Intelligence, notably in the areas of Natural Language Processing and Deep Learning. Additionally, hate speech detection in dialogues has been gaining popularity…

Computation and Language · Computer Science 2023-06-02 Durgesh Nandini , Ute Schmid

Hate speech detection is a critical problem in social media platforms, being often accused for enabling the spread of hatred and igniting physical violence. Hate speech detection requires overwhelming resources including high-performance…

Computation and Language · Computer Science 2020-05-14 Tomer Wullach , Amir Adler , Einat Minkov

This paper highlights a shift in how to approach material generation. Instead of material-to-material, we propose a language-to-material generation architecture that utilizes millions of untapped data points. Using a web scraper to collect…

Computation and Language · Computer Science 2023-11-15 Neel Redkar