English
Related papers

Related papers: Breaking BERT: Gradient Attack on Twitter Sentimen…

200 papers

Natural language processing (NLP) tasks, ranging from text classification to text generation, have been revolutionised by the pre-trained language models, such as BERT. This allows corporations to easily build powerful APIs by encapsulating…

Computation and Language · Computer Science 2021-03-19 Xuanli He , Lingjuan Lyu , Qiongkai Xu , Lichao Sun

Artificial intelligence and machine learning have significantly bolstered the technological world. This paper explores the potential of transfer learning in natural language processing focusing mainly on sentiment analysis. The models…

Computation and Language · Computer Science 2023-11-29 Aman Yadav , Abhishek Vichare

White supremacists embrace a radical ideology that considers white people superior to people of other races. The critical influence of these groups is no longer limited to social media; they also have a significant effect on society in many…

Computation and Language · Computer Science 2020-10-02 Hind Saleh Alatawi , Areej Maatog Alhothali , Kawthar Mustafa Moria

Twitter is a well-known microblogging social site where users express their views and opinions in real-time. As a result, tweets tend to contain valuable information. With the advancements of deep learning in the domain of natural language…

Computation and Language · Computer Science 2020-10-22 Mohiuddin Md Abdul Qudar , Vijay Mago

The successful application of large pre-trained models such as BERT in natural language processing has attracted more attention from researchers. Since the BERT typically acts as an end-to-end black box, classification systems based on it…

Computation and Language · Computer Science 2023-09-06 Shuai Jiang , Sayaka Kamei , Chen Li , Shengzhe Hou , Yasuhiko Morimoto

Adversarial attacks against deep learning models represent a major threat to the security and reliability of natural language processing (NLP) systems. In this paper, we propose a modification to the BERT-Attack framework, integrating…

Machine Learning · Computer Science 2024-08-01 Hetvi Waghela , Jaydip Sen , Sneha Rakshit

Deep Neural Networks have taken Natural Language Processing by storm. While this led to incredible improvements across many tasks, it also initiated a new research field, questioning the robustness of these neural networks by attacking…

Computation and Language · Computer Science 2021-09-16 Jens Hauser , Zhao Meng , Damián Pascual , Roger Wattenhofer

The enormous amount of data being generated on the web and social media has increased the demand for detecting online hate speech. Detecting hate speech will reduce their negative impact and influence on others. A lot of effort in the…

Computation and Language · Computer Science 2021-11-03 Hind Saleh , Areej Alhothali , Kawthar Moria

We present FireBERT, a set of three proof-of-concept NLP classifiers hardened against TextFooler-style word-perturbation by producing diverse alternatives to original samples. In one approach, we co-tune BERT against the training data and…

Computation and Language · Computer Science 2020-08-11 Gunnar Mein , Kevin Hartman , Andrew Morris

The internet today has become an unrivalled source of information where people converse on content based websites such as Quora, Reddit, StackOverflow and Twitter asking doubts and sharing knowledge with the world. A major arising problem…

Computation and Language · Computer Science 2020-12-15 Ashwin Rachha , Gaurav Vanmane

Sentiment analysis is an important task in the field ofNature Language Processing (NLP), in which users' feedbackdata on a specific issue are evaluated and analyzed. Manydeep learning models have been proposed to tackle this task, including…

Computation and Language · Computer Science 2020-11-23 Quoc Thai Nguyen , Thoai Linh Nguyen , Ngoc Hoang Luong , Quoc Hung Ngo

Recent advances in large-scale language representation models such as BERT have improved the state-of-the-art performances in many NLP tasks. Meanwhile, character-level Chinese NLP models, including BERT for Chinese, have also demonstrated…

Computation and Language · Computer Science 2020-04-09 Boxin Wang , Boyuan Pan , Xin Li , Bo Li

Most of existing work learn sentiment-specific word representation for improving Twitter sentiment classification, which encoded both n-gram and distant supervised tweet sentiment information in learning process. They assume all words…

Computation and Language · Computer Science 2018-05-30 Shufeng Xiong

The use of transfer learning methods is largely responsible for the present breakthrough in Natural Learning Processing (NLP) tasks across multiple domains. In order to solve the problem of sentiment detection, we examined the performance…

Computation and Language · Computer Science 2023-07-05 Olumide Ebenezer Ojo , Hoang Thang Ta , Alexander Gelbukh , Hiram Calvo , Olaronke Oluwayemisi Adebanji , Grigori Sidorov

The purpose of the study is to investigate the relative effectiveness of four different sentiment analysis techniques: (1) unsupervised lexicon-based model using Sent WordNet; (2) traditional supervised machine learning model using logistic…

Computation and Language · Computer Science 2020-07-03 Shivaji Alaparthi , Manit Mishra

Moral values play a fundamental role in how we evaluate information, make decisions, and form judgements around important social issues. Controversial topics, including vaccination, abortion, racism, and sexual orientation, often elicit…

Computation and Language · Computer Science 2024-07-22 Vjosa Preniqi , Iacopo Ghinassi , Julia Ive , Charalampos Saitis , Kyriaki Kalimeri

Adversarial attacks expose important blind spots of deep learning systems. While word- and sentence-level attack scenarios mostly deal with finding semantic paraphrases of the input that fool NLP models, character-level attacks typically…

Computation and Language · Computer Science 2021-06-04 Yannik Keller , Jan Mackensen , Steffen Eger

Online conversations can be toxic and subjected to threats, abuse, or harassment. To identify toxic text comments, several deep learning and machine learning models have been proposed throughout the years. However, recent studies…

Machine Learning · Computer Science 2023-11-09 Md Azim Khan

The growing use of social media has led to the development of several Machine Learning (ML) and Natural Language Processing(NLP) tools to process the unprecedented amount of social media content to make actionable decisions. However, these…

Computation and Language · Computer Science 2021-10-28 Izzat Alsmadi , Kashif Ahmad , Mahmoud Nazzal , Firoj Alam , Ala Al-Fuqaha , Abdallah Khreishah , Abdulelah Algosaibi

Personal attacks in the context of social media conversations often lead to fast-paced derailment, leading to even more harmful exchanges being made. State-of-the-art systems for the detection of such conversational derailment often make…

Computation and Language · Computer Science 2023-11-20 Steven Leung , Filippos Papapolyzos