English
Related papers

Related papers: Does BERT Learn as Humans Perceive? Understanding …

200 papers

Given a task, human learns from easy to hard, whereas the model learns randomly. Undeniably, difficulty insensitive learning leads to great success in NLP, but little attention has been paid to the effect of text difficulty in NLP. In this…

Computation and Language · Computer Science 2024-04-03 Bowen Chen , Xiao Ding , Li Du , Qin Bing , Ting Liu

Subjective bias detection is critical for applications like propaganda detection, content recommendation, sentiment analysis, and bias neutralization. This bias is introduced in natural language via inflammatory words and phrases, casting…

Computation and Language · Computer Science 2020-06-16 Tanvi Dadu , Kartikey Pant , Radhika Mamidi

Do state-of-the-art natural language understanding models care about word order - one of the most important characteristics of a sequence? Not always! We found 75% to 90% of the correct predictions of BERT-based classifiers, trained on many…

Computation and Language · Computer Science 2021-07-27 Thang M. Pham , Trung Bui , Long Mai , Anh Nguyen

Do machines and humans process language in similar ways? Recent research has hinted at the affirmative, showing that human neural activity can be effectively predicted using the internal representations of language models (LMs). Although…

Computation and Language · Computer Science 2025-01-15 Yuchen Zhou , Emmy Liu , Graham Neubig , Michael J. Tarr , Leila Wehbe

We analyze if large language models are able to predict patterns of human reading behavior. We compare the performance of language-specific and multilingual pretrained transformer models to predict reading time measures reflecting natural…

Computation and Language · Computer Science 2021-04-13 Nora Hollenstein , Federico Pirovano , Ce Zhang , Lena Jäger , Lisa Beinborn

Hate Speech takes many forms to target communities with derogatory comments, and takes humanity a step back in societal progress. HateXplain is a recently published and first dataset to use annotated spans in the form of rationales, along…

Computation and Language · Computer Science 2022-08-10 Arvind Subramaniam , Aryan Mehra , Sayani Kundu

This paper covers the two approaches for sentiment analysis: i) lexicon based method; ii) machine learning method. We describe several techniques to implement these approaches and discuss how they can be adopted for sentiment classification…

Computation and Language · Computer Science 2019-02-19 Olga Kolchyna , Tharsis T. P. Souza , Philip Treleaven , Tomaso Aste

Language models that are trained on the next-word prediction task have been shown to accurately model human behavior in word prediction and reading speed. In contrast with these findings, we present a scenario in which the performance of…

Computation and Language · Computer Science 2023-10-24 Aditya R. Vaidya , Javier Turek , Alexander G. Huth

Lexical ambiguity is widespread in language, allowing for the reuse of economical word forms and therefore making language more efficient. If ambiguous words cannot be disambiguated from context, however, this gain in efficiency might make…

Computation and Language · Computer Science 2024-05-29 Tiago Pimentel , Rowan Hall Maudslay , Damián Blasi , Ryan Cotterell

It is important for machines to interpret human emotions properly for better human-machine communications, as emotion is an essential part of human-to-human communications. One aspect of emotion is reflected in the language we use. How to…

Computation and Language · Computer Science 2018-08-23 Ji Ho Park

We undertake the task of comparing lexicon-based sentiment classification of film reviews with machine learning approaches. We look at existing methodologies and attempt to emulate and improve on them using a 'given' lexicon and a…

Computation and Language · Computer Science 2019-05-14 Milan Gritta

Sentiment analysis is one of the most widely used techniques in text analysis. Recent advancements with Large Language Models have made it more accurate and accessible than ever, allowing researchers to classify text with only a plain…

Computation and Language · Computer Science 2024-05-07 Michael Burnham

Lexicon-based approaches to sentiment analysis of text are based on each word or lexical entry having a pre-defined weight indicating its sentiment polarity. These are usually manually assigned but the accuracy of these when compared…

Computation and Language · Computer Science 2023-11-13 Siddhant Jaydeep Mahajani , Shashank Srivastava , Alan F. Smeaton

Artificial intelligence and machine learning have significantly bolstered the technological world. This paper explores the potential of transfer learning in natural language processing focusing mainly on sentiment analysis. The models…

Computation and Language · Computer Science 2023-11-29 Aman Yadav , Abhishek Vichare

Automatic readability assessment plays a key role in ensuring effective and accessible written communication. Despite significant progress, the field is hindered by inconsistent definitions of readability and measurements that rely on…

Computation and Language · Computer Science 2025-10-20 Catarina G Belem , Parker Glenn , Alfy Samuel , Anoop Kumar , Daben Liu

Are the predictions of humans and language models affected by similar things? Research suggests that while comprehending language, humans make predictions about upcoming words, with more predictable words being processed more easily.…

Computation and Language · Computer Science 2022-11-11 James A. Michaelov , Benjamin K. Bergen

The growth of deep learning (DL) relies heavily on huge amounts of labelled data for tasks such as natural language processing and computer vision. Specifically, in image-to-text or image-to-image pipelines, opinion (sentiment) may be…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Aleksei Krotov , Alison Tebo , Dylan K. Picart , Aaron Dean Algave

Sensitive attributes are legally protected characteristics that should not be used to discriminate. Careful steps have been taken to minimize the risk of human bias regarding these fields, such as race and age. Large language models (LLMs)…

Computers and Society · Computer Science 2026-04-14 Anay Agarwalla , Simeon Sayer

Social media is increasingly used by humans to express their feelings and opinions in the form of short text messages. Detecting sentiments in the text has a wide range of applications including identifying anxiety or depression of…

Computation and Language · Computer Science 2018-07-23 Shaunak Joshi , Deepali Deshpande

In this paper, we investigate the emotion recognition ability of the pre-training language model, namely BERT. By the nature of the framework of BERT, a two-sentence structure, we adapt BERT to continues dialogue emotion prediction tasks,…

Computation and Language · Computer Science 2019-08-20 Yen-Hao Huang , Ssu-Rui Lee , Mau-Yun Ma , Yi-Hsin Chen , Ya-Wen Yu , Yi-Shin Chen