English
Related papers

Related papers: Fine-grained Sentiment Classification using BERT

200 papers

Recent advancements in language representation models such as BERT have led to a rapid improvement in numerous natural language processing tasks. However, language models usually consist of a few hundred million trainable parameters with…

Machine Learning · Computer Science 2019-12-12 Mehrdad Valipour , En-Shiun Annie Lee , Jaime R. Jamacaro , Carolina Bessega

Fine-tuning pre-trained language models like BERT has become an effective way in NLP and yields state-of-the-art results on many downstream tasks. Recent studies on adapting BERT to new tasks mainly focus on modifying the model structure,…

Computation and Language · Computer Science 2020-02-25 Yige Xu , Xipeng Qiu , Ligao Zhou , Xuanjing Huang

In this work we focus on fine-tuning a pre-trained BERT model and applying it to patent classification. When applied to large datasets of over two millions patents, our approach outperforms the state of the art by an approach using CNN with…

Computation and Language · Computer Science 2019-07-02 Jieh-Sheng Lee , Jieh Hsiang

Deep learning approaches for sentiment classification do not fully exploit sentiment linguistic knowledge. In this paper, we propose a Multi-sentiment-resource Enhanced Attention Network (MEAN) to alleviate the problem by integrating three…

Computation and Language · Computer Science 2018-07-16 Zeyang Lei , Yujiu Yang , Min Yang , Yi Liu

The successful application of large pre-trained models such as BERT in natural language processing has attracted more attention from researchers. Since the BERT typically acts as an end-to-end black box, classification systems based on it…

Computation and Language · Computer Science 2023-09-06 Shuai Jiang , Sayaka Kamei , Chen Li , Shengzhe Hou , Yasuhiko Morimoto

In this paper, we investigate the emotion recognition ability of the pre-training language model, namely BERT. By the nature of the framework of BERT, a two-sentence structure, we adapt BERT to continues dialogue emotion prediction tasks,…

Computation and Language · Computer Science 2019-08-20 Yen-Hao Huang , Ssu-Rui Lee , Mau-Yun Ma , Yi-Hsin Chen , Ya-Wen Yu , Yi-Shin Chen

User reviews have an essential role in the success of the developed mobile apps. User reviews in the textual form are unstructured data, creating a very high complexity when processed for sentiment analysis. Previous approaches that have…

We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models, BERT is designed to pre-train deep bidirectional…

Computation and Language · Computer Science 2019-05-28 Jacob Devlin , Ming-Wei Chang , Kenton Lee , Kristina Toutanova

BERT, which stands for Bidirectional Encoder Representations from Transformers, is a recently introduced language representation model based upon the transfer learning paradigm. We extend its fine-tuning procedure to address one of its…

Computation and Language · Computer Science 2019-10-25 Raghavendra Pappagari , Piotr Żelasko , Jesús Villalba , Yishay Carmiel , Najim Dehak

This study presents a comparative analysis of deep learning methodologies such as BERT, FinBERT and ULMFiT for sentiment analysis of earnings call transcripts. The objective is to investigate how Natural Language Processing (NLP) can be…

Computation and Language · Computer Science 2026-03-24 Umair Zakir , Evan Daykin , Amssatou Diagne , Jacob Faile

Contrastive learning techniques have been widely used in the field of computer vision as a means of augmenting datasets. In this paper, we extend the use of these contrastive learning embeddings to sentiment analysis tasks and demonstrate…

Computation and Language · Computer Science 2021-12-03 Ipsita Mohanty , Ankit Goyal , Alex Dotterweich

The enormous amount of data being generated on the web and social media has increased the demand for detecting online hate speech. Detecting hate speech will reduce their negative impact and influence on others. A lot of effort in the…

Computation and Language · Computer Science 2021-11-03 Hind Saleh , Areej Alhothali , Kawthar Moria

Detecting emotions in limited text datasets from under-resourced languages presents a formidable obstacle, demanding specialized frameworks and computational strategies. This study conducts a thorough examination of deep learning techniques…

Computation and Language · Computer Science 2024-03-12 Siddhanth Bhat

We consider the task of fine-grained sentiment analysis from the perspective of multiple instance learning (MIL). Our neural model is trained on document sentiment labels, and learns to predict the sentiment of text segments, i.e. sentences…

Computation and Language · Computer Science 2018-01-29 Stefanos Angelidis , Mirella Lapata

A sentiment analysis system powered by machine learning was created in this study to improve real-time social network public opinion monitoring. For sophisticated sentiment identification, the suggested approach combines cutting-edge…

Computation and Language · Computer Science 2025-02-25 Arsen Tolebay Nurlanuly

Sentiment analysis (SA) in Bengali is challenging due to this Indo-Aryan language's highly inflected properties with more than 160 different inflected forms for verbs and 36 different forms for noun and 24 different forms for pronouns. The…

Computation and Language · Computer Science 2020-12-15 Khondoker Ittehadul Islam , Md. Saiful Islam , Md Ruhul Amin

BERT, as one of the pretrianed language models, attracts the most attention in recent years for creating new benchmarks across GLUE tasks via fine-tuning. One pressing issue is to open up the blackbox and explain the decision makings of…

Computation and Language · Computer Science 2021-01-05 Zhengxuan Wu , Desmond C. Ong

Sentiment analysis (SA) has become an extensive research area in recent years impacting diverse fields including ecommerce, consumer business, and politics, driven by increasing adoption and usage of social media platforms. It is…

Computation and Language · Computer Science 2021-06-03 Sarojadevi Palani , Prabhu Rajagopal , Sidharth Pancholi

Sentiment analysis is a very important natural language processing activity in which one identifies the polarity of a text, whether it conveys positive, negative, or neutral sentiment. Along with the growth of social media and the Internet,…

Computation and Language · Computer Science 2025-09-30 Meysam Shirdel Bilehsavar , Negin Mahmoudi , Mohammad Jalili Torkamani , Kiana Kiashemshaki

We introduce a new language representation model in finance called Financial Embedding Analysis of Sentiment (FinEAS). In financial markets, news and investor sentiment are significant drivers of security prices. Thus, leveraging the…

Computation and Language · Computer Science 2021-11-22 Asier Gutiérrez-Fandiño , Miquel Noguer i Alonso , Petter Kolm , Jordi Armengol-Estapé