English
Related papers

Related papers: Sentiment-Aware Word and Sentence Level Pre-traini…

200 papers

The pre-training for language models captures general language understanding but fails to distinguish the affective impact of a particular context to a specific word. Recent works have sought to introduce contrastive learning (CL) for…

Computation and Language · Computer Science 2024-05-06 Jin Wang , Liang-Chih Yu , Xuejie Zhang

In natural language the intended meaning of a word or phrase is often implicit and depends on the context. In this work, we propose a simple yet effective method for sentiment analysis using contextual embeddings and a self-attention…

Computation and Language · Computer Science 2020-10-07 Katarzyna Biesialska , Magdalena Biesialska , Henryk Rybinski

Pre-trained language models (PLMs) have achieved great success in NLP and have recently been used for tasks in computational semantics. However, these tasks do not fully benefit from PLMs since meaning representations are not explicitly…

Computation and Language · Computer Science 2023-06-02 Chunliu Wang , Huiyuan Lai , Malvina Nissim , Johan Bos

Sentiment analysis is a crucial task in natural language processing (NLP) that enables the extraction of meaningful insights from textual data, particularly from dynamic platforms like Twitter and IMDB. This study explores a hybrid…

Computation and Language · Computer Science 2026-03-02 Aish Albladi , Md Kaosar Uddin , Minarul Islam , Cheryl Seals

Recent advancements in Deep and Self-Supervised Learning (SSL) have led to substantial improvements in Speech Emotion Recognition (SER) performance, reaching unprecedented levels. However, obtaining sufficient amounts of accurately labeled…

Computation and Language · Computer Science 2025-02-25 Bulat Khaertdinov , Pedro Jeuris , Annanda Sousa , Enrique Hortal

Sentence embedding is an important research topic in natural language processing (NLP) since it can transfer knowledge to downstream tasks. Meanwhile, a contextualized word representation, called BERT, achieves the state-of-the-art…

Computation and Language · Computer Science 2020-06-02 Bin Wang , C. -C. Jay Kuo

A standard paradigm for sentiment analysis is to rely on a singular LLM and makes the decision in a single round under the framework of in-context learning. This framework suffers the key disadvantage that the single-turn output generated…

Computation and Language · Computer Science 2023-11-06 Xiaofei Sun , Xiaoya Li , Shengyu Zhang , Shuhe Wang , Fei Wu , Jiwei Li , Tianwei Zhang , Guoyin Wang

With the advent of word embeddings, lexicons are no longer fully utilized for sentiment analysis although they still provide important features in the traditional setting. This paper introduces a novel approach to sentiment analysis that…

Computation and Language · Computer Science 2017-08-24 Bonggun Shin , Timothy Lee , Jinho D. Choi

Emotion recognition in conversation (ERC) aims to detect the emotion for each utterance in a given conversation. The newly proposed ERC models have leveraged pre-trained language models (PLMs) with the paradigm of pre-training and…

Computation and Language · Computer Science 2022-07-28 Jingjie Yi , Deqing Yang , Siyu Yuan , Caiyan Cao , Zhiyao Zhang , Yanghua Xiao

The same multi-word expressions may have different meanings in different sentences. They can be mainly divided into two categories, which are literal meaning and idiomatic meaning. Non-contextual-based methods perform poorly on this…

Computation and Language · Computer Science 2022-04-14 Zheng Chu , Ziqing Yang , Yiming Cui , Zhigang Chen , Ming Liu

Emotion classification is a challenging task in NLP due to the inherent idiosyncratic and subjective nature of linguistic expression, especially with code-mixed data. Pre-trained language models (PLMs) have achieved high performance for…

Computation and Language · Computer Science 2024-02-06 Kushal Tatariya , Heather Lent , Johannes Bjerva , Miryam de Lhoneux

Word Sense Disambiguation (WSD) is a historical task in computational linguistics that has received much attention over the years. However, with the advent of Large Language Models (LLMs), interest in this task (in its classical definition)…

Computation and Language · Computer Science 2025-03-12 Pierpaolo Basile , Lucia Siciliani , Elio Musacchio , Giovanni Semeraro

Large, pre-trained neural networks consisting of self-attention layers (transformers) have recently achieved state-of-the-art results on several speech emotion recognition (SER) datasets. These models are typically pre-trained in…

Sentiment classification, a complex task in natural language processing, becomes even more challenging when analyzing passages with multiple conflicting tones. Typically, longer passages exacerbate this issue, leading to decreased model…

Machine Learning · Computer Science 2025-05-13 Jan Kościałkowski , Paweł Marcinkowski

Determining the intended sense of words in text - word sense disambiguation (WSD) - is a long standing problem in natural language processing. Recently, researchers have shown promising results using word vectors extracted from a neural…

Computation and Language · Computer Science 2016-11-08 Dayu Yuan , Julian Richardson , Ryan Doherty , Colin Evans , Eric Altendorf

We propose a segmental neural language model that combines the generalization power of neural networks with the ability to discover word-like units that are latent in unsegmented character sequences. In contrast to previous segmentation…

Computation and Language · Computer Science 2019-06-19 Kazuya Kawakami , Chris Dyer , Phil Blunsom

Recent advances in Speech Large Language Models (Speech LLMs) have led to great progress in speech understanding tasks such as Automatic Speech Recognition (ASR) and Speech Emotion Recognition (SER). However, whether these models can…

Sound · Computer Science 2025-12-01 Chen Li , Peiji Yang , Yicheng Zhong , Jianxing Yu , Zhisheng Wang , Zihao Gou , Wenqing Chen , Jian Yin

Sentiment analysis is a process widely used in opinion mining campaigns conducted today. This phenomenon presents applications in a variety of fields, especially in collecting information related to the attitude or satisfaction of users…

Computation and Language · Computer Science 2020-09-08 George-Eduard Zaharia , George-Alexandru Vlad , Dumitru-Clementin Cercel , Traian Rebedea , Costin-Gabriel Chiru

Aspect-based sentiment classification (ABSC) is a very challenging subtask of sentiment analysis (SA) and suffers badly from the class-imbalance. Existing methods only process sentences independently, without considering the domain-level…

Computation and Language · Computer Science 2022-02-22 Zhenxin Wu , Jiazheng Gong , Kecen Guo , Guanye Liang , Qingliang Che , Bo Liu

Recent developments in generative AI have shone a spotlight on high-performance synthetic text generation technologies. The now wide availability and ease of use of such models highlights the urgent need to provide equally powerful…

Computation and Language · Computer Science 2023-10-25 Alan Cowap , Yvette Graham , Jennifer Foster