English
Related papers

Related papers: Transfer Learning with Joint Fine-Tuning for Multi…

200 papers

Images have become one of the most popular types of media through which users convey their emotions within online social networks. Although vast amount of research is devoted to sentiment analysis of textual data, there has been very…

Computer Vision and Pattern Recognition · Computer Science 2014-11-24 Can Xu , Suleyman Cetintas , Kuang-Chih Lee , Li-Jia Li

Multimodal Emotion Recognition (MER) aims to automatically identify and understand human emotional states by integrating information from various modalities. However, the scarcity of annotated multimodal data significantly hinders the…

Human-Computer Interaction · Computer Science 2024-09-11 Zhixian Zhao , Haifeng Chen , Xi Li , Dongmei Jiang , Lei Xie

Visual media are powerful means of expressing emotions and sentiments. The constant generation of new content in social networks highlights the need of automated visual sentiment analysis tools. While Convolutional Neural Networks (CNNs)…

Multimedia · Computer Science 2015-08-25 Victor Campos , Amaia Salvador , Brendan Jou , Xavier Giró-i-Nieto

This study integrates real-time sentiment analysis from financial news, GPT-2 and FinBERT, with technical indicators and time-series models like ARIMA and ETS to optimize S&P 500 trading strategies. By merging sentiment data with momentum…

Computational Finance · Quantitative Finance 2025-07-15 Haojie Liu , Zihan Lin , Randall R. Rojas

Multimodal sentiment analysis (MSA) identifies individuals' sentiment states in videos by integrating visual, audio, and text modalities. Despite progress in existing methods, the inherent modality heterogeneity limits the effective capture…

Machine Learning · Computer Science 2025-12-19 Shanmin Wang , Chengguang Liu , Qingshan Liu

In this study, we test transfer learning approach on Russian sentiment benchmark datasets using additional train sample created with distant supervision technique. We compare several variants of combining additional data with benchmark…

Computation and Language · Computer Science 2021-07-07 Anton Golubev , Natalia Loukachevitch

In an era where financial markets are heavily influenced by many static and dynamic factors, it has become increasingly critical to carefully integrate diverse data sources with machine learning for accurate stock price prediction. This…

Statistical Finance · Quantitative Finance 2025-03-10 Furkan Karadaş , Bahaeddin Eravcı , Ahmet Murat Özbayoğlu

Numerous recent techniques for text style transfer characterize their approaches as variants of reinforcement learning and preference optimization. In this work, we consider the relationship between these approaches and a class of…

Computation and Language · Computer Science 2024-07-30 Shuai Liu , Jonathan May

Modality representation learning is an important problem for multimodal sentiment analysis (MSA), since the highly distinguishable representations can contribute to improving the analysis effect. Previous works of MSA have usually focused…

Multimedia · Computer Science 2023-01-31 Peipei Liu , Xin Zheng , Hong Li , Jie Liu , Yimo Ren , Hongsong Zhu , Limin Sun

Sentiment analysis, a popular technique for opinion mining, has been used by the software engineering research community for tasks such as assessing app reviews, developer emotions in issue trackers and developer opinions on APIs. Past…

Computation and Language · Computer Science 2018-12-27 Achyudh Ram , Meiyappan Nagappan

In this work we examine the performance enhancement in classification of medical imaging data when image features are combined with associated non-image data. We compare the performance of eight state-of-the-art deep neural networks in…

Image and Video Processing · Electrical Eng. & Systems 2021-11-30 Spencer A. Thomas

Aspect-based sentiment analysis of review texts is of great value for understanding user feedback in a fine-grained manner. It has in general two sub-tasks: (i) extracting aspects from each review, and (ii) classifying aspect-based reviews…

Computation and Language · Computer Science 2020-10-15 Jiaxin Huang , Yu Meng , Fang Guo , Heng Ji , Jiawei Han

This study presents a thorough examination of various Generative Pretrained Transformer (GPT) methodologies in sentiment analysis, specifically in the context of Task 4 on the SemEval 2017 dataset. Three primary strategies are employed: 1)…

Computation and Language · Computer Science 2023-07-25 Kiana Kheiri , Hamid Karimi

There has been a good amount of progress in sentiment analysis over the past 10 years, including the proposal of new methods and the creation of benchmark datasets. In some papers, however, there is a tendency to compare models only on one…

Computation and Language · Computer Science 2017-09-14 Jeremy Barnes , Roman Klinger , Sabine Schulte im Walde

Sentiment analysis is known as one of the most crucial tasks in the field of natural language processing and Convolutional Neural Network (CNN) is one of those prominent models that is commonly used for this aim. Although convolutional…

Computation and Language · Computer Science 2021-02-24 Hossein Sadr , Mozhdeh Nazari Solimandarabi , Mir Mohsen Pedram , Mohammad Teshnehlab

Multimodal sentiment analysis has become an important research area in the field of artificial intelligence. With the latest advances in deep learning, this technology has reached new heights. It has great potential for both application and…

Computation and Language · Computer Science 2023-07-06 Songning Lai , Xifeng Hu , Haoxuan Xu , Zhaoxia Ren , Zhi Liu

In this work, we propose a new model for aspect-based sentiment analysis. In contrast to previous approaches, we jointly model the detection of aspects and the classification of their polarity in an end-to-end trainable neural network. We…

Computation and Language · Computer Science 2018-08-29 Martin Schmitt , Simon Steinheber , Konrad Schreiber , Benjamin Roth

Fine-tuning is a popular way of exploiting knowledge contained in a pre-trained convolutional network for a new visual recognition task. However, the orthogonal setting of transferring knowledge from a pretrained network to a visually…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Amelie Royer , Christoph H. Lampert

Humans express their emotions via facial expressions, voice intonation and word choices. To infer the nature of the underlying emotion, recognition models may use a single modality, such as vision, audio, and text, or a combination of…

Machine Learning · Computer Science 2022-02-21 Vandana Rajan , Alessio Brutti , Andrea Cavallaro

There has been much recent work on image captioning models that describe the factual aspects of an image. Recently, some models have incorporated non-factual aspects into the captions, such as sentiment or style. However, such models…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Omid Mohamad Nezami , Mark Dras , Stephen Wan , Cecile Paris