English
Related papers

Related papers: SentiXRL: An advanced large language Model Framewo…

200 papers

Speech emotion recognition (SER) has made significant strides with the advent of powerful self-supervised learning (SSL) models. However, the generalization of these models to diverse languages and emotional expressions remains a challenge.…

Computation and Language · Computer Science 2024-08-16 Mohamed Osman , Daniel Z. Kaplan , Tamer Nadeem

Large language models (LLMs) have been widely adopted due to their remarkable performance across various applications, driving the accelerated development of a large number of diverse models. However, these individual LLMs show limitations…

Computation and Language · Computer Science 2025-06-13 Kaushal Kumar Maurya , KV Aditya Srivatsa , Ekaterina Kochmar

Multimodal Large Language Models (MLLMs) have made substantial progress in recent years. However, their rigorous evaluation within specialized domains like finance is hindered by the absence of datasets characterized by professional-level…

Artificial Intelligence · Computer Science 2025-11-25 Shuangyan Deng , Haizhou Peng , Jiachen Xu , Rui Mao , Ciprian Doru Giurcăneanu , Jiamou Liu

We introduce SAM4MLLM, an innovative approach which integrates the Segment Anything Model (SAM) with Multi-Modal Large Language Models (MLLMs) for pixel-aware tasks. Our method enables MLLMs to learn pixel-level location information without…

Artificial Intelligence · Computer Science 2024-12-17 Yi-Chia Chen , Wei-Hua Li , Cheng Sun , Yu-Chiang Frank Wang , Chu-Song Chen

Recently, the usage of speech self-supervised models (SSL) for downstream tasks has been drawing a lot of attention. While large pre-trained models commonly outperform smaller models trained from scratch, questions regarding the optimal…

Machine Learning · Computer Science 2024-05-08 Daria Diatlova , Anton Udalov , Vitalii Shutov , Egor Spirin

We propose a novel framework that leverages large language models (LLMs) to guide the rank selection in tensor network models for higher-order data analysis. By utilising the intrinsic reasoning capabilities and domain knowledge of LLMs,…

Machine Learning · Computer Science 2024-10-15 Giorgos Iacovides , Wuyang Zhou , Danilo Mandic

Sentiment Analysis and Emotion Detection in conversation is key in several real-world applications, with an increase in modalities available aiding a better understanding of the underlying emotions. Multi-modal Emotion Detection and…

Computation and Language · Computer Science 2020-08-04 Aman Shenoy , Ashish Sardana

This work investigates the capabilities of large language models (LLMs) in detecting and understanding human emotions through text. Drawing upon emotion models from psychology, we adopt an interdisciplinary perspective that integrates…

Computation and Language · Computer Science 2025-03-10 Florian Lecourt , Madalina Croitoru , Konstantin Todorov

Recently, large language models (LLMs) with hundreds of billions of parameters have demonstrated the emergent ability, surpassing traditional methods in various domains even without fine-tuning over domain-specific data. However, when it…

Computation and Language · Computer Science 2025-03-10 Xinyu Wei , Luojia Liu

Semantic segmentation plays a crucial role in enabling machines to understand and interpret visual scenes at a pixel level. While traditional segmentation methods have achieved remarkable success, their generalization to diverse scenes and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Philip Hughes , Larry Burns , Luke Adams

Large language models (LLMs) demonstrate strong cognitive intelligence (IQ), yet many real-world interactions also require emotional intelligence (EQ) to produce responses that are both factually reliable and emotionally appropriate. In…

Computation and Language · Computer Science 2026-03-18 Yifei Zhang , Mingyang Li , Henry Gao , Liang Zhao

Recognising emotions in context involves identifying an individual's apparent emotions while considering contextual cues from the surrounding scene. Previous approaches to this task have typically designed explicit scene-encoding…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Alexandros Xenos , Niki Maria Foteinopoulou , Ioanna Ntinou , Ioannis Patras , Georgios Tzimiropoulos

This paper introduces a novel approach for multimodal sentiment analysis on social media, particularly in the context of natural disasters, where understanding public sentiment is crucial for effective crisis management. Unlike conventional…

Machine Learning · Computer Science 2025-08-20 Meriem Zerkouk , Miloud Mihoubi , Belkacem Chikhaoui

Large Language Models (LLMs) excel in handling general knowledge tasks, yet they struggle with user-specific personalization, such as understanding individual emotions, writing styles, and preferences. Personalized Large Language Models…

Artificial Intelligence · Computer Science 2025-09-23 Jiahong Liu , Zexuan Qiu , Zhongyang Li , Quanyu Dai , Wenhao Yu , Jieming Zhu , Minda Hu , Menglin Yang , Tat-Seng Chua , Irwin King

Fine-tuning of Large Language Models (LLMs) for downstream tasks, performed on domain-specific data has shown significant promise. However, commercial use of such LLMs is limited by the high computational cost required for their deployment…

Computation and Language · Computer Science 2025-03-06 Boris Nazarov , Darya Frolova , Yackov Lubarsky , Alexei Gaissinski , Pavel Kisilev

We present a statistical parsing framework for sentence-level sentiment classification in this article. Unlike previous works that employ syntactic parsing results for sentiment analysis, we develop a statistical parser to directly analyze…

Computation and Language · Computer Science 2015-03-06 Li Dong , Furu Wei , Shujie Liu , Ming Zhou , Ke Xu

We propose a framework for multimodal sentiment analysis and emotion recognition using convolutional neural network-based feature extraction from text and visual modalities. We obtain a performance improvement of 10% over the state of the…

Multimedia · Computer Science 2017-08-01 Erik Cambria , Devamanyu Hazarika , Soujanya Poria , Amir Hussain , R. B. V. Subramaanyam

Recent advances in product bundling have leveraged multimodal information through sophisticated encoders, but remain constrained by limited semantic understanding and a narrow scope of knowledge. Therefore, some attempts employ In-context…

Information Retrieval · Computer Science 2025-02-04 Xiaohao Liu , Jie Wu , Zhulin Tao , Yunshan Ma , Yinwei Wei , Tat-seng Chua

Large language models (LLMs) have demonstrated strong performance in sentence-level machine translation, but scaling to document-level translation remains challenging, particularly in modeling long-range dependencies and discourse phenomena…

Computation and Language · Computer Science 2025-08-29 Miguel Moura Ramos , Patrick Fernandes , Sweta Agrawal , André F. T. Martins

The rapid advancement of Large Language Models (LLMs) has spurred discussions about their potential to enhance quantitative trading strategies. LLMs excel in analyzing sentiments about listed companies from financial news, providing…

Computation and Language · Computer Science 2024-05-07 Haohan Zhang , Fengrui Hua , Chengjin Xu , Hao Kong , Ruiting Zuo , Jian Guo