English
Related papers

Related papers: SentiXRL: An advanced large language Model Framewo…

200 papers

Understanding sentiment in complex textual expressions remains a fundamental challenge in affective computing. To address this, we propose a Dynamic Fusion Learning Model (DyFuLM), a multimodal framework designed to capture both…

Computation and Language · Computer Science 2025-12-02 Ruohan Zhou , Jiachen Yuan , Churui Yang , Wenzheng Huang , Guoyan Zhang , Shiyao Wei , Jiazhen Hu , Ning Xin , Md Maruf Hasan

We present SegLLM, a novel multi-round interactive reasoning segmentation model that enhances LLM-based segmentation by exploiting conversational memory of both visual and textual outputs. By leveraging a mask-aware multimodal LLM, SegLLM…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 XuDong Wang , Shaolun Zhang , Shufan Li , Konstantinos Kallidromitis , Kehan Li , Yusuke Kato , Kazuki Kozuka , Trevor Darrell

Structured data offers a sophisticated mechanism for the organization of information. Existing methodologies for the text-serialization of structured data in the context of large language models fail to adequately address the heterogeneity…

Computation and Language · Computer Science 2024-02-20 YiQiu Guo , Yuchen Yang , Ya Zhang , Yu Wang , Yanfeng Wang

While end-to-end Automatic Speech Recognition (ASR) models have shown impressive performance in transcribing general speech, they often struggle to accurately recognize contextually relevant keywords, such as proper nouns or user-specific…

Computation and Language · Computer Science 2025-07-17 Shilin Zhou , Zhenghua Li

Large Multimodal Models (LMMs), or Vision-Language Models (VLMs), have shown impressive capabilities in a wide range of visual tasks. However, they often struggle with fine-grained visual reasoning, failing to identify domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Yucheng Shi , Quanzheng Li , Jin Sun , Xiang Li , Ninghao Liu

This study explores transformer-based models such as BERT, mBERT, and XLM-R for multi-lingual sentiment analysis across diverse linguistic structures. Key contributions include the identification of XLM-R superior adaptability in…

Computation and Language · Computer Science 2025-01-23 Mikhail Krasitskii , Olga Kolesnikova , Liliana Chanona Hernandez , Grigori Sidorov , Alexander Gelbukh

While speech Large Language Models (LLMs) excel at conventional tasks like basic speech recognition, they lack fine-grained, multi-dimensional perception. This deficiency is evident in their struggle to disentangle complex features like…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-13 Guojian Li , Zhixian Zhao , Zhennan Lin , Jingbin Hu , Qirui Zhan , Yuang Cao , Pengyuan Xie , Chuan Xie , Jie Liu , Qiang Zhang , Zhonghua Fu , Lei Xie

Speech emotion recognition is a challenging task and an important step towards more natural human-machine interaction. We show that pre-trained language models can be fine-tuned for text emotion recognition, achieving an accuracy of 69.5%…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-06 Verena Heusser , Niklas Freymuth , Stefan Constantin , Alex Waibel

Understanding sentiment in multimodal conversations is a complex yet crucial challenge toward building emotionally intelligent AI systems. The Multimodal Conversational Aspect-based Sentiment Analysis (MCABSA) Challenge invited participants…

Computation and Language · Computer Science 2025-12-30 Zhiqiang Gao , Shihao Gao , Zixing Zhang , Yihao Guo , Hongyu Chen , Jing Han

Recognizing multiple labels of images is a practical and challenging task, and significant progress has been made by searching semantic-aware regions and modeling label dependency. However, current methods cannot locate the semantic regions…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Tianshui Chen , Muxin Xu , Xiaolu Hui , Hefeng Wu , Liang Lin

Large Language Models (LLMs) have rapidly become central to NLP, demonstrating their ability to adapt to various tasks through prompting techniques, including sentiment analysis. However, we still have a limited understanding of how these…

Computation and Language · Computer Science 2025-06-02 Dario Di Palma , Alessandro De Bellis , Giovanni Servedio , Vito Walter Anelli , Fedelucio Narducci , Tommaso Di Noia

Speech emotion recognition is a challenging task because the emotion expression is complex, multimodal and fine-grained. In this paper, we propose a novel multimodal deep learning approach to perform fine-grained emotion recognition from…

Sound · Computer Science 2021-07-16 Hang Li , Wenbiao Ding , Zhongqin Wu , Zitao Liu

Low-resource African languages remain underrepresented in sentiment analysis, limiting both lexical coverage and the performance of multilingual Natural Language Processing (NLP) systems. This study proposes TriLex, a three-stage retrieval…

Recently, neural networks have achieved great success on sentiment classification due to their ability to alleviate feature engineering. However, one of the remaining challenges is to model long texts in document-level sentiment…

Computation and Language · Computer Science 2016-10-18 Jiacheng Xu , Danlu Chen , Xipeng Qiu , Xuangjing Huang

Large language models (LLMs) show promising capabilities in predicting human emotions from text. However, the mechanisms through which these models process emotional stimuli remain largely unexplored. Our study addresses this gap by…

Computation and Language · Computer Science 2025-07-01 Ala N. Tak , Amin Banayeeanzade , Anahita Bolourani , Mina Kian , Robin Jia , Jonathan Gratch

Large Language Models (LLMs) with their strong task-handling capabilities have shown remarkable advancements across a spectrum of fields, moving beyond natural language understanding. However, their proficiency within the chemistry domain…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Khiem Le , Zhichun Guo , Kaiwen Dong , Xiaobao Huang , Bozhao Nan , Roshni Iyer , Xiangliang Zhang , Olaf Wiest , Wei Wang , Ting Hua , Nitesh V. Chawla

The emergence of multimodal large language models (MLLMs) advances multimodal emotion recognition (MER) to the next level, from naive discriminative tasks to complex emotion understanding with advanced video understanding abilities and…

Human-Computer Interaction · Computer Science 2025-05-08 Zheng Lian , Haoyu Chen , Lan Chen , Haiyang Sun , Licai Sun , Yong Ren , Zebang Cheng , Bin Liu , Rui Liu , Xiaojiang Peng , Jiangyan Yi , Jianhua Tao

With the rapid advancement of Multimodal Large Language Models (MLLMs), they have demonstrated exceptional capabilities across a variety of vision-language tasks. However, current evaluation benchmarks predominantly focus on objective…

Computation and Language · Computer Science 2025-09-24 Haokun Li , Yazhou Zhang , Jizhi Ding , Qiuchi Li , Peng Zhang

In this paper, we propose a self-attentive bidirectional long short-term memory (SA-BiLSTM) network to predict multiple emotions for the EmotionX challenge. The BiLSTM exhibits the power of modeling the word dependencies, and extracting the…

Computation and Language · Computer Science 2018-06-21 Linkai Luo , Haiqing Yang , Francis Y. L. Chin

Multimodal large language models (MLLMs) have been widely applied across various fields due to their powerful perceptual and reasoning capabilities. In the realm of psychology, these models hold promise for a deeper understanding of human…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jinpeng Hu , Hongchang Shi , Chongyuan Dai , Zhuo Li , Peipei Song , Meng Wang