English
Related papers

Related papers: EmoBench-M: Benchmarking Emotional Intelligence fo…

200 papers

Descriptive Multimodal Emotion Recognition (DMER) has garnered increasing research attention. Unlike traditional discriminative paradigms that rely on predefined emotion taxonomies, DMER aims to describe human emotional state using…

Human-Computer Interaction · Computer Science 2025-09-29 Zheng Lian , Licai Sun , Lan Chen , Haoyu Chen , Zebang Cheng , Fan Zhang , Ziyu Jia , Ziyang Ma , Fei Ma , Xiaojiang Peng , Jianhua Tao

With the rapid advancement of Generative AI technology, Multimodal Large Language Models(MLLMs) have the potential to act as AI software engineers capable of executing complex web application development. Considering that the model requires…

Computation and Language · Computer Science 2025-06-10 Zhiyu Lin , Zhengda Zhou , Zhiyuan Zhao , Tianrui Wan , Yilun Ma , Junyu Gao , Xuelong Li

Multimodal Emotion Recognition (MER) is critical for interpreting real-world interactions. While Multimodal Large Language Models (MLLM) have shown promise in MER, their internal decision-making mechanisms under modality conflict and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yueru Sun , Yimeng Zhang , Haoyu Gu , Nuo Chen , Dong She , Xianrong Yao , Yang Gao , Zhanpeng Jin

Multimodal large language models (MLLMs), which integrate language and visual cues for problem-solving, are crucial for advancing artificial general intelligence (AGI). However, current benchmarks for measuring the intelligence of MLLMs…

As AI agents increasingly operate in open, real-world environments, they require a deep synergy of multimodal perception, tool invocation with multi-hop reasoning, and dynamic interaction with users. However, existing benchmarks fail to…

Artificial Intelligence · Computer Science 2026-05-28 Yunqi Liu , Tong Niu , Zitong Wang , Zhenlong Dai , Yuqi Qing , Weiqiang Wang , Jian Liu

While Multimodal Large Language Models (MLLMs) show promising performance in automated electrocardiogram interpretation, it remains unclear whether they genuinely perform actual step-by-step reasoning or just rely on superficial visual…

Machine Learning · Computer Science 2026-03-17 Jungwoo Oh , Hyunseung Chung , Junhee Lee , Min-Gyu Kim , Hangyul Yoon , Ki Seong Lee , Youngchae Lee , Muhan Yeo , Edward Choi

Multimodal emotion recognition plays a crucial role in enhancing user experience in human-computer interaction. Over the past few decades, researchers have proposed a series of algorithms and achieved impressive progress. Although each…

Human-Computer Interaction · Computer Science 2024-04-23 Zheng Lian , Licai Sun , Yong Ren , Hao Gu , Haiyang Sun , Lan Chen , Bin Liu , Jianhua Tao

Speech Language Models (SLMs) have made significant progress in spoken language understanding. Yet it remains unclear whether they can fully perceive non lexical vocal cues alongside spoken words, and respond with empathy that aligns with…

Computation and Language · Computer Science 2026-03-06 Li Zhou , Lutong Yu , You Lyu , Yihang Lin , Zefeng Zhao , Junyi Ao , Yuhao Zhang , Benyou Wang , Haizhou Li

Memory systems address the challenge of context loss in Large Language Model during prolonged interactions. However, compared to human cognition, the efficacy of these systems in processing emotion-related information remains inconclusive.…

Computation and Language · Computer Science 2026-03-02 Peng Liu , Zhen Tao , Jihao Zhao , Ding Chen , Yansong Zhang , Cuiping Li , Zhiyu Li , Hong Chen

As a prominent direction of Artificial General Intelligence (AGI), Multimodal Large Language Models (MLLMs) have garnered increased attention from both industry and academia. Building upon pre-trained LLMs, this family of models further…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Chaoyou Fu , Yi-Fan Zhang , Shukang Yin , Bo Li , Xinyu Fang , Sirui Zhao , Haodong Duan , Xing Sun , Ziwei Liu , Liang Wang , Caifeng Shan , Ran He

Multimodal emotion understanding requires effective integration of text, audio, and visual modalities for both discrete emotion recognition and continuous sentiment analysis. We present EGMF, a unified framework combining expert-guided…

Computation and Language · Computer Science 2026-01-13 Jiaqi Qiao , Xiujuan Xu , Xinran Li , Yu Liu

Large language models (LLMs) and their variants have shown extraordinary efficacy across numerous downstream natural language processing (NLP) tasks, which has presented a new vision for the development of NLP. Despite their remarkable…

Computation and Language · Computer Science 2024-01-18 Yazhou Zhang , Mengyao Wang , Youxi Wu , Prayag Tiwari , Qiuchi Li , Benyou Wang , Jing Qin

While Large Language Models (LLMs) have achieved remarkable success in cognitive and reasoning benchmarks, they exhibit a persistent deficit in anthropomorphic intelligence-the capacity to navigate complex social, emotional, and ethical…

Computation and Language · Computer Science 2025-12-29 Jiaxin Liu , Peiyi Tu , Wenyu Chen , Yihong Zhuang , Xinxia Ling , Anji Zhou , Chenxi Wang , Zhuo Han , Zhengkai Yang , Junbo Zhao , Zenan Huang , Yuanyuan Wang

Multimodal Large Language Models (MLLMs) show promising results as decision-making engines for embodied agents operating in complex, physical environments. However, existing benchmarks often prioritize high-level planning or spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Dayong Liu , Chao Xu , Weihong Chen , Suyu Zhang , Juncheng Wang , Jiankang Deng , Baigui Sun , Yang Liu

Multimodal Large Language Models (MLLMs) demonstrate impressive problem-solving abilities across a wide range of tasks and domains. However, their capacity for face understanding has not been systematically studied. To address this gap, we…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Kartik Narayan , Vibashan VS , Vishal M. Patel

Large Language Models (LLMs) have shown strong potential as conversational agents. Yet, their effectiveness remains limited by deficiencies in robust long-term memory, particularly in complex, long-term web-based services such as online…

Computation and Language · Computer Science 2026-02-03 Tiantian Chen , Jiaqi Lu , Ying Shen , Lin Zhang

Recent progress in Multimodal Large Language Models (MLLMs) has demonstrated remarkable advances in perception and reasoning, suggesting their potential for embodied intelligence. While recent studies have evaluated embodied MLLMs in…

Artificial Intelligence · Computer Science 2026-04-23 Shengyu Guo , Tongrui Ye , Jianbo Zhang , Zicheng Zhang , Chunyi Li , Guangtao Zhai

Large Multimodal Models (LMMs) exhibit impressive cross-modal understanding and reasoning abilities, often assessed through multiple-choice questions (MCQs) that include an image, a question, and several options. However, many benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Jinsheng Huang , Liang Chen , Taian Guo , Fu Zeng , Yusheng Zhao , Bohan Wu , Ye Yuan , Haozhe Zhao , Zhihui Guo , Yichi Zhang , Jingyang Yuan , Wei Ju , Luchen Liu , Tianyu Liu , Baobao Chang , Ming Zhang

Multimodal large language models (MLLMs) have shown great potential in perception and interpretation tasks, but their capabilities in predictive reasoning remain under-explored. To address this gap, we introduce a novel benchmark that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Mingwei Zhu , Leigang Sha , Yu Shu , Kangjia Zhao , Tiancheng Zhao , Jianwei Yin

The recent advancement of Multimodal Large Language Models (MLLMs) is transforming human-computer interaction (HCI) from surface-level exchanges into more nuanced and emotionally intelligent communication. To realize this shift, emotion…

Artificial Intelligence · Computer Science 2026-01-06 Hyeongseop Rha , Jeong Hun Yeo , Yeonju Kim , Yong Man Ro