English
Related papers

Related papers: Towards Unified Music Emotion Recognition across D…

200 papers

Music Emotion Recognition (MER) is a task deeply connected to human perception, relying heavily on subjective annotations collected from contributors. Prior studies tend to focus on specific musical styles rather than incorporating a…

Sound · Computer Science 2025-11-14 Joann Ching , Gerhard Widmer

Symbolic Music Emotion Recognition(SMER) is to predict music emotion from symbolic data, such as MIDI and MusicXML. Previous work mainly focused on learning better representation via (mask) language model pre-training but ignored the…

Sound · Computer Science 2022-01-19 Jibao Qiu , C. L. Philip Chen , Tong Zhang

Multimodal emotion recognition (MER) seeks to integrate various modalities to predict emotional states accurately. However, most current research focuses solely on the fusion of audio and text features, overlooking the valuable information…

Sound · Computer Science 2025-04-08 Xuechun Shao , Yinfeng Yu , Liejun Wang

Multimodal emotion recognition (MER) aims to identify human emotions by combining data from various modalities such as language, audio, and vision. Despite the recent advances of MER approaches, the limitations in obtaining extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yehun Song , Sunyoung Cho

Multimodal emotion recognition (MER) aims to detect the emotional status of a given expression by combining the speech and text information. Intuitively, label information should be capable of helping the model locate the salient…

Computation and Language · Computer Science 2023-09-06 Peiying Wang , Sunlu Zeng , Junqing Chen , Lu Fan , Meng Chen , Youzheng Wu , Xiaodong He

Deep learning models for music have advanced drastically in recent years, but how good are machine learning models at capturing emotion, and what challenges are researchers facing? In this paper, we provide a comprehensive overview of the…

Sound · Computer Science 2025-06-25 Jaeyong Kang , Dorien Herremans

Multimodal music emotion recognition (MMER) is an emerging discipline in music information retrieval that has experienced a surge in interest in recent years. This survey provides a comprehensive overview of the current state-of-the-art in…

Multimedia · Computer Science 2025-04-29 Rashini Liyanarachchi , Aditya Joshi , Erik Meijering

The Music Emotion Recognition (MER) field has seen steady developments in recent years, with contributions from feature engineering, machine learning, and deep learning. The landscape has also shifted from audio-centric systems to bimodal…

Emotion is a complicated notion present in music that is hard to capture even with fine-tuned feature engineering. In this paper, we investigate the utility of state-of-the-art pre-trained deep audio embedding methods to be used in the…

Sound · Computer Science 2021-04-15 Eunjeong Koh , Shlomo Dubnov

Multi-modal Multi-label Emotion Recognition (MMER) aims to identify various human emotions from heterogeneous visual, audio and text modalities. Previous methods mainly focus on projecting multiple modalities into a common latent space and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Yi Zhang , Mingyuan Chen , Jundong Shen , Chongjun Wang

In this paper, we propose a novel framework for recognizing both discrete and dimensional emotions. In our framework, deep features extracted from foundation models are used as robust acoustic and visual representations of raw video. Three…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-18 Haotian Wang , Yuxuan Xi , Hang Chen , Jun Du , Yan Song , Qing Wang , Hengshun Zhou , Chenxi Wang , Jiefeng Ma , Pengfei Hu , Ya Jiang , Shi Cheng , Jie Zhang , Yuzhe Weng

Music Emotion Recogniser (MER) research faces challenges due to limited high-quality annotated datasets and difficulties in addressing cross-track feature drift. This work presents two primary contributions to address these issues.…

Sound · Computer Science 2025-12-18 Qilin Li , C. L. Philip Chen , Tong Zhang

Emotion recognition plays a vital role in enhancing human-computer interaction. In this study, we tackle the MER-SEMI challenge of the MER2025 competition by proposing a novel multimodal emotion recognition framework. To address the issue…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Juewen Hu , Yexin Li , Jiulin Li , Shuo Chen , Pring Wong

Music emotion recognition (MER) aims to identify the emotions conveyed in a given musical piece. However, currently, in the field of MER, the available public datasets have limited sample sizes. Recently, segment-based methods for…

Sound · Computer Science 2025-04-23 Yifu Sun , Xulong Zhang , Monan Zhou , Wei Li

Emotion recognition is involved in several real-world applications. With an increase in available modalities, automatic understanding of emotions is being performed more accurately. The success in Multimodal Emotion Recognition (MER),…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Riccardo Franceschini , Enrico Fini , Cigdem Beyan , Alessandro Conti , Federica Arrigoni , Elisa Ricci

Accurate emotion perception is crucial for various applications, including human-computer interaction, education, and counseling. However, traditional single-modality approaches often fail to capture the complexity of real-world emotional…

Artificial Intelligence · Computer Science 2024-11-05 Zebang Cheng , Zhi-Qi Cheng , Jun-Yan He , Jingdong Sun , Kai Wang , Yuxiang Lin , Zheng Lian , Xiaojiang Peng , Alexander Hauptmann

Human multimodal emotion recognition (MER) aims to perceive human emotions via language, visual and acoustic modalities. Despite the impressive performance of previous MER approaches, the inherent multimodal heterogeneities still haunt and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Yong Li , Yuanzhi Wang , Zhen Cui

This paper aims to test whether a multi-modal approach for music emotion recognition (MER) performs better than a uni-modal one on high-level song features and lyrics. We use 11 song features retrieved from the Spotify API, combined lyrics…

Sound · Computer Science 2023-02-28 Tibor Krols , Yana Nikolova , Ninell Oldenburg

Music Emotion Recognition involves the automatic identification of emotional elements within music tracks, and it has garnered significant attention due to its broad applicability in the field of Music Information Retrieval. It can also be…

Sound · Computer Science 2023-08-29 Kexin Zhu , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

Speech emotion recognition (SER) has many challenges, but one of the main challenges is that each framework does not have a unified standard. In this paper, we propose SpeechEQ, a framework for unifying SER tasks based on a multi-scale…

Sound · Computer Science 2022-07-29 Zuheng Kang , Junqing Peng , Jianzong Wang , Jing Xiao
‹ Prev 1 2 3 10 Next ›