English
Related papers

Related papers: VoxEmo: Benchmarking Speech Emotion Recognition wi…

200 papers

Large Audio-Language Models (LALMs) are increasingly integrated into daily applications, yet their generative biases remain underexplored. Existing speech fairness benchmarks rely on synthetic speech and Multiple-Choice Questions (MCQs),…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-21 Yi-Cheng Lin , Yusuke Hirota , Sung-Feng Huang , Hung-yi Lee

Recent advances in multimodal large language models (MLLMs) have catalyzed transformative progress in affective computing, enabling models to exhibit emergent emotional intelligence. Despite substantial methodological progress, current…

Cross-lingual emotion detection allows us to analyze global trends, public opinion, and social phenomena at scale. We participated in the Explainability of Cross-lingual Emotion Detection (EXALT) shared task, achieving an F1-score of 0.6046…

Computation and Language · Computer Science 2024-07-03 Long Cheng , Qihao Shao , Christine Zhao , Sheng Bi , Gina-Anne Levow

Emotional intelligence significantly impacts our daily behaviors and interactions. Although Large Language Models (LLMs) are increasingly viewed as a stride toward artificial general intelligence, exhibiting impressive performance in…

Computation and Language · Computer Science 2023-11-14 Cheng Li , Jindong Wang , Yixuan Zhang , Kaijie Zhu , Wenxin Hou , Jianxun Lian , Fang Luo , Qiang Yang , Xing Xie

Emotion is essential in spoken communication, yet most existing frameworks in speech emotion modeling rely on predefined categories or low-dimensional continuous attributes, which offer limited expressive capacity. Recent advances in speech…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-07 Tianhua Qi , Wenming Zheng , Björn W. Schuller , Zhaojie Luo , Haizhou Li

Static Application Security Testing (SAST) tools often suffer from high false positive rates, leading to alert fatigue that consumes valuable auditing resources. Recent efforts leveraging Large Language Models (LLMs) as filters offer…

Cryptography and Security · Computer Science 2026-03-05 Mingcheng Jiang , Jiancheng Huang , Jiangfei Wang , Zhengzhu Xie , Nan Fang , Guang Cheng , Xiaoyan Hu , Hua Wu

Speech Large Language Models (SLLMs) enable high-level emotion reasoning but often produce ungrounded, text-biased judgments without verifiable acoustic evidence. In contrast, self-supervised speech encoders such as WavLM provide strong…

Machine Learning · Computer Science 2026-02-16 Esther Sun , Bo-Hao Su , Abinay Reddy Naini , Shinji Watanabe , Carlos Busso

Recent audio language models can follow long conversations. However, research on emotion-aware or spoken dialogue summarization is constrained by the lack of data that links speech, summaries, and paralinguistic cues. We introduce Spoken…

Computation and Language · Computer Science 2025-12-19 Yen-Ju Lu , Kunxiao Gao , Mingrui Liang , Helin Wang , Thomas Thebaud , Laureano Moro-Velazquez , Najim Dehak , Jesus Villalba

MER2025 is the third year of our MER series of challenges, aiming to bring together researchers in the affective computing community to explore emerging trends and future directions in the field. Previously, MER2023 focused on multi-label…

Speech emotion recognition (SER) systems aim to recognize human emotional state during human-computer interaction. Most existing SER systems are trained based on utterance-level labels. However, not all frames in an audio have affective…

Sound · Computer Science 2023-12-29 Qifei Li , Yingming Gao , Cong Wang , Yayue Deng , Jinlong Xue , Yichen Han , Ya Li

With the advent of large vision-language models (LVLMs) demonstrating increasingly human-like abilities, a pivotal question emerges: do different LVLMs interpret multimodal sarcasm differently, and can a single model grasp sarcasm from…

Computation and Language · Computer Science 2025-11-04 Junjie Chen , Xuyang Liu , Subin Huang , Linfeng Zhang , Hang Yu

Voice interfaces integral to the human-computer interaction systems can benefit from speech emotion recognition (SER) to customize responses based on user emotions. Since humans convey emotions through multi-modal audio-visual cues,…

Machine Learning · Computer Science 2025-07-02 Varsha Pendyala , Pedro Morgado , William Sethares

Effective and safe human-machine collaboration requires the regulated and meaningful exchange of emotions between humans and artificial intelligence (AI). Current AI systems based on large language models (LLMs) can provide feedback that…

Computation and Language · Computer Science 2025-06-18 Xiuwen Wu , Hao Wang , Zhiang Yan , Xiaohan Tang , Pengfei Xu , Wai-Ting Siok , Ping Li , Jia-Hong Gao , Bingjiang Lyu , Lang Qin

In this work, we explore the dependencies between speaker recognition and emotion recognition. We first show that knowledge learned for speaker recognition can be reused for emotion recognition through transfer learning. Then, we show the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-13 Raghavendra Pappagari , Tianzi Wang , Jesus Villalba , Nanxin Chen , Najim Dehak

The ability to handle various emotion labels without dedicated training is crucial for building adaptable Emotion Recognition (ER) systems. Conventional ER models rely on training using fixed label sets and struggle to generalize beyond…

Computation and Language · Computer Science 2025-05-26 Minxue Niu , Emily Mower Provost

Vision Large Language Models (VLLMs) exhibit promising potential for multi-modal understanding, yet their application to video-based emotion recognition remains limited by insufficient spatial and contextual awareness. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Zhifeng Wang , Qixuan Zhang , Peter Zhang , Wenjia Niu , Kaihao Zhang , Ramesh Sankaranarayana , Sabrina Caldwell , Tom Gedeon

Current methods for analyzing student engagement in e-learning platforms, including automated systems, often struggle with challenges such as handling fuzzy sentiment in text comments and relying on limited metadata. Traditional approaches,…

Computation and Language · Computer Science 2024-12-20 Ali Hamdi , Ahmed Abdelmoneim Mazrou , Mohamed Shaltout

This paper introduces TinyEmo, a family of small multi-modal language models for emotional reasoning and classification. Our approach features: (1) a synthetic emotional instruct dataset for both pre-training and fine-tuning stages, (2) a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Cristian Gutierrez

Speech emotion recognition is a vital contributor to the next generation of human-computer interaction (HCI). However, current existing small-scale databases have limited the development of related research. In this paper, we present LSSED,…

Sound · Computer Science 2021-02-04 Weiquan Fan , Xiangmin Xu , Xiaofen Xing , Weidong Chen , Dongyan Huang

Progress in speech processing has been facilitated by shared datasets and benchmarks. Historically these have focused on automatic speech recognition (ASR), speaker identification, or other lower-level tasks. Interest has been growing in…

Computation and Language · Computer Science 2022-08-01 Suwon Shon , Ankita Pasad , Felix Wu , Pablo Brusco , Yoav Artzi , Karen Livescu , Kyu J. Han
‹ Prev 1 8 9 10 Next ›