English
Related papers

Related papers: AImoclips: A Benchmark for Evaluating Emotion Conv…

200 papers

Current emotional Text-To-Speech (TTS) and style transfer methods rely on reference encoders to control global style or emotion vectors, but do not capture nuanced acoustic details of the reference speech. To this end, we propose a novel…

Sound · Computer Science 2025-10-03 Jianing Yang , Sheng Li , Takahiro Shinozaki , Yuki Saito , Hiroshi Saruwatari

We provide a new multi-task benchmark for evaluating text-to-image models. We perform a human evaluation comparing the most common open-source (Stable Diffusion) and commercial (DALL-E 2) models. Twenty computer science AI graduate students…

In recent years, remarkable advancements in artificial intelligence-generated content (AIGC) have been achieved in the fields of image synthesis and text generation, generating content comparable to that produced by humans. However, the…

Sound · Computer Science 2025-01-16 Sida Tian , Can Zhang , Wei Yuan , Wei Tan , Wenjie Zhu

Despite significant advancements in music generation systems, the methodologies for evaluating generated music have not progressed as expected due to the complex nature of music, with aspects such as structure, coherence, creativity, and…

Sound · Computer Science 2025-09-03 Faria Binte Kader , Santu Karmaker

In the rapidly evolving landscape of AI-mediated communication (AIMC), tools powered by Large Language Models (LLMs) are becoming integral to interpersonal communication. Employing a mixed-methods approach, we conducted a one-week diary and…

Human-Computer Interaction · Computer Science 2024-03-12 Yue Fu , Sami Foell , Xuhai Xu , Alexis Hiniker

Many frameworks for emotional text-to-speech (E-TTS) rely on human-annotated emotion labels that are often inaccurate and difficult to obtain. Learning emotional prosody implicitly presents a tough challenge due to the subjective nature of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-21 Shreeram Suresh Chandra , Zongyang Du , Berrak Sisman

Natural language processing (NLP) systems are increasingly trained to generate open-ended text rather than classifying between responses. This makes research on evaluation metrics for generated language -- functions that score system output…

Computation and Language · Computer Science 2021-10-19 Thomas Scialom , Felix Hill

Generative AI systems are increasingly capable of expressing emotions via text and imagery. Effective emotional expression will likely play a major role in the efficacy of AI systems -- particularly those designed to support human mental…

This paper presents the computational details of our emotion model, EEGS, and also provides an overview of a three-stage validation methodology used for the evaluation of our model, which can also be applicable for other computational…

Artificial Intelligence · Computer Science 2020-11-06 Suman Ojha , Jonathan Vitale , Mary-Anne Williams

Multi-label sentiment classification plays a vital role in natural language processing by detecting multiple emotions within a single text. However, existing datasets like GoEmotions often suffer from severe class imbalance, which hampers…

Computation and Language · Computer Science 2026-03-31 Zijin Su , Huanzhu Lyu , Yuren Niu , Yiming Liu

Text-image generation has advanced rapidly, but assessing whether outputs truly capture the objects, attributes, and relations described in prompts remains a central challenge. Evaluation in this space relies heavily on automated metrics,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Seyed Amir Kasaei , Ali Aghayari , Arash Marioriyad , Niki Sepasian , MohammadAmin Fazli , Mahdieh Soleymani Baghshah , Mohammad Hossein Rohban

We introduce a framework that recommends music based on the emotions of speech. In content creation and daily life, speech contains information about human emotions, which can be enhanced by music. Our framework focuses on a cross-domain…

Sound · Computer Science 2023-03-21 SeungHeon Doh , Minz Won , Keunwoo Choi , Juhan Nam

Human emotion synthesis is a crucial aspect of affective computing. It involves using computational methods to mimic and convey human emotions through various modalities, with the goal of enabling more natural and effective human-computer…

Machine Learning · Computer Science 2024-12-11 Fei Ma , Yukan Li , Yifan Xie , Ying He , Yi Zhang , Hongwei Ren , Zhou Liu , Wei Yao , Fuji Ren , Fei Richard Yu , Shiguang Ni

Deep Learning models have shown very promising results in automatically composing polyphonic music pieces. However, it is very hard to control such models in order to guide the compositions towards a desired goal. We are interested in…

Machine Learning · Computer Science 2021-03-11 Lucas N. Ferreira , Jim Whitehead

Black-box deep neural networks excel in text classification, yet their application in high-stakes domains is hindered by their lack of interpretability. To address this, we propose Text Bottleneck Models (TBM), an intrinsically…

Computation and Language · Computer Science 2024-04-04 Josh Magnus Ludan , Qing Lyu , Yue Yang , Liam Dugan , Mark Yatskar , Chris Callison-Burch

This work investigates the capabilities of large language models (LLMs) in detecting and understanding human emotions through text. Drawing upon emotion models from psychology, we adopt an interdisciplinary perspective that integrates…

Computation and Language · Computer Science 2025-03-10 Florian Lecourt , Madalina Croitoru , Konstantin Todorov

With the integration of multimodal large language models (MLLMs) into robotic systems and AI applications, embedding emotional intelligence (EI) capabilities is essential for enabling these models to perceive, interpret, and respond to…

Computation and Language · Computer Science 2026-04-28 He Hu , Lianzhong You , Hongbo Xu , Qianning Wang , Fei Richard Yu , Fei Ma , Zebang Cheng , Zheng Lian , Yucheng Zhou , Laizhong Cui

Diffusion and flow-matching models have revolutionized automatic text-to-audio generation in recent times. These models are increasingly capable of generating high quality and faithful audio outputs capturing to speech and acoustic events.…

Emotion labels in emotion recognition corpora are highly noisy and ambiguous, due to the annotators' subjective perception of emotions. Such ambiguity may introduce errors in automatic classification and affect the overall performance. We…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-11 Takuya Fujioka , Dario Bertero , Takeshi Homma , Kenji Nagamatsu

While human evaluation is the most reliable metric for evaluating speech generation systems, it is generally costly and time-consuming. Previous studies on automatic speech quality assessment address the problem by predicting human…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-12 Soumi Maiti , Yifan Peng , Takaaki Saeki , Shinji Watanabe