English
Related papers

Related papers: AImoclips: A Benchmark for Evaluating Emotion Conv…

200 papers

Music is a powerful medium for influencing listeners' emotional states, and this capacity has driven a surge of research interest in AI-based affective music generation in recent years. Many existing systems, however, are a black box which…

Human-Computer Interaction · Computer Science 2025-06-23 Kat R. Agres , Adyasha Dash , Phoebe Chua , Stefan K. Ehrlich

We propose MusicRL, the first music generation system finetuned from human feedback. Appreciation of text-to-music models is particularly subjective since the concept of musicality as well as the specific intention behind a caption are…

In this paper, we introduce Story2MIDI, a sequence-to-sequence Transformer-based model for generating emotion-aligned music from a given piece of text. To develop this model, we construct the Story2MIDI dataset by merging existing datasets…

While music generation models have evolved to handle complex multimodal inputs mixing text, lyrics, and reference audio, evaluation mechanisms have lagged behind. In this paper, we bridge this critical gap by establishing a comprehensive…

This study addresses the deficiency in conventional music recommendation systems by focusing on the vital role of emotions in shaping users music choices. These systems often disregard the emotional context, relying predominantly on past…

Information Retrieval · Computer Science 2023-11-21 Tina Babu , Rekha R Nair , Geetha A

The field of AI-assisted music creation has made significant strides, yet existing systems often struggle to meet the demands of iterative and nuanced music production. These challenges include providing sufficient control over the…

Sound · Computer Science 2024-11-22 Yixiao Zhang

The advancing fluency of LLMs raises important questions about their ability to emulate complex human traits, including emotional expression and personality, across diverse linguistic and cultural contexts. This study investigates whether…

Computation and Language · Computer Science 2026-03-25 Nasser A Alsadhan

There has been significant progress in emotional Text-To-Speech (TTS) synthesis technology in recent years. However, existing methods primarily focus on the synthesis of a limited number of emotion types and have achieved unsatisfactory…

Sound · Computer Science 2023-06-02 Haobin Tang , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

This paper presents an overview and the technical framework of the ICME 2026 Grand Challenge on Academic Text-to-Music Generation (ATTM). Despite the rapid progress in text-to-music generation (TTM) systems, the field is currently dominated…

Sound · Computer Science 2026-05-22 Fang-Chih Hsieh , Wei-Jaw Lee , Chun-Ping Wang , Hung-yi Lee , Hao-Wen Dong , Yi-Hsuan Yang

Large-scale text-to-music generation models have significantly enhanced music creation capabilities, offering unprecedented creative freedom. However, their ability to collaborate effectively with human musicians remains limited. In this…

Sound · Computer Science 2024-07-16 Yongyi Zang , Yixiao Zhang

Effective and safe human-machine collaboration requires the regulated and meaningful exchange of emotions between humans and artificial intelligence (AI). Current AI systems based on large language models (LLMs) can provide feedback that…

Computation and Language · Computer Science 2025-06-18 Xiuwen Wu , Hao Wang , Zhiang Yan , Xiaohan Tang , Pengfei Xu , Wai-Ting Siok , Ping Li , Jia-Hong Gao , Bingjiang Lyu , Lang Qin

State-of-the art Text-To-Music (TTM) generative AI models are large and require desktop or server class compute, making them infeasible for deployment on mobile phones. This paper presents an analysis of trade-offs between model compression…

Lyrics-to-melody generation is an interesting and challenging topic in AI music research field. Due to the difficulty of learning the correlations between lyrics and melody, previous methods suffer from low generation quality and lack of…

Sound · Computer Science 2023-06-06 Zhe Zhang , Yi Yu , Atsuhiro Takasu

Text-To-Music (TTM) models have recently revolutionized the automatic music generation research field. Specifically, by reaching superior performances to all previous state-of-the-art models and by lowering the technical proficiency needed…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-26 Luca Comanducci , Paolo Bestagini , Stefano Tubaro

Artificial Intelligence (AI) has demonstrated significant capabilities in various fields, and in areas such as human-computer interaction (HCI), embodied intelligence, and the design and animation of virtual digital humans, both…

Computation and Language · Computer Science 2024-11-19 Yingjie Zhou , Zicheng Zhang , Jiezhang Cao , Jun Jia , Yanwei Jiang , Farong Wen , Xiaohong Liu , Xiongkuo Min , Guangtao Zhai

Developing text-driven symbolic music generation models remains challenging due to the scarcity of aligned text-music datasets and the unreliability of automated captioning pipelines. While most efforts have focused on MIDI, sheet music…

Loopable music generation systems enable diverse applications, but they often lack controllability and customization capabilities. We argue that enhancing controllability can enrich these models, with emotional expression being a crucial…

Sound · Computer Science 2024-01-26 Wenqian Cui , Pedro Sarmento , Mathieu Barthet

The versatility of Large Language Models (LLMs) in natural language understanding has made them increasingly popular in mental health research. While many studies explore LLMs' capabilities in emotion recognition, a critical gap remains in…

Computation and Language · Computer Science 2025-09-12 Bangzhao Shu , Isha Joshi , Melissa Karnaze , Anh C. Pham , Ishita Kakkar , Sindhu Kothe , Arpine Hovasapian , Mai ElSherief

Research increasingly leverages audio-visual materials to analyze emotions in political communication. Multimodal large language models (mLLMs) promise to enable such analyses through in-context learning. However, we lack systematic…

Computation and Language · Computer Science 2026-04-07 Hauke Licht

Although current neural text-to-speech (TTS) models are able to generate high-quality speech, intensity controllable emotional TTS is still a challenging task. Most existing methods need external optimizations for intensity calculation,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-17 Yiwei Guo , Chenpeng Du , Xie Chen , Kai Yu