English
Related papers

Related papers: Enabling Embodied Analogies in Intelligent Music S…

200 papers

Affective computing - combining sensor technology, machine learning, and psychology - have been studied for over three decades and is employed in AI-powered technologies to enhance emotional awareness in AI systems, and detect symptoms of…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-21 Anders Rolighed Larsen , Sneha Das , Nicole Nadine Lønfeldt , Paula Petcu , Line Clemmensen

Music is used to convey emotions, and thus generating emotional music is important in automatic music generation. Previous work on emotional music generation directly uses annotated emotion labels as control signals, which suffers from…

Sound · Computer Science 2023-07-06 Chenfei Kang , Peiling Lu , Botao Yu , Xu Tan , Wei Ye , Shikun Zhang , Jiang Bian

Multimodal Affective Computing (MAC) aims to recognize and interpret human emotions by integrating information from diverse modalities such as text, video, and audio. Recent advancements in Multimodal Large Language Models (MLLMs) have…

Artificial Intelligence · Computer Science 2025-08-05 Miaosen Luo , Jiesen Long , Zequn Li , Yunying Yang , Yuncheng Jiang , Sijie Mai

In recent decades, neuroscientific and psychological research has traced direct relationships between taste and auditory perceptions. This article explores multimodal generative models capable of converting taste information into music,…

Sound · Computer Science 2025-09-01 Matteo Spanio , Massimiliano Zampini , Antonio Rodà , Franco Pierucci

Music retrieval and recommendation applications often rely on content features encoded as embeddings, which provide vector representations of items in a music dataset. Numerous complementary embeddings can be derived from processing items…

Information Retrieval · Computer Science 2023-08-15 Andres Ferraro , Jaehun Kim , Sergio Oramas , Andreas Ehmann , Fabien Gouyon

We discuss a novel task, Chorus Recognition, which could potentially benefit downstream tasks such as song search and music summarization. Different from the existing tasks such as music summarization or lyrics summarization relying on…

Information Retrieval · Computer Science 2021-07-01 Jiaan Wang , Zhixu Li , Binbin Gu , Tingyi Zhang , Qingsheng Liu , Zhigang Chen

Despite the recent increase in research on artificial intelligence for music, prominent correlations between key components of lyrics and rhythm such as keywords, stressed syllables, and strong beats are not frequently studied. This is…

Sound · Computer Science 2025-07-10 Callie C. Liao , Duoduo Liao , Jesse Guessford

Music is essential in daily life, fulfilling emotional and entertainment needs, and connecting us personally, socially, and culturally. A better understanding of music can enhance our emotions, cognitive skills, and cultural connections.…

We present our submission to the Hume-ABAW10 Emotional Mimicry Intensity (EMI) Challenge, which aims to predict six continuous emotion intensity dimensions: Admiration, Amusement, Determination, Empathic Pain, Excitement, and Joy, from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Dinithi Dissanayake , Shaveen Silva , Ovindu Atukorala , Prasanth Sasikumar , Suranga Nanayakkara

Music is a potent form of expression that can communicate, accentuate or even create the emotions of an individual or a collective. Both historically and in contemporary experiences, musical expression was and is commonly instrumentalized…

Information Retrieval · Computer Science 2024-11-12 Abhishek Kaushik , Kayla Rush

Music generation with the aid of computers has been recently grabbed the attention of many scientists in the area of artificial intelligence. Deep learning techniques have evolved sequence production methods for this purpose. Yet, a…

Neural and Evolutionary Computing · Computer Science 2020-04-09 Majid Farzaneh , Rahil Mahdian Toroghi

The aim of this study is to teach an algorithm how to recognize different types of music. Users will submit songs for analysis. Since the algorithm hasn't heard these songs before, it needs to figure out what makes each song unique. It does…

Sound · Computer Science 2024-05-28 Navin Kamuni , Dheerendra Panwar

Music mixing involves combining individual tracks into a cohesive mixture, a task characterized by subjectivity where multiple valid solutions exist for the same input. Existing automatic mixing systems treat this task as a deterministic…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-12 Eloi Moliner , Marco A. Martínez-Ramírez , Junghyun Koo , Wei-Hsiang Liao , Kin Wai Cheuk , Joan Serrà , Vesa Välimäki , Yuki Mitsufuji

Music information is often conveyed or recorded across multiple data modalities including but not limited to audio, images, text and scores. However, music information retrieval research has almost exclusively focused on single modality…

Sound · Computer Science 2021-06-03 Ho-Hsiang Wu , Magdalena Fuentes , Juan P. Bello

Driven by the escalating global burden of mental health conditions, music-based interventions have attracted significant attention as a non-invasive, cost-effective modality for emotion regulation and psychological stress relief. However,…

Sound · Computer Science 2026-05-19 Yimeng Zhang , Yueru Sun , Haoyu Gu , Zhanpeng Jin

In this work, we introduce Mozualization, a music generation and editing tool that creates multi-style embedded music by integrating diverse inputs, such as keywords, images, and sound clips (e.g., segments from various pieces of music or…

Human-Computer Interaction · Computer Science 2025-04-22 Wanfang Xu , Lixiang Zhao , Haiwen Song , Xinheng Song , Zhaolin Lu , Yu Liu , Min Chen , Eng Gee Lim , Lingyun Yu

Challenges in managing linguistic diversity and integrating various musical modalities are faced by current music information retrieval systems. These limitations reduce their effectiveness in a global, multimodal music environment. To…

This review examines the roles of adaptation and synchronization in music performance, drawing on concepts from complex systems theory to understand the dynamic interactions between musicians, music, and listeners. Adaptation is explored…

Physics and Society · Physics 2025-04-08 Jakub Sawicki

Key features of mental illnesses are reflected in speech. Our research focuses on designing a multimodal deep learning structure that automatically extracts salient features from recorded speech samples for predicting various mental…

Machine Learning · Computer Science 2020-04-15 Habibeh Naderi , Behrouz Haji Soleimani , Stan Matwin

This paper describes an open-source Python framework for handling datasets for music processing tasks, built with the aim of improving the reproducibility of research projects in music computing and assessing the generalization abilities of…

Multimedia · Computer Science 2021-12-28 Federico Simonetta , Stavros Ntalampiras , Federico Avanzini