English
Related papers

Related papers: AffectMachine-Classical: A novel system for genera…

200 papers

Generating music with emotion similar to that of an input video is a very relevant issue nowadays. Video content creators and automatic movie directors benefit from maintaining their viewers engaged, which can be facilitated by producing…

Sound · Computer Science 2020-04-07 Gwenaelle Cunha Sergio , Minho Lee

Emotional cues frequently arise and shape group dynamics in interactive settings where multiple humans and artificial agents communicate through shared digital channels. While artificial agents lack intrinsic emotional states, they can…

Human-Computer Interaction · Computer Science 2025-07-17 Fernando Koch , Jessica Nahulan , Jeremy Fox , Martin Keen

The majority of current systems for end-to-end dialog generation focus on response quality without an explicit control over the affective content of the responses. In this paper, we present an affect-driven dialog system, which generates…

Computation and Language · Computer Science 2019-04-08 Pierre Colombo , Wojciech Witon , Ashutosh Modi , James Kennedy , Mubbasir Kapadia

LLM-based multimodal emotion recognition relies on static parametric memory and often hallucinates when interpreting nuanced affective states. In this paper, given that single-round retrieval-augmented generation is highly susceptible to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Zeheng Wang , Zitong Yu , Yijie Zhu , Bo Zhao , Haochen Liang , Taorui Wang , Wei Xia , Jiayu Zhang , Zhishu Liu , Hui Ma , Fei Ma , Qi Tian

Human use language not just to convey information but also to express their inner feelings and mental states. In this work, we adapt the state-of-the-art language generation models to generate affective (emotional) text. We posit a model…

Computation and Language · Computer Science 2020-11-10 Ishika Singh , Ahsan Barkati , Tushar Goswamy , Ashutosh Modi

In the field of affective computing, traditional methods for generating emotions predominantly rely on deep learning techniques and large-scale emotion datasets. However, deep learning techniques are often complex and difficult to…

Human-Computer Interaction · Computer Science 2025-03-24 Haidong Wang , Qia Shan , JianHua Zhang , PengFei Xiao , Ao Liu

The development of agents with emotional intelligence is becoming increasingly vital due to their significant role in human-computer interaction and the growing integration of computer systems across various sectors of society. Affective…

Human-Computer Interaction · Computer Science 2026-05-05 Raziyeh Zall , Alireza Kheyrkhah , Erik Cambria , Zahra Naseri , M. Reza Kangavari

Achieving advancements in automatic recognition of emotions that music can induce require considering multiplicity and simultaneity of emotions. Comparison of different machine learning algorithms performing multilabel and multiclass…

Current recommendation systems often tend to overlook emotional context and rely on historical listening patterns or static mood tags. This paper introduces a novel music recommendation framework employing a variant of Wide and Deep…

Information Retrieval · Computer Science 2025-10-28 Apoorva Chavali , Reeve Menezes

Prior efforts to create an autonomous computer system capable of predicting what a human being is thinking or feeling from facial expression data have been largely based on outdated, inaccurate models of how emotions work that rely on many…

Artificial Intelligence · Computer Science 2018-08-06 Trevor Buteau , Damian Lyons

Rapid advancements in artificial intelligence have significantly enhanced generative tasks involving music and images, employing both unimodal and multimodal approaches. This research develops a model capable of generating music that…

Sound · Computer Science 2024-09-13 Tanisha Hisariya , Huan Zhang , Jinhua Liang

Current artificial intelligence (AI) technology is mainly used in rational work such as computation and logical analysis. How to make the machine as aesthetic and creative as humans has gradually gained attention. This paper presents a…

Human-Computer Interaction · Computer Science 2019-06-06 Min Chen , Yingying Jiang , Yong Cao , Albert Y. Zomaya

In this paper, we introduce Story2MIDI, a sequence-to-sequence Transformer-based model for generating emotion-aligned music from a given piece of text. To develop this model, we construct the Story2MIDI dataset by merging existing datasets…

As robots and artificial agents become increasingly integrated into daily life, enhancing their ability to interact with humans is essential. Emotions, which play a crucial role in human interactions, can improve the naturalness and…

Robotics · Computer Science 2025-04-17 Francesca Corrao , Alice Nardelli , Jennifer Renoux , Carmine Tommaso Recchiuto

With the increasing demands of emotion comprehension and regulation in our daily life, a customized music-based emotion regulation system is introduced by employing current EEG information and song features, which predicts users' emotion…

Human-Computer Interaction · Computer Science 2022-11-29 Jiyang Li , Wei Wang , Kratika Bhagtani , Yincheng Jin , Zhanpeng Jin

In recent decades, neuroscientific and psychological research has traced direct relationships between taste and auditory perceptions. This article explores multimodal generative models capable of converting taste information into music,…

Sound · Computer Science 2025-09-01 Matteo Spanio , Massimiliano Zampini , Antonio Rodà , Franco Pierucci

This study proposes a system designed to enumerate the process of collaborative composition among humans, using automatic music composition technology. By integrating multiple Recurrent Neural Network (RNN) models, the system provides an…

Sound · Computer Science 2024-03-07 So Hirawata , Noriko Otani

Functional music applications, from consumer focus and sleep aids to clinical interventions, share a distinctive recommendation problem: success is defined by the listener's affective state, but online experimentation on emotion is…

Affective computing plays a key role in human-computer interactions, entertainment, teaching, safe driving, and multimedia integration. Major breakthroughs have been made recently in the areas of affective computing (i.e., emotion…

Multimedia · Computer Science 2022-03-22 Yan Wang , Wei Song , Wei Tao , Antonio Liotta , Dawei Yang , Xinlei Li , Shuyong Gao , Yixuan Sun , Weifeng Ge , Wei Zhang , Wenqiang Zhang

Despite recent advances in audio content-based music emotion recognition, a question that remains to be explored is whether an algorithm can reliably discern emotional or expressive qualities between different performances of the same…

Sound · Computer Science 2021-07-29 Shreyan Chowdhury , Gerhard Widmer