English
Related papers

Related papers: Affective Computing for Large-Scale Heterogeneous …

200 papers

Multimodal learning has driven innovation across various industries, particularly in the field of music. By enabling more intuitive interaction experiences and enhancing immersion, it not only lowers the entry barriers to the music but also…

Multimedia · Computer Science 2026-02-24 Sifei Li , Mining Tan , Feier Shen , Minyan Luo , Zijiao Yin , Fan Tang , Weiming Dong , Changsheng Xu

Classification of human emotions can play an essential role in the design and improvement of human-machine systems. While individual biological signals such as Electrocardiogram (ECG) and Electrodermal Activity (EDA) have been widely used…

Machine Learning · Computer Science 2021-08-06 Anubhav Bhatti , Behnam Behinaein , Dirk Rodenburg , Paul Hungler , Ali Etemad

Perception of auditory events is inherently multimodal relying on both audio and visual cues. A large number of existing multimodal approaches process each modality using modality-specific models and then fuse the embeddings to encode the…

Sound · Computer Science 2022-07-19 Amir Shirian , Krishna Somandepalli , Victor Sanchez , Tanaya Guha

Nowadays, the amount of heterogeneous biomedical data is increasing more and more thanks to novel sensing techniques and high-throughput technologies. In reference to biomedical image analysis, the advances in image acquisition modalities…

Image and Video Processing · Electrical Eng. & Systems 2021-06-09 Leonardo Rundo

Human communication includes information, opinions, and reactions. Reactions are often captured by the affective-messages in written as well as verbal communications. While there has been work in affect modeling and to some extent affective…

Computation and Language · Computer Science 2018-05-22 Sopan Khosla , Niyati Chhaya , Kushal Chawla

In daily life, images as common affective stimuli have widespread applications. Despite significant progress in text-driven image editing, there is limited work focusing on understanding users' emotional requests. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Peixuan Zhang , Shuchen Weng , Chengxuan Zhu , Binghao Tang , Zijian Jia , Si Li , Boxin Shi

Emotion recognition and generation have emerged as crucial topics in Artificial Intelligence research, playing a significant role in enhancing human-computer interaction within healthcare, customer service, and other fields. Although…

Machine Learning · Computer Science 2025-02-12 Rebecca Mobbs , Dimitrios Makris , Vasileios Argyriou

Humans express feelings or emotions via different channels. Take language as an example, it entails different sentiments under different visual-acoustic contexts. To precisely understand human intentions as well as reduce the…

Artificial Intelligence · Computer Science 2021-11-17 Ting Wu , Junjie Peng , Wenqiang Zhang , Huiran Zhang , Chuanshuai Ma , Yansong Huang

Software developers are increasingly using machine learning APIs to implement 'intelligent' features. Studies show that incorporating machine learning into an application increases technical debt, creates data dependencies, and introduces…

Software Engineering · Computer Science 2020-05-28 Maheswaree K Curumsing , Alex Cummaudo , Ulrike Maria Graetsch , Scott Barnett , Rajesh Vasa

It has long been hypothesized that perceptual ambiguities play an important role in aesthetic experience: a work with some ambiguity engages a viewer more than one that does not. However, current frameworks for testing this theory are…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Xi Wang , Zoya Bylinskii , Aaron Hertzmann , Robert Pepperell

The group affect or emotion in an image of people can be inferred by extracting features about both the people in the picture and the overall makeup of the scene. The state-of-the-art on this problem investigates a combination of facial…

Computer Vision and Pattern Recognition · Computer Science 2018-03-15 Ashok Sundaresan , Sugumar Murugesan , Sean Davis , Karthik Kappaganthu , ZhongYi Jin , Divya Jain , Anurag Maunder

Deep learning models for music have advanced drastically in recent years, but how good are machine learning models at capturing emotion, and what challenges are researchers facing? In this paper, we provide a comprehensive overview of the…

Sound · Computer Science 2025-06-25 Jaeyong Kang , Dorien Herremans

Research in emotion analysis is scattered across different label formats (e.g., polarity types, basic emotion categories, and affective dimensions), linguistic levels (word vs. sentence vs. discourse), and, of course, (few well-resourced…

Computation and Language · Computer Science 2021-11-09 Sven Buechel , Luise Modersohn , Udo Hahn

Human emotions unfold over time, and more affective computing research has to prioritize capturing this crucial component of real-world affect. Modeling dynamic emotional stimuli requires solving the twin challenges of time-series modeling…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Desmond C. Ong , Zhengxuan Wu , Tan Zhi-Xuan , Marianne Reddan , Isabella Kahhale , Alison Mattek , Jamil Zaki

Social Media has seen a tremendous growth in the last decade and is continuing to grow at a rapid pace. With such adoption, it is increasingly becoming a rich source of data for opinion mining and sentiment analysis. The detection and…

Machine Learning · Computer Science 2019-12-18 Rahul Radhakrishnan Iyer , Jing Chen , Haonan Sun , Keyang Xu

Towards improving the performance in various music information processing tasks, recent studies exploit different modalities able to capture diverse aspects of music. Such modalities include audio recordings, symbolic music scores,…

Multimedia · Computer Science 2019-02-15 Federico Simonetta , Stavros Ntalampiras , Federico Avanzini

Due to its ability to accurately predict emotional state using multimodal features, audiovisual emotion recognition has recently gained more interest from researchers. This paper proposes two methods to predict emotional attributes from…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-22 Bagus Tris Atmaja , Masato Akagi

Artificial Intelligence (AI) has been used for processing data to make decisions, interact with humans, and understand their feelings and emotions. With the advent of the internet, people share and express their thoughts on day-to-day…

Computation and Language · Computer Science 2022-05-09 Sheetal Kusal , Shruti Patil , Jyoti Choudrie , Ketan Kotecha , Deepali Vora , Ilias Pappas

We propose a cross-modal co-attention model for continuous emotion recognition using visual-audio-linguistic information. The model consists of four blocks. The visual, audio, and linguistic blocks are used to learn the spatial-temporal…

Multimedia · Computer Science 2022-03-31 Su Zhang , Ruyi An , Yi Ding , Cuntai Guan

As artificial intelligence becomes more and more ingrained in daily life, we present a novel system that uses deep learning for music recommendation and emotion-based detection. Through the use of facial recognition and the DeepFace…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Swetha Kambham , Hubert Jhonson , Sai Prathap Reddy Kambham