English
Related papers

Related papers: Human-Machine Cooperative Multimodal Learning Meth…

200 papers

Emotion recognition has become an important field of research in Human Computer Interactions as we improve upon the techniques for modelling the various aspects of behaviour. With the advancement of technology our understanding of emotions…

Artificial Intelligence · Computer Science 2019-11-11 Samarth Tripathi , Sarthak Tripathi , Homayoon Beigi

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

Computation and Language · Computer Science 2025-05-09 Nischal Mandal , Yang Li

Multiple-objective optimization is common in biological systems. In the mammalian olfactory system, each sensory neuron stochastically expresses only one out of up to thousands of olfactory receptor (OR) gene alleles; at organism level the…

Molecular Networks · Quantitative Biology 2016-05-11 Xiao-Jun Tian , Hang Zhang , Jens Sannerud , Jianhua Xing

As an essential element for the diagnosis and rehabilitation of psychiatric disorders, the electroencephalogram (EEG) based emotion recognition has achieved significant progress due to its high precision and reliability. However, one…

Machine Learning · Computer Science 2021-07-19 Hao Chen , Ming Jin , Zhunan Li , Cunhang Fan , Jinpeng Li , Huiguang He

In recent years, Affective Computing and its applications have become a fast-growing research topic. Furthermore, the rise of Deep Learning has introduced significant improvements in the emotion recognition system compared to classical…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Joaquim Comas , Decky Aspandi , Xavier Binefa

Affect (emotion) recognition has gained significant attention from researchers in the past decade. Emotion-aware computer systems and devices have many applications ranging from interactive robots, intelligent online tutor to emotion based…

Human-Computer Interaction · Computer Science 2016-07-12 Amol Patwardhan , Gerald Knapp

Consumers often react expressively to products such as food samples, perfume, jewelry, sunglasses, and clothing accessories. This research discusses a multimodal affect recognition system developed to classify whether a consumer likes or…

Human-Computer Interaction · Computer Science 2017-05-09 Amol S Patwardhan , Gerald M Knapp

Electroencephalography (EEG) interpretation using multimodal large language models (MLLMs) offers a novel approach for analyzing brain signals. However, the complex nature of brain activity introduces critical challenges: EEG signals…

Signal Processing · Electrical Eng. & Systems 2025-10-02 Ziyi Zeng , Zhenyang Cai , Yixi Cai , Xidong Wang , Junying Chen , Rongsheng Wang , Yipeng Liu , Siqi Cai , Benyou Wang , Zhiguo Zhang , Haizhou Li

Electroencephalography (EEG) is a widely used technique for measuring brain activity. EEG-based signals can reveal a persons emotional state, as they directly reflect activity in different brain regions. Emotion-aware systems and EEG-based…

Machine Learning · Computer Science 2026-02-03 Ashna Purwar , Gaurav Simkar , Madhumita , Sachin Kadam

Multimodal Machine Learning has emerged as a prominent research direction across various applications such as Sentiment Analysis, Emotion Recognition, Machine Translation, Hate Speech Recognition, and Movie Genre Classification. This…

Computation and Language · Computer Science 2023-06-13 Abdelhamid Haouhat , Slimane Bellaouar , Attia Nehar , Hadda Cherroun

Emotion recognition has become an important field of research in the human-computer interactions domain. The latest advancements in the field show that combining visual with audio information lead to better results if compared to the case…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Nicolae-Catalin Ristea , Liviu Cristian Dutu , Anamaria Radoi

Human emotion can be presented in different modes i.e., audio, video, and text. However, the contribution of each mode in exhibiting each emotion is not uniform. Furthermore, the availability of complete mode-specific details may not always…

Artificial Intelligence · Computer Science 2024-02-20 Naresh Kumar Devulapally , Sidharth Anand , Sreyasee Das Bhattacharjee , Junsong Yuan

The traditional dietary recommendation systems are basically nutrition or health-aware where the human feelings on food are ignored. Human affects vary when it comes to food cravings, and not all foods are appealing in all moods. A…

Human-Computer Interaction · Computer Science 2023-08-15 Tanvir Islam , Anika Rahman Joyita , Md. Golam Rabiul Alam , Mohammad Mehedi Hassan , Md. Rafiul Hassan , Raffaele Gravina

Clinical electroencephalography is routinely used to evaluate patients with diverse and often overlapping neurological conditions, yet interpretation remains manual, time-intensive, and variable across experts. While automated EEG analysis…

Human-Computer Interaction · Computer Science 2025-12-30 Argha Kamal Samanta , Deepak Mewada , Monalisa Sarma , Debasis Samanta

Descriptive Multimodal Emotion Recognition (DMER) has garnered increasing research attention. Unlike traditional discriminative paradigms that rely on predefined emotion taxonomies, DMER aims to describe human emotional state using…

Human-Computer Interaction · Computer Science 2025-09-29 Zheng Lian , Licai Sun , Lan Chen , Haoyu Chen , Zebang Cheng , Fan Zhang , Ziyu Jia , Ziyang Ma , Fei Ma , Xiaojiang Peng , Jianhua Tao

Speech has been a widely used modality in the field of affective computing. Recently however, there has been a growing interest in the use of multi-modal affective computing systems. These multi-modal systems incorporate both verbal and…

Human-Computer Interaction · Computer Science 2018-05-18 Jonny O'Dwyer , Niall Murray , Ronan Flynn

With the rapid advancement of deep learning, attention mechanisms have become indispensable in electroencephalography (EEG) signal analysis, significantly enhancing Brain-Computer Interface (BCI) applications. This paper presents a…

Signal Processing · Electrical Eng. & Systems 2025-07-08 Jiyuan Wang , Weishan Ye , Jialin He , Li Zhang , Gan Huang , Zhuliang Yu , Zhen Liang

Despite extraordinary progress in artificial intelligence (AI), modern systems remain incomplete representations of human cognition. Vision, audition, and language have received disproportionate attention due to well-defined benchmarks,…

Artificial Intelligence · Computer Science 2025-06-03 Kordel K. France , Rohith Peddi , Nik Dennler , Ovidiu Daescu

Automatic emotion recognition is an active research topic with wide range of applications. Due to the high manual annotation cost and inevitable label ambiguity, the development of emotion recognition dataset is limited in both scale and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-08 Jingjun Liang , Ruichen Li , Qin Jin

Speech emotion recognition is a challenging task for three main reasons: 1) human emotion is abstract, which means it is hard to distinguish; 2) in general, human emotion can only be detected in some specific moments during a long…

Sound · Computer Science 2019-05-03 Yuanyuan Zhang , Jun Du , Zirui Wang , Jianshu Zhang