English
Related papers

Related papers: Human-Machine Cooperative Multimodal Learning Meth…

200 papers

Humans express their emotions via facial expressions, voice intonation and word choices. To infer the nature of the underlying emotion, recognition models may use a single modality, such as vision, audio, and text, or a combination of…

Machine Learning · Computer Science 2022-02-21 Vandana Rajan , Alessio Brutti , Andrea Cavallaro

Olfaction sensing in autonomous robotics faces challenges in dynamic operations, energy efficiency, and edge processing. It necessitates a machine learning algorithm capable of managing real-world odor interference, ensuring resource…

Signal Processing · Electrical Eng. & Systems 2024-07-09 Rizwana Kausar , Fakhreddine Zayer , Jaime Viegas , Jorge Dias

Emotional expressions are inherently multimodal -- integrating facial behavior, speech, and gaze -- but their automatic recognition is often limited to a single modality, e.g. speech during a phone call. While previous work proposed…

Machine Learning · Computer Science 2022-05-03 Ahmed Abdou , Ekta Sood , Philipp Müller , Andreas Bulling

Electroencephalography (EEG) is shown to be a valuable data source for evaluating subjects' mental states. However, the interpretation of multi-modal EEG signals is challenging, as they suffer from poor signal-to-noise-ratio, are highly…

Signal Processing · Electrical Eng. & Systems 2022-04-19 David Bethge , Philipp Hallgarten , Ozan Özdenizci , Ralf Mikut , Albrecht Schmidt , Tobias Grosse-Puppendahl

The affective brain-computer interface is a crucial technology for affective interaction and emotional intelligence, emerging as a significant area of research in the human-computer interaction. Compared to single-type features, multi-type…

Human-Computer Interaction · Computer Science 2025-08-11 Xueyuan Xu , Wenjia Dong , Fulin Wei , Li Zhuo

The integration of information across multiple modalities and across time is a promising way to enhance the emotion recognition performance of affective systems. Much previous work has focused on instantaneous emotion recognition. The 2018…

Image and Video Processing · Electrical Eng. & Systems 2018-05-07 Didan Deng , Yuqian Zhou , Jimin Pi , Bertram E. Shi

Using deep learning methods to classify EEG signals can accurately identify people's emotions. However, existing studies have rarely considered the application of the information in another domain's representations to feature selection in…

Signal Processing · Electrical Eng. & Systems 2023-03-22 Kexin Zhu , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

Applications in behavioural research, human-computer interaction, and mental health depend on the ability to recognize emotions. In order to improve the accuracy of emotion recognition using electroencephalography (EEG) data, this work…

Signal Processing · Electrical Eng. & Systems 2024-11-28 Ali Asgar Chandanwala , Srutakirti Bhowmik , Parna Chaudhury , Sheena Christabel Pravin

One of the key challenges to predict odor from molecular structure is unarguably our limited understanding of the odor space and the complexity of the underlying structure-odor relationships. Here, we show that the predictive performance of…

Quantitative Methods · Quantitative Biology 2025-08-14 Akshay Sajan , Stijn Sluis , Reza Haydarlou , Sanne Abeln , Pasquale Lisena , Raphael Troncy , Caro Verbeek , Inger Leemans , Halima Mouhib

Classification of olfactory-induced electroencephalogram (EEG) signals has shown great potential in many fields. Since different frequency bands within the EEG signals contain different information, extracting specific frequency bands for…

Signal Processing · Electrical Eng. & Systems 2022-02-08 Biao Sun , Zhigang Wei , Pei Liang , Huirang Hou

Nowadays, personalized recommender systems play an increasingly important role in music scenarios in our daily life with the preference prediction ability. However, existing methods mainly rely on users' implicit feedback (e.g., click,…

Human-Computer Interaction · Computer Science 2024-04-25 Zhiyu He , Jiayu Li , Weizhi Ma , Min Zhang , Yiqun Liu , Shaoping Ma

Emotion recognition (ER) technology is an integral part for developing innovative applications such as drowsiness detection and health monitoring that plays a pivotal role in contemporary society. This study delves into ER using…

Human-Computer Interaction · Computer Science 2024-02-07 Haseeb ur Rahman Abbasi , Zeeshan Rashid , Muhammad Majid , Syed Muhammad Anwar

Our experience of the world is multimodal - we see objects, hear sounds, feel texture, smell odors, and taste flavors. Modality refers to the way in which something happens or is experienced and a research problem is characterized as…

Machine Learning · Computer Science 2017-08-02 Tadas Baltrušaitis , Chaitanya Ahuja , Louis-Philippe Morency

A systematic review on machine-learning strategies for improving generalizability (cross-subjects and cross-sessions) electroencephalography (EEG) based in emotion classification was realized. In this context, the non-stationarity of EEG…

Predicting the relationship between a molecule's structure and its odor remains a difficult, decades-old task. This problem, termed quantitative structure-odor relationship (QSOR) modeling, is an important challenge in chemistry, impacting…

Continuous cough monitors can greatly aid doctors in home monitoring and treatment of respiratory diseases. Although many algorithms have been proposed, they still face limitations in data privacy and short-term monitoring. Edge-AI offers a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-01 Stefano Albini , Lara Orlandic , Jonathan Dan , Jérôme Thevenot , Tomas Teijeiro , Denisa Andreea Constantinescu , David Atienza

Emotion recognition from EEG signals is essential for affective computing and has been widely explored using deep learning. While recent deep learning approaches have achieved strong performance on single EEG emotion datasets, their…

Machine Learning · Computer Science 2025-11-17 Yuning Chen , Sha Zhao , Shijian Li , Gang Pan

The electroencephalography classifier is the most important component of brain-computer interface based systems. There are two major problems hindering the improvement of it. First, traditional methods do not fully exploit multimodal…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Chuanqi Tan , Fuchun Sun , Wenchang Zhang

Computer interfaces are advancing towards using multi-modalities to enable better human-computer interactions. The use of automatic emotion recognition (AER) can make the interactions natural and meaningful thereby enhancing the user…

Sound · Computer Science 2025-03-26 Upasana Tiwari , Rupayan Chakraborty , Sunil Kumar Kopparapu

The detection of emotions using an Electroencephalogram (EEG) is a crucial area in brain-computer interfaces and has valuable applications in fields such as rehabilitation and medicine. In this study, we employed transfer learning to…

Signal Processing · Electrical Eng. & Systems 2024-04-09 Sidharth Sidharth , Ashish Abraham Samuel , Ranjana H , Jerrin Thomas Panachakel , Sana Parveen K