English
Related papers

Related papers: Human-Machine Cooperative Multimodal Learning Meth…

200 papers

The ability to perceive and recognize objects is fundamental for the interaction with the external environment. Studies that investigate them and their relationship with brain activity changes have been increasing due to the possible…

Signal Processing · Electrical Eng. & Systems 2020-08-31 Jenifer Kalafatovich , Minji Lee , Seong-Whan Lee

Evaluating human-computer interaction is essential as a broadening population uses machines, sometimes in sensitive contexts. However, traditional evaluation methods may fail to combine real-time measures, an "objective" approach and data…

Human-Computer Interaction · Computer Science 2013-11-12 Jérémy Frey , Christian Mühl , Fabien Lotte , Martin Hachet

An electroencephalography (EEG) based brain activity recognition is a fundamental field of study for a number of significant applications such as intention prediction, appliance control, and neurological disease diagnosis in smart home and…

Human-Computer Interaction · Computer Science 2017-09-27 Xiang Zhang , Lina Yao , Dalin Zhang , Xianzhi Wang , Quan Z. Sheng , Tao Gu

Emotion recognition has a wide range of applications in human-computer interaction, marketing, healthcare, and other fields. In recent years, the development of deep learning technology has provided new methods for emotion recognition.…

Computation and Language · Computer Science 2025-01-28 Junwei Feng , Xueyan Fan

Electroencephalography (EEG) is a fundamental modality for cognitive state monitoring in brain-computer interfaces (BCIs). However, it is highly susceptible to intrinsic signal errors and human-induced labeling errors, which lead to label…

Machine Learning · Computer Science 2025-12-15 Hyo-Jeong Jang , Hye-Bin Shin , Seong-Whan Lee

Emotion recognition is essential for applications in affective computing and behavioral prediction, but conventional systems relying on single-modality data often fail to capture the complexity of affective states. To address this…

Multimedia · Computer Science 2025-09-08 Jianlu Wang , Yanan Wang , Tong Liu

Sentiment classification typically relies on a large amount of labeled data. In practice, the availability of labels is highly imbalanced among different languages, e.g., more English texts are labeled than texts in any other languages,…

Information Retrieval · Computer Science 2019-03-26 Zhenpeng Chen , Sheng Shen , Ziniu Hu , Xuan Lu , Qiaozhu Mei , Xuanzhe Liu

Throughout the past decade, many studies have classified human emotions using only a single sensing modality such as face video, electroencephalogram (EEG), electrocardiogram (ECG), galvanic skin response (GSR), etc. The results of these…

Human-Computer Interaction · Computer Science 2018-06-22 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

Molecular odor prediction is the process of using a molecule's structure to predict its smell. While accurate prediction remains challenging, AI models can suggest potential odors. Existing methods, however, often rely on basic descriptors…

Machine Learning · Computer Science 2025-05-02 Hong Xin Xie , Jian De Sun , Fan Fu Xue , Zi Fei Han , Shan Shan Feng , Qi Chen

Olfaction -- how molecules are perceived as odors to humans -- remains poorly understood. Recently, the principal odor map (POM) was introduced to digitize the olfactory properties of single compounds. However, smells in real life are not…

Machine Learning · Computer Science 2025-01-28 Gary Tom , Cher Tian Ser , Ella M. Rajaonson , Stanley Lo , Hyun Suk Park , Brian K. Lee , Benjamin Sanchez-Lengeling

EEG-based analysis of pain perception, enhanced by machine learning, reveals how the brain encodes pain by identifying neural patterns evoked by noxious stimulation. However, a major challenge that remains is the generalization of machine…

Signal Processing · Electrical Eng. & Systems 2025-08-19 Mathis Rezzouk , Fabrice Gagnon , Alyson Champagne , Mathieu Roy , Philippe Albouy , Michel-Pierre Coll , Cem Subakan

We present a generalized theoretical framework for olfactory representation and plasticity, using the theory of smooth manifolds and sheaves to depict categorical odor learning via distributed neural computation. Beginning with the space of…

Neurons and Cognition · Quantitative Biology 2023-10-13 Jack A. Cook , Thomas A. Cleland

Our sense of smell relies on sensitive, selective atomic-scale processes that are initiated when a scent molecule meets specific receptors in the nose. However, the physical mechanisms of detection are not clear. While odorant shape and…

Biological Physics · Physics 2015-06-26 Jennifer C. Brookes , Filio Hartoutsiou , A. P. Horsfield , A. M. Stoneham

Despite remarkable advances in emotion recognition, they are severely restrained from either the essentially limited property of the employed single modality, or the synchronous presence of all involved multiple modalities. Motivated by…

Machine Learning · Computer Science 2019-07-25 Jing Han , Zixing Zhang , Zhao Ren , Björn Schuller

With the rapid advancement of technology, different biometric user authentication, and identification systems are emerging. Traditional biometric systems like face, fingerprint, and iris recognition, keystroke dynamics, etc. are prone to…

Traditional psychological evaluations rely heavily on human observation and interpretation, which are prone to subjectivity, bias, fatigue, and inconsistency. To address these limitations, this work presents a multimodal emotion recognition…

Human-Computer Interaction · Computer Science 2024-12-25 Kris Kraack

Emotion recognition is an important research direction in artificial intelligence, helping machines understand and adapt to human emotional states. Multimodal electrophysiological(ME) signals, such as EEG, GSR, respiration(Resp), and…

Multimedia · Computer Science 2023-08-07 Yunfei Guo , Tao Zhang , Wu Huang

The purpose of emotion recognition in conversation (ERC) is to identify the emotion category of an utterance based on contextual information. Previous ERC methods relied on simple connections for cross-modal fusion and ignored the…

Computation and Language · Computer Science 2024-05-29 Haoxiang Shi , Xulong Zhang , Ning Cheng , Yong Zhang , Jun Yu , Jing Xiao , Jianzong Wang

In human contact, emotion is very crucial. Attributes like words, voice intonation, facial expressions, and kinesics can all be used to portray one's feelings. However, brain-computer interface (BCI) devices have not yet reached the level…

Signal Processing · Electrical Eng. & Systems 2023-04-14 Shashank Joshi , Falak Joshi

Molecular odor prediction has great potential across diverse fields such as chemistry, pharmaceuticals, and environmental science, enabling the rapid design of new materials and enhancing environmental monitoring. However, current methods…

Machine Learning · Computer Science 2025-02-04 HongXin Xie , JianDe Sun , Yi Shao , Shuai Li , Sujuan Hou , YuLong Sun , Yuxiang Liu