中文
相关论文

相关论文: Human-Machine Cooperative Multimodal Learning Meth…

200 篇论文

Humans express their emotions via facial expressions, voice intonation and word choices. To infer the nature of the underlying emotion, recognition models may use a single modality, such as vision, audio, and text, or a combination of…

机器学习 · 计算机科学 2022-02-21 Vandana Rajan , Alessio Brutti , Andrea Cavallaro

Olfaction sensing in autonomous robotics faces challenges in dynamic operations, energy efficiency, and edge processing. It necessitates a machine learning algorithm capable of managing real-world odor interference, ensuring resource…

信号处理 · 电气工程与系统科学 2024-07-09 Rizwana Kausar , Fakhreddine Zayer , Jaime Viegas , Jorge Dias

Emotional expressions are inherently multimodal -- integrating facial behavior, speech, and gaze -- but their automatic recognition is often limited to a single modality, e.g. speech during a phone call. While previous work proposed…

机器学习 · 计算机科学 2022-05-03 Ahmed Abdou , Ekta Sood , Philipp Müller , Andreas Bulling

Electroencephalography (EEG) is shown to be a valuable data source for evaluating subjects' mental states. However, the interpretation of multi-modal EEG signals is challenging, as they suffer from poor signal-to-noise-ratio, are highly…

信号处理 · 电气工程与系统科学 2022-04-19 David Bethge , Philipp Hallgarten , Ozan Özdenizci , Ralf Mikut , Albrecht Schmidt , Tobias Grosse-Puppendahl

The affective brain-computer interface is a crucial technology for affective interaction and emotional intelligence, emerging as a significant area of research in the human-computer interaction. Compared to single-type features, multi-type…

人机交互 · 计算机科学 2025-08-11 Xueyuan Xu , Wenjia Dong , Fulin Wei , Li Zhuo

The integration of information across multiple modalities and across time is a promising way to enhance the emotion recognition performance of affective systems. Much previous work has focused on instantaneous emotion recognition. The 2018…

图像与视频处理 · 电气工程与系统科学 2018-05-07 Didan Deng , Yuqian Zhou , Jimin Pi , Bertram E. Shi

Using deep learning methods to classify EEG signals can accurately identify people's emotions. However, existing studies have rarely considered the application of the information in another domain's representations to feature selection in…

信号处理 · 电气工程与系统科学 2023-03-22 Kexin Zhu , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

Applications in behavioural research, human-computer interaction, and mental health depend on the ability to recognize emotions. In order to improve the accuracy of emotion recognition using electroencephalography (EEG) data, this work…

信号处理 · 电气工程与系统科学 2024-11-28 Ali Asgar Chandanwala , Srutakirti Bhowmik , Parna Chaudhury , Sheena Christabel Pravin

One of the key challenges to predict odor from molecular structure is unarguably our limited understanding of the odor space and the complexity of the underlying structure-odor relationships. Here, we show that the predictive performance of…

Classification of olfactory-induced electroencephalogram (EEG) signals has shown great potential in many fields. Since different frequency bands within the EEG signals contain different information, extracting specific frequency bands for…

信号处理 · 电气工程与系统科学 2022-02-08 Biao Sun , Zhigang Wei , Pei Liang , Huirang Hou

Nowadays, personalized recommender systems play an increasingly important role in music scenarios in our daily life with the preference prediction ability. However, existing methods mainly rely on users' implicit feedback (e.g., click,…

人机交互 · 计算机科学 2024-04-25 Zhiyu He , Jiayu Li , Weizhi Ma , Min Zhang , Yiqun Liu , Shaoping Ma

Emotion recognition (ER) technology is an integral part for developing innovative applications such as drowsiness detection and health monitoring that plays a pivotal role in contemporary society. This study delves into ER using…

人机交互 · 计算机科学 2024-02-07 Haseeb ur Rahman Abbasi , Zeeshan Rashid , Muhammad Majid , Syed Muhammad Anwar

Our experience of the world is multimodal - we see objects, hear sounds, feel texture, smell odors, and taste flavors. Modality refers to the way in which something happens or is experienced and a research problem is characterized as…

机器学习 · 计算机科学 2017-08-02 Tadas Baltrušaitis , Chaitanya Ahuja , Louis-Philippe Morency

A systematic review on machine-learning strategies for improving generalizability (cross-subjects and cross-sessions) electroencephalography (EEG) based in emotion classification was realized. In this context, the non-stationarity of EEG…

Predicting the relationship between a molecule's structure and its odor remains a difficult, decades-old task. This problem, termed quantitative structure-odor relationship (QSOR) modeling, is an important challenge in chemistry, impacting…

Continuous cough monitors can greatly aid doctors in home monitoring and treatment of respiratory diseases. Although many algorithms have been proposed, they still face limitations in data privacy and short-term monitoring. Edge-AI offers a…

音频与语音处理 · 电气工程与系统科学 2025-07-01 Stefano Albini , Lara Orlandic , Jonathan Dan , Jérôme Thevenot , Tomas Teijeiro , Denisa Andreea Constantinescu , David Atienza

Emotion recognition from EEG signals is essential for affective computing and has been widely explored using deep learning. While recent deep learning approaches have achieved strong performance on single EEG emotion datasets, their…

机器学习 · 计算机科学 2025-11-17 Yuning Chen , Sha Zhao , Shijian Li , Gang Pan

The electroencephalography classifier is the most important component of brain-computer interface based systems. There are two major problems hindering the improvement of it. First, traditional methods do not fully exploit multimodal…

计算机视觉与模式识别 · 计算机科学 2018-08-07 Chuanqi Tan , Fuchun Sun , Wenchang Zhang

Computer interfaces are advancing towards using multi-modalities to enable better human-computer interactions. The use of automatic emotion recognition (AER) can make the interactions natural and meaningful thereby enhancing the user…

声音 · 计算机科学 2025-03-26 Upasana Tiwari , Rupayan Chakraborty , Sunil Kumar Kopparapu

The detection of emotions using an Electroencephalogram (EEG) is a crucial area in brain-computer interfaces and has valuable applications in fields such as rehabilitation and medicine. In this study, we employed transfer learning to…

信号处理 · 电气工程与系统科学 2024-04-09 Sidharth Sidharth , Ashish Abraham Samuel , Ranjana H , Jerrin Thomas Panachakel , Sana Parveen K