English
Related papers

Related papers: Unsupervised Multi-Modal Representation Learning f…

200 papers

Biological imaging data are often partially confounded or contain unwanted variability. Examples of such phenomena include variable lighting across microscopy image captures, stain intensity variation in histological slides, and batch…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Craig A. Glastonbury , Michael Ferlaino , Christoffer Nellåker , Cecilia M. Lindgren

Emotional expressions are the behaviors that communicate our emotional state or attitude to others. They are expressed through verbal and non-verbal communication. Complex human behavior can be understood by studying physical features from…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Liam Schoneveld , Alice Othmani , Hazem Abdelkawy

Emotion recognition from EEG signals is essential for affective computing and has been widely explored using deep learning. While recent deep learning approaches have achieved strong performance on single EEG emotion datasets, their…

Machine Learning · Computer Science 2025-11-17 Yuning Chen , Sha Zhao , Shijian Li , Gang Pan

Emotion recognition is an important research direction in artificial intelligence, helping machines understand and adapt to human emotional states. Multimodal electrophysiological(ME) signals, such as EEG, GSR, respiration(Resp), and…

Multimedia · Computer Science 2023-08-07 Yunfei Guo , Tao Zhang , Wu Huang

The affective brain-computer interface is a crucial technology for affective interaction and emotional intelligence, emerging as a significant area of research in the human-computer interaction. Compared to single-type features, multi-type…

Human-Computer Interaction · Computer Science 2025-08-11 Xueyuan Xu , Wenjia Dong , Fulin Wei , Li Zhuo

Social robots able to continually learn facial expressions could progressively improve their emotion recognition capability towards people interacting with them. Semi-supervised learning through ensemble predictions is an efficient strategy…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Henrique Siqueira , Pablo Barros , Sven Magg , Stefan Wermter

Multimodal dimensional emotion recognition has drawn a great attention from the affective computing community and numerous schemes have been extensively investigated, making a significant progress in this area. However, several questions…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Dung Nguyen , Duc Thanh Nguyen , Rui Zeng , Thanh Thi Nguyen , Son N. Tran , Thin Nguyen , Sridha Sridharan , Clinton Fookes

Conventionally, autoencoders are unsupervised representation learning tools. In this work, we propose a novel discriminative autoencoder. Use of supervised discriminative learning ensures that the learned representation is robust to…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Anupriya Gogna , Angshul Majumdar

Physiological measurements involves observing variables that attribute to the normative functioning of human systems and subsystems directly or indirectly. The measurements can be used to detect affective states of a person with aims such…

Machine Learning · Computer Science 2022-10-31 Nibraas Khan , Nilanjan Sarkar

An important challenge in emotion recognition is to develop methods that can leverage unlabeled training data. In this paper, we propose the VQ-MAE-AV model, a self-supervised multimodal model that leverages masked autoencoders to learn…

Sound · Computer Science 2025-05-12 Samir Sadok , Simon Leglaive , Renaud Séguier

To date, research on sensor-equipped mobile devices has primarily focused on the purely supervised task of human activity recognition (walking, running, etc), demonstrating limited success in inferring high-level health outcomes from…

Machine Learning · Computer Science 2020-11-10 Dimitris Spathis , Ignacio Perez-Pozuelo , Soren Brage , Nicholas J. Wareham , Cecilia Mascolo

Unsupervised representation learning holds the promise of exploiting large amounts of unlabeled data to learn general representations. A promising technique for unsupervised learning is the framework of Variational Auto-encoders (VAEs).…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Kamal Gupta , Saurabh Singh , Abhinav Shrivastava

With the increasing number of deep multi-wavelength galaxy surveys, the spectral energy distribution (SED) of galaxies has become an invaluable tool for studying the formation of their structures and their evolution. In this context,…

Instrumentation and Methods for Astrophysics · Physics 2017-07-12 Joana Frontera-Pons , Florent Sureau , Jerome Bobin , Emeric Le Floc'h

Emotion recognition in conversations (ERC) is challenging due to the multimodal nature of the emotion expression. In this paper, we propose to pretrain a text-based recognition model from unsupervised speech transcripts with LLM guidance.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Soumya Dutta , Sriram Ganapathy

Although deep learning are commonly employed for image recognition, usually huge amount of labeled training data is required, which may not always be readily available. This leads to a noticeable performance disparity when compared to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Enoch Solomon , Abraham Woubie , Eyael Solomon Emiru

Throughout the past decade, many studies have classified human emotions using only a single sensing modality such as face video, electroencephalogram (EEG), electrocardiogram (ECG), galvanic skin response (GSR), etc. The results of these…

Human-Computer Interaction · Computer Science 2018-06-22 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

Human emotion is expressed in many communication modalities and media formats and so their computational study is equally diversified into natural language processing, audio signal analysis, computer vision, etc. Similarly, the large…

Machine Learning · Computer Science 2023-08-16 Sven Buechel , Udo Hahn

Emotion recognition is an important part of affective computing. Extracting emotional cues from human gaits yields benefits such as natural interaction, a nonintrusive nature, and remote detection. Recently, the introduction of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Cheng Song , Lu Lu , Zhen Ke , Long Gao , Shuai Ding

Autoencoders are unsupervised deep learning models used for learning representations. In literature, autoencoders have shown to perform well on a variety of tasks spread across multiple domains, thereby establishing widespread…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Maneet Singh , Shruti Nagpal , Mayank Vatsa , Richa Singh , Afzel Noore

The aim of this research is development of rule based decision model for emotion recognition. This research also proposes using the rules for augmenting inter-corporal recognition accuracy in multimodal systems that use supervised learning…

Human-Computer Interaction · Computer Science 2016-07-12 Amol Patwardhan , Gerald Knapp