English
Related papers

Related papers: Linking emotions to behaviors through deep transfe…

200 papers

Predicting human performance in interaction tasks allows designers or developers to understand the expected performance of a target interface without actually testing it with real users. In this work, we present a deep neural net to model…

Human-Computer Interaction · Computer Science 2018-03-15 Yang Li , Samy Bengio , Gilles Bailly

Obtaining large, human labelled speech datasets to train models for emotion recognition is a notoriously challenging task, hindered by annotation cost and label ambiguity. In this work, we consider the task of learning embeddings for speech…

Computer Vision and Pattern Recognition · Computer Science 2018-08-17 Samuel Albanie , Arsha Nagrani , Andrea Vedaldi , Andrew Zisserman

EEG is a non-invasive, safe, and low-risk method to record electrophysiological signals inside the brain. Especially with recent technology developments like dry electrodes, consumer-grade EEG devices, and rapid advances in machine…

Machine Learning · Computer Science 2025-06-23 Tri Duc Ly , Gia H. Ngo

Sentiment analysis is the process of identifying and extracting subjective information from text. Despite the advances to employ cross-lingual approaches in an automatic way, the implementation and evaluation of sentiment analysis systems…

Computation and Language · Computer Science 2023-04-11 Razhan Hameed , Sina Ahmadi , Fatemeh Daneshfar

The ability to combine linguistic guidance from others with direct experience is central to human development, enabling safe and rapid learning in new environments. How do people integrate these two sources of knowledge, and how might AI…

Artificial Intelligence · Computer Science 2026-02-19 Cédric Colas , Tracey Mills , Ben Prystawski , Michael Henry Tessler , Noah Goodman , Jacob Andreas , Joshua Tenenbaum

In crowd behavior understanding, a model of crowd behavior need to be trained using the information extracted from video sequences. Since there is no ground-truth available in crowd datasets except the crowd behavior labels, most of the…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Hamidreza Rabiee , Javad Haddadnia , Hossein Mousavi , Moin Nabi , Vittorio Murino , Nicu Sebe

Images have become one of the most popular types of media through which users convey their emotions within online social networks. Although vast amount of research is devoted to sentiment analysis of textual data, there has been very…

Computer Vision and Pattern Recognition · Computer Science 2014-11-24 Can Xu , Suleyman Cetintas , Kuang-Chih Lee , Li-Jia Li

Human action recognition is an important application domain in computer vision. Its primary aim is to accurately describe human actions and their interactions from a previously unseen data sequence acquired by sensors. The ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Hieu H. Pham , Louahdi Khoudour , Alain Crouzil , Pablo Zegers , Sergio A. Velastin

Classification of human emotions can play an essential role in the design and improvement of human-machine systems. While individual biological signals such as Electrocardiogram (ECG) and Electrodermal Activity (EDA) have been widely used…

Machine Learning · Computer Science 2021-08-06 Anubhav Bhatti , Behnam Behinaein , Dirk Rodenburg , Paul Hungler , Ali Etemad

Scientists often use observational time series data to study complex natural processes, but regression analyses often assume simplistic dynamics. Recent advances in deep learning have yielded startling improvements to the performance of…

Machine Learning · Computer Science 2023-04-21 Cory Shain , William Schuler

Video activity recognition by deep neural networks is impressive for many classes. However, it falls short of human performance, especially for challenging to discriminate activities. Humans differentiate these complex activities by…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Joseph Chrol-Cannon , Andrew Gilbert , Ranko Lazic , Adithya Madhusoodanan , Frank Guerin

In dialog system, dialog act recognition and sentiment classification are two correlative tasks to capture speakers intentions, where dialog act and sentiment can indicate the explicit and the implicit intentions separately. Most of the…

Computation and Language · Computer Science 2020-08-18 Libo Qin , Wanxiang Che , Yangming Li , Minheng Ni , Ting Liu

Speech emotions play a crucial role in human-computer interaction, shaping engagement and context-aware communication. Despite recent advances in spoken dialogue systems, a holistic system for evaluating emotional reasoning is still…

This study takes a preliminary step toward teaching computers to recognize human emotions through Facial Emotion Recognition (FER). Transfer learning is applied using ResNeXt, EfficientNet models, and an ArcFace model originally trained on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Dylan Waldner , Shyamal Mitra

Finding and facilitating commonalities between the linguistic behaviors of large language models and humans could lead to major breakthroughs in our understanding of the acquisition, processing, and evolution of language. However, most…

Computation and Language · Computer Science 2024-11-28 Lukas Galke , Limor Raviv

The goal of the present study is to explore the application of deep convolutional network features to emotion recognition. Results indicate that they perform similarly to other published models at a best recognition rate of 94.4%, and do so…

Computer Vision and Pattern Recognition · Computer Science 2014-08-19 Sébastien Ouellet

Humans have a selective memory, remembering relevant episodes and forgetting the less relevant information. Possessing awareness of event memorability for a user could help intelligent systems in more accurate user modelling, especially for…

Human-Computer Interaction · Computer Science 2025-07-21 Maria Tsfasman , Ramin Ghorbani , Catholijn M. Jonker , Bernd Dudzik

Speech is the most common way humans express their feelings, and sentiment analysis is the use of tools such as natural language processing and computational algorithms to identify the polarity of these feelings. Even though this field has…

Human emotion is expressed in many communication modalities and media formats and so their computational study is equally diversified into natural language processing, audio signal analysis, computer vision, etc. Similarly, the large…

Machine Learning · Computer Science 2023-08-16 Sven Buechel , Udo Hahn

Emotion Recognition in Conversations (ERC) has been gaining increasing importance as conversational agents become more and more common. Recognizing emotions is key for effective communication, being a crucial component in the development of…

Computation and Language · Computer Science 2023-06-06 Patrícia Pereira , Helena Moniz , Isabel Dias , Joao Paulo Carvalho