English
Related papers

Related papers: End-to-end facial and physiological model for Affe…

200 papers

Understanding the mental state of other people is an important skill for intelligent agents and robots to operate within social environments. However, the mental processes involved in `mind-reading' are complex. One explanation of such…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Jonathan Vitale , Mary-Anne Williams , Benjamin Johnston , Giuseppe Boccignone

The integration of information across multiple modalities and across time is a promising way to enhance the emotion recognition performance of affective systems. Much previous work has focused on instantaneous emotion recognition. The 2018…

Image and Video Processing · Electrical Eng. & Systems 2018-05-07 Didan Deng , Yuqian Zhou , Jimin Pi , Bertram E. Shi

Non-speech emotion recognition has a wide range of applications including healthcare, crime control and rescue, and entertainment, to name a few. Providing these applications using edge computing has great potential, however, recent studies…

Sound · Computer Science 2023-05-02 Ibrahim Malik , Siddique Latif , Sanaullah Manzoor , Muhammad Usama , Junaid Qadir , Raja Jurdak

The rapid expansion of social media platforms has provided unprecedented access to massive amounts of multimodal user-generated content. Comprehending user emotions can provide valuable insights for improving communication and understanding…

Social and Information Networks · Computer Science 2025-01-15 Sree Bhattacharyya , Shuhua Yang , James Z. Wang

The COVID-19 pandemic has undoubtedly changed the standards and affected all aspects of our lives, especially social communication. It has forced people to extensively wear medical face masks, in order to prevent transmission. This face…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Nikolaos Kegkeroglou , Panagiotis P. Filntisis , Petros Maragos

The affective brain-computer interface is a crucial technology for affective interaction and emotional intelligence, emerging as a significant area of research in the human-computer interaction. Compared to single-type features, multi-type…

Human-Computer Interaction · Computer Science 2025-08-11 Xueyuan Xu , Wenjia Dong , Fulin Wei , Li Zhuo

Understanding the facial expressions of our interlocutor is important to enrich the communication and to give it a depth that goes beyond the explicitly expressed. In fact, studying one's facial expression gives insight into their hidden…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Rim EL Cheikh , Hélène Tran , Issam Falih , Engelbert Mephu Nguifo

We propose a graph-based mechanism to extract rich-emotion bearing patterns, which fosters a deeper analysis of online emotional expressions, from a corpus. The patterns are then enriched with word embeddings and evaluated through several…

Computation and Language · Computer Science 2018-04-25 Elvis Saravia , Hsien-Chi Toby Liu , Yi-Shin Chen

In the latest social networks, more and more people prefer to express their emotions in videos through text, speech, and rich facial expressions. Multimodal video emotion analysis techniques can help understand users' inner world…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Qinglan Wei , Xuling Huang , Yuan Zhang

Automatic emotion recognition (ER) has recently gained lot of interest due to its potential in many real-world applications. In this context, multimodal approaches have been shown to improve performance (over unimodal approaches) by…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 R Gnana Praveen , Eric Granger , Patrick Cardinal

The complex information processing system of humans generates a lot of objective and subjective evaluations, making the exploration of human cognitive products of great cutting-edge theoretical value. In recent years, deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yang Xiao

Automated facial identification and facial expression recognition have been topics of active research over the past few decades. Facial and expression recognition find applications in human-computer interfaces, subject tracking, real-time…

Computer Vision and Pattern Recognition · Computer Science 2016-10-25 Sohini Roychowdhury , Michelle Emmons

Analyzing individual emotions during group conversation is crucial in developing intelligent agents capable of natural human-machine interaction. While reliable emotion recognition techniques depend on different modalities (text, audio,…

This paper proposes a multimodal emotion recognition system based on hybrid fusion that classifies the emotions depicted by speech utterances and corresponding images into discrete classes. A new interpretability technique has been…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Puneet Kumar , Sarthak Malik , Balasubramanian Raman

Affective computing has proven to be a viable field of research comprised of a large number of multidisciplinary researchers resulting in work that is widely published. The majority of this work consists of computational models of emotion…

Artificial Intelligence · Computer Science 2009-03-05 Joost Broekens

Technological advancement and its omnipresent connection have pushed humans past the boundaries and limitations of a computer screen, physical state, or geographical location. It has provided a depth of avenues that facilitate…

Multimedia · Computer Science 2023-11-21 Dayo Samuel Banjo , Connice Trimmingham , Niloofar Yousefi , Nitin Agarwal

Emotion recognition has become a popular topic of interest, especially in the field of human computer interaction. Previous works involve unimodal analysis of emotion, while recent efforts focus on multi-modal emotion recognition from…

Computation and Language · Computer Science 2019-03-11 Chan Woo Lee , Kyu Ye Song , Jihoon Jeong , Woo Yong Choi

Emotions play a crucial role in human interaction, health care and security investigations and monitoring. Automatic emotion recognition (AER) using electroencephalogram (EEG) signals is an effective method for decoding the real emotions,…

Machine Learning · Computer Science 2019-05-01 Emad-ul-Haq Qazi , Muhammad Hussain , Hatim AboAlsamh , Ihsan Ullah

In many domains, including online education, healthcare, security, and human-computer interaction, facial emotion recognition (FER) is essential. Real-world FER is still difficult despite its significance because of some factors such as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Deeptimaan Banerjee , Prateek Gothwal , Ashis Kumer Biswas

This paper focuses on the use of emotion recognition techniques to assist psychologists in performing children's therapy through remotely robot operated sessions. In the field of psychology, the use of agent-mediated therapy is growing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Rafael Zimmer , Marcos Sobral , Helio Azevedo