English
Related papers

Related papers: Multimodal Video-based Apparent Personality Recogn…

200 papers

Personality analysis has been widely studied in psychology, neuropsychology, and signal processing fields, among others. From the past few years, it also became an attractive research area in visual computing. From the computational point…

Recent studies show that apparent personality traits can be reflected from human facial behavior dynamics. However, most existing methods can only encode single-scale short-term facial behaviors in the latent features for personality…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Fang Li

Understanding human perceptions presents a formidable multimodal challenge for computers, encompassing aspects such as sentiment tendencies and sense of humor. While various methods have recently been introduced to extract…

Multimedia · Computer Science 2023-11-21 Hao Sun , Ziwei Niu , Xinyao Yu , Jiaqing Liu , Yen-Wei Chen , Lanfen Lin

This project investigates the human multi-modal behavior identification algorithm utilizing deep neural networks. According to the characteristics of different modal information, different deep neural networks are used to adapt to different…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Jinyin Wang , Xingchen Li , Yixuan Jin , Yihao Zhong , Keke Zhang , Chang Zhou

Judgments about personality based on facial appearance are strong effectors in social decision making, and are known to have impact on areas from presidential elections to jury decisions. Recent work has shown that it is possible to predict…

Computer Vision and Pattern Recognition · Computer Science 2016-12-28 Edward Grant , Stephan Sahm , Mariam Zabihi , Marcel van Gerven

Apparent personality and emotion analysis are both central to affective computing. Existing works solve them individually. In this paper we investigate if such high-level affect traits and their relationship can be jointly learned from face…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Le Zhang , Songyou Peng , Stefan Winkler

Emotion recognition has become an important field of research in the human-computer interactions domain. The latest advancements in the field show that combining visual with audio information lead to better results if compared to the case…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Nicolae-Catalin Ristea , Liviu Cristian Dutu , Anamaria Radoi

In this paper we describe a solution to our entry for the emotion recognition challenge EmotiW 2017. We propose an ensemble of several models, which capture spatial and audio features from videos. Spatial features are captured by…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Boris Knyazev , Roman Shvetsov , Natalia Efremova , Artem Kuharenko

Apparent personality analysis from short videos poses significant chal-lenges due to the complex interplay of visual, auditory, and textual cues. In this paper, we propose GAME, a Graph-Augmented Multimodal Encoder designed to robustly…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Kangsheng Wang , Yuhang Li , Chengwei Ye , Yufei Lin , Huanzhen Zhang , Bohan Hu , Linuo Xu , Shuyan Liu

Emotion recognition and sentiment analysis are pivotal tasks in speech and language processing, particularly in real-world scenarios involving multi-party, conversational data. This paper presents a multimodal approach to tackle these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Aref Farhadipour , Hossein Ranjbar , Masoumeh Chapariniya , Teodora Vukovic , Sarah Ebling , Volker Dellwo

Recently, the automatic prediction of personality traits has received a lot of attention. Specifically, personality trait prediction from multimodal data has emerged as a hot topic within the field of affective computing. In this paper, we…

Machine Learning · Computer Science 2020-10-23 Yash Mehta , Navonil Majumder , Alexander Gelbukh , Erik Cambria

The successful portrayal of personality in digital characters improves communication and immersion. Current research focuses on expressing personality through modifying animations using heuristic rules or data-driven models. While studies…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Ayda Yurtoğlu , Sinan Sonlu , Yalım Doğan , Uğur Güdükbay

Automatic personality trait assessment is essential for high-quality human-machine interactions. Systems capable of human behavior analysis could be used for self-driving cars, medical research, and surveillance, among many others. We…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Ádám Fodor , Rachid R. Saboundji , András Lőrincz

We explore the efficacy of multimodal behavioral cues for explainable prediction of personality and interview-specific traits. We utilize elementary head-motion units named kinemes, atomic facial movements termed action units and speech…

Machine Learning · Computer Science 2023-02-24 Surbhi Madan , Monika Gahalawat , Tanaya Guha , Roland Goecke , Ramanathan Subramanian

In recent years, predicting Big Five personality traits from multimodal data has received significant attention in artificial intelligence (AI). However, existing computational models often fail to achieve satisfactory performance.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Bin Tang , Keqi Pan , Miao Zheng , Ning Zhou , Jialu Sui , Dandan Zhu , Cheng-Long Deng , Shu-Guang Kuai

Facial expressions vary from person to person, and the brightness, contrast, and resolution of every random image are different. This is why recognizing facial expressions is very difficult. This article proposes an efficient system for…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Faisal Ghaffar

The group affect or emotion in an image of people can be inferred by extracting features about both the people in the picture and the overall makeup of the scene. The state-of-the-art on this problem investigates a combination of facial…

Computer Vision and Pattern Recognition · Computer Science 2018-03-15 Ashok Sundaresan , Sugumar Murugesan , Sean Davis , Karthik Kappaganthu , ZhongYi Jin , Divya Jain , Anurag Maunder

In the latest social networks, more and more people prefer to express their emotions in videos through text, speech, and rich facial expressions. Multimodal video emotion analysis techniques can help understand users' inner world…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Qinglan Wei , Xuling Huang , Yuan Zhang

We consider the task of predicting various traits of a person given an image of their face. We estimate both objective traits, such as gender, ethnicity and hair-color; as well as subjective traits, such as the emotion a person expresses or…

Computer Vision and Pattern Recognition · Computer Science 2016-05-31 Yoad Lewenberg , Yoram Bachrach , Sukrit Shankar , Antonio Criminisi

Human affective recognition is an important factor in human-computer interaction. However, the method development with in-the-wild data is not yet accurate enough for practical usage. In this paper, we introduce the affective recognition…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Sachihiro Youoku , Takahisa Yamamoto , Junya Saito , Akiyoshi Uchida , Xiaoyu Mi , Ziqiang Shi , Liu Liu , Zhongling Liu , Osafumi Nakayama , Kentaro Murase