English
Related papers

Related papers: Context-Aware Personality Inference in Dyadic Scen…

200 papers

Dyadic and small group collaboration is an evolutionary advantageous behaviour and the need for such collaboration is a regular occurrence in day to day life. In this paper we estimate the perceived personality traits of individuals in…

Human-Computer Interaction · Computer Science 2022-11-10 Kristian Fenech , Ádám Fodor , Sean P. Bergeron , Rachid R. Saboundji , Catharine Oertel , András Lőrincz

Automatic speech-based affect recognition of individuals in dyadic conversation is a challenging task, in part because of its heavy reliance on manual pre-processing. Traditional approaches frequently require hand-crafted speech features…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-24 Huili Chen , Yue Zhang , Felix Weninger , Rosalind Picard , Cynthia Breazeal , Hae Won Park

Nowadays, automatical personality inference is drawing extensive attention from both academia and industry. Conventional methods are mainly based on user generated contents, e.g., profiles, likes, and texts of an individual, on social…

Computation and Language · Computer Science 2020-09-29 Qiang Liu

Active speaker detection is an important component in video analysis algorithms for applications such as speaker diarization, video re-targeting for meetings, speech enhancement, and human-robot interaction. The absence of a large,…

Audio-driven 3D facial animation has been widely explored, but achieving realistic, human-like performance is still unsolved. This is due to the lack of available 3D datasets, models, and standard evaluation metrics. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Daniel Cudeiro , Timo Bolkart , Cassidy Laidlaw , Anurag Ranjan , Michael J. Black

Advances in neural fields are enabling high-fidelity capture of the shape and appearance of dynamic 3D scenes. However, their capabilities lag behind those offered by conventional representations such as 2D videos because of algorithmic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Cheng-You Lu , Peisen Zhou , Angela Xing , Chandradeep Pokhariya , Arnab Dey , Ishaan Shah , Rugved Mavidipalli , Dylan Hu , Andrew Comport , Kefan Chen , Srinath Sridhar

Friendship and rapport play an important role in the formation of constructive social interactions, and have been widely studied in educational settings due to their impact on student outcomes. Given the growing interest in automating the…

In this article we present a novel underwater dataset collected from several field trials within the EU FP7 project "Cognitive autonomous diving buddy (CADDY)", where an Autonomous Underwater Vehicle (AUV) was used to interact with divers…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 Arturo Gomez Chavez , Andrea Ranieri , Davide Chiarella , Enrica Zereik , Anja Babić , Andreas Birk

Accurate recognition of human emotions is critical for adaptive human-computer interaction, yet remains challenging in dynamic, conversation-like settings. This work presents a personality-aware multimodal framework that integrates…

Conversations contain a wide spectrum of multimodal information that gives us hints about the emotions and moods of the speaker. In this paper, we developed a system that supports humans to analyze conversations. Our main contribution is…

Human-Computer Interaction · Computer Science 2020-01-29 Joshua Y. Kim , Greyson Y. Kim , Kalina Yacef

This approach builds on two following findings in cognitive science: (i) human cognition partially determines expressed behaviour and is directly linked to true personality traits; and (ii) in dyadic interactions individuals' nonverbal…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Siyang Song , Zilong Shao , Shashank Jaiswal , Linlin Shen , Michel Valstar , Hatice Gunes

We address the problem of accurate capture and expressive modelling of interactive behaviors happening between two persons in daily scenarios. Different from previous works which either only consider one person or focus on conversational…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yinghao Huang , Leo Ho , Dafei Qin , Mingyi Shi , Taku Komura

We address the problem of accurate capture of interactive behaviors between two people in daily scenarios. Most previous works either only consider one person or solely focus on conversational gestures of two people, assuming the body…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Leo Ho , Yinghao Huang , Dafei Qin , Mingyi Shi , Wangpok Tse , Wei Liu , Junichi Yamagishi , Taku Komura

Communicating in noisy, multi-talker environments is challenging, especially for people with hearing impairments. Egocentric video data can potentially be used to identify a user's conversation partners, which could be used to inform…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Tobias Dorszewski , Søren A. Fuglsang , Jens Hjortkjær

We present UniTalk, a novel dataset specifically designed for the task of active speaker detection, emphasizing challenging scenarios to enhance model generalization. Unlike previously established benchmarks such as AVA, which predominantly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Le Thien Phuc Nguyen , Zhuoran Yu , Khoa Quang Nhat Cao , Yuwei Guo , Tu Ho Manh Pham , Tuan Tai Nguyen , Toan Ngo Duc Vo , Lucas Poon , Soochahn Lee , Yong Jae Lee

Accurate emotion recognition is pivotal for nuanced and engaging human-computer interactions, yet remains difficult to achieve, especially in dynamic, conversation-like settings. In this study, we showcase how integrating eye-tracking data,…

Human-Computer Interaction · Computer Science 2025-11-03 Meisam Jamshidi Seikavandi , Jostein Fimland , Maria Barrett , Paolo Burelli

We present a review on the current state of publicly available datasets within the human action recognition community; highlighting the revival of pose based methods and recent progress of understanding person-person interaction modeling.…

Computer Vision and Pattern Recognition · Computer Science 2015-11-20 Michael Edwards , Jingjing Deng , Xianghua Xie

We present the Multiview Extended Video with Activities (MEVA) dataset, a new and very-large-scale dataset for human activity recognition. Existing security datasets either focus on activity counts by aggregating public video disseminated…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Kellie Corona , Katie Osterdahl , Roderic Collins , Anthony Hoogs

Identifying the direction of emotional influence in a dyadic dialogue is of increasing interest in the psychological sciences with applications in psychotherapy, analysis of political interactions, or interpersonal conflict behavior. Facial…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Maha Shadaydeh , Lea Mueller , Dana Schneider , Martin Thuemmel , Thomas Kessler , Joachim Denzler

Generating realistic conversational gestures are essential for achieving natural, socially engaging interactions with digital humans. However, existing methods typically map a single audio stream to a single speaker's motion, without…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yichen Peng , Jyun-Ting Song , Siyeol Jung , Ruofan Liu , Haiyang Liu , Xuangeng Chu , Ruicong Liu , Erwin Wu , Hideki Koike , Kris Kitani