English
Related papers

Related papers: Inter-Stance: A Dyadic Multimodal Corpus for Conve…

200 papers

Conversational memory is the process by which humans encode, retain and retrieve verbal, non-verbal and contextual information from a conversation. Since human memory is selective, differing recollections of the same events can lead to…

Computation and Language · Computer Science 2024-10-16 Maria Tsfasman , Bernd Dudzik , Kristian Fenech , Andras Lorincz , Catholijn M. Jonker , Catharine Oertel

Short-form video platforms integrate text, visuals, and audio into complex communicative acts, yet existing research analyzes these modalities in isolation, lacking scalable frameworks to interpret their joint contributions. This study…

Multimedia · Computer Science 2026-01-22 Mingyue Zha , Ho-Chun Herbert Chang

Humans express feelings or emotions via different channels. Take language as an example, it entails different sentiments under different visual-acoustic contexts. To precisely understand human intentions as well as reduce the…

Artificial Intelligence · Computer Science 2021-11-17 Ting Wu , Junjie Peng , Wenqiang Zhang , Huiran Zhang , Chuanshuai Ma , Yansong Huang

Collaborative learning is an educational approach that enhances learning through shared goals and working together. Interaction and regulation are two essential factors related to the success of collaborative learning. Since the information…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Yante Li , Yang Liu , KhÁnh Nguyen , Henglin Shi , Eija Vuorenmaa , Sanna Jarvela , Guoying Zhao

When interpersonal interactions between individuals are described by the (discrete or continuous) dynamical systems, the interactions are usually assumed to be instantaneous: the rates of change of the actual states of the actors at given…

Dynamical Systems · Mathematics 2012-02-17 Natalia Bielczyk , Urszula Foryś , Tadeusz Płatkowski

The computer vision community has explored dyadic interactions for atomic actions such as pushing, carrying-object, etc. However, with the advancement in deep learning models, there is a need to explore more complex dyadic situations such…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Abid Ali , Rui Dai , Ashish Marisetty , Guillaume Astruc , Monique Thonnat , Jean-Marc Odobez , Susanne Thümmler , Francois Bremond

During social interactions, understanding the intricacies of the context can be vital, particularly for socially anxious individuals. While previous research has found that the presence of a social interaction can be detected from ambient…

Human-Computer Interaction · Computer Science 2024-07-22 Varun Reddy , Zhiyuan Wang , Emma Toner , Max Larrazabal , Mehdi Boukhechba , Bethany A. Teachman , Laura E. Barnes

We present a new research task and a dataset to understand human social interactions via computational methods, to ultimately endow machines with the ability to encode and decode a broad channel of social signals humans use. This research…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Hanbyul Joo , Tomas Simon , Mina Cikara , Yaser Sheikh

The rapid proliferation of multimodal social media content has driven research in Multimodal Conversational Stance Detection (MCSD), which aims to interpret users' attitudes toward specific targets within complex discussions. However,…

Computation and Language · Computer Science 2026-03-11 Bingbing Wang , Zhixin Bai , Zhengda Jin , Zihan Wang , Xintong Song , Jingjie Lin , Sixuan Li , Jing Li , Ruifeng Xu

There is a growing need for social robots and intelligent agents that can effectively interact with and support users. For the interactions to be seamless, the agents need to analyse social scenes and behavioural cues from their (robot's)…

Robotics · Computer Science 2025-10-28 Tongfei Bian , Mathieu Chollet , Tanaya Guha

Non-verbal behavior is a central challenge in understanding the dynamics of a conversation and the affective states between interlocutors arising from the interaction. Although psychological research has demonstrated that non-verbal…

Computation and Language · Computer Science 2024-09-24 Marius Funk , Shogo Okada , Elisabeth André

Individuals often align their speaking patterns with their interlocutors, a phenomenon linked to engagement and rapport. While well documented in task-oriented dialogues, less is known about entrainment in naturalistic, non-task and virtual…

Human-Computer Interaction · Computer Science 2026-04-20 Thanushi Withanage , Elizabeth Redcay , Carol Espy-Wilson

Socially relevant situations that involve strategic interactions are widespread among animals and humans alike. To study these situations, theoretical and experimental works have adopted a game-theoretical perspective, which has allowed to…

Despite progress in speech-to-video synthesis, existing methods often struggle to capture cross-individual dependencies and provide fine-grained control over reactive behaviors in dyadic settings. To address these challenges, we propose…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Dongwei Pan , Longwei Guo , Jiazhi Guan , Luying Huang , Yiding Li , Haojie Liu , Haocheng Feng , Wei He , Kaisiyuan Wang , Hang Zhou

We are approaching a future where social robots will progressively become widespread in many aspects of our daily lives, including education, healthcare, work, and personal use. All of such practical applications require that humans and…

Artificial Intelligence · Computer Science 2021-10-19 Nguyen Tan Viet Tuyen , Oya Celiktutan

Multimodal sentiment analysis has recently gained popularity because of its relevance to social media posts, customer service calls and video blogs. In this paper, we address three aspects of multimodal sentiment analysis; 1. Cross modal…

Computation and Language · Computer Science 2020-03-03 Ayush Kumar , Jithendra Vepa

Traditional psychological evaluations rely heavily on human observation and interpretation, which are prone to subjectivity, bias, fatigue, and inconsistency. To address these limitations, this work presents a multimodal emotion recognition…

Human-Computer Interaction · Computer Science 2024-12-25 Kris Kraack

We present a review on the current state of publicly available datasets within the human action recognition community; highlighting the revival of pose based methods and recent progress of understanding person-person interaction modeling.…

Computer Vision and Pattern Recognition · Computer Science 2015-11-20 Michael Edwards , Jingjing Deng , Xianghua Xie

The 2026 ACII Dyadic Conversations (ACII-DaiKon) Workshop & Challenge introduces a benchmark for modeling interpersonal affect and social dynamics in dyadic conversations. Although conversational affect modeling has advanced rapidly, most…

Socially Interactive Agents (SIAs) are physical or virtual embodied agents that display similar behavior as human multimodal behavior. Modeling SIAs' non-verbal behavior, such as speech and facial gestures, has always been a challenging…

Human-Computer Interaction · Computer Science 2023-05-22 Jieyeon Woo , Mireille Fares , Catherine Pelachaud , Catherine Achard