English
Related papers

Related papers: The 2026 ACII Dyadic Conversations (DaiKon) Worksh…

200 papers

Individuals often align their speaking patterns with their interlocutors, a phenomenon linked to engagement and rapport. While well documented in task-oriented dialogues, less is known about entrainment in naturalistic, non-task and virtual…

Human-Computer Interaction · Computer Science 2026-04-20 Thanushi Withanage , Elizabeth Redcay , Carol Espy-Wilson

Emotional Mimicry Intensity (EMI) estimation plays a pivotal role in understanding human social behavior and advancing human-computer interaction. The core challenges lie in dynamic correlation modeling and robust fusion of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Jun Yu , Lingsi Zhu , Yanjun Chi , Yunxiang Zhang , Yang Zheng , Yongqi Wang , Xilong Lu

Social infrastructure and other built environments are increasingly expected to support well-being and community resilience by enabling social interaction. Yet in civil and built-environment research, there is no consistent and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Cheyu Lin , Katherine A. Flanigan , Sirajum Munir

The rapid evolution of end-to-end spoken dialogue systems demands transcending mere textual semantics to incorporate paralinguistic nuances and the spontaneous nature of human conversation. However, current methods struggle with two…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-12 Jingyu Lu , Yuhan Wang , Fan Zhuo , Xize Cheng , Changhao Pan , Xueyi Pu , Yifu Chen , Chenyuhao Wen , Tianle Liang , Zhou Zhao

Human-human communication is like a delicate dance where listeners and speakers concurrently interact to maintain conversational dynamics. Hence, an effective model for generating listener nonverbal behaviors requires understanding the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Minh Tran , Di Chang , Maksim Siniukov , Mohammad Soleymani

Parent-AI collaboration to support real-time conversations with children is challenging due to the sensitivity and open-ended nature of such interactions. Existing systems often simplify collaboration into static modes, providing limited…

Human-Computer Interaction · Computer Science 2026-04-02 Yu Mei , Ziyao Zhang , Qingyang Wan , Shiyi Wang , Ge Wang , Jie Cai , Chun Yu , Yuanchun Shi

Human-AI interactions are increasingly part of everyday life, yet the interpersonal dynamics that unfold during such exchanges remain underexplored. This study investigates how emotional alignment, semantic exploration, and linguistic…

Human-Computer Interaction · Computer Science 2025-12-22 Halfdan Nordahl Fundal , Johannes Eide Rambøll , Karsten Olsen

Conversational AI is increasingly deployed in emotionally charged and ethically sensitive interactions. Previous research has primarily concentrated on emotional benchmarks or static safety checks, overlooking how alignment unfolds in…

Computation and Language · Computer Science 2026-04-06 Jiawen Deng , Wentao Zhang , Ziyun Jiao , Fuji Ren

AI support of collaborative interactions entails mediating potential misalignment between interlocutor beliefs. Common preference alignment methods like DPO excel in static settings, but struggle in dynamic collaborative tasks where the…

Computation and Language · Computer Science 2025-05-27 Abhijnan Nath , Carine Graff , Andrei Bachinin , Nikhil Krishnaswamy

Non-verbal behavior is a central challenge in understanding the dynamics of a conversation and the affective states between interlocutors arising from the interaction. Although psychological research has demonstrated that non-verbal…

Computation and Language · Computer Science 2024-09-24 Marius Funk , Shogo Okada , Elisabeth André

Recent advances in conversational AI have demonstrated impressive capabilities in single-turn responses, yet multi-turn dialogues remain challenging for even the most sophisticated language models. Current dialogue datasets are limited in…

Computation and Language · Computer Science 2025-05-27 Alkis Koudounas , Moreno La Quatra , Elena Baralis

Human conversation involves continuous exchanges of speech and nonverbal cues such as head nods, gaze shifts, and facial expressions that convey attention and emotion. Modeling these bidirectional dynamics in 3D is essential for building…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Junjie Chen , Fei Wang , Zhihao Huang , Qing Zhou , Kun Li , Dan Guo , Linfeng Zhang , Xun Yang

The impression we make on others depends not only on what we say, but also, to a large extent, on how we say it. As a sub-branch of affective computing and social signal processing, impression recognition has proven critical in both…

Multimedia · Computer Science 2022-03-29 Yuanchao Li , Catherine Lai

Conversations contain a wide spectrum of multimodal information that gives us hints about the emotions and moods of the speaker. In this paper, we developed a system that supports humans to analyze conversations. Our main contribution is…

Human-Computer Interaction · Computer Science 2020-01-29 Joshua Y. Kim , Greyson Y. Kim , Kalina Yacef

Automatic depression detection from conversational data has gained significant interest in recent years. The DAIC-WOZ dataset, interviews conducted by a human-controlled virtual agent, has been widely used for this task. Recent studies have…

A key component of dyadic spoken interactions is the contextually relevant non-verbal gestures, such as head movements that reflect a listener's response to the interlocutor's speech. Although significant progress has been made in the…

Robotics · Computer Science 2024-10-01 Bishal Ghosh , Emma Li , Tanaya Guha

Human nonverbal emotional communication in dyadic dialogs is a process of mutual influence and adaptation. Identifying the direction of influence, or cause-effect relation between participants is a challenging task, due to two main…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Lea Müller , Maha Shadaydeh , Martin Thümmel , Thomas Kessler , Dana Schneider , Joachim Denzler

Multimodal information-gathering settings, where users collaborate with AI in dynamic environments, are increasingly common. These involve complex processes with textual and multimodal interactions, often requiring additional structural…

Conversational agents (CAs) play an important role in human computer interaction. Creating believable movements for CAs is challenging, since the movements have to be meaningful and natural, reflecting the coupling between gestures and…

Human-Computer Interaction · Computer Science 2023-05-15 Najmeh Sadoughi , Carlos Busso

Rapid improvements in large language models have unveiled a critical challenge in human-AI interaction: sycophancy. In this context, sycophancy refers to the tendency of models to excessively agree with or flatter users, often at the…

Computation and Language · Computer Science 2025-03-18 Joshua Liu , Aarav Jain , Soham Takuri , Srihan Vege , Aslihan Akalin , Kevin Zhu , Sean O'Brien , Vasu Sharma