English
Related papers

Related papers: Speaker and Time-aware Joint Contextual Learning f…

200 papers

Existing goal-oriented dialogue datasets focus mainly on identifying slots and values. However, customer support interactions in reality often involve agents following multi-step procedures derived from explicitly-defined company policies…

Computation and Language · Computer Science 2021-04-05 Derek Chen , Howard Chen , Yi Yang , Alex Lin , Zhou Yu

Spoken dialogue is a primary source of information in videos; therefore, accurately identifying who spoke what and when is essential for deep video understanding. We introduce D-ORCA, a \textbf{d}ialogue-centric \textbf{o}mni-modal large…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Changli Tang , Tianyi Wang , Fengyun Rao , Jing Lyu , Chao Zhang

Mainstream Audio Analytics models are trained to learn under the paradigm of one class label to many recordings focusing on one task. Learning under such restricted supervision limits the flexibility of models because they require labeled…

Sound · Computer Science 2022-06-13 Benjamin Elizalde , Soham Deshmukh , Mahmoud Al Ismail , Huaming Wang

Interactions involving children span a wide range of important domains from learning to clinical diagnostic and therapeutic contexts. Automated analyses of such interactions are motivated by the need to seek accurate insights and offer…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-13 Anfeng Xu , Kevin Huang , Tiantian Feng , Helen Tager-Flusberg , Shrikanth Narayanan

We describe a statistical approach for modeling dialogue acts in conversational speech, i.e., speech-act-like units such as Statement, Question, Backchannel, Agreement, Disagreement, and Apology. Our model detects and predicts dialogue acts…

Computation and Language · Computer Science 2022-02-28 A. Stolcke , K. Ries , N. Coccaro , E. Shriberg , R. Bates , D. Jurafsky , P. Taylor , R. Martin , C. Van Ess-Dykema , M. Meteer

Dialogue related Machine Reading Comprehension requires language models to effectively decouple and model multi-turn dialogue passages. As a dialogue development goes after the intentions of participants, its topic may not keep constant…

Computation and Language · Computer Science 2023-09-19 Xinbei Ma , Yi Xu , Hai Zhao , Zhuosheng Zhang

The use of conversational assistants to search for information is becoming increasingly more popular among the general public, pushing the research towards more advanced and sophisticated techniques. In the last few years, in particular,…

Information Retrieval · Computer Science 2021-04-15 Rafael Ferreira , David Semedo , Joao Magalhaes

Turn-taking modeling is fundamental to spoken dialogue systems, yet its evaluation remains fragmented and often limited to binary boundary detection under narrow interaction settings. Such protocols hinder systematic comparison and obscure…

Sound · Computer Science 2026-04-02 Huan Shen , Yingao Wang , Shangkun Huang , Wei Zou , Yunzhang Chen

The aim of the workshop was to bring together experts working on open-domain dialogue research. In this speedily advancing research area many challenges still exist, such as learning information from conversations, and engaging in a…

Computation and Language · Computer Science 2024-11-20 Yvette Graham , Mohammed Rameez Qureshi , Haider Khalid , Gerasimos Lampouras , Ignacio Iacobacci , Qun Liu

Unlike well-structured text, such as news reports and encyclopedia articles, dialogue content often comes from two or more interlocutors, exchanging information with each other. In such a scenario, the topic of a conversation can vary upon…

Computation and Language · Computer Science 2021-09-13 Junpeng Liu , Yanyan Zou , Hainan Zhang , Hongshen Chen , Zhuoye Ding , Caixia Yuan , Xiaojie Wang

Building open domain conversational systems that allow users to have engaging conversations on topics of their choice is a challenging task. Alexa Prize was launched in 2016 to tackle the problem of achieving natural, sustained, coherent…

Existing task-oriented conversational search systems heavily rely on domain ontologies with pre-defined slots and candidate value sets. In practical applications, these prerequisites are hard to meet, due to the emerging new user…

Computation and Language · Computer Science 2023-05-09 Yuxia Wu , Tianhao Dai , Zhedong Zheng , Lizi Liao

Dialogue segmentation is a crucial task for dialogue systems allowing a better understanding of conversational texts. Despite recent progress in unsupervised dialogue segmentation methods, their performances are limited by the lack of…

Computation and Language · Computer Science 2023-10-17 Junfeng Jiang , Chengzhang Dong , Sadao Kurohashi , Akiko Aizawa

Predicting when to initiate speech in real-world environments remains a fundamental challenge for conversational agents. We introduce EgoSpeak, a novel framework for real-time speech initiation prediction in egocentric streaming video. By…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Junhyeok Kim , Min Soo Kim , Jiwan Chung , Jungbin Cho , Jisoo Kim , Sungwoong Kim , Gyeongbo Sim , Youngjae Yu

Dialogue systems for mental health care aim to provide appropriate support to individuals experiencing mental distress. While extensive research has been conducted to deliver adequate emotional support, existing studies cannot identify…

Computation and Language · Computer Science 2024-08-13 Seungyeon Seo , Gary Geunbae Lee

Natural Language Understanding (NLU) is a core component of dialog systems. It typically involves two tasks - intent classification (IC) and slot labeling (SL), which are then followed by a dialogue management (DM) component. Such NLU…

Computation and Language · Computer Science 2019-09-20 Arshit Gupta , Peng Zhang , Garima Lalwani , Mona Diab

In conversation-based psychotherapy, therapists use verbal techniques to help clients express thoughts and feelings, and change behavior. In particular, how well therapists convey empathy is an essential quality index of psychotherapy…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-29 Dehua Tao , Tan Lee , Harold Chui , Sarah Luk

A dialogue act (DA) represents the meaning of an utterance at the illocutionary force level (Austin 1962) such as a question, a request, and a greeting. Since DAs take charge of the most fundamental part of communication, we believe that…

Artificial Intelligence · Computer Science 2022-10-04 Akane Matsushima , Ryosuke Kanajiri , Yusuke Hattori , Chie Fukada , Natsuki Oka

Dialogue act (DA) classification has been studied for the past two decades and has several key applications such as workflow automation and conversation analytics. Researchers have used, to address this problem, various traditional machine…

Computation and Language · Computer Science 2019-08-07 Ozan İrsoy , Rakesh Gosangi , Haimin Zhang , Mu-Hsin Wei , Peter Lund , Duccio Pappadopulo , Brendan Fahy , Neophytos Nephytou , Camilo Ortiz

During social interactions, understanding the intricacies of the context can be vital, particularly for socially anxious individuals. While previous research has found that the presence of a social interaction can be detected from ambient…

Human-Computer Interaction · Computer Science 2024-07-22 Varun Reddy , Zhiyuan Wang , Emma Toner , Max Larrazabal , Mehdi Boukhechba , Bethany A. Teachman , Laura E. Barnes