English
Related papers

Related papers: M3TCM: Multi-modal Multi-task Context Model for Ut…

200 papers

Audio Large Language Models (AudioLLMs) have achieved strong results in semantic tasks like speech recognition and translation, but remain limited in modeling paralinguistic cues such as emotion. Existing approaches often treat emotion…

Computation and Language · Computer Science 2025-09-30 Wenyu Zhang , Yingxu He , Geyu Lin , Zhuohan Liu , Shuo Sun , Bin Wang , Xunlong Zou , Jeremy H. M. Wong , Qiongqiong Wang , Hardik B. Sailor , Nancy F. Chen , Ai Ti Aw

In this paper, we analyze the performance of a multitask end-to-end transformer model on the task of conversational recommendations, which aim to provide recommendations based on a user's explicit preferences expressed in dialogue. While…

Computation and Language · Computer Science 2023-05-11 Naveen Ram , Dima Kuzmin , Ellie Ka In Chio , Moustafa Farid Alzantot , Santiago Ontanon , Ambarish Jash , Judith Yue Li

Dialogue disentanglement aims to detach the chronologically ordered utterances into several independent sessions. Conversation utterances are essentially organized and described by the underlying discourse, and thus dialogue disentanglement…

Computation and Language · Computer Science 2023-06-13 Bobo Li , Hao Fei , Fei Li , Shengqiong Wu , Lizi Liao , Yinwei Wei , Tat-Seng Chua , Donghong Ji

With the help of Chain-of-Thought (CoT) prompting, Large Language Models (LLMs) have achieved remarkable performance on various reasoning tasks. However, most of them have been evaluated under noise-free context and the dilemma for LLMs to…

Computation and Language · Computer Science 2023-10-26 Qingyuan Tian , Hanlun Zhu , Lei Wang , Yang Li , Yunshi Lan

This paper proposes an utterance-to-utterance interactive matching network (U2U-IMN) for multi-turn response selection in retrieval-based chatbots. Different from previous methods following context-to-response matching or…

Computation and Language · Computer Science 2019-11-19 Jia-Chen Gu , Zhen-Hua Ling , Quan Liu

Task interference, the performance degradation caused by task switches within a single conversation, has been studied exclusively in text-only settings despite the growing prevalence of multimodal dialogue systems. We introduce a benchmark…

Computation and Language · Computer Science 2026-03-20 Masayuki Kawarada , Tatsuya Ishigaki , Hiroya Takamura

Understanding context is key to understanding human language, an ability which Large Language Models (LLMs) have been increasingly seen to demonstrate to an impressive extent. However, though the evaluation of LLMs encompasses various…

Computation and Language · Computer Science 2024-02-02 Yilun Zhu , Joel Ruben Antony Moniz , Shruti Bhargava , Jiarui Lu , Dhivya Piraviperumal , Site Li , Yuan Zhang , Hong Yu , Bo-Hsiang Tseng

Both humans and machines learn the meaning of unknown words through contextual information in a sentence, but not all contexts are equally helpful for learning. We introduce an effective method for capturing the level of contextual…

Computation and Language · Computer Science 2023-11-10 Sungjin Nam , David Jurgens , Gwen Frishkoff , Kevyn Collins-Thompson

Large language models (LLMs) are increasingly relied upon for complex multi-turn conversations across diverse real-world applications. However, existing benchmarks predominantly focus on single-turn evaluations, overlooking the models'…

Computation and Language · Computer Science 2024-01-31 Wai-Chung Kwan , Xingshan Zeng , Yuxin Jiang , Yufei Wang , Liangyou Li , Lifeng Shang , Xin Jiang , Qun Liu , Kam-Fai Wong

Task-oriented dialogue systems in industry settings need to have high conversational capability, be easily adaptable to changing situations and conform to business constraints. This paper describes a 3-step procedure to develop a…

Computation and Language · Computer Science 2022-10-27 Lahari Poddar , György Szarvas , Cheng Wang , Jorge Balazs , Pavel Danchenko , Patrick Ernst

Each utterance in multi-turn empathetic dialogues has features such as emotion, keywords, and utterance-level meaning. Feature transitions between utterances occur naturally. However, existing approaches fail to perceive the transitions…

Computation and Language · Computer Science 2022-05-09 Wongyu Kim , Youbin Ahn , Donghyun Kim , Kyong-Ho Lee

We introduce a dynamic benchmarking system for conversational agents that evaluates their performance through a single, simulated, and lengthy user$\leftrightarrow$agent interaction. The interaction is a conversation between the user and…

Computation and Language · Computer Science 2024-10-14 David Castillo-Bolado , Joseph Davidson , Finlay Gray , Marek Rosa

In conversation-based psychotherapy, therapists use verbal techniques to help clients express thoughts and feelings, and change behavior. In particular, how well therapists convey empathy is an essential quality index of psychotherapy…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-29 Dehua Tao , Tan Lee , Harold Chui , Sarah Luk

We explore the benefits that multitask learning offer to speech processing as we train models on dual objectives with automatic speech recognition and intent classification or sentiment classification. Our models, although being of modest…

Computation and Language · Computer Science 2022-11-28 Quentin Meeus , Marie-Francine Moens , Hugo Van hamme

Topic drift is a common phenomenon in multi-turn dialogue. Therefore, an ideal dialogue generation models should be able to capture the topic information of each context, detect the relevant context, and produce appropriate responses…

Computation and Language · Computer Science 2020-09-29 Hainan Zhang , Yanyan Lan , Liang Pang , Hongshen Chen , Zhuoye Ding , Dawei Yin

In this paper, we propose a multi-label classification framework to detect multiple speaking styles in a speech sample. Unlike previous studies that have primarily focused on identifying a single target style, our framework effectively…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-19 Miseul Kim , Seyun Um , Hyeonjin Cha , Hong-goo Kang

While modern Transformer-based language models (LMs) have achieved major success in multi-task generalization, they often struggle to capture long-range dependencies within their context window. This work introduces a novel approach using…

Computation and Language · Computer Science 2025-09-23 Alok N. Shah , Khush Gupta , Keshav Ramji , Pratik Chaudhari

A range of studies have concluded that neural word prediction models can distinguish grammatical from ungrammatical sentences with high accuracy. However, these studies are based primarily on monolingual evidence from English. To…

Computation and Language · Computer Science 2020-05-22 Aaron Mueller , Garrett Nicolai , Panayiota Petrou-Zeniou , Natalia Talmina , Tal Linzen

Precisely understanding users' contextual search intent has been an important challenge for conversational search. As conversational search sessions are much more diverse and long-tailed, existing methods trained on limited data still show…

Information Retrieval · Computer Science 2023-10-23 Kelong Mao , Zhicheng Dou , Fengran Mo , Jiewen Hou , Haonan Chen , Hongjin Qian

This study employs deep learning techniques to explore four speaker profiling tasks on the TIMIT dataset, namely gender classification, accent classification, age estimation, and speaker identification, highlighting the potential and…

Sound · Computer Science 2024-04-19 Rong Wang , Kun Sun