English
Related papers

Related papers: DARER: Dual-task Temporal Relational Recurrent Rea…

200 papers

Speech Emotion Recognition (SER) task has known significant improvements over the last years with the advent of Deep Neural Networks (DNNs). However, even the most successful methods are still rather failing when adaptation to specific…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-16 Clément Le Moine , Nicolas Obin , Axel Roebel

Speech emotion recognition is the task of recognizing the speaker's emotional state given a recording of their utterance. While most of the current approaches focus on inferring emotion from isolated utterances, we argue that this is not…

Computation and Language · Computer Science 2021-09-14 Raghavendra Pappagari , Piotr Żelasko , Jesús Villalba , Laureano Moro-Velazquez , Najim Dehak

The modeling of conversational context plays a vital role in emotion recognition from conversation (ERC). In this paper, we put forward a novel idea of encoding the utterances with a directed acyclic graph (DAG) to better model the…

Computation and Language · Computer Science 2021-09-17 Weizhou Shen , Siyue Wu , Yunyi Yang , Xiaojun Quan

In task-oriented dialogue systems the dialogue state tracker (DST) component is responsible for predicting the state of the dialogue based on the dialogue history. Current DST approaches rely on a predefined domain ontology, a fact that…

Computation and Language · Computer Science 2020-01-22 Vevake Balaraman , Bernardo Magnini

Effective understanding of dynamically evolving multiagent interactions is crucial to capturing the underlying behavior of agents in social systems. It is usually challenging to observe these interactions directly, and therefore modeling…

Robotics · Computer Science 2022-08-24 Enna Sachdeva , Chiho Choi

Despite the recent progress in speech emotion recognition (SER), state-of-the-art systems are unable to achieve improved performance in cross-language settings. In this paper, we propose a Multimodal Dual Attention Transformer (MDAT) model…

Computation and Language · Computer Science 2023-07-17 Syed Aun Muhammad Zaidi , Siddique Latif , Junaid Qadir

Relational thinking refers to the inherent ability of humans to form mental impressions about relations between sensory signals and prior knowledge, and subsequently incorporate them into their model of their world. Despite the crucial role…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Zheng Nan , Ting Dang , Vidhyasaharan Sethu , Beena Ahmed

In multi-turn dialogs, natural language understanding models can introduce obvious errors by being blind to contextual information. To incorporate dialog history, we present a neural architecture with Speaker-Sensitive Dual Memory Networks…

Computation and Language · Computer Science 2017-11-30 Young-Bum Kim , Sungjin Lee , Ruhi Sarikaya

Task-oriented dialogue systems are essential for applications ranging from customer service to personal assistants and are widely used across various industries. However, developing effective multi-domain systems remains a significant…

Computation and Language · Computer Science 2024-11-04 Aman Gupta , Anirudh Ravichandran , Ziji Zhang , Swair Shah , Anurag Beniwal , Narayanan Sadagopan

Speech emotion recognition (SER) plays a vital role in improving the interactions between humans and machines by inferring human emotion and affective states from speech signals. Whereas recent works primarily focus on mining spatiotemporal…

Sound · Computer Science 2023-10-03 Jiaxin Ye , Xin-cheng Wen , Yujie Wei , Yong Xu , Kunhong Liu , Hongming Shan

Although automatic emotion recognition (AER) has recently drawn significant research interest, most current AER studies use manually segmented utterances, which are usually unavailable for dialogue systems. This paper proposes integrating…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-15 Wen Wu , Chao Zhang , Philip C. Woodland

Extracting temporal relations among events from unstructured text has extensive applications, such as temporal reasoning and question answering. While it is difficult, recent development of Neural-symbolic methods has shown promising…

Computation and Language · Computer Science 2021-12-03 Bo-Ying Su , Shang-Ling Hsu , Kuan-Yin Lai , Jane Yung-jen Hsu

Dialogue Act recognition associate dialogue acts (i.e., semantic labels) to utterances in a conversation. The problem of associating semantic labels to utterances can be treated as a sequence labeling problem. In this work, we build a…

Computation and Language · Computer Science 2017-09-15 Harshit Kumar , Arvind Agarwal , Riddhiman Dasgupta , Sachindra Joshi , Arun Kumar

Most multi-agent systems rely exclusively on autoregressive language models (ARMs) that are based on sequential generation. Although effective for fluent text, ARMs limit global reasoning and plan revision. On the other hand, Discrete…

Machine Learning · Computer Science 2026-03-11 Lina Berrayana , Ahmed Heakl , Abdullah Sohail , Thomas Hofmann , Salman Khan , Wei Chen

To alleviate the problem of structured databases' limited coverage, recent task-oriented dialogue systems incorporate external unstructured knowledge to guide the generation of system responses. However, these usually use word or sentence…

Computation and Language · Computer Science 2022-12-13 Yue Feng , Gerasimos Lampouras , Ignacio Iacobacci

This paper presents a novel latent variable recurrent neural network architecture for jointly modeling sequences of words and (possibly latent) discourse relations between adjacent sentences. A recurrent neural network generates individual…

Computation and Language · Computer Science 2016-04-06 Yangfeng Ji , Gholamreza Haffari , Jacob Eisenstein

Dialogue-based Relation Extraction (DRE) aims to predict the relation type of argument pairs that are mentioned in dialogue. The latest trigger-enhanced methods propose trigger prediction tasks to promote DRE. However, these methods are not…

Computation and Language · Computer Science 2023-03-31 Hao An , Dongsheng Chen , Weiyuan Xu , Zhihong Zhu , Yuexian Zou

Emotion dynamics modeling is a significant task in emotion recognition in conversation. It aims to predict conversational emotions when building empathetic dialogue systems. Existing studies mainly develop models based on Recurrent Neural…

Artificial Intelligence · Computer Science 2021-04-22 Haiqin Yang , Jianping Shen

At a cocktail party, humans exhibit an impressive ability to direct their attention. The auditory attention detection (AAD) approach seeks to identify the attended speaker by analyzing brain signals, such as EEG signals. However, current…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-19 Sheng Yan , Cunhang fan , Hongyu Zhang , Xiaoke Yang , Jianhua Tao , Zhao Lv

The current paradigm of evaluating Large Language Models (LLMs) through static benchmarks comes with significant limitations, such as vulnerability to data contamination and a lack of adaptability to the evolving capabilities of LLMs.…

Computation and Language · Computer Science 2024-06-26 Zhehao Zhang , Jiaao Chen , Diyi Yang