English
Related papers

Related papers: DialBERT: A Hierarchical Pre-Trained Model for Con…

200 papers

Recent years have witnessed a substantial increase in the use of deep learning to solve various natural language processing (NLP) problems. Early deep learning models were constrained by their sequential or unidirectional nature, such that…

Information Retrieval · Computer Science 2024-03-05 Jiajia Wang , Jimmy X. Huang , Xinhui Tu , Junmei Wang , Angela J. Huang , Md Tahmid Rahman Laskar , Amran Bhuiyan

Large language models (LLMs) have showcased remarkable capabilities in conversational AI, enabling open-domain responses in chat-bots, as well as advanced processing of conversations like summarization, intent classification, and insights…

Computation and Language · Computer Science 2025-03-24 Reem Gody , Mohamed Abdelghaffar , Mohammed Jabreel , Ahmed Tawfik

The use of multilingual language models for tasks in low and high-resource languages has been a success story in deep learning. In recent times, Arabic has been receiving widespread attention on account of its dialectal variance. While…

Computation and Language · Computer Science 2022-11-09 Soumajyoti Sarkar , Kaixiang Lin , Sailik Sengupta , Leonard Lausen , Sheng Zha , Saab Mansour

Autonomous systems conducting schema-grounded information-gathering dialogues face an instrumentation gap, lacking turn-level observables for monitoring acquisition efficiency and detecting when questioning becomes unproductive. We…

Computation and Language · Computer Science 2026-01-15 Dimitris Panagopoulos , Adolfo Perrusquia , Weisi Guo

In multilingual societies, social conversations often involve code-mixed speech. The current speech technology may not be well equipped to extract information from multi-lingual multi-speaker conversations. The DISPLACE challenge entails a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-06 Shikha Baghel , Shreyas Ramoji , Sidharth , Ranjana H , Prachi Singh , Somil Jain , Pratik Roy Chowdhuri , Kaustubh Kulkarni , Swapnil Padhi , Deepu Vijayasenan , Sriram Ganapathy

Although pre-trained contextualized language models such as BERT achieve significant performance on various downstream tasks, current language representation still only focuses on linguistic objective at a specific granularity, which may…

Computation and Language · Computer Science 2021-01-01 Yian Li , Hai Zhao

Disentanglement of a speaker's timbre and style is very important for style transfer in multi-speaker multi-style text-to-speech (TTS) scenarios. With the disentanglement of timbres and styles, TTS systems could synthesize expressive speech…

Sound · Computer Science 2022-11-23 Wei Song , Yanghao Yue , Ya-jie Zhang , Zhengchen Zhang , Youzheng Wu , Xiaodong He

Topics play an important role in the global organisation of a conversation as what is currently discussed constrains the possible contributions of the participant. Understanding the way topics are organised in interaction would provide…

Computation and Language · Computer Science 2024-02-06 Amandine Decker , Maxime Amblard

Multimodal emotion recognition in conversations aims to infer utterance-level emotions by jointly modeling textual, acoustic, and visual cues within context. Despite recent progress, key challenges remain, including redundant cross-modal…

Sound · Computer Science 2026-04-17 Chengling Guo , Yuntao Shou , Tao Meng , Wei Ai , Yun Tan , Keqin Li

Large Language Models are increasingly used to simulate human opinion dynamics, yet the effect of genuine interaction is often obscured by systematic biases. We develop a Bayesian framework to disentangle and quantify three such biases: (i)…

Physics and Society · Physics 2026-05-25 Vincent C. Brockers , David A. Ehrlich , Viola Priesemann

Interruption in a dialogue occurs when the listener begins their speech before the current speaker finishes speaking. Interruptions can be broadly divided into two groups: cooperative (when the listener wants to support the speaker), and…

Computation and Language · Computer Science 2024-07-23 Dmitrii Galimzianov , Viacheslav Vyshegorodtsev

There is a huge performance gap between formal and informal language understanding tasks. The recent pre-trained models that improved the performance of formal language understanding tasks did not achieve a comparable result on informal…

Computation and Language · Computer Science 2020-04-30 Jing Gu , Zhou Yu

Pre-trained language models such as BERT have achieved great success in a broad range of natural language processing tasks. However, BERT cannot well support E-commerce related tasks due to the lack of two levels of domain knowledge, i.e.,…

Computation and Language · Computer Science 2021-12-20 Denghui Zhang , Zixuan Yuan , Yanchi Liu , Fuzhen Zhuang , Haifeng Chen , Hui Xiong

We propose to take on the problem ofWord Sense Disambiguation (WSD). In language, words of the same form can take different meanings depending on context. While humans easily infer the meaning or gloss of such words by their context,…

Computation and Language · Computer Science 2021-12-15 Nikhil Patel , James Hale , Kanika Jindal , Apoorva Sharma , Yichun Yu

Open-domain multi-turn conversations mainly have three features, which are hierarchical semantic structure, redundant information, and long-term dependency. Grounded on these, selecting relevant context becomes a challenge step for…

Computation and Language · Computer Science 2021-02-19 Lei Shen , Haolan Zhan , Xin Shen , Yang Feng

Recent developments in machine translation and multilingual text generation have led researchers to adopt trained metrics such as COMET or BLEURT, which treat evaluation as a regression problem and use representations from multilingual…

Computation and Language · Computer Science 2021-10-14 Amy Pu , Hyung Won Chung , Ankur P. Parikh , Sebastian Gehrmann , Thibault Sellam

Deep cooperative multi-agent reinforcement learning has demonstrated its remarkable success over a wide spectrum of complex control tasks. However, recent advances in multi-agent learning mainly focus on value decomposition while leaving…

Machine Learning · Computer Science 2024-05-24 Shunyu Liu , Jie Song , Yihe Zhou , Na Yu , Kaixuan Chen , Zunlei Feng , Mingli Song

Pre-trained language models such as BERT have exhibited remarkable performances in many tasks in natural language understanding (NLU). The tokens in the models are usually fine-grained in the sense that for languages like English they are…

Computation and Language · Computer Science 2021-05-28 Xinsong Zhang , Pengshuai Li , Hang Li

Cross-lingual timbre and style generalizable text-to-speech (TTS) aims to synthesize speech with a specific reference timbre or style that is never trained in the target language. It encounters the following challenges: 1) timbre and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-28 Yahuan Cong , Haoyu Zhang , Haopeng Lin , Shichao Liu , Chunfeng Wang , Yi Ren , Xiang Yin , Zejun Ma

Natural Language Processing has recently made understanding human interaction easier, leading to improved sentimental analysis and behaviour prediction. However, the choice of words and vocal cues in conversations presents an underexplored…

Computers and Society · Computer Science 2022-06-24 Amna Anwar , Eiman Kanjo , Dario Ortega Anderez