English
Related papers

Related papers: BERT Embeddings Can Track Context in Conversationa…

200 papers

BERT-based text ranking models have dramatically advanced the state-of-the-art in ad-hoc retrieval, wherein most models tend to consider individual query-document pairs independently. In the mean time, the importance and usefulness to…

Information Retrieval · Computer Science 2021-04-20 Xiaoyang Chen , Kai Hui , Ben He , Xianpei Han , Le Sun , Zheng Ye

Tremendous amounts of multimedia associated with speech information are driving an urgent need to develop efficient and effective automatic summarization methods. To this end, we have seen rapid progress in applying supervised deep neural…

Computation and Language · Computer Science 2020-06-03 Shi-Yan Weng , Tien-Hong Lo , Berlin Chen

Existing neural relevance models do not give enough consideration for query and item context information which diversifies the search results to adapt for personal preference. To bridge this gap, this paper presents a neural learning…

Information Retrieval · Computer Science 2023-09-12 Deguang Kong , Daniel Zhou , Zhiheng Huang , Steph Sigalas

Finding semantically rich and computer-understandable representations for textual dialogues, utterances and words is crucial for dialogue systems (or conversational agents), as their performance mostly depends on understanding the context…

Computation and Language · Computer Science 2017-10-23 Alexander Bartl , Gerasimos Spanakis

Pre-trained language models have been widely exploited to learn dense representations of documents and queries for information retrieval. While previous efforts have primarily focused on improving effectiveness and user satisfaction,…

Information Retrieval · Computer Science 2025-05-01 Cristina Ioana Muntean , Franco Maria Nardini , Raffaele Perego , Guido Rocchietti , Cosimo Rulli

Phrase representations derived from BERT often do not exhibit complex phrasal compositionality, as the model relies instead on lexical similarity to determine semantic relatedness. In this paper, we propose a contrastive fine-tuning…

Computation and Language · Computer Science 2021-10-15 Shufan Wang , Laure Thompson , Mohit Iyyer

We propose to learn acoustic word embeddings with temporal context for query-by-example (QbE) speech search. The temporal context includes the leading and trailing word sequences of a word. We assume that there exist spoken word pairs in…

Computation and Language · Computer Science 2018-06-19 Yougen Yuan , Cheung-Chi Leung , Lei Xie , Hongjie Chen , Bin Ma , Haizhou Li

Modern neural speech models benefit from having longer context, and many approaches have been proposed to increase the maximum context a model can use. However, few have attempted to measure how much context these models actually use, i.e.,…

Sound · Computer Science 2025-05-29 Yen Meng , Sharon Goldwater , Hao Tang

With the extensive accumulation of conversational data on the Internet, emotion recognition in conversations (ERC) has received increasing attention. Previous efforts of this task mainly focus on leveraging contextual and speaker-specific…

Computation and Language · Computer Science 2023-06-28 Yinyi Wei , Shuaipeng Liu , Hailei Yan , Wei Ye , Tong Mo , Guanglu Wan

Measuring the quality of a generated sequence against a set of references is a central problem in many learning frameworks, be it to compute a score, to assign a reward, or to perform discrimination. Despite great advances in model…

Machine Learning · Computer Science 2020-03-06 Florian Schmidt , Thomas Hofmann

Conversational agents have begun to rise both in the academic (in terms of research) and commercial (in terms of applications) world. This paper investigates the task of building a non-goal driven conversational agent, using neural network…

Computation and Language · Computer Science 2019-02-01 Raffaele Piccini , Gerasimos Spanakis

Both humans and machines learn the meaning of unknown words through contextual information in a sentence, but not all contexts are equally helpful for learning. We introduce an effective method for capturing the level of contextual…

Computation and Language · Computer Science 2023-11-10 Sungjin Nam , David Jurgens , Gwen Frishkoff , Kevyn Collins-Thompson

Modern sequential recommender systems commonly use transformer-based models for next-item prediction. While these models demonstrate a strong balance between efficiency and quality, integrating interleaving features - such as the query…

Information Retrieval · Computer Science 2025-08-13 Andrii Dzhoha , Alisa Mironenko , Evgeny Labzin , Vladimir Vlasov , Maarten Versteegh , Marjan Celikik

Word embeddings are a powerful approach for capturing semantic similarity among terms in a vocabulary. In this paper, we develop exponential family embeddings, a class of methods that extends the idea of word embeddings to other types of…

Machine Learning · Statistics 2016-11-22 Maja R. Rudolph , Francisco J. R. Ruiz , Stephan Mandt , David M. Blei

In human-computer conversation systems, the context of a user-issued utterance is particularly important because it provides useful background information of the conversation. However, it is unwise to track all previous utterances in the…

Computation and Language · Computer Science 2016-10-14 Yiping Song , Lili Mou , Rui Yan , Li Yi , Zinan Zhu , Xiaohua Hu , Ming Zhang

Spoken language applications in natural dialogue settings place serious requirements on the choice of processing architecture. Especially under adverse phonetic and acoustic conditions parsing procedures have to be developed which do not…

cmp-lg · Computer Science 2008-02-03 Wolfgang Menzel

Intelligent personal assistant systems with either text-based or voice-based conversational interfaces are becoming increasingly popular around the world. Retrieval-based conversation models have the advantages of returning fluent and…

Information Retrieval · Computer Science 2018-05-10 Liu Yang , Minghui Qiu , Chen Qu , Jiafeng Guo , Yongfeng Zhang , W. Bruce Croft , Jun Huang , Haiqing Chen

The contextual word embedding model, BERT, has proved its ability on downstream tasks with limited quantities of annotated data. BERT and its variants help to reduce the burden of complex annotation work in many interdisciplinary research…

Computation and Language · Computer Science 2022-04-07 Gechuan Zhang , Paul Nulty , David Lillis

With the tremendous growth in the number of scientific papers being published, searching for references while writing a scientific paper is a time-consuming process. A technique that could add a reference citation at the appropriate place…

Computation and Language · Computer Science 2019-03-18 Chanwoo Jeong , Sion Jang , Hyuna Shin , Eunjeong Park , Sungchul Choi

With the development of dialog techniques, conversational search has attracted more and more attention as it enables users to interact with the search engine in a natural and efficient manner. However, comparing with the natural language…

Computation and Language · Computer Science 2018-10-09 Yunlun Yang , Yu Gong , Xi Chen