English
Related papers

Related papers: Context Retrieval via Normalized Contextual Latent…

200 papers

Retrieval-augmented language models (RALMs) hold promise to produce language understanding systems that are are factual, efficient, and up-to-date. An important desideratum of RALMs, is that retrieved information helps model performance…

Computation and Language · Computer Science 2024-05-07 Ori Yoran , Tomer Wolfson , Ori Ram , Jonathan Berant

Large Language Models (LLMs) have garnered widespread attention due to their remarkable performance across various tasks. However, to mitigate the issue of hallucinations, LLMs often incorporate retrieval-augmented pipeline to provide them…

Computation and Language · Computer Science 2024-08-29 Haowen Hou , Fei Ma , Binwen Bai , Xinxin Zhu , Fei Yu

With the improvements in speech recognition and voice generation technologies over the last years, a lot of companies have sought to develop conversation understanding systems that run on mobile phones or smart home devices through natural…

Computation and Language · Computer Science 2020-02-03 Mohammad Aliannejadi , Manajit Chakraborty , Esteban Andrés Ríssola , Fabio Crestani

Interactive conversational recommender systems have gained significant attention for their ability to capture user preferences through natural language interactions. However, existing approaches face substantial challenges in handling…

Artificial Intelligence · Computer Science 2025-10-03 Bo Ma , Hang Li , ZeHua Hu , XiaoFan Gui , LuYao Liu , Simon Lau

Multi-Agent Discussion (MAD) has garnered increasing attention very recently, where multiple LLM instances collaboratively solve problems via structured discussion. However, we find that current MAD methods easily suffer from discussion…

Artificial Intelligence · Computer Science 2026-05-14 Xingyuan Hua , Sheng Yue , Xinyi Li , Yizhe Zhao , Jinrui Zhang , Ju Ren

Conversational search utilizes muli-turn natural language contexts to retrieve relevant passages. Existing conversational dense retrieval models mostly view a conversation as a fixed sequence of questions and responses, overlooking the…

Computation and Language · Computer Science 2024-06-05 Haonan Chen , Zhicheng Dou , Kelong Mao , Jiongnan Liu , Ziliang Zhao

In-context learning (ICL) allows a language model to improve its problem-solving capability when provided with suitable information in context. Since the choice of in-context information can be determined based on the problem itself,…

Computation and Language · Computer Science 2025-09-12 Yinghui He , Abhishek Panigrahi , Yong Lin , Sanjeev Arora

Intelligent personal assistant systems with either text-based or voice-based conversational interfaces are becoming increasingly popular around the world. Retrieval-based conversation models have the advantages of returning fluent and…

Information Retrieval · Computer Science 2018-05-10 Liu Yang , Minghui Qiu , Chen Qu , Jiafeng Guo , Yongfeng Zhang , W. Bruce Croft , Jun Huang , Haiqing Chen

Neural task-oriented dialogue systems often struggle to smoothly interface with a knowledge base. In this work, we seek to address this problem by proposing a new neural dialogue agent that is able to effectively sustain grounded,…

Computation and Language · Computer Science 2017-07-17 Mihail Eric , Christopher D. Manning

Large language models (LLMs) are increasingly capable of carrying out long-running, real-world tasks. However, as the amount of context grows, their reliability often deteriorates, a phenomenon known as "context rot". Existing long-context…

Artificial Intelligence · Computer Science 2026-02-10 Weihao Zeng , Yuzhen Huang , Junxian He

Recent advancements in Large Language Models (LLMs) have significantly enhanced their capacity to process long contexts. However, effectively utilizing this long context remains a challenge due to the issue of distraction, where irrelevant…

Computation and Language · Computer Science 2024-11-12 Zijun Wu , Bingyuan Liu , Ran Yan , Lei Chen , Thomas Delteil

Modern Security Operations Centres (SOCs) integrate diverse tools, such as SIEM, IDS, and XDR systems, offering rich contextual data, including alert enrichments, flow features, and similar case histories. Yet, analysts must still manually…

Cryptography and Security · Computer Science 2025-06-12 Ronal Singh , Mohan Baruwal Chhetri , Surya Nepal , Cecile Paris

The core of the dialogue system is to generate relevant, informative, and human-like responses based on extensive dialogue history. Recently, dialogue generation domain has seen mainstream adoption of large language models (LLMs), due to…

Computation and Language · Computer Science 2024-06-05 Shixuan Fan , Wei Wei , Wendi Li , Xian-Ling Mao , Wenfeng Xie , Dangyang Chen

Conversational understanding is an integral part of modern intelligent devices. In a large fraction of the global traffic from customers using smart digital assistants, frictions in dialogues may be attributed to incorrect understanding of…

Machine Learning · Computer Science 2022-10-25 Niranjan Uma Naresh , Ziyan Jiang , Ankit , Sungjin Lee , Jie Hao , Xing Fan , Chenlei Guo

In-context learning enables language models (LM) to adapt to downstream data or tasks by incorporating few samples as demonstrations within the prompts. It offers strong performance without the expense of fine-tuning. However, the…

Computation and Language · Computer Science 2024-10-15 Jian Gu , Aldeida Aleti , Chunyang Chen , Hongyu Zhang

For a speech-enhancement algorithm, it is highly desirable to simultaneously improve perceptual quality and recognition rate. Thanks to computational costs and model complexities, it is challenging to train a model that effectively…

Machine Learning · Computer Science 2018-02-19 Rasool Fakoor , Xiaodong He , Ivan Tashev , Shuayb Zarar

Large language model (LLM) agents increasingly operate over long and recurring external contexts, like document corpora and code repositories. Across invocations, existing approaches preserve either the agent's trajectory, passive access to…

Artificial Intelligence · Computer Science 2026-05-20 Zhuohan Gu , Qizheng Zhang , Omar Khattab , Samuel Madden

Time series forecasting in real-world settings often depends not only on historical observations, but also on external context that must be actively discovered from noisy, heterogeneous information sources. Yet existing context-aided…

Accurate prediction of conversation topics can be a valuable signal for creating coherent and engaging dialog systems. In this work, we focus on context-aware topic classification methods for identifying topics in free-form human-chatbot…

Computation and Language · Computer Science 2018-10-22 Chandra Khatri , Rahul Goel , Behnam Hedayatnia , Angeliki Metanillou , Anushree Venkatesh , Raefer Gabriel , Arindam Mandal

Large Language Models (LLMs) have demonstrated remarkable capabilities in various tasks, yet they often struggle with context-faithfulness generations that properly reflect contextual knowledge. While existing approaches focus on enhancing…

Computation and Language · Computer Science 2025-04-23 Xiaowei Yuan , Zhao Yang , Ziyang Huang , Yequan Wang , Siqi Fan , Yiming Ju , Jun Zhao , Kang Liu