English
Related papers

Related papers: Distilling Knowledge for Fast Retrieval-based Chat…

200 papers

Recent advances in deep neural networks, language modeling and language generation have introduced new ideas to the field of conversational agents. As a result, deep neural models such as sequence-to-sequence, Memory Networks, and the…

Computation and Language · Computer Science 2019-02-27 Momchil Hardalov , Ivan Koychev , Preslav Nakov

Pre-trained models like BERT (Devlin et al., 2018) have dominated NLP / IR applications such as single sentence classification, text pair classification, and question answering. However, deploying these models in real systems is highly…

Computation and Language · Computer Science 2021-05-06 Jiecao Chen , Liu Yang , Karthik Raman , Michael Bendersky , Jung-Jung Yeh , Yun Zhou , Marc Najork , Danyang Cai , Ehsan Emadzadeh

Retrieval-augmented generation framework can address the limitations of large language models by enabling real-time knowledge updates for more accurate answers. An efficient way in the training phase of retrieval-augmented models is…

Computation and Language · Computer Science 2024-02-20 Zizhong Li , Haopeng Zhang , Jiawei Zhang

Ranker and retriever are two important components in dense passage retrieval. The retriever typically adopts a dual-encoder model, where queries and documents are separately input into two pre-trained models, and the vectors generated by…

Information Retrieval · Computer Science 2023-12-29 Haifeng Li , Mo Hai , Dong Tang

Knowledge distillation, the technique of transferring knowledge from large, complex models to smaller ones, marks a pivotal step towards efficient AI deployment. Distilling Step-by-Step~(DSS), a novel method utilizing chain-of-thought~(CoT)…

Computation and Language · Computer Science 2024-06-11 Xin Chen , Hanxian Huang , Yanjun Gao , Yi Wang , Jishen Zhao , Ke Ding

Although BERT-based ranking models have been commonly used in commercial search engines, they are usually time-consuming for online ranking tasks. Knowledge distillation, which aims at learning a smaller model with comparable performance to…

Information Retrieval · Computer Science 2023-02-09 Xubo Qin , Xiyuan Liu , Xiongfeng Zheng , Jie Liu , Yutao Zhu

In this paper we present the results of our experiments in training and deploying a self-supervised retrieval-based chatbot trained with contrastive learning for assisting customer support agents. In contrast to most existing research…

Computation and Language · Computer Science 2025-08-18 Kristen Moore , Shenjun Zhong , Zhen He , Torsten Rudolf , Nils Fisher , Brandon Victor , Neha Jindal

Conversational Search (CS) involves retrieving relevant documents from a corpus while considering the conversational context, integrating retrieval with context modeling. Recent advancements in Large Language Models (LLMs) have…

Information Retrieval · Computer Science 2025-05-19 Simon Lupart , Mohammad Aliannejadi , Evangelos Kanoulas

Semantic correspondence, the task of determining relationships between different parts of images, underpins various applications including 3D reconstruction, image-to-image translation, object tracking, and visual place recognition. Recent…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Frank Fundel , Johannes Schusterbauer , Vincent Tao Hu , Björn Ommer

Traditional object detection are ill-equipped for incremental learning. However, fine-tuning directly on a well-trained detection model with only new data will leads to catastrophic forgetting. Knowledge distillation is a straightforward…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Tao Feng , Mang Wang

In monolingual dense retrieval, lots of works focus on how to distill knowledge from cross-encoder re-ranker to dual-encoder retriever and these methods achieve better performance due to the effectiveness of cross-encoder re-ranker.…

Information Retrieval · Computer Science 2023-03-28 Houxing Ren , Linjun Shou , Ning Wu , Ming Gong , Daxin Jiang

Neural retrievers based on pre-trained language models (PLMs), such as dual-encoders, have achieved promising performance on the task of open-domain question answering (QA). Their effectiveness can further reach new state-of-the-arts by…

Computation and Language · Computer Science 2022-05-20 Yuxiang Lu , Yiding Liu , Jiaxiang Liu , Yunsheng Shi , Zhengjie Huang , Shikun Feng Yu Sun , Hao Tian , Hua Wu , Shuaiqiang Wang , Dawei Yin , Haifeng Wang

Scarcity of parallel sentence-pairs poses a significant hurdle for training high-quality Neural Machine Translation (NMT) models in bilingually low-resource scenarios. A standard approach is transfer learning, which involves taking a model…

Computation and Language · Computer Science 2020-10-13 Fahimeh Saleh , Wray Buntine , Gholamreza Haffari

Deep neural network architectures have attained remarkable improvements in scene understanding tasks. Utilizing an efficient model is one of the most important constraints for limited-resource devices. Recently, several compression methods…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Mahdi Ghorbani , Fahimeh Fooladgar , Shohreh Kasaei

Retrieval-based conversation systems generally tend to highly rank responses that are semantically similar or even identical to the given conversation context. While the system's goal is to find the most appropriate response, rather than…

Computation and Language · Computer Science 2018-10-09 Denis Fedorenko , Nikita Smetanin , Artem Rodichev

Deploying new architectures in large-scale user response prediction systems incurs high model switching costs due to expensive retraining on massive historical data and performance degradation under data retention constraints. Existing…

Artificial Intelligence · Computer Science 2026-02-03 Yucheng Wu , Yuekui Yang , Hongzheng Li , Anan Liu , Jian Xiao , Junjie Zhai , Huan Yu , Shaoping Ma , Leye Wang

Face recognition in the wild is now advancing towards light-weight models, fast inference speed and resolution-adapted capability. In this paper, we propose a bridge distillation approach to turn a complex face model pretrained on private…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Shiming Ge , Shengwei Zhao , Chenyu Li , Yu Zhang , Jia Li

Endowing chatbots with a consistent persona is essential to an engaging conversation, yet it remains an unresolved challenge. In this work, we propose a new retrieval-enhanced approach for personalized response generation. Specifically, we…

Computation and Language · Computer Science 2023-06-13 Shuai Liu , Hyundong J. Cho , Marjorie Freedman , Xuezhe Ma , Jonathan May

Human-like chatbots necessitate the use of commonsense reasoning in order to effectively comprehend and respond to implicit information present within conversations. Achieving such coherence and informativeness in responses, however, is a…

Computation and Language · Computer Science 2023-10-24 Hyungjoo Chae , Yongho Song , Kai Tzu-iunn Ong , Taeyoon Kwon , Minjin Kim , Youngjae Yu , Dongha Lee , Dongyeop Kang , Jinyoung Yeo

Despite that current reading comprehension systems have achieved significant advancements, their promising performances are often obtained at the cost of making an ensemble of numerous models. Besides, existing approaches are also…

Computation and Language · Computer Science 2018-09-18 Minghao Hu , Yuxing Peng , Furu Wei , Zhen Huang , Dongsheng Li , Nan Yang , Ming Zhou