English
Related papers

Related papers: Distilling Knowledge for Fast Retrieval-based Chat…

200 papers

A typical assumption in state-of-the-art self-localization models is that an annotated training dataset is available for the target workspace. However, this is not necessarily true when a robot travels around the general open world. This…

Robotics · Computer Science 2024-09-27 Kenta Tsukahara , Kanji Tanaka

Knowledge distillation is an effective way for model compression in deep learning. Given a large model (i.e., teacher model), it aims to improve the performance of a compact model (i.e., student model) by transferring the information from…

Machine Learning · Computer Science 2022-03-31 Qi Qian , Hao Li , Juhua Hu

Deep neural networks can capture the intricate interaction history information between queries and documents, because of their many complicated nonlinear units, allowing them to provide correct search recommendations. However, service…

Information Retrieval · Computer Science 2022-08-25 Zhitao Zhu , Shijing Si , Jianzong Wang , Yaodong Yang , Jing Xiao

Existing conversational models are handled by a database(DB) and API based systems. However, very often users' questions require information that cannot be handled by such systems. Nonetheless, answers to these questions are available in…

Computation and Language · Computer Science 2023-04-03 Raja Kumar

The exponential growth of big data has intensified the need for efficient and interpretable machine learning models that can handle diverse data characteristics while maintaining computational efficiency. Knowledge distillation has…

Machine Learning · Computer Science 2026-05-20 Mahdi Naser Moghadasi

Creating a data-driven model that is trained on a large dataset of unstructured dialogs is a crucial step in developing Retrieval-based Chatbot systems. This paper presents a Long Short Term Memory (LSTM) based architecture that learns…

Computation and Language · Computer Science 2026-01-28 Danny Brahman , Pooran S. Negi , Mohammad Mahoor

Massively multilingual Transformers (MMTs), such as mBERT and XLM-R, are widely used for cross-lingual transfer learning. While these are pretrained to represent hundreds of languages, end users of NLP systems are often interested only in…

Computation and Language · Computer Science 2023-06-05 Alan Ansell , Edoardo Maria Ponti , Anna Korhonen , Ivan Vulić

To improve the performance of the dual-encoder retriever, one effective approach is knowledge distillation from the cross-encoder ranker. Existing works construct the candidate passages following the supervised learning setting where a…

Computation and Language · Computer Science 2024-06-07 Chongyang Tao , Chang Liu , Tao Shen , Can Xu , Xiubo Geng , Binxing Jiao , Daxin Jiang

We propose a response-based method of knowledge distillation (KD) for the head pose estimation problem. A student model trained by the proposed KD achieves results better than a teacher model, which is atypical for the response-based…

Computer Vision and Pattern Recognition · Computer Science 2022-01-31 Andrey Sheka , Victor Samun

Non-autoregressive machine translation (NAT) systems predict a sequence of output tokens in parallel, achieving substantial improvements in generation speed compared to autoregressive models. Existing NAT models usually rely on the…

Computation and Language · Computer Science 2021-02-24 Chunting Zhou , Graham Neubig , Jiatao Gu

Sample-and-rank is a key decoding strategy for modern generation-based dialogue systems. It helps achieve diverse and high-quality responses by selecting an answer from a small pool of generated candidates. The current state-of-the-art…

Computation and Language · Computer Science 2023-05-16 Chiyu Song , Hongliang He , Haofei Yu , Pengfei Fang , Leyang Cui , Zhenzhong Lan

Distilling knowledge from a well-trained cumbersome network to a small one has recently become a new research topic, as lightweight neural networks with high performance are particularly in need in various resource-restricted systems. This…

Computation and Language · Computer Science 2016-07-26 Lili Mou , Ran Jia , Yan Xu , Ge Li , Lu Zhang , Zhi Jin

Dual encoders and cross encoders have been widely used for image-text retrieval. Between the two, the dual encoder encodes the image and text independently followed by a dot product, while the cross encoder jointly feeds image and text as…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Jie Lei , Xinlei Chen , Ning Zhang , Mengjiao Wang , Mohit Bansal , Tamara L. Berg , Licheng Yu

In NLP, a large volume of tasks involve pairwise comparison between two sequences (e.g. sentence similarity and paraphrase identification). Predominantly, two formulations are used for sentence-pair tasks: bi-encoders and cross-encoders.…

Computation and Language · Computer Science 2022-03-15 Fangyu Liu , Yunlong Jiao , Jordan Massiah , Emine Yilmaz , Serhii Havrylov

Deep learning has shown promise in enhancing channel state information (CSI) feedback. However, many studies indicate that better feedback performance often accompanies higher computational complexity. Pursuing better performance-complexity…

Signal Processing · Electrical Eng. & Systems 2024-03-05 Yiming Cui , Jiajia Guo , Zheng Cao , Huaze Tang , Chao-Kai Wen , Shi Jin , Xin Wang , Xiaolin Hou

We study learning of a matching model for response selection in retrieval-based dialogue systems. The problem is equally important with designing the architecture of a model, but is less explored in existing literature. To learn a robust…

Computation and Language · Computer Science 2019-06-12 Jiazhan Feng , Chongyang Tao , Wei Wu , Yansong Feng , Dongyan Zhao , Rui Yan

Models for low-latency, streaming applications could benefit from the knowledge capacity of larger models, but edge devices cannot run these models due to resource constraints. A possible solution is to transfer hints during inference from…

Machine Learning · Computer Science 2024-07-26 Vidya Srinivas , Malek Itani , Tuochao Chen , Sefik Emre Eskimez , Takuya Yoshioka , Shyamnath Gollakota

Context distillation compresses contextual information into model parameters, yet existing methods often ignore how multiple distilled latent memories should be stored, retrieved, and safely activated in non-oracle settings. We formulate…

Machine Learning · Computer Science 2026-05-29 Ziyang Zheng , Zeju Li , Xiangyu Wen , Jianyuan Zhong , Junhua Huang , Lei Chen , Mingxuan Yuan , Qiang Xu

Emotion recognition in conversations (ERC), the task of recognizing the emotion of each utterance in a conversation, is crucial for building empathetic machines. Existing studies focus mainly on capturing context- and speaker-sensitive…

Artificial Intelligence · Computer Science 2023-11-01 Hui Ma , Jian Wang , Hongfei Lin , Bo Zhang , Yijia Zhang , Bo Xu

With the rise of deep learning, large datasets and complex models have become common, requiring significant computing power. To address this, data distillation has emerged as a technique to quickly train models with lower memory and time…

Computation and Language · Computer Science 2023-08-10 Shivam Sahni , Harsh Patel