English
Related papers

Related papers: Shallow Cross-Encoders for Low-Latency Retrieval

200 papers

General-purpose pretrained sentence encoders such as BERT are not ideal for real-world conversational AI applications; they are computationally heavy, slow, and expensive to train. We propose ConveRT (Conversational Representations from…

Computation and Language · Computer Science 2020-04-30 Matthew Henderson , Iñigo Casanueva , Nikola Mrkšić , Pei-Hao Su , Tsung-Hsien Wen , Ivan Vulić

The Transformer-Kernel (TK) model has demonstrated strong reranking performance on the TREC Deep Learning benchmark---and can be considered to be an efficient (but slightly less effective) alternative to BERT-based ranking models. In this…

Information Retrieval · Computer Science 2020-07-22 Bhaskar Mitra , Sebastian Hofstatter , Hamed Zamani , Nick Craswell

A vital step towards the widespread adoption of neural retrieval models is their resource efficiency throughout the training, indexing and query workflows. The neural IR community made great advancements in training effective dual-encoder…

Information Retrieval · Computer Science 2021-05-27 Sebastian Hofstätter , Sheng-Chieh Lin , Jheng-Hong Yang , Jimmy Lin , Allan Hanbury

We leverage embedding duplication between aligned sub-words to extend the Parent-Child transfer learning method, so as to improve low-resource machine translation. We conduct experiments on benchmark datasets of My-En, Id-En and Tr-En…

Computation and Language · Computer Science 2022-05-10 Minhan Xu , Yu Hong

Existing information retrieval systems are largely constrained by their reliance on vector inner products to assess query-document relevance, which naturally limits the expressiveness of the relevance score they can produce. We propose a…

Information Retrieval · Computer Science 2025-05-02 Julian Killingback , Hansi Zeng , Hamed Zamani

The remarkable success of large transformer-based models such as BERT, RoBERTa and XLNet in many NLP tasks comes with a large increase in monetary and environmental cost due to their high computational load and energy consumption. In order…

Computation and Language · Computer Science 2022-04-14 Jonathan Mamou , Oren Pereg , Moshe Wasserblat , Roy Schwartz

Work on retrieval-based chatbots, like most sequence pair matching tasks, can be divided into Cross-encoders that perform word matching over the pair, and Bi-encoders that encode the pair separately. The latter has better performance,…

Computation and Language · Computer Science 2019-11-07 Amir Vakili Tahami , Azadeh Shakery

Encrypted traffic classification requires discriminative and robust traffic representation captured from content-invisible and imbalanced traffic data for accurate classification, which is challenging but indispensable to achieve network…

Cryptography and Security · Computer Science 2022-02-22 Xinjie Lin , Gang Xiong , Gaopeng Gou , Zhen Li , Junzheng Shi , Jing Yu

Neural image compression methods have seen increasingly strong performance in recent years. However, they suffer orders of magnitude higher computational complexity compared to traditional codecs, which hinders their real-world deployment.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Yibo Yang , Stephan Mandt

Understanding search queries is critical for shopping search engines to deliver a satisfying customer experience. Popular shopping search engines receive billions of unique queries yearly, each of which can depict any of hundreds of user…

Information Retrieval · Computer Science 2020-01-14 Mukul Kumar , Youna Hu , Will Headden , Rahul Goutam , Heran Lin , Bing Yin

Cross-encoders deliver state-of-the-art ranking effectiveness in information retrieval, but have a high inference cost. This prevents them from being used as first-stage rankers, but also incurs a cost when re-ranking documents. Prior work…

Information Retrieval · Computer Science 2026-03-04 Mathias Vast , Victor Morand , Basile van Cooten , Laure Soulier , Josiane Mothe , Benjamin Piwowarski

Recently, large-scale transformer-based models have been proven to be effective over various tasks across many domains. Nevertheless, applying them in industrial production requires tedious and heavy works to reduce inference costs. To fill…

Computation and Language · Computer Science 2022-05-25 Gongzheng Li , Yadong Xi , Jingzhen Ding , Duan Wang , Bai Liu , Changjie Fan , Xiaoxi Mao , Zeng Zhao

Highly performing deep neural networks come at the cost of computational complexity that limits their practicality for deployment on portable devices. We propose the low-rank transformer (LRT), a memory-efficient and fast neural…

Computation and Language · Computer Science 2020-02-17 Genta Indra Winata , Samuel Cahyawijaya , Zhaojiang Lin , Zihan Liu , Pascale Fung

Scalability is a major challenge in modern recommender systems. In sequential recommendations, full Cross-Entropy (CE) loss achieves state-of-the-art recommendation quality but consumes excessive GPU memory with large item catalogs,…

Information Retrieval · Computer Science 2024-08-15 Danil Gusak , Gleb Mezentsev , Ivan Oseledets , Evgeny Frolov

Streaming ASR with strict latency constraints is required in many speech recognition applications. In order to achieve the required latency, streaming ASR models sacrifice accuracy compared to non-streaming ASR models due to lack of future…

Computation and Language · Computer Science 2022-03-30 Jay Mahadeokar , Yangyang Shi , Ke Li , Duc Le , Jiedan Zhu , Vikas Chandra , Ozlem Kalinli , Michael L Seltzer

The goal of natural language semantic code search is to retrieve a semantically relevant code snippet from a fixed set of candidates using a natural language query. Existing approaches are neither effective nor efficient enough towards a…

Computation and Language · Computer Science 2021-10-18 Akhilesh Deepak Gotmare , Junnan Li , Shafiq Joty , Steven C. H. Hoi

End-to-end learning of a communications system using the deep learning-based autoencoder concept has drawn interest in recent research due to its simplicity, flexibility and its potential of adapting to complex channel models and practical…

Information Theory · Computer Science 2020-01-22 Nuwanthika Rajapaksha , Nandana Rajatheva , Matti Latva-aho

The dominance of large decoder-only language models has overshadowed encoder-decoder architectures, despite their fundamental efficiency advantages in sequence processing. For small language models (SLMs) - those with 1 billion parameters…

Computation and Language · Computer Science 2025-01-31 Mohamed Elfeki , Rui Liu , Chad Voegele

State-of-the-art neural models typically encode document-query pairs using cross-attention for re-ranking. To this end, models generally utilize an encoder-only (like BERT) paradigm or an encoder-decoder (like T5) approach. These paradigms,…

Computation and Language · Computer Science 2022-04-26 Kai Hui , Honglei Zhuang , Tao Chen , Zhen Qin , Jing Lu , Dara Bahri , Ji Ma , Jai Prakash Gupta , Cicero Nogueira dos Santos , Yi Tay , Don Metzler

Document retrieval identifies relevant documents but does not provide fine-grained evidence cues, such as specific relevant spans. A possible solution is to apply an LLM after retrieval; however, this introduces significant computational…

Information Retrieval · Computer Science 2026-04-02 Antonín Jarolím , Martin Fajčík