English
Related papers

Related papers: FastLane: Efficient Routed Systems for Late-Intera…

200 papers

Multi-vector late-interaction retrievers such as ColBERT achieve state-of-the-art retrieval quality, but their query-time cost is dominated by exhaustively computing token-level MaxSim interactions for every candidate document. While…

Information Retrieval · Computer Science 2026-02-04 Roi Pony , Adi Raz , Oshri Naparstek , Idan Friedman , Udi Barzelay

Models based on attention mechanisms have shown unprecedented speech recognition performance. However, they are computationally expensive and unnecessarily complex for keyword spotting, a task targeted to small-footprint devices. This work…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-02 Biel Tura , Santiago Escuder , Ferran Diego , Carlos Segura , Jordi Luque

Many recent approaches of passage retrieval are using dense embeddings generated from deep neural models, called "dense passage retrieval". The state-of-the-art end-to-end dense passage retrieval systems normally deploy a deep neural model…

Information Retrieval · Computer Science 2022-10-11 Yifan Wang , Haodi Ma , Daisy Zhe Wang

Neural information retrieval systems excel in high-resource languages but remain underexplored for morphologically rich, lower-resource languages such as Turkish. Dense bi-encoders currently dominate Turkish IR, yet late-interaction models…

Computation and Language · Computer Science 2025-11-21 Özay Ezerceli , Mahmoud El Hussieni , Selva Taş , Reyhan Bayraktar , Fatma Betül Terzioğlu , Yusuf Çelebi , Yağız Asker

Late interaction neural IR models like ColBERT offer a competitive effectiveness-efficiency trade-off across many benchmarks. However, they require a huge memory space to store the contextual representation for all the document tokens. Some…

Information Retrieval · Computer Science 2025-04-18 Yuxuan Zong , Benjamin Piwowarski

Hybrid Approximate Nearest Neighbor Search (Hybrid ANNS) is a foundational search technology for large-scale heterogeneous data and has gained significant attention in both academia and industry. However, current approaches overlook the…

Information Retrieval · Computer Science 2026-04-03 Qianyun Yang , Zhiwei Chen , Yupeng Hu , Zixu Li , Zhiheng Fu , Liqiang Nie

Establishing retrieval-based dialogue systems that can select appropriate responses from the pre-built index has gained increasing attention from researchers. For this task, the adoption of pre-trained language models (such as BERT) has led…

Computation and Language · Computer Science 2021-10-04 Chongyang Tao , Jiazhan Feng , Chang Liu , Juntao Li , Xiubo Geng , Daxin Jiang

Neural document ranking approaches, specifically transformer models, have achieved impressive gains in ranking performance. However, query processing using such over-parameterized models is both resource and time intensive. In this paper,…

Information Retrieval · Computer Science 2022-04-05 Jurek Leonhardt , Koustav Rudra , Megha Khosla , Abhijit Anand , Avishek Anand

Approximate nearest neighbor (ANN) search is widely used in the retrieval stage of large-scale recommendation systems. In this stage, candidate items are indexed using their learned embedding vectors, and ANN search is executed for each…

We introduce the Fastron, a configuration space (C-space) model to be used as a proxy to kinematic-based collision detection. The Fastron allows iterative updates to account for a changing environment through a combination of a novel…

Robotics · Computer Science 2017-09-08 Nikhil Das , Naman Gupta , Michael Yip

Approximate k-Nearest Neighbour (ANN) methods are often used for mining information and aiding machine learning on large scale high-dimensional datasets. ANN methods typically differ in the index structure used for accelerating searches,…

Machine Learning · Computer Science 2025-02-04 Ben Harwood , Amir Dezfouli , Iadine Chades , Conrad Sanderson

The Localization of the target object for data retrieval is a key issue in the Intelligent and Connected Transportation Systems (ICTS). However, due to lack of intelligence in the traditional transportation system, it can take tremendous…

Computer Vision and Pattern Recognition · Computer Science 2018-04-09 Sijia Chen , Bin Song , Jie Guo , Xiaojiang Du , Mohsen Guizani

Recent work for extracting relations from texts has achieved excellent performance. However, most existing methods pay less attention to the efficiency, making it still challenging to quickly extract relations from massive or streaming text…

Computation and Language · Computer Science 2022-05-24 Guozheng Li , Xu Chen , Peng Wang , Jiafeng Xie , Qiqing Luo

Minimizing computational overhead in time-series classification, particularly in deep learning models, presents a significant challenge. This challenge is further compounded by adversarial attacks, emphasizing the need for resilient methods…

Machine Learning · Computer Science 2025-03-12 Cagla Ipek Kocal , Onat Gungor , Aaron Tartz , Tajana Rosing , Baris Aksanli

Transfer Learning has become one of the standard methods to solve problems to overcome the isolated learning paradigm by utilizing knowledge acquired for one task to solve another related one. However, research needs to be done, to identify…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Parth Ganeriwala , Siddhartha Bhattacharyya , Raja Muthalagu

In this technical report, we introduce FastFusionNet, an efficient variant of FusionNet [12]. FusionNet is a high performing reading comprehension architecture, which was designed primarily for maximum retrieval accuracy with less regard…

Computation and Language · Computer Science 2019-03-05 Felix Wu , Boyi Li , Lequn Wang , Ni Lao , John Blitzer , Kilian Q. Weinberger

Accurate lane detection is critical for navigation in autonomous vehicles, particularly the active lane which demarcates the single road space that the vehicle is currently traveling on. Recent state-of-the-art lane detection algorithms…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Zhe Ming Chng , Joseph Mun Hung Lew , Jimmy Addison Lee

Provenance embedding algorithms are well known for tracking the footprints of information flow in wireless networks. Recently, low-latency provenance embedding algorithms have received traction in vehicular networks owing to strict…

Information Theory · Computer Science 2022-04-04 Suraj Sajeev , Manish Bansal , Sriraam S , J. Harshan , Huzur Saran , Yih-Chun Hu

We present lambda layers -- an alternative framework to self-attention -- for capturing long-range interactions between an input and structured contextual information (e.g. a pixel surrounded by other pixels). Lambda layers capture such…

Computer Vision and Pattern Recognition · Computer Science 2021-02-18 Irwan Bello

Approximate nearest neighbor (ANN) search is a key component in many modern machine learning pipelines; recent use cases include retrieval-augmented generation (RAG) and vector databases. Clustering-based ANN algorithms, that use score…

Machine Learning · Computer Science 2024-10-25 Elias Jääsaari , Ville Hyvönen , Teemu Roos