English
Related papers

Related papers: ESPN: Memory-Efficient Multi-Vector Information Re…

200 papers

This paper develops a model that addresses sentence embedding, a hot topic in current natural language processing research, using recurrent neural networks with Long Short-Term Memory (LSTM) cells. Due to its ability to capture long term…

Computation and Language · Computer Science 2016-11-18 Hamid Palangi , Li Deng , Yelong Shen , Jianfeng Gao , Xiaodong He , Jianshu Chen , Xinying Song , Rabab Ward

Providing high-quality item recall for text queries is crucial in large-scale e-commerce search systems. Current Embedding-based Retrieval Systems (ERS) embed queries and items into a shared low-dimensional space, but uni-modality ERS rely…

Information Retrieval · Computer Science 2024-08-28 Hao Jiang , Haoxiang Zhang , Qingshan Hou , Chaofeng Chen , Weisi Lin , Jingchang Zhang , Annan Wang

Vector search plays a crucial role in many real-world applications. In addition to single-vector search, multi-vector search becomes important for multi-modal and multi-feature scenarios today. In a multi-vector database, each row is an…

Databases · Computer Science 2026-05-05 Jiongli Zhu , Yue Wang , Bailu Ding , Philip A. Bernstein , Vivek Narasayya , Surajit Chaudhuri

One of the primary areas of interest in High Performance Computing is the improvement of performance of parallel workloads. Nowadays, compilable source code-based optimization tasks that employ deep learning often exploit LLVM Intermediate…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-03 Akash Dutta , Ali Jannesari

Convolutional neural networks (CNNs), such as the time-delay neural network (TDNN), have shown their remarkable capability in learning speaker embedding. However, they meanwhile bring a huge computational cost in storage size, processing,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Rui Wang , Zhihua Wei , Haoran Duan , Shouling Ji , Yang Long , Zhen Hong

Most text-based information retrieval (IR) systems index objects by words or phrases. These discrete systems have been augmented by models that use embeddings to measure similarity in continuous space. But continuous-space models are…

Information Retrieval · Computer Science 2018-11-21 Daniel Gillick , Alessandro Presta , Gaurav Singh Tomar

Multimodal large language models (MLLMs) have shown promising potential in Vision-Language Navigation (VLN). However, their practical development is severely hindered by the substantial training overhead. We recognize two key issues that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Duo Zheng , Shijia Huang , Yanyang Li , Liwei Wang

Cross-modal retrieval is an important functionality in modern search engines, as it increases the user experience by allowing queries and retrieved objects to pertain to different modalities. In this paper, we focus on the image-sentence…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Nicola Messina , Giuseppe Amato , Fabrizio Falchi , Claudio Gennaro , Stéphane Marchand-Maillet

Downsampling is widely adopted to achieve a good trade-off between accuracy and latency for visual recognition. Unfortunately, the commonly used pooling layers are not learned, and thus cannot preserve important information. As another…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Ho Man Kwan , Shenghui Song

This work presents an efficient decoding pipeline for neuromorphic implantable brain-machine interfaces (Neu-iBMI), leveraging sparse neural event data from an event-based neural sensing scheme. We introduce a tunable event filter…

Machine Learning · Computer Science 2025-05-12 Vivek Mohan , Biyan Zhou , Zhou Wang , Anil Bharath , Emmanuel Drakakis , Arindam Basu

Speech Emotion Recognition (SER) presents a significant yet persistent challenge in human-computer interaction. While deep learning has advanced spoken language processing, achieving high performance on limited datasets remains a critical…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Tai Vu

The modeling of users' behaviors is crucial in modern recommendation systems. A lot of research focuses on modeling users' lifelong sequences, which can be extremely long and sometimes exceed thousands of items. These models use the target…

Information Retrieval · Computer Science 2024-07-16 Kaiming Shen , Xichen Ding , Zixiang Zheng , Yuqi Gong , Qianqian Li , Zhongyi Liu , Guannan Zhang

Machine learning models and libraries can train datasets of different sizes and perform prediction and classification operations, but machine learning models and libraries cause slow and long training times on large datasets. This article…

Machine Learning · Computer Science 2025-09-17 Halil Hüseyin Çalışkan , Talha Koruk

State-space models (SSMs) have recently attention as an efficient alternative to computationally expensive attention-based models for sequence modeling. They rely on linear recurrences to integrate information over time, enabling fast…

Machine Learning · Computer Science 2026-01-01 Mahdi Karami , Ali Behrouz , Peilin Zhong , Razvan Pascanu , Vahab Mirrokni

How to learn highly compact yet effective sentence representation? Pre-trained language models have been effective in many NLP tasks. However, these models are often huge and produce large sentence embeddings. Moreover, there is a big…

Computation and Language · Computer Science 2022-03-16 Xuandong Zhao , Zhiguo Yu , Ming Wu , Lei Li

Text retrieval using learned sparse representations of queries and documents has, over the years, evolved into a highly effective approach to search. It is thanks to recent advances in approximate nearest neighbor search-with the emergence…

Information Retrieval · Computer Science 2026-02-06 Sebastian Bruch , Martino Fontana , Franco Maria Nardini , Cosimo Rulli , Rossano Venturini

In reservoir computing, an input sequence is processed by a recurrent neural network, the reservoir, which transforms it into a spatial pattern that a shallow readout network can then exploit for tasks such as memorization and time-series…

Neural and Evolutionary Computing · Computer Science 2025-12-30 Denis Kleyko , Christopher J. Kymn , E. Paxon Frady , Amy Loutfi , Friedrich T. Sommer

Deep learning techniques have been applied in the context of image super-resolution (SR), achieving remarkable advances in terms of reconstruction performance. Existing techniques typically employ highly complex model structures which…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Yuxuan Jiang , Jakub Nawala , Fan Zhang , David Bull

Advancements in adapting deep convolution architectures for Spiking Neural Networks (SNNs) have significantly enhanced image classification performance and reduced computational burdens. However, the inability of Multiplication-Free…

Neural and Evolutionary Computing · Computer Science 2024-04-29 Boyan Li , Luziwei Leng , Shuaijie Shen , Kaixuan Zhang , Jianguo Zhang , Jianxing Liao , Ran Cheng

Segmentation is an important task in a wide range of computer vision applications, including medical image analysis. Recent years have seen an increase in the complexity of medical image segmentation approaches based on sophisticated…

Image and Video Processing · Electrical Eng. & Systems 2023-12-19 Tariq M Khan , Syed S. Naqvi , Erik Meijering