English
Related papers

Related papers: A Unified Framework for Learned Sparse Retrieval

200 papers

Learned sparse document representations using a transformer-based neural model has been found to be attractive in both relevance effectiveness and time efficiency. This paper describes a representation sparsification scheme based on hard…

Information Retrieval · Computer Science 2023-06-21 Yifan Qiao , Yingrui Yang , Shanxiu He , Tao Yang

Sparse neural retrievers, such as DeepImpact, uniCOIL and SPLADE, have been introduced recently as an efficient and effective way to perform retrieval with inverted indexes. They aim to learn term importance and, in some cases, document…

Information Retrieval · Computer Science 2023-04-26 Carlos Lassance , Simon Lupart , Hervé Dejean , Stéphane Clinchant , Nicola Tonellotto

This report presents our participation to the WSDM Cup 2026 shared task on multilingual document retrieval from English queries. The task provides a challenging benchmark for cross-lingual generalization. It also provides a natural testbed…

Information Retrieval · Computer Science 2026-02-25 Thibault Formal , Maxime Louis , Hervé Déjean , Stéphane Clinchant

We propose a robust and efficient approach to the problem of compressive phase retrieval in which the goal is to reconstruct a sparse vector from the magnitude of a number of its linear measurements. The proposed framework relies on…

Information Theory · Computer Science 2015-10-28 Sohail Bahmani , Justin Romberg

Large Language Models (LLMs) have shown potential in generating hypothetical documents for query expansion, thereby enhancing information retrieval performance. However, the efficacy of this method is highly dependent on the quality of the…

Information Retrieval · Computer Science 2025-06-11 Lingyuan Liu , Mengxiang Zhang

Despite the advantages of their low-resource settings, traditional sparse retrievers depend on exact matching approaches between high-dimensional bag-of-words (BoW) representations of both the queries and the collection. As a result,…

Information Retrieval · Computer Science 2024-04-16 Dahlia Shehata

Shuffled linear regression (SLR) seeks to estimate latent features through a linear transformation, complicated by unknown permutations in the measurement dimensions. This problem extends traditional least-squares (LS) and Least Absolute…

Statistics Theory · Mathematics 2025-04-17 Hang Liu , Anna Scaglione

Recently, tensor data (or multidimensional array) have been generated in many modern applications, such as functional magnetic resonance imaging (fMRI) in neuroscience and videos in video analysis. Many efforts are made in recent years to…

Machine Learning · Computer Science 2023-08-10 Jiaqi Zhang , Yinghao Cai , Zhaoyang Wang , Beilun Wang

The training paradigm integrating large language models (LLM) is gradually reshaping sequential recommender systems (SRS) and has shown promising results. However, most existing LLM-enhanced methods rely on rich textual information on the…

Information Retrieval · Computer Science 2024-10-17 Dugang Liu , Shenxian Xian , Xiaolin Lin , Xiaolian Zhang , Hong Zhu , Yuan Fang , Zhen Chen , Zhong Ming

Embedding-based retrieval models have made significant strides in retrieval-augmented generation (RAG) techniques for text and multimodal large language models (LLMs) applications. However, when it comes to speech larage language models…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-11 Chunyu Sun , Bingyu Liu , Zhichao Cui , Junhan Shi , Anbin Qi , Tian-hao Zhang , Dinghao Zhou , Lewei Lu

Recent advances in large language models (LLMs) have opened new opportunities for academic literature retrieval. However, existing systems often rely on rigid pipelines and exhibit limited reasoning capabilities. We introduce SPAR, a…

Information Retrieval · Computer Science 2025-07-22 Xiaofeng Shi , Yuduo Li , Qian Kou , Longbin Yu , Jinxin Xie , Hua Zhou

Although the sparse multinomial logistic regression (SMLR) has provided a useful tool for sparse classification, it suffers from inefficacy in dealing with high dimensional features and manually set initial regressor values. This has…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Faxian Cao , Zhijing Yang , Jinchang Ren , Wing-Kuen Ling

Conversational Search (CS) involves retrieving relevant documents from a corpus while considering the conversational context, integrating retrieval with context modeling. Recent advancements in Large Language Models (LLMs) have…

Information Retrieval · Computer Science 2025-05-19 Simon Lupart , Mohammad Aliannejadi , Evangelos Kanoulas

Pseudo-relevance feedback (PRF) is a classical approach to address lexical mismatch by enriching the query using first-pass retrieval. Moreover, recent work on generative-relevance feedback (GRF) shows that query expansion models using text…

Information Retrieval · Computer Science 2023-05-15 Iain Mackie , Shubham Chatterjee , Jeffrey Dalton

Sparse dictionary learning (SDL) is a fundamental technique that is useful for many image processing tasks. As an example we consider here image recovery, where SDL can be cast as a nonsmooth optimization problem. For this kind of problems,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Mohammadsadegh Khoshghiaferezaee , Moritz Krauth , Shima Shabani , Michael Breuß

Learned sparse retrieval, which can efficiently perform retrieval through mature inverted-index engines, has garnered growing attention in recent years. Particularly, the inference-free sparse retrievers are attractive as they eliminate…

Information Retrieval · Computer Science 2025-07-02 Zhichao Geng , Yiwen Wang , Dongyu Ru , Yang Yang

Reverse Dictionary (RD) is the task of obtaining the most relevant word or set of words given a textual description or dictionary definition. Effective RD methods have applications in accessibility, translation or writing support systems.…

Computation and Language · Computer Science 2024-12-10 Fatemah Almeman , Luis Espinosa-Anke

The performance of machine learning and pattern recognition algorithms generally depends on data representation. That is why, much of the current effort in performing machine learning algorithms goes into the design of preprocessing…

Machine Learning · Computer Science 2025-10-28 Fadi Dornaika , Ahmad Khoder , Abdelmalik Moujahid , Wassim Khoder

Sparse lexical representation learning has demonstrated much progress in improving passage retrieval effectiveness in recent models such as DeepImpact, uniCOIL, and SPLADE. This paper describes a straightforward yet effective approach for…

Information Retrieval · Computer Science 2021-12-20 Jheng-Hong Yang , Xueguang Ma , Jimmy Lin

The proliferation of long-form documents presents a fundamental challenge to information retrieval (IR), as their length, dispersed evidence, and complex structures demand specialized methods beyond standard passage-level techniques. This…

Information Retrieval · Computer Science 2025-10-28 Minghan Li , Miyang Luo , Tianrui Lv , Yishuai Zhang , Siqi Zhao , Ercong Nie , Guodong Zhou