English
Related papers

Related papers: Sparse Bayesian Inference for Dense Semantic Mappi…

200 papers

The proliferation of automated inference algorithms in Bayesian statistics has provided practitioners newfound access to fast, reproducible data analysis and powerful statistical models. Designing automated methods that are also both…

Machine Learning · Statistics 2019-10-29 Trevor Campbell , Boyan Beronov

Recent studies have utilized sparse classifications to predict categorical variables from high-dimensional brain activity signals to expose human's intentions and mental states, selecting the relevant features automatically in the model…

Machine Learning · Computer Science 2025-08-07 Yuanhao Li , Badong Chen , Yuxi Shi , Natsue Yoshimura , Yasuharu Koike

There has been an intense development on the estimation of a sparse regression coefficient vector in statistics, machine learning and related fields. In this paper, we focus on the Bayesian approach to this problem, where sparsity is…

Computation · Statistics 2016-02-25 Xichen Huang , Jin Wang , Feng Liang

Learned sparse and dense representations capture different successful approaches to text retrieval and the fusion of their results has proven to be more effective and robust. Prior work combines dense and sparse retrievers by fusing their…

Information Retrieval · Computer Science 2021-12-10 Sheng-Chieh Lin , Jimmy Lin

Performing signal processing tasks on compressive measurements of data has received great attention in recent years. In this paper, we extend previous work on compressive dictionary learning by showing that more general random projections…

Machine Learning · Statistics 2015-04-07 Farhad Pourkamali-Anaraki , Stephen Becker , Shannon M. Hughes

Deep generative models have been studied and developed primarily in the context of natural images and computer vision. This has spurred the development of (Bayesian) methods that use these generative models for inverse problems in image…

Signal Processing · Electrical Eng. & Systems 2025-04-17 Tristan S. W. Stevens , Jeroen Overdevest , Oisín Nolan , Wessel L. van Nierop , Ruud J. G. van Sloun , Yonina C. Eldar

The Bayesian Lasso is constructed in the linear regression framework and applies the Gibbs sampling to estimate the regression parameters. This paper develops a new sparse learning model, named the Bayesian Lasso Sparse (BLS) model, that…

Machine Learning · Statistics 2022-07-15 Ingvild M. Helgøy , Yushu Li

In this paper, we propose a new Bayesian inference method for a high-dimensional sparse factor model that allows both the factor dimensionality and the sparse structure of the loading matrix to be inferred. The novelty is to introduce a…

Machine Learning · Statistics 2023-05-31 Ilsang Ohn , Lizhen Lin , Yongdai Kim

Despite their recent popularity and well-known advantages, dense retrievers still lag behind sparse methods such as BM25 in their ability to reliably match salient phrases and rare entities in the query and to generalize to out-of-domain…

Computation and Language · Computer Science 2022-11-15 Xilun Chen , Kushal Lakhotia , Barlas Oğuz , Anchit Gupta , Patrick Lewis , Stan Peshterliev , Yashar Mehdad , Sonal Gupta , Wen-tau Yih

Signal modeling lies at the core of numerous signal and image processing applications. A recent approach that has drawn considerable attention is sparse representation modeling, in which the signal is assumed to be generated as a…

Information Theory · Computer Science 2016-11-17 Tomer Peleg , Yonina C. Eldar , Michael Elad

While Large Language Models (LLMs) exhibit exceptional zero-shot relevance modeling, their high computational cost necessitates framing passage retrieval as a budget-constrained global optimization problem. Existing approaches passively…

Information Retrieval · Computer Science 2026-04-21 Junyoung Kim , Anton Korikov , Jiazhou Liang , Justin Cui , Yifan Simon Liu , Qianfeng Wen , Mark Zhao , Scott Sanner

We address the problem of inferring self-supervised dense semantic correspondences between objects in multi-object scenes. The method introduces learning of class-aware dense object descriptors by providing either unsupervised discrete…

Robotics · Computer Science 2021-10-06 Denis Hadjivelichkov , Dimitrios Kanoulas

Random projection is often used to project higher-dimensional vectors onto a lower-dimensional space, while approximately preserving their pairwise distances. It has emerged as a powerful tool in various data processing tasks and has…

Machine Learning · Computer Science 2020-06-30 Wenye Li , Shuzhong Zhang

Vector representations and vector space modeling (VSM) play a central role in modern machine learning. We propose a novel approach to `vector similarity searching' over dense semantic representations of words and documents that can be…

Information Retrieval · Computer Science 2017-06-06 Jan Rygl , Jan Pomikálek , Radim Řehůřek , Michal Růžička , Vít Novotný , Petr Sojka

Sparse Bayesian learning (SBL) is a powerful framework for tackling the sparse coding problem. However, the most popular inference algorithms for SBL become too expensive for high-dimensional settings, due to the need to store and compute a…

Signal Processing · Electrical Eng. & Systems 2022-02-28 Alexander Lin , Andrew H. Song , Berkin Bilgic , Demba Ba

Open-set semantic mapping requires (i) determining the correct granularity to represent the scene (e.g., how should objects be defined), and (ii) fusing semantic knowledge across multiple 2D observations into an overall 3D reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Dominic Maggio , Luca Carlone

Sparse modeling for signal processing and machine learning has been at the focus of scientific research for over two decades. Among others, supervised sparsity-aware learning comprises two major paths paved by: a) discriminative methods and…

Machine Learning · Statistics 2022-11-23 Lei Cheng , Feng Yin , Sergios Theodoridis , Sotirios Chatzis , Tsung-Hui Chang

Explaining why dense retrievers assign high relevance scores remains challenging because retrieval decisions are made through opaque high-dimensional embeddings. Existing explanations often focus on surface signals, such as lexical matches,…

Artificial Intelligence · Computer Science 2026-05-29 Zhixin Cai , Jun Bai , Yang Liu , Jiaqi Li , Yichi Zhang , Taichuan Li , Zhuofan Chen , Zixia Jia , Zilong Zheng , Wenge Rong

We introduce sparse random projection, an important dimension-reduction tool from machine learning, for the estimation of discrete-choice models with high-dimensional choice sets. Initially, high-dimensional data are compressed into a…

Machine Learning · Statistics 2016-04-21 Khai X. Chiong , Matthew Shum

Relevance Vector Machine (RVM) is a supervised learning algorithm extended from Support Vector Machine (SVM) based on the Bayesian sparsity model. Compared with the regression problem, RVM classification is difficult to be conducted because…

Machine Learning · Statistics 2022-10-28 Wenyang Wang , Dongchu Sun , Zhuoqiong He