English
Related papers

Related papers: SINDI: an Efficient Index for Approximate Maximum …

200 papers

Applications often require a fast, single-threaded search algorithm over sorted data, typical in table-lookup operations. We explore various search algorithms for a large number of search candidates over a relatively small array of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-09 Benjamin Mastripolito , Nicholas Koskelo , Dylan Weatherred , David A. Pimentel , Daniel Sheppard , Anna Pietarila Graham , Laura Monroe , Robert Robey

Inversion by Direct Iteration (InDI) is a new formulation for supervised image restoration that avoids the so-called "regression to the mean" effect and produces more realistic and detailed images than existing regression-based methods. It…

Image and Video Processing · Electrical Eng. & Systems 2024-02-05 Mauricio Delbracio , Peyman Milanfar

Sparse model identification enables the discovery of nonlinear dynamical systems purely from data; however, this approach is sensitive to noise, especially in the low-data limit. In this work, we leverage the statistical approach of…

Numerical Analysis · Mathematics 2022-05-04 Urban Fasel , J. Nathan Kutz , Bingni W. Brunton , Steven L. Brunton

Vector-based retrieval systems have become a common staple for academic and industrial search applications because they provide a simple and scalable way of extending the search to leverage contextual representations for documents and…

Information Retrieval · Computer Science 2023-04-04 Daniel Campos , ChengXiang Zhai

Maximum inner product search (MIPS) is a crucial subroutine in machine learning, requiring the identification of key vectors that align best with a given query. We propose amortized MIPS: a learning-based approach that trains neural…

Machine Learning · Computer Science 2026-03-10 Theo X. Olausson , João Monteiro , Michal Klein , Marco Cuturi

Sparse document representations have been widely used to retrieve relevant documents via exact lexical matching. Owing to the pre-computed inverted index, it supports fast ad-hoc search but incurs the vocabulary mismatch problem. Although…

Information Retrieval · Computer Science 2023-10-06 Eunseong Choi , Sunkyung Lee , Minjin Choi , Hyeseon Ko , Young-In Song , Jongwuk Lee

There exist endless examples of dynamical systems with vast available data and unsatisfying mathematical descriptions. Sparse regression applied to symbolic libraries has quickly emerged as a powerful tool for learning governing equations…

Machine Learning · Computer Science 2024-05-17 Matthew Golden

In recent years, the detection of infrared small targets using deep learning methods has garnered substantial attention due to notable advancements. To improve the detection capability of small targets, these methods commonly maintain a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Qianchen Mao , Qiang Li , Bingshu Wang , Yongjun Zhang , Tao Dai , C. L. Philip Chen

Sparse matrix vector multiplication (SpMV) is central to numerous data-intensive applications, but requires streaming indirect memory accesses that severely degrade both processing and memory throughput in state-of-the-art architectures.…

Hardware Architecture · Computer Science 2023-11-20 Chi Zhang , Paul Scheffler , Thomas Benz , Matteo Perotti , Luca Benini

For multiple index models, it has recently been shown that the sliced inverse regression (SIR) is consistent for estimating the sufficient dimension reduction (SDR) space if and only if $\rho=\lim\frac{p}{n}=0$, where $p$ is the dimension…

Statistics Theory · Mathematics 2018-06-19 Qian Lin , Zhigen Zhao , Jun S. Liu

We focus on Maximum Inner Product Search (MIPS), which is an essential problem in many machine learning communities. Given a query, MIPS finds the most similar items with the maximum inner products. Methods for Nearest Neighbor Search (NNS)…

Information Retrieval · Computer Science 2022-01-25 Chao Feng , Defu Lian , Xiting Wang , Zheng liu , Xing Xie , Enhong Chen

Low-precision networks, with weights and activations quantized to low bit-width, are widely used to accelerate inference on edge devices. However, current solutions are uniform, using identical bit-width for all filters. This fails to…

Machine Learning · Computer Science 2020-04-14 Zhaowei Cai , Nuno Vasconcelos

Traditionally, sparse retrieval systems relied on lexical representations to retrieve documents, such as BM25, dominated information retrieval tasks. With the onset of pre-trained transformer models such as BERT, neural sparse retrieval has…

Information Retrieval · Computer Science 2023-07-21 Nandan Thakur , Kexin Wang , Iryna Gurevych , Jimmy Lin

Leveraging the high temporal resolution and dynamic range, object detection with event cameras can enhance the performance and safety of automotive and robotics applications in real-world scenarios. However, processing sparse event data…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Shenqi Wang , Yingfu Xu , Amirreza Yousefzadeh , Sherif Eissa , Henk Corporaal , Federico Corradi , Guangzhi Tang

Spatial query and analysis results are often directly applied to decision-making processes such as facility location, proximity resource discovery, accessibility analysis, and risk assessment. Therefore, the efficiency of underlying spatial…

Databases · Computer Science 2026-05-14 Zhongpu Chen , Yikai Dong , Wanjun Hao

This paper presents GPU performance optimization and scaling results for inference models of the Sparse Deep Neural Network Challenge 2020. Demands for network quality have increased rapidly, pushing the size and thus the memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-04 Mert Hidayetoglu , Carl Pearson , Vikram Sharma Mailthody , Eiman Ebrahimi , Jinjun Xiong , Rakesh Nagi , Wen-Mei Hwu

The Sparse Identification of Nonlinear Dynamics (SINDy) algorithm can be applied to stochastic differential equations to estimate the drift and the diffusion function using data from a realization of the SDE. The SINDy algorithm requires…

Numerical Analysis · Mathematics 2024-01-29 Mathias Wanner , Igor Mezić

Music search at the scale of Amazon Music presents a unique challenge: queries frequently deviate from indexed metadata due to misspellings, transpositions, and phonetic variations, yet the retrieval system must operate under strict…

Artificial Intelligence · Computer Science 2026-05-19 Paul Greyson , Zhichao Geng , Wei Zhang , Yang Yang

DeepSeek Sparse Attention (DSA) sets the state of the art for fine-grained inference-time sparse attention by introducing a learned token-wise indexer that scores every prefix token and selects the most relevant ones for the main attention.…

Machine Learning · Computer Science 2026-05-11 Ruijie Zhou , Fanxu Meng , Yufei Xu , Tongxuan Liu , Guangming Lu , Muhan Zhang , Wenjie Pei

In this work, we revisit dictionary-based sparse regression, in particular, Sequential Threshold Least Squares (STLS), and propose a score-guided library selection to provide practical guidance for data-driven modeling, with emphasis on…

Machine Learning · Statistics 2025-12-17 Hangjun Cho , Fabio V. G. Amaral , Andrei A. Klishin , Cassio M. Oishi , Steven L. Brunton