English
Related papers

Related papers: Sublinear Least-Squares Value Iteration via Locali…

200 papers

We present a new algorithm and the corresponding convergence analysis for the regularization of linear inverse problems with sparsity constraints, applied to a new generalized sparsity promoting functional. The algorithm is based on the…

Numerical Analysis · Mathematics 2016-12-30 Sergey Voronin , Ingrid Daubechies

Common assumptions, like linear or RKHS models, and Gaussian or log-concave posteriors over the models, do not explain practical success of RL across a wider range of distributions and models. Thus, we study how to design RL algorithms with…

Machine Learning · Computer Science 2025-02-06 Emilio Jorge , Christos Dimitrakakis , Debabrota Basu

Wave equation techniques have been an integral part of geophysical imaging workflows to investigate the Earth's subsurface. Least-squares reverse time migration (LSRTM) is a linearized inversion problem that iteratively minimizes a misfit…

Computational Physics · Physics 2019-12-11 Janaki Vamaraju , Jeremy Vila , Mauricio Araya-Polo , Debanjan Datta , Mohamed Sidahmed , Mrinal Sen

In Reinforcement Learning (RL), tasks with instantaneous hard constraints present significant challenges, particularly when the decision space is non-convex or non-star-convex. This issue is especially relevant in domains like autonomous…

Machine Learning · Computer Science 2025-02-27 Amirhossein Roknilamouki , Arnob Ghosh , Ming Shi , Fatemeh Nourzad , Eylem Ekici , Ness B. Shroff

Stochastic search algorithms are among the most sucessful approaches for solving hard combinatorial problems. A large class of stochastic search approaches can be cast into the framework of Las Vegas Algorithms (LVAs). As the run-time…

Artificial Intelligence · Computer Science 2013-02-01 Holger H. Hoos , Thomas Stutzle

The iteratively reweighted least squares method (IRLS) is a popular technique used in practice for solving regression problems. Various versions of this method have been proposed, but their theoretical analyses failed to capture the good…

Data Structures and Algorithms · Computer Science 2019-07-11 Alina Ene , Adrian Vladu

Locality-Sensitive Hashing (LSH) is one of the most popular methods for $c$-Approximate Nearest Neighbor Search ($c$-ANNS) in high-dimensional spaces. In this paper, we propose a novel LSH scheme based on the Longest Circular Co-Substring…

Databases · Computer Science 2020-04-14 Yifan Lei , Qiang Huang , Mohan Kankanhalli , Anthony K. H. Tung

We present an I/O-efficient algorithm for computing similarity joins based on locality-sensitive hashing (LSH). In contrast to the filtering methods commonly suggested our method has provable sub-quadratic dependency on the data size.…

Data Structures and Algorithms · Computer Science 2017-03-29 Rasmus Pagh , Ninh Pham , Francesco Silvestri , Morten Stöckel

Recently it was shown that the problem of Maximum Inner Product Search (MIPS) is efficient and it admits provably sub-linear hashing algorithms. Asymmetric transformations before hashing were the key in solving MIPS which was otherwise…

Machine Learning · Statistics 2014-11-14 Anshumali Shrivastava , Ping Li

We present a data structure for *spherical range reporting* on a point set $S$, i.e., reporting all points in $S$ that lie within radius $r$ of a given query point $q$. Our solution builds upon the Locality-Sensitive Hashing (LSH) framework…

Data Structures and Algorithms · Computer Science 2017-04-11 Thomas D. Ahle , Martin Aumüller , Rasmus Pagh

We introduce a novel optimization algorithm for image recovery under learned sparse and low-rank constraints, which we parameterize as weighted extensions of the $\ell_p^p$-vector and $\mathcal S_p^p$ Schatten-matrix quasi-norms for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Stamatios Lefkimmiatis , Iaroslav Koshelev

The classical theory of reinforcement learning (RL) has focused on tabular and linear representations of value functions. Further progress hinges on combining RL with modern function approximators such as kernel functions and deep neural…

Machine Learning · Computer Science 2021-01-01 Zhuoran Yang , Chi Jin , Zhaoran Wang , Mengdi Wang , Michael I. Jordan

A classical problem in matrix computations is the efficient and reliable approximation of a given matrix by a matrix of lower rank. The truncated singular value decomposition (SVD) is known to provide the best such approximation for any…

Numerical Analysis · Mathematics 2014-08-12 Ming Gu

This paper investigates a new yet challenging problem called Reverse $k$-Maximum Inner Product Search (R$k$MIPS). Given a query (item) vector, a set of item vectors, and a set of user vectors, the problem of R$k$MIPS aims to find a set of…

Information Retrieval · Computer Science 2023-06-30 Qiang Huang , Yanhao Wang , Anthony K. H. Tung

Least squares (LS) fitting is one of the most fundamental techniques in science and engineering. It is used to estimate parameters from multiple noisy observations. In many problems the parameters are known a-priori to be bounded integer…

Information Theory · Computer Science 2009-01-05 Amir Leshem , Jacob Goldberger

The adoption of an appropriate approximate similarity search method is an essential prereq-uisite for developing a fast and efficient CBIR system, especially when dealing with large amount ofdata. In this study we implement a web image…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Alessio Schiavo , Filippo Minutella , Mattia Daole , Marsha Gomez Gomez

This paper discusses a few algorithms for updating the approximate Singular Value Decomposition (SVD) in the context of information retrieval by Latent Semantic Indexing (LSI) methods. A unifying framework is considered which is based on…

Numerical Analysis · Mathematics 2014-05-14 Eugene Vecharynski , Yousef Saad

Solving symmetric positive definite linear problems is a fundamental computational task in machine learning. The exact solution, famously, is cubicly expensive in the size of the matrix. To alleviate this problem, several linear-time…

Machine Learning · Computer Science 2017-06-02 Filip de Roos , Philipp Hennig

In this work we present a novel optimization strategy for image reconstruction tasks under analysis-based image regularization, which promotes sparse and/or low-rank solutions in some learned transform domain. We parameterize such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Iaroslav Koshelev , Stamatios Lefkimmiatis

Locality Sensitive Hashing (LSH) is an effective method of indexing a set of items to support efficient nearest neighbors queries in high-dimensional spaces. The basic idea of LSH is that similar items should produce hash collisions with…

Data Structures and Algorithms · Computer Science 2021-02-22 Haim Kaplan , Jay Tenenbaum