English
Related papers

Related papers: A Sparse Johnson-Lindenstrauss Transform using Fas…

200 papers

Data remap between non-matching meshes is a critical step in multiphysics coupling using a partitioned approach. The data fields being transferred often have jumps in function values or derivatives. It is important but very challenging to…

Numerical Analysis · Mathematics 2021-01-26 Yipeng Li , Qiao Chen , Xuebin Wang , Xiangmin Jiao

$ \newcommand{\kalg}{{k_{\mathrm{alg}}}} \newcommand{\kopt}{{k_{\mathrm{opt}}}} \newcommand{\algset}{{T}} \renewcommand{\Re}{\mathbb{R}} \newcommand{\eps}{\varepsilon} \newcommand{\pth}[2][\!]{#1\left({#2}\right)} \newcommand{\npoints}{n}…

Computational Geometry · Computer Science 2017-07-04 Avrim Blum , Sariel Har-Peled , Benjamin Raichel

In scientific fields such as quantum computing, physics, chemistry, and machine learning, high dimensional data are typically represented using sparse tensors. Tensor contraction is a popular operation on tensors to exploit meaning or alter…

Data Structures and Algorithms · Computer Science 2024-10-15 Andrew Ensinger , Gabriel Kulp , Victor Agostinelli , Dennis Lyakhov , Lizhong Chen

For Euclidean space ($\ell_2$), there exists the powerful dimension reduction transform of Johnson and Lindenstrauss, with a host of known applications. Here, we consider the problem of dimension reduction for all $\ell_p$ spaces $1 \le p…

Computational Geometry · Computer Science 2015-12-08 Yair Bartal , Lee-Ad Gottlieb

In this work, we explore modewise Johnson-Lindenstrauss embeddings (JLEs) as a tool to reduce the computational cost and memory requirements of nuclear many-body methods. JLEs are randomized projections of high-dimensional data tensors onto…

Nuclear Theory · Physics 2023-05-04 A. Zare , R. Wirth , C. A. Haselby , H. Hergert , M. Iwen

We present a novel binary convex reformulation of the sparse regression problem that constitutes a new duality perspective. We devise a new cutting plane method and provide evidence that it can solve to provable optimality the sparse…

Optimization and Control · Mathematics 2017-09-29 Dimitris Bertsimas , Bart Van Parys

In this paper a sublinear time algorithm is presented for the reconstruction of functions that can be represented by just few out of a potentially large candidate set of Fourier basis functions in high spatial dimensions, a so-called…

Numerical Analysis · Mathematics 2020-06-24 Lutz Kämmerer , Felix Krahmer , Toni Volkmer

We consider the problem of learning an $M$-sparse Hamiltonian and the related problem of Hamiltonian sparsity testing. Through a detailed analysis of Bell sampling, we reduce the total evolution time required by the state-of-the-art…

Quantum Physics · Physics 2025-09-10 Savar D. Sinha , Yu Tong

Locality Sensitive Hashing (LSH) is an effective method of indexing a set of items to support efficient nearest neighbors queries in high-dimensional spaces. The basic idea of LSH is that similar items should produce hash collisions with…

Data Structures and Algorithms · Computer Science 2021-02-22 Haim Kaplan , Jay Tenenbaum

The unadjusted Langevin algorithm is widely used for sampling from complex high-dimensional distributions. It is well known to be biased, with the bias typically scaling linearly with the dimension when measured in squared Wasserstein…

Machine Learning · Statistics 2025-09-11 Daniel Lacker , Fuzhong Zhou

The rapid scaling of large language models~(LLMs) has made inference efficiency a primary bottleneck in the practical deployment. To address this, semi-structured sparsity offers a promising solution by strategically retaining $N$ elements…

Machine Learning · Computer Science 2026-05-14 Yan Sun , Qixin Zhang , Zhiyuan Yu , Xikun Zhang , Li Shen , Dacheng Tao

Sparse phase retrieval plays an important role in many fields of applied science and thus attracts lots of attention. In this paper, we propose a \underline{sto}chastic alte\underline{r}nating \underline{m}inimizing method for…

Machine Learning · Statistics 2019-06-17 Jianfeng Cai , Yuling Jiao , Xiliang Lu , Juntao You

Given the observation of a high-dimensional Ornstein-Uhlenbeck (OU) process in continuous time, we proceed to the inference of the drift parameter under a row-sparsity assumption. Towards that aim, we consider the negative log-likelihood of…

Machine Learning · Statistics 2017-07-12 Stéphane Gaïffas , Gustaw Matulewicz

We consider the distributed and parallel construction of low-diameter decompositions with strong diameter for (weighted) graphs and (weighted) graphs that can be separated through $k \in \tilde{O}(1)$ shortest paths. This class of graphs…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-02 Jinfeng Dou , Thorsten Götte , Henning Hillebrandt , Christian Scheideler , Julian Werthmann

High-dimensional data often lie in low-dimensional subspaces corresponding to different classes they belong to. Finding sparse representations of data points in a dictionary built using the collection of data helps to uncover…

Machine Learning · Statistics 2016-02-16 Ehsan Elhamifar , Mahdi Soltanolkotabi , Shankar Sastry

In this work we apply the "deviation maximization", a new column selection strategy, to the Lawson-Hanson algorithm for the solution of NonNegative Least Squares (NNLS), devising a new algorithm we call Lawson-Hanson with Deviation…

Numerical Analysis · Mathematics 2023-09-12 Monica Dessole , Marco Dell'Orto , Fabio Marcuzzi

We consider the problem of encoding a set of vectors into a minimal number of bits while preserving information on their Euclidean geometry. We show that this task can be accomplished by applying a Johnson-Lindenstrauss embedding and…

Information Theory · Computer Science 2022-04-12 Sjoerd Dirksen , Alexander Stollenwerk

We study the problem of list-decodable sparse mean estimation. Specifically, for a parameter $\alpha \in (0, 1/2)$, we are given $m$ points in $\mathbb{R}^n$, $\lfloor \alpha m \rfloor$ of which are i.i.d. samples from a distribution $D$…

Data Structures and Algorithms · Computer Science 2024-07-08 Ilias Diakonikolas , Daniel M. Kane , Sushrut Karmalkar , Ankit Pensia , Thanasis Pittas

We introduce and study the notion of an outer bi-Lipschitz extension of a map between Euclidean spaces. The notion is a natural analogue of the notion of a Lipschitz extension of a Lipschitz map. We show that for every map $f$ there exists…

Data Structures and Algorithms · Computer Science 2018-11-09 Sepideh Mahabadi , Konstantin Makarychev , Yury Makarychev , Ilya Razenshteyn

Multi-label learning problems have manifested themselves in various machine learning applications. The key to successful multi-label learning algorithms lies in the exploration of inter-label correlations, which usually incur great…

Computer Vision and Pattern Recognition · Computer Science 2018-05-16 Zongting Lyu , Yan Yan , Fei Wu