中文
相关论文

相关论文: Johnson-Lindenstrauss Embeddings with Kronecker St…

200 篇论文

An important problem is to determine under which circumstances a metric on a conformally compact manifold is conformal to a Poincar\'e--Einstein metric. Such conformal rescalings are in general obstructed by conformal invariants of the…

微分几何 · 数学 2021-07-23 Samuel Blitz , A. Rod Gover , Andrew Waldron

Why does the low dimensionality of representations, typically $d\approx 1000$, not prevent modern embedding-based retrieval models from scaling to billions, or even trillions, of data points? To answer this question, we study maximal-margin…

机器学习 · 计算机科学 2026-05-25 Kiril Bangachev , Guy Bresler , Jonathan Kogan , Yury Polyanskiy

The hierarchical matrix framework partitions matrices into subblocks that are either small or of low numerical rank, enabling linear storage complexity and efficient matrix-vector multiplication. This work focuses on the $H^2$-matrix format…

数值分析 · 数学 2026-02-02 Anna Yesypenko , Per-Gunnar Martinsson

An oblivious subspace embedding (OSE), characterized by parameters $m,n,d,\epsilon,\delta$, is a random matrix $\Pi\in \mathbb{R}^{m\times n}$ such that for any $d$-dimensional subspace $T\subseteq \mathbb{R}^n$, $\Pr_\Pi[\forall x\in T,…

数据结构与算法 · 计算机科学 2021-12-22 Yi Li , Mingmou Liu

Kronecker compressed sensing refers to using Kronecker product matrices as sparsifying bases and measurement matrices in compressed sensing. This work focuses on the Kronecker compressed sensing problem, encompassing three sparsity…

信号处理 · 电气工程与系统科学 2025-04-11 Yanbin He , Geethu Joseph

Matrices satisfying the Restricted Isometry Property (RIP) play an important role in the areas of compressed sensing and statistical learning. RIP matrices with optimal parameters are mainly obtained via probabilistic arguments, as explicit…

机器学习 · 计算机科学 2019-11-01 Shiva Prasad Kasiviswanathan , Mark Rudelson

Random projections or sketching are widely used in many algorithmic and learning contexts. Here we study the performance of iterative Hessian sketch for least-squares problems. By leveraging and extending recent results from random matrix…

最优化与控制 · 数学 2020-10-26 Jonathan Lacotte , Sifan Liu , Edgar Dobriban , Mert Pilanci

In this paper we establish new simple local geometric criteria for discrete entropic curvature introduced in [47] that are powerful enough to capture many geometric properties of complex models arising in mathematical physics. These results…

概率论 · 数学 2024-07-01 Martin Rapaport , Paul-Marie Samson

Compressed sensing is a technique for finding sparse solutions to underdetermined linear systems. This technique relies on properties of the sensing matrix such as the restricted isometry property. Sensing matrices that satisfy the…

计算复杂性 · 计算机科学 2011-10-18 Pascal Koiran , Anastasios Zouzias

Dimension reduction algorithms are a crucial part of many data science pipelines, including data exploration, feature creation and selection, and denoising. Despite their wide utilization, many non-linear dimension reduction algorithms are…

机器学习 · 统计学 2024-08-06 Ryan Murray , Adam Pickarski

We provide a control-theoretic perspective on optimal tensor algorithms for minimizing a convex function in a finite-dimensional Euclidean space. Given a function $\Phi: \mathbb{R}^d \rightarrow \mathbb{R}$ that is convex and twice…

最优化与控制 · 数学 2026-01-21 Tianyi Lin , Michael. I. Jordan

We study constructions of $k \times n$ matrices $A$ that both (1) satisfy the restricted isometry property (RIP) at sparsity $s$ with optimal parameters, and (2) are efficient in the sense that only $O(n\log n)$ operations are required to…

数值分析 · 计算机科学 2013-02-19 Nir Ailon , Holger Rauhut

Motivated by the problem of compressing point sets into as few bits as possible while maintaining information about approximate distances between points, we construct random nonlinear maps $\varphi_\ell$ that compress point sets in the…

计算几何 · 计算机科学 2024-03-05 Brett Leroux , Luis Rademacher

We show that the condition number of any cyclically contiguous $p\times q$ submatrix of the $N\times N$ discrete Fourier transform (DFT) matrix is at least $$ \exp \left( \frac{\pi}{2} \left[\min(p,q)- \frac{pq}{N}\right] \right)~, $$ up to…

数值分析 · 数学 2020-08-17 Alex H. Barnett

In this work, we explore modewise Johnson-Lindenstrauss embeddings (JLEs) as a tool to reduce the computational cost and memory requirements of nuclear many-body methods. JLEs are randomized projections of high-dimensional data tensors onto…

核理论 · 物理学 2023-05-04 A. Zare , R. Wirth , C. A. Haselby , H. Hergert , M. Iwen

Compressed Sensing (CS) is an emerging field that enables reconstruction of a sparse signal $x \in {\mathbb R} ^n$ that has only $k \ll n$ non-zero coefficients from a small number $m \ll n$ of linear projections. The projections are…

信息论 · 计算机科学 2011-03-29 Shriram Sarvotham , Richard G. Baraniuk

A Banach space $X$ is said to have Efremov's property ($\mathcal{E}$) if every element of the weak$^*$-closure of a convex bounded set $C \subseteq X^*$ is the weak$^*$-limit of a sequence in $C$. By assuming the Continuum Hypothesis, we…

泛函分析 · 数学 2018-04-30 Antonio Avilés , Gonzalo Martínez-Cervantes , José Rodríguez

For a family of interpolation norms $\| \cdot \|_{1,2,s}$ on $\mathbb{R}^n$, we provide a distribution over random matrices $\Phi_s \in \mathbb{R}^{m \times n}$ parametrized by sparsity level $s$ such that for a fixed set $X$ of $K$ points…

数据结构与算法 · 计算机科学 2015-06-03 Felix Krahmer , Rachel Ward

We study integration and $L_2$-approximation on countable tensor products of function spaces of increasing smoothness. We obtain upper and lower bounds for the minimal errors, which are sharp in many cases including, e.g., Korobov, Walsh,…

数值分析 · 数学 2021-09-21 M. Gnewuch , M. Hefter , A. Hinrichs , K. Ritter , G. W. Wasilkowski

Let $\varepsilon\in(0,1)$ and $X\subset\mathbb R^d$ be arbitrary with $|X|$ having size $n>1$. The Johnson-Lindenstrauss lemma states there exists $f:X\rightarrow\mathbb R^m$ with $m = O(\varepsilon^{-2}\log n)$ such that $$ \forall x\in X\…

数据结构与算法 · 计算机科学 2018-10-23 Shyam Narayanan , Jelani Nelson