中文
相关论文

相关论文: On Deterministic Sketching and Streaming for Spars…

200 篇论文

Linear bandits have become a cornerstone of online learning and sequential decision-making, providing solid theoretical foundations for balancing exploration and exploitation. Within this domain, matrix sketching serves as a critical…

机器学习 · 计算机科学 2026-03-02 Dongxie Wen , Hanyan Yin , Xiao Zhang , Peng Zhao , Lijun Zhang , Zhewei Wei

We resolve the space complexity of linear sketches for approximating the maximum matching problem in dynamic graph streams where the stream may include both edge insertion and deletion. Specifically, we show that for any $\epsilon > 0$,…

数据结构与算法 · 计算机科学 2015-05-07 Sepehr Assadi , Sanjeev Khanna , Yang Li , Grigory Yaroslavtsev

We study the problem of solving semidefinite programs (SDP) in the streaming model. Specifically, $m$ constraint matrices and a target matrix $C$, all of size $n\times n$ together with a vector $b\in \mathbb{R}^m$ are streamed to us…

数据结构与算法 · 计算机科学 2023-09-12 Zhao Song , Mingquan Ye , Lichen Zhang

We introduce a new sub-linear space sketch---the Weight-Median Sketch---for learning compressed linear classifiers over data streams while supporting the efficient recovery of large-magnitude weights in the model. This enables…

机器学习 · 计算机科学 2018-04-10 Kai Sheng Tai , Vatsal Sharan , Peter Bailis , Gregory Valiant

We consider the problem of exact recovery of a $k$-sparse binary vector from generalized linear measurements (such as logistic regression). We analyze the linear estimation algorithm (Plan, Vershynin, Yudovina, 2017), and also show…

机器学习 · 统计学 2025-02-25 Arya Mazumdar , Neha Sangwan

We characterize the effectiveness of a classical algorithm for recovering the Markov graph of a general discrete pairwise graphical model from i.i.d. samples. The algorithm is (appropriately regularized) maximum conditional log-likelihood,…

机器学习 · 计算机科学 2019-06-20 Shanshan Wu , Sujay Sanghavi , Alexandros G. Dimakis

This paper provides a sparse signal recovery algorithm, DU-PSISTA (Deep Unfolded-Periodic Sketched Iterative Shrinkage-Thresholding Algorithm), which aims to balance computational efficiency and accuracy for recovering high-dimensional…

信号处理 · 电气工程与系统科学 2026-04-23 Tatsuki Tokumura , Ayano Nakai-Kasai , Tadashi Wadayama

For a tall $n\times d$ matrix $A$ and a random $m\times n$ sketching matrix $S$, the sketched estimate of the inverse covariance matrix $(A^\top A)^{-1}$ is typically biased: $E[(\tilde A^\top\tilde A)^{-1}]\ne(A^\top A)^{-1}$, where…

数据结构与算法 · 计算机科学 2021-07-13 Michał Dereziński , Zhenyu Liao , Edgar Dobriban , Michael W. Mahoney

Accurate signal recovery or image reconstruction from indirect and possibly undersampled data is a topic of considerable interest; for example, the literature in the recent field of compressed sensing is already quite immense. Inspired by…

最优化与控制 · 数学 2011-04-15 Stephen Becker , Jerome Bobin , Emmanuel Candes

We consider the problem of estimating a time-varying sparse precision matrix, which is assumed to evolve in a piece-wise constant manner. Building upon the Group Fused LASSO and LASSO penalty functions, we estimate both the network…

统计理论 · 数学 2024-10-08 Ying Lin , Benjamin Poignard , Ting Kei Pong , Akiko Takeda

It is now well understood that (1) it is possible to reconstruct sparse signals exactly from what appear to be highly incomplete sets of linear measurements and (2) that this can be done by constrained L1 minimization. In this paper, we…

统计方法学 · 统计学 2007-11-13 Emmanuel J. Candes , Michael B. Wakin , Stephen P. Boyd

We present a new approach for computing compact sketches that can be used to approximate the inner product between pairs of high-dimensional vectors. Based on the Weighted MinHash algorithm, our approach admits strong accuracy guarantees…

Solving l1 regularized optimization problems is common in the fields of computational biology, signal processing and machine learning. Such l1 regularization is utilized to find sparse minimizers of convex functions. A well-known example is…

数值分析 · 计算机科学 2016-07-04 Eran Treister , Javier S. Turek , Irad Yavneh

The goal of (stable) sparse recovery is to recover a $k$-sparse approximation $x*$ of a vector $x$ from linear measurements of $x$. Specifically, the goal is to recover $x*$ such that ||x-x*||_p <= C min_{k-sparse x'} ||x-x'||_q for some…

数据结构与算法 · 计算机科学 2011-10-19 Piotr Indyk , Eric Price , David P. Woodruff

Sketching has emerged as a powerful technique for speeding up problems in numerical linear algebra, such as regression. In the overconstrained regression problem, one is given an $n \times d$ matrix $A$, with $n \gg d$, as well as an $n…

数据结构与算法 · 计算机科学 2017-05-31 Eric Price , Zhao Song , David P. Woodruff

$D$-optimal designs originate in statistics literature as an approach for optimal experimental designs. In numerical analysis points and weights resulting from maximal determinants turned out to be useful for quadrature and interpolation.…

数值分析 · 数学 2024-12-04 Felix Bartel , Lutz Kämmerer , Kateryna Pozharska , Martin Schäfer , Tino Ullrich

We consider the problem of learning a graph modeling the statistical relations of the $d$ variables from a dataset with $n$ samples $X \in \mathbb{R}^{n \times d}$. Standard approaches amount to searching for a precision matrix $\Theta$…

机器学习 · 统计学 2023-12-13 Titouan Vayer , Etienne Lasalle , Rémi Gribonval , Paulo Gonçalves

We study sketching and streaming algorithms for the Longest Common Subsequence problem (LCS) on strings of small alphabet size $|\Sigma|$. For the problem of deciding whether the LCS of strings $x,y$ has length at least $L$, we obtain a…

数据结构与算法 · 计算机科学 2018-10-03 Karl Bringmann , Bhaskar Ray Chaudhury

We consider the problem of recovering an $N$-dimensional sparse vector $\vm{x}$ from its linear transformation $\vm{y}=\vm{D} \vm{x}$ of $M(< N)$ dimension. Minimizing the $l_{1}$-norm of $\vm{x}$ under the constraint $\vm{y} = \vm{D}…

信息论 · 计算机科学 2015-03-20 Yoshiyuki Kabashima , Mikko Vehkapera , Saikat Chatterjee

Image reconstruction of EIT mathematically is a typical nonlinear and severely ill-posed inverse problem. Appropriate priors or penalties are required to enable the reconstruction. The commonly used L2-norm can enforce the stability to…

数值分析 · 数学 2018-03-13 Jing Wang , Bo Han , Wei Wang