中文
相关论文

相关论文: Optimal Non-Linear Models for Sparsity and Samplin…

200 篇论文

We consider the problem of designing sparse sampling strategies for multidomain signals, which can be represented using tensors that admit a known multilinear decomposition. We leverage the multidomain structure of tensor signals and…

信息论 · 计算机科学 2019-06-26 Guillermo Ortiz-Jiménez , Mario Coutino , Sundeep Prabhakar Chepuri , Geert Leus

Motivated by the computational difficulties incurred by popular deep learning algorithms for the generative modeling of temporal densities, we propose a cheap alternative which requires minimal hyperparameter tuning and scales favorably to…

机器学习 · 统计学 2023-10-13 Jonah Botvinick-Greenhouse , Yunan Yang , Romit Maulik

We investigate the reconstruction of multivariate functions from samples using sparse recovery techniques. For Square Root Lasso, Orthogonal Matching Pursuit, and Compressive Sampling Matching Pursuit, we demonstrate both theoretically and…

To accelerate kernel methods, we propose a near input sparsity time algorithm for sampling the high-dimensional feature space implicitly defined by a kernel transformation. Our main contribution is an importance sampling method for…

数据结构与算法 · 计算机科学 2020-07-15 David P. Woodruff , Amir Zandieh

In this work, we propose an optimization framework for estimating a sparse robust one-dimensional subspace. Our objective is to minimize both the representation error and the penalty, in terms of the l1-norm criterion. Given that the…

机器学习 · 统计学 2024-03-07 Xiao Ling , Paul Brooks

A simple model to study subspace clustering is the high-dimensional $k$-Gaussian mixture model where the cluster means are sparse vectors. Here we provide an exact asymptotic characterization of the statistically optimal reconstruction…

机器学习 · 统计学 2023-04-04 Luca Pesce , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

This paper studies the question of how well a signal can be reprsented by a sparse linear combination of reference signals from an overcomplete dictionary. When the dictionary size is exponential in the dimension of signal, then the exact…

信息论 · 计算机科学 2009-05-14 Halyun Jeong , Young-Han Kim

In the problem of learning mixtures of linear regressions, the goal is to learn a collection of signal vectors from a sequence of (possibly noisy) linear measurements, where each measurement is evaluated on an unknown signal drawn uniformly…

机器学习 · 计算机科学 2019-11-01 Akshay Krishnamurthy , Arya Mazumdar , Andrew McGregor , Soumyabrata Pal

The structure of Magnetic Resonance Images (MRI) and especially their compressibility in an appropriate representation basis enables the application of the compressive sensing theory, which guarantees exact image recovery from incomplete…

统计理论 · 数学 2013-07-26 Nicolas Chauffert , Philippe Ciuciu , Pierre Weiss

In the context of the compressed sensing problem, we propose a new ensemble of sparse random matrices which allow one (i) to acquire and compress a {\rho}0-sparse signal of length N in a time linear in N and (ii) to perfectly recover the…

信息论 · 计算机科学 2013-04-15 Maria Chiara Angelini , Federico Ricci-Tersenghi , Yoshiyuki Kabashima

Localizing more sources than sensors with a sparse linear array (SLA) has long relied on minimizing a distance between two covariance matrices and recent algorithms often utilize semidefinite programming (SDP). Although deep neural network…

信号处理 · 电气工程与系统科学 2025-03-11 Kuan-Lin Chen , Bhaskar D. Rao

Subspace segmentation or subspace learning is a challenging and complicated task in machine learning. This paper builds a primary frame and solid theoretical bases for the minimal subspace segmentation (MSS) of finite samples. Existence and…

机器学习 · 计算机科学 2019-09-10 Zhenyue Zhang , Yuqing Xia

Sub-sampling is a common and often effective method to deal with the computational challenges of large datasets. However, for most statistical models, there is no well-motivated approach for drawing a non-uniform subsample. We show that the…

机器学习 · 统计学 2017-09-07 Daniel Ting , Eric Brochu

Is it possible to find the sparsest vector (direction) in a generic subspace $\mathcal{S} \subseteq \mathbb{R}^p$ with $\mathrm{dim}(\mathcal{S})= n < p$? This problem can be considered a homogeneous variant of the sparse recovery problem,…

信息论 · 计算机科学 2016-09-21 Qing Qu , Ju Sun , John Wright

Estimating linear, mean-square continuous functionals is a pivotal challenge in statistics. In high-dimensional contexts, this estimation is often performed under the assumption of exact model sparsity, meaning that only a small number of…

统计理论 · 数学 2025-08-04 Jelena Bradic , Victor Chernozhukov , Whitney K. Newey , Yinchu Zhu

This letter presents a new spectral-clustering-based approach to the subspace clustering problem. Underpinning the proposed method is a convex program for optimal direction search, which for each data point d finds an optimal direction in…

计算机视觉与模式识别 · 计算机科学 2017-11-28 Mostafa Rahmani , George Atia

The facility location problem is widely used for summarizing large datasets and has additional applications in sensor placement, image retrieval, and clustering. One difficulty of this problem is that submodular optimization algorithms…

机器学习 · 统计学 2017-03-09 Erik M. Lindgren , Shanshan Wu , Alexandros G. Dimakis

Dimension reduction is widely regarded as an effective way for decreasing the computation, storage and communication loads of data-driven intelligent systems, leading to a growing demand for statistical methods that allow analysis (e.g.,…

计算机视觉与模式识别 · 计算机科学 2019-08-23 Guangcan Liu , Zhao Zhang , Qingshan Liu , Kongkai Xiong

Expand-and-sparsify representations are a class of theoretical models that capture sparse representation phenomena observed in the sensory systems of many animals. At a high level, these representations map an input $x \in \mathbb{R}^d$ to…

统计理论 · 数学 2026-03-20 Kaushik Sinha , Christopher Tosh

In high-dimensional statistics, variable selection recovers the latent sparse patterns from all possible covariate combinations. This paper proposes a novel optimization method to solve the exact L0-regularized regression problem, which is…

统计方法学 · 统计学 2022-06-02 Mingzhang Yin , Nhat Ho , Bowei Yan , Xiaoning Qian , Mingyuan Zhou