中文
相关论文

相关论文: Newton-Type Optimal Thresholding Algorithms for Sp…

200 篇论文

Orthogonal matching pursuit (OMP) is a widely used algorithm for recovering sparse high dimensional vectors in linear regression models. The optimal performance of OMP requires \textit{a priori} knowledge of either the sparsity of…

机器学习 · 统计学 2018-06-05 Sreejith Kallummil , Sheetal Kalyani

In this paper, we propose a sparse least squares (SLS) optimization model for solving multilinear equations, in which the sparsity constraint on the solutions can effectively reduce storage and computation costs. By employing variational…

最优化与控制 · 数学 2023-10-10 Xin Li , Ziyan Luo , Yang Chen

We propose and analyze a solution to the problem of recovering a block sparse signal with sparse blocks from linear measurements. Such problems naturally emerge inter alia in the context of mobile communication, in order to meet the…

信息论 · 计算机科学 2020-09-23 Ingo Roth , Martin Kliesch , Axel Flinth , Gerhard Wunder , Jens Eisert

As a forerunner in 5G technologies, Narrowband Internet of Things (NB-IoT) will be inevitably coexisting with the legacy Long-Term Evolution (LTE) system. Thus, it is imperative for NB-IoT to mitigate LTE interference. By virtue of the…

信息论 · 计算机科学 2021-10-07 Yijia Guo , Wenkun Wen , Peiran Wu , Minghua Xia

Nonconvex sparse models have received significant attention in high-dimensional machine learning. In this paper, we study a new model consisting of a general convex or nonconvex objectives and a variety of continuous nonconvex…

最优化与控制 · 数学 2020-10-26 Digvijay Boob , Qi Deng , Guanghui Lan , Yilin Wang

This article introduces a new notion of optimal transport (OT) between tensor fields, which are measures whose values are positive semidefinite (PSD) matrices. This "quantum" formulation of OT (Q-OT) corresponds to a relaxed version of the…

图形学 · 计算机科学 2017-07-25 Gabriel Peyré , Lenaïc Chizat , François-Xavier Vialard , Justin Solomon

This study proposes a Newton based multiple objective optimization algorithm for hyperparameter search. The first order differential (gradient) is calculated using finite difference method and a gradient matrix with vectorization is formed…

最优化与控制 · 数学 2024-01-09 Qinwu Xu

Regularized optimal transport (OT) is now increasingly used as a loss or as a matching layer in neural networks. Entropy-regularized OT can be computed using the Sinkhorn algorithm but it leads to fully-dense transportation plans, meaning…

机器学习 · 统计学 2023-04-17 Tianlin Liu , Joan Puigcerver , Mathieu Blondel

We address the problem of recovering a sparse signal from clipped or quantized measurements. We show how these two problems can be formulated as minimizing the distance to a convex feasibility set, which provides a convex and differentiable…

信号处理 · 电气工程与系统科学 2018-12-05 Lucas Rencker , Francis Bach , Wenwu Wang , Mark D. Plumbley

In this work we present an adaptive Newton-type method to solve nonlinear constrained optimization problems in which the constraint is a system of partial differential equations discretized by the finite element method. The adaptive…

最优化与控制 · 数学 2017-06-05 Thomas Carraro , Simon Dörsam , Stefan Frei , Daniel Schwarz

Matrix recovery from sparse observations is an extensively studied topic emerging in various applications, such as recommendation system and signal processing, which includes the matrix completion and compressed sensing models as special…

统计方法学 · 统计学 2026-04-13 Ziyuan Chen , Ying Yang , Fang Yao

Compressed sensing aims at reconstructing sparse signals from significantly reduced number of samples, and a popular reconstruction approach is $\ell_1$-norm minimization. In this correspondence, a method called orthonormal expansion is…

信息论 · 计算机科学 2015-05-30 Zai Yang , Cishen Zhang , Jun Deng , Wenmiao Lu

Screening and working set techniques are important approaches to reducing the size of an optimization problem. They have been widely used in accelerating first-order methods for solving large-scale sparse learning problems. In this paper,…

机器学习 · 统计学 2023-04-24 Jian Huang , Yuling Jiao , Lican Kang , Jin Liu , Yanyan Liu , Xiliang Lu , Yuanyuan Yang

Matrix scaling problems with sparse cost matrices arise frequently in various domains, such as optimal transport, image processing, and machine learning. The Sinkhorn-Knopp algorithm is a popular iterative method for solving these problems,…

最优化与控制 · 数学 2024-06-26 Jose Rafael Espinosa Mena

We consider the problem of minimizing a sum of $n$ functions over a convex parameter set $\mathcal{C} \subset \mathbb{R}^p$ where $n\gg p\gg 1$. In this regime, algorithms which utilize sub-sampling techniques are known to be effective. In…

机器学习 · 统计学 2015-12-03 Murat A. Erdogdu , Andrea Montanari

We study the support recovery problem for compressed sensing, where the goal is to reconstruct the a high-dimensional $K$-sparse signal $\mathbf{x}\in\mathbb{R}^N$, from low-dimensional linear measurements with and without noise. Our key…

信息论 · 计算机科学 2018-02-27 Xiao Li , Dong Yin , Sameer Pawar , Ramtin Pedarsani , Kannan Ramchandran

We propose a probabilistic framework for interpreting and developing hard thresholding sparse signal reconstruction methods and present several new algorithms based on this framework. The measurements follow an underdetermined linear model,…

信息论 · 计算机科学 2010-11-08 Kun Qiu , Aleksandar Dogandzic

The problem of computing the Fourier Transform of a signal whose spectrum is dominated by a small number $k$ of frequencies quickly and using a small number of samples of the signal in time domain (the Sparse FFT problem) has received…

数据结构与算法 · 计算机科学 2017-08-18 Michael Kapralov

Support recovery of sparse signals from compressed linear measurements is a fundamental problem in compressed sensing (CS). In this paper, we study the orthogonal matching pursuit (OMP) algorithm for the recovery of support under noise. We…

信息论 · 计算机科学 2015-10-28 Jian Wang

Motivated by the well-known Papoulis-Gerchberg algorithm, an iterative thresholding algorithm for recovery of sparse signals from few observations is proposed. The sequence of iterates turns out to be similar to that of the thresholded…

信息论 · 计算机科学 2009-02-13 M. H. Kayvanrad , D. Zonoobi , A. A. Kassim