English
Related papers

Related papers: Towards Discrete Solution: A Sparse Preserving Met…

200 papers

In this work, we formulate the fixed-length distribution matching as a Bayesian inference problem. Our proposed solution is inspired from the compressed sensing paradigm and the sparse superposition (SS) codes. First, we introduce sparsity…

Information Theory · Computer Science 2018-11-27 Mohamad Dia , Vahid Aref , Laurent Schmalen

We study the exactness of the semidefinite programming (SDP) relaxation of quadratically constrained quadratic programs (QCQPs). With the aggregate sparsity matrix from the data matrices of a QCQP with $n$ variables, the rank and positive…

Optimization and Control · Mathematics 2020-09-22 Godai Azuma , Mituhiro Fukuda , Sunyoung Kim , Makoto Yamashita

Exact recovery of a sparse solution for an underdetermined system of linear equations implies full search among all possible subsets of the dictionary, which is computationally intractable, while l1 minimization will do the job when a…

Information Theory · Computer Science 2014-12-22 Mohsen Joneidi , Mahdi Barzegar Khalilsarai , Alireza Zaeemzadeh , Nazanin Rahnavard

The joint sparse recovery problem is a generalization of the single measurement vector problem which is widely studied in Compressed Sensing and it aims to recovery a set of jointly sparse vectors. i.e. have nonzero entries concentrated at…

Information Theory · Computer Science 2017-01-10 Changlong Wang , Jigen Peng

Large Language Models (LLMs) have demonstrated remarkable proficiency in language comprehension and generation; however, their widespread adoption is constrained by substantial bandwidth and computational demands. While pruning and low-rank…

Computation and Language · Computer Science 2025-10-31 Zeliang Zong , Kai Zhang , Zheyang Li , Wenming Tan , Ye Ren , Yiyan Zhai , Jilin Hu

In compressed sensing, the l0-norm minimization of sparse signal reconstruction is NP-hard. Recent work shows that compared with the best convex relaxation (l1-norm), nonconvex penalties can better approximate the l0-norm and can…

Signal Processing · Electrical Eng. & Systems 2018-05-03 Hao Wang , Zhanglei Shi , Chi-Sing Leung , Hing Cheung So

In this manuscript, we analyze the sparse signal recovery (compressive sensing) problem from the perspective of convex optimization by stochastic proximal gradient descent. This view allows us to significantly simplify the recovery analysis…

Data Structures and Algorithms · Computer Science 2013-04-19 Rong Jin , Tianbao Yang , Shenghuo Zhu

Total variation (TV) regularization has proven effective for a range of computer vision tasks through its preferential weighting of sharp image edges. Existing TV-based methods, however, often suffer from the over-smoothing issue and…

Computer Vision and Pattern Recognition · Computer Science 2018-12-26 Dong Gong , Mingkui Tan , Qinfeng Shi , Anton van den Hengel , Yanning Zhang

In this paper we combine an infeasible Interior Point Method (IPM) with the Proximal Method of Multipliers (PMM). The resulting algorithm (IP-PMM) is interpreted as a primal-dual regularized IPM, suitable for solving linearly constrained…

Optimization and Control · Mathematics 2021-02-01 Spyridon Pougkakiotis , Jacek Gondzio

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

Machine Learning · Computer Science 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

We consider a linear inverse problem whose solution is expressed as a sum of two components: one smooth and the other sparse. This problem is addressed by minimizing an objective function with a least squares data-fidelity term and a…

Signal Processing · Electrical Eng. & Systems 2024-06-18 Adrian Jarret , Valérie Costa , Julien Fageot

Online sparse linear regression is an online problem where an algorithm repeatedly chooses a subset of coordinates to observe in an adversarially chosen feature vector, makes a real-valued prediction, receives the true label, and incurs the…

Machine Learning · Computer Science 2020-07-27 Satyen Kale , Zohar Karnin , Tengyuan Liang , Dávid Pál

Computing maximum a posteriori (MAP) estimation in graphical models is an important inference problem with many applications. We present message-passing algorithms for quadratic programming (QP) formulations of MAP estimation for pairwise…

Artificial Intelligence · Computer Science 2012-02-20 Akshat Kumar , Shlomo Zilberstein

Spreading the information over all coefficients of a representation is a desirable property in many applications such as digital communication or machine learning. This so-called antisparse representation can be obtained by solving a convex…

Machine Learning · Computer Science 2020-07-15 Clément Elvira , Cédric Herzet

Spatial Pyramid Matching (SPM) and its variants have achieved a lot of success in image classification. The main difference among them is their encoding schemes. For example, ScSPM incorporates Sparse Code (SC) instead of Vector…

Computer Vision and Pattern Recognition · Computer Science 2016-03-22 Xi Peng , Rui Yan , Bo Zhao , Huajin Tang , Zhang Yi

Accurate and stable feature matching is critical for computer vision tasks, particularly in applications such as Simultaneous Localization and Mapping (SLAM). While recent learning-based feature matching methods have demonstrated promising…

Robotics · Computer Science 2025-04-08 Yuqing Wang , Yan Wang , Hailiang Tang , Xiaoji Niu

The Matching Augmentation Problem (MAP) has recently received significant attention as an important step towards better approximation algorithms for finding cheap $2$-edge connected subgraphs. This has culminated in a…

Data Structures and Algorithms · Computer Science 2022-08-25 Etienne Bamas , Marina Drygala , Ola Svensson

An image super-resolution method from multiple observation of low-resolution images is proposed. The method is based on sub-pixel accuracy block matching for estimating relative displacements of observed images, and sparse signal…

Computer Vision and Pattern Recognition · Computer Science 2014-02-18 Toshiyuki Kato , Hideitsu Hino , Noboru Murata

The sparse representation of signals defined on Euclidean domains has been successfully applied in signal processing. Bringing the power of sparse representations to non-regular domains is still a challenge, but promising approaches have…

Computational Geometry · Computer Science 2020-11-26 Lizeth J. Fuentes Perez , Luciano A. Romero Calla , Anselmo A. Montenegro , Claudio Mura , Renato Pajarola

In this paper, a sparse-based method for the estimation of the parameters of multidimensional ($R$-D) modal (harmonic or damped) complex signals in noise is presented. The problem is formulated as $R$ simultaneous sparse approximations of…

Information Theory · Computer Science 2015-11-02 Souleymen Sahnoun , El-Hadi Djermoune , David Brie , Pierre Comon