English
Related papers

Related papers: A General Framework for the Design and Analysis of…

200 papers

Sparsity-constrained optimization is an important and challenging problem that has wide applicability in data mining, machine learning, and statistics. In this paper, we focus on sparsity-constrained optimization in cases where the cost…

Machine Learning · Computer Science 2016-12-19 Feng Chen , Baojian Zhou

Federated learning (FL) enables edge devices to collaboratively learn a model in a distributed fashion. Many existing researches have focused on improving communication efficiency of high-dimensional models and addressing bias caused by…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-06 Yuzhu Mao , Zihao Zhao , Meilin Yang , Le Liang , Yang Liu , Wenbo Ding , Tian Lan , Xiao-Ping Zhang

We propose an algebraic framework for studying efficient algorithms for query evaluation, aggregation, enumeration, and maintenance under updates, on sparse databases. Our framework allows to treat those problems in a unified way, by…

Logic in Computer Science · Computer Science 2020-01-01 Szymon Toruńczyk

Finding the sparset solution of an underdetermined system of linear equations $y=Ax$ has attracted considerable attention in recent years. Among a large number of algorithms, iterative thresholding algorithms are recognized as one of the…

Information Theory · Computer Science 2013-10-16 Jinshan Zeng , Shaobo Lin , Zongben Xu

Identifying the start time of a sequence of symbols received at the receiver, commonly referred to as \emph{frame synchronization}, is a critical task for achieving good performance in digital communications systems employing…

Signal Processing · Electrical Eng. & Systems 2020-07-14 Oren Kolaman , Ron Dabora

Signal processing is rich in inherently continuous and often nonlinear applications, such as spectral estimation, optical imaging, and super-resolution microscopy, in which sparsity plays a key role in obtaining state-of-the-art results.…

Machine Learning · Computer Science 2020-03-23 Luiz F. O. Chamon , Yonina C. Eldar , Alejandro Ribeiro

Linear detectors such as zero forcing (ZF) or minimum mean square error (MMSE) are imperative for large/massive MIMO systems for both the downlink and uplink scenarios. However these linear detectors require matrix inversion which is…

Information Theory · Computer Science 2016-11-15 Vipul Gupta , Abhay Kumar Sah , A. K. Chaturvedi

Many regression and classification procedures fit a parameterized function $f(x;w)$ of predictor variables $x$ to data $\{x_{i},y_{i}\}_1^N$ based on some loss criterion $L(y,f)$. Often, regularization is applied to improve accuracy by…

Machine Learning · Computer Science 2021-07-16 Gilmer Valdes , Wilmer Arbelo , Yannet Interian , Jerome H. Friedman

The maximum absolute correlation between regressors, which is called mutual coherence, plays an essential role in sparse estimation. A regressor matrix whose columns are highly correlated may result from optimal input design, since there is…

Systems and Control · Electrical Eng. & Systems 2024-10-11 Javad Parsa , Cristian R. Rojas , Håkan Hjalmarsson

Deep stereo matching has made significant progress in recent years. However, state-of-the-art methods are based on expensive 4D cost volume, which limits their use in real-world applications. To address this issue, 3D correlation maps and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Xiaoming Zhao , Weihai Chen , Xingming Wu , Peter C. Y. Chen , Zhengguo Li

We develop a Recursive $\mathcal{L}_1$-Regularized Least Squares (SPARLS) algorithm for the estimation of a sparse tap-weight vector in the adaptive filtering setting. The SPARLS algorithm exploits noisy observations of the tap-weight…

Information Theory · Computer Science 2009-01-08 Behtash Babadi , Nicholas Kalouptsidis , Vahid Tarokh

Sparse tensors are rapidly becoming critical components of modern deep learning workloads. However, developing high-performance sparse operators can be difficult and tedious, and existing vendor libraries cannot satisfy the escalating…

Machine Learning · Computer Science 2023-02-22 Zihao Ye , Ruihang Lai , Junru Shao , Tianqi Chen , Luis Ceze

In this paper we aim to apply an adaptation of the recently developed technique of sparse identification of nonlinear dynamical systems on a Duffing experimental setup with cubic feedback of the output. The Duffing oscillator described by…

Classical Physics · Physics 2018-05-10 Saeideh Khatiry Goharoodi , Kevin Dekemele , Luc Dupre , Mia Loccufier , Guillaume Crevecoeur

Sparse linear regression is the well-studied inference problem where one is given a design matrix $\mathbf{A} \in \mathbb{R}^{M\times N}$ and a response vector $\mathbf{b} \in \mathbb{R}^M$, and the goal is to find a solution $\mathbf{x}…

Machine Learning · Computer Science 2022-02-17 Aparna Gupte , Vinod Vaikuntanathan

Graph signal processing (GSP) provides a powerful framework for analyzing signals arising in a variety of domains. In many applications of GSP, multiple network structures are available, each of which captures different aspects of the same…

Machine Learning · Statistics 2021-11-03 Michael Weylandt , George Michailidis , T. Mitchell Roddenberry

When Fourier series are employed to solve partial differential equations, low-pass filters can be used to regularize divergent series that may appear. In this paper we show that the linear low-pass filters defined in a previous paper can be…

Complex Variables · Mathematics 2015-03-25 Jorge L. deLyra

Nonlinear adaptive filters often show some sparse behavior due to the fact that not all the coefficients are equally useful for the modeling of any nonlinearity. Recently, a class of proportionate algorithms has been proposed for nonlinear…

Signal Processing · Electrical Eng. & Systems 2022-12-16 Danilo Comminiello , Michele Scarpiniti , Simone Scardapane , Luis A. Azpicueta-Ruiz , Aurelio Uncini

In the transmission of digital data at a relatively high rate over a particular band limited channel, it is normally necessary to employ an equalizer at the receiver in order to correct the signal distortion introduced by the channel .ISI…

Information Theory · Computer Science 2014-03-18 Laith Awda Kadhim , Salih Mohammed , Osamah Saad

We consider the problem of reconstructing an infinite set of sparse, finite-dimensional vectors, that share a common sparsity pattern, from incomplete measurements. This is in contrast to the work [17], where the single vector signal can be…

Optimization and Control · Mathematics 2021-11-29 Nick Dexter , Hoang Tran , Clayton Webster

In this paper, we propose a successive convex approximation framework for sparse optimization where the nonsmooth regularization function in the objective function is nonconvex and it can be written as the difference of two convex…

Machine Learning · Computer Science 2018-10-26 Yang Yang , Marius Pesavento , Symeon Chatzinotas , Björn Ottersten