English
Related papers

Related papers: Iterative Sparse Asymptotic Minimum Variance Based…

200 papers

We derive fundamental sample complexity bounds for recovering sparse and structured signals for linear and nonlinear observation models including sparse regression, group testing, multivariate regression and problems with missing features.…

Information Theory · Computer Science 2017-02-17 Cem Aksoylar , George Atia , Venkatesh Saligrama

In this paper, we investigate power-constrained sensing matrix design in a sparse Gaussian linear dimensionality reduction framework. Our study is carried out in a single--terminal setup as well as in a multi--terminal setup consisting of…

Information Theory · Computer Science 2015-10-28 Amirpasha Shirazinia , Subhrakanti Dey

Sharpness-Aware Minimization (SAM) is a recent optimization framework aiming to improve the deep neural network generalization, through obtaining flatter (i.e. less sharp) solutions. As SAM has been numerically successful, recent papers…

Machine Learning · Statistics 2023-05-22 Kayhan Behdin , Rahul Mazumder

The training of deep neural networks is inherently a nonconvex optimization problem, yet standard approaches such as stochastic gradient descent (SGD) require simultaneous updates to all parameters, often leading to unstable convergence and…

Machine Learning · Computer Science 2025-08-07 Chengcheng Yan , Jiawei Xu , Zheng Peng , Qingsong Wang

We consider minimizing $f(x) = \mathbb{E}[f(x,\omega)]$ when $f(x,\omega)$ is possibly nonsmooth and either strongly convex or convex in $x$. (I) Strongly convex. When $f(x,\omega)$ is $\mu-$strongly convex in $x$, we propose a variable…

Optimization and Control · Mathematics 2022-10-10 Afrooz Jalilzadeh , Uday V. Shanbhag , Jose H. Blanchet , Peter W. Glynn

Approximate Message Passing (AMP) has been shown to be a superior method for inference problems, such as the recovery of signals from sets of noisy, lower-dimensionality measurements, both in terms of reconstruction accuracy and in…

Information Theory · Computer Science 2015-06-10 Andre Manoel , Florent Krzakala , Eric W. Tramel , Lenka Zdeborová

We consider a single stage stochastic program without recourse with a strictly convex loss function. We assume a compact decision space and grid it with a finite set of points. In addition, we assume that the decision maker can generate…

Computation · Statistics 2018-11-20 Prateek Jaiswal , Harsha Honnappa , Raghu Pasupathy

Mathematical modelling, particularly through approaches such as structured sparse support vector machines (SS-SVM), plays a crucial role in processing data with complex feature structures, yet efficient algorithms for distributed…

Machine Learning · Computer Science 2026-01-13 Rongmei Liang , Zizheng Liu , Xiaofei Wu , Jingwen Tu

Blind calibration of sensors arrays (without using calibration signals) is an important, yet challenging problem in array processing. While many methods have been proposed for "classical" array structures, such as uniform linear arrays, not…

Signal Processing · Electrical Eng. & Systems 2020-10-29 Amir Weiss , Arie Yeredor

Approximate message passing (AMP) algorithms are devised under the Gaussianity assumption of the measurement noise vector. In this work, we relax this assumption within the vector AMP (VAMP) framework to arbitrary independent and…

Information Theory · Computer Science 2024-02-07 Mohamed Akrout , Tiancheng Gao , Faouzi Bellili , Amine Mezghani

This paper is concerned with estimating unknown multi-dimensional frequencies from linear compressive measurements. This is accomplished by employing the recently proposed atomic norm minimization framework to recover these frequencies…

Signal Processing · Electrical Eng. & Systems 2018-11-07 Sebastian Semper , Florian Römer

Sparse signal recoveries from multiple measurement vectors (MMV) with joint sparsity property have many applications in signal, image, and video processing. The problem becomes much more involved when snapshots of the signal matrix are…

Information Theory · Computer Science 2021-01-25 Ningning Han , Shidong Li , Jian Lu

Purpose: To propose an alternating learning approach to learn the sampling pattern (SP) and the parameters of variational networks (VN) in accelerated parallel magnetic resonance imaging (MRI). Methods: The approach alternates between…

Image and Video Processing · Electrical Eng. & Systems 2021-10-29 Marcelo V. W. Zibetti , Florian Knoll , Ravinder R. Regatte

This paper presents a novel method for estimating the direction of arrival (DOA) for a non-uniform and sparse linear sensor array using the weighted lifted structure low-rank matrix completion. The proposed method uses a single snapshot…

Signal Processing · Electrical Eng. & Systems 2025-07-29 Saeed Razavikia , Mohammad Bokaei , Arash Amini , Stefano Rini , Carlo Fischione

We introduce a novel Bayesian framework for estimating time-varying volatility by extending the Random Walk Stochastic Volatility (RWSV) model with Dynamic Shrinkage Processes (DSP) in log-variances. Unlike the classical Stochastic…

Methodology · Statistics 2025-12-25 Jason B. Cho , David S. Matteson

Single-snapshot direction-of-arrival (DOA) estimation using sparse linear arrays (SLAs) has gained significant attention in the field of automotive MIMO radars. This is due to the dynamic nature of automotive settings, where multiple…

Signal Processing · Electrical Eng. & Systems 2023-09-18 Yunqiao Hu , Shunqiao Sun

Many information systems employ lossy compression as a crucial intermediate stage among other processing components. While the important distortion is defined by the system's input and output signals, the compression usually ignores the…

Information Theory · Computer Science 2018-05-14 Yehuda Dar , Michael Elad , Alfred M. Bruckstein

This paper considers efficient sampling of simultaneously sparse and correlated (S$\&$C) signals. Such signals arise in various applications in array processing. We propose an implementable sampling architecture for the acquisition of…

Information Theory · Computer Science 2023-01-19 Ali Ahmed , Fahad Shamshad , Humera Hameed

With the large rising of complex data, the nonconvex models such as nonconvex loss function and nonconvex regularizer are widely used in machine learning and pattern recognition. In this paper, we propose a class of mini-batch stochastic…

Optimization and Control · Mathematics 2019-06-26 Feihu Huang , Songcan Chen

Recently, diffusion models (DMs) have been increasingly used in audio processing tasks, including speech super-resolution (SR), which aims to restore high-frequency content given low-resolution speech utterances. This is commonly achieved…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-22 Chin-Yun Yu , Sung-Lin Yeh , György Fazekas , Hao Tang