English
Related papers

Related papers: Total Variation Sparse Bayesian Learning for Block…

200 papers

Deep neural networks often suffer from poor generalization caused by complex and non-convex loss landscapes. One of the popular solutions is Sharpness-Aware Minimization (SAM), which smooths the loss landscape via minimizing the maximized…

Machine Learning · Computer Science 2022-10-25 Peng Mi , Li Shen , Tianhe Ren , Yiyi Zhou , Xiaoshuai Sun , Rongrong Ji , Dacheng Tao

Despite the popularity and practical success of total variation (TV) regularization for function estimation, surprisingly little is known about its theoretical performance in a statistical setting. While TV regularization has been known for…

Statistics Theory · Mathematics 2026-05-08 Miguel del Álamo , Housen Li , Axel Munk

In this paper, we consider the recovery of the high-dimensional block-sparse signal from a compressed set of measurements, where the non-zero coefficients of the recovered signal occur in a small number of blocks. Adopting the idea of deep…

Signal Processing · Electrical Eng. & Systems 2021-11-19 Rong Fu , Vincent Monardo , Tianyao Huang , Yimin Liu

We present a method for supervised learning of sparsity-promoting regularizers for denoising signals and images. Sparsity-promoting regularization is a key ingredient in solving modern signal reconstruction problems; however, the operators…

Machine Learning · Computer Science 2023-09-07 Avrajit Ghosh , Michael T. McCann , Madeline Mitchell , Saiprasad Ravishankar

Dynamic network reconstruction has been shown to be challenging due to the requirements on sparse network structures and network identifiability. The direct parametric method (e.g., using ARX models) requires a large amount of parameters in…

Systems and Control · Computer Science 2018-11-22 Zuogong Yue , Johan Thunberg , Lennart Ljung , Jorge Goncalves

This work deals with directional of arrival (DOA) estimation with a large antenna array. We first develop a novel signal model with a sparse system transfer matrix using an inverse discrete Fourier transform (DFT) operation, which leads to…

Signal Processing · Electrical Eng. & Systems 2023-09-04 Yiwen Mao , Dawei Gao , Qinghua Guo , Ming Jin

Deep neural networks have emerged as powerful tools for learning operators defined over infinite-dimensional function spaces. However, existing theories frequently encounter difficulties related to dimensionality and limited…

Machine Learning · Computer Science 2026-05-12 Jianfei Li , Shuo Huang , Han Feng , Ding-Xuan Zhou , Gitta Kutyniok

Orthogonal delay-Doppler division multiplexing (ODDM) is a promising modulation technique for reliable communications in high-mobility scenarios. However, the existing channel estimation frameworks for ODDM systems cannot achieve both high…

Econometrics · Economics 2026-02-10 Jiasong Han , Xuehan Wang , Jingbo Tan , Jintao Wang , Yu Zhang , Hai Lin , Jinhong Yuan

Two complementary approaches have been extensively used in signal and image processing leading to novel results, the sparse representation methodology and the variational strategy. Recently, a new sparsity based model has been proposed, the…

Computer Vision and Pattern Recognition · Computer Science 2015-08-17 Raja Giryes , Michael Elad , Alfred M. Bruckstein

Sparsification of neural networks is one of the effective complexity reduction methods to improve efficiency and generalizability. We consider the problem of learning a one hidden layer convolutional neural network with ReLU activation…

Optimization and Control · Mathematics 2020-02-26 Thu Dinh , Jack Xin

Total Variation (TV) is an effective and popular prior model in the field of regularization-based image processing. This paper focuses on total variation for removing impulse noise in image restoration. This type of noise frequently arises…

Numerical Analysis · Computer Science 2018-12-31 Ganzhao Yuan , Bernard Ghanem

Recently, a number of mostly $\ell_1$-norm regularized least squares type deterministic algorithms have been proposed to address the problem of \emph{sparse} adaptive signal estimation and system identification. From a Bayesian perspective,…

We propose a new superresolution imaging technique for interferometry using sparse modeling, utilizing two regularization terms: the $\ell_1$-norm and a new function named Total Squared Variation (TSV) of the brightness distribution. TSV is…

Instrumentation and Methods for Astrophysics · Physics 2018-06-06 Kazuki Kuramochi , Kazunori Akiyama , Shiro Ikeda , Fumie Tazaki , Vincent L. Fish , Hung-Yi Pu , Keiichi Asada , Mareki Honma

In the past decade, sparsity-driven regularization has led to significant improvements in image reconstruction. Traditional regularizers, such as total variation (TV), rely on analytical models of sparsity. However, increasingly the field…

Computer Vision and Pattern Recognition · Computer Science 2018-10-31 Jiaming Liu , Yu Sun , Xiaojian Xu , Ulugbek S. Kamilov

It is now well understood that (1) it is possible to reconstruct sparse signals exactly from what appear to be highly incomplete sets of linear measurements and (2) that this can be done by constrained L1 minimization. In this paper, we…

Methodology · Statistics 2007-11-13 Emmanuel J. Candes , Michael B. Wakin , Stephen P. Boyd

Compressed sensing (CS) techniques demand significant storage and computational resources, when recovering high-dimensional sparse signals. Block CS (BCS), a special class of CS, addresses both the storage and complexity issues by…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Aron Bevelander , Kim Batselier , Nitin Jonathan Myers

This work considers the use of Total variation (TV) minimization in the recovery of a given gradient sparse vector from Gaussian linear measurements. It has been shown in recent studies that there exist a sharp phase transition behavior in…

Information Theory · Computer Science 2019-02-11 Sajad Daei , Farzan Haddadi , Arash Amini

The task of finding a sparse signal decomposition in an overcomplete dictionary is made more complicated when the signal undergoes an unknown modulation (or convolution in the complementary Fourier domain). Such simultaneous sparse recovery…

Information Theory · Computer Science 2019-10-02 Youye Xie , Michael B. Wakin , Gongguo Tang

Although block compressive sensing (BCS) makes it tractable to sense large-sized images and video, its recovery performance has yet to be significantly improved because its recovered images or video usually suffer from blurred edges, loss…

Computer Vision and Pattern Recognition · Computer Science 2017-03-16 Trinh Van Chien , Khanh Quoc Dinh , Byeungwoo Jeon , Martin Burger

Learning the "blocking" structure is a central challenge for high dimensional data (e.g., gene expression data). Recently, a sparse singular value decomposition (SVD) has been used as a biclustering tool to achieve this goal. However, this…

Machine Learning · Computer Science 2016-03-22 Wenwen Min , Juan Liu , Shihua Zhang