English
Related papers

Related papers: A Robust Deep Unfolded Network for Sparse Signal R…

200 papers

Deep unfolding network (DUN) that unfolds the optimization algorithm into a deep neural network has achieved great success in compressive sensing (CS) due to its good interpretability and high performance. Each stage in DUN corresponds to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Jiechong Song , Bin Chen , Jian Zhang

Despite the considerable success of neural networks in security settings such as malware detection, such models have proved vulnerable to evasion attacks, in which attackers make slight changes to inputs (e.g., malware) to bypass detection.…

Machine Learning · Computer Science 2021-06-09 Netanel Raviv , Aidan Kelley , Michael Guo , Yevgeny Vorobeychik

In this paper, we propose a neural-based coding scheme in which an artificial neural network is exploited to automatically compress and decompress speech signals by a trainable approach. Having a two-stage training phase, the system can be…

Sound · Computer Science 2016-01-25 Mahmood Yousefi-Azar , Farbod Razzazi

We address the problem of reconstructing sparse signals from noisy and compressive measurements using a feed-forward deep neural network (DNN) with an architecture motivated by the iterative shrinkage-thresholding algorithm (ISTA). We…

Machine Learning · Computer Science 2017-05-23 Debabrata Mahapatra , Subhadip Mukherjee , Chandra Sekhar Seelamantula

In this paper, we consider the efficient and robust reconstruction of signals and images via $\ell_{1}-\alpha \ell_{2}~(0<\alpha\leq 1)$ minimization in impulsive noise case. To achieve this goal, we introduce two new models: the…

Optimization and Control · Mathematics 2018-10-15 Peng Li , Huanmin Ge , Wengu Chen

In this effort, we propose a new deep architecture utilizing residual blocks inspired by implicit discretization schemes. As opposed to the standard feed-forward networks, the outputs of the proposed implicit residual blocks are defined as…

Machine Learning · Computer Science 2021-02-23 Viktor Reshniak , Clayton Webster

In this paper we look at a well known linear inverse problem that is one of the mathematical cornerstones of the compressed sensing field. In seminal works \cite{CRT,DOnoho06CS} $\ell_1$ optimization and its success when used for recovering…

Information Theory · Computer Science 2015-07-17 Mihailo Stojnic

In this work, we propose an effective scheme (called DP-Net) for compressing the deep neural networks (DNNs). It includes a novel dynamic programming (DP) based algorithm to obtain the optimal solution of weight quantization and an…

Machine Learning · Computer Science 2020-03-24 Dingcheng Yang , Wenjian Yu , Ao Zhou , Haoyuan Mu , Gary Yao , Xiaoyi Wang

The compression of deep neural networks (DNNs) to reduce inference cost becomes increasingly important to meet realistic deployment requirements of various applications. There have been a significant amount of work regarding network…

Machine Learning · Computer Science 2020-11-12 Tianyi Chen , Bo Ji , Yixin Shi , Tianyu Ding , Biyi Fang , Sheng Yi , Xiao Tu

In many professional fields, such as medicine, remote sensing and sciences, users often demand image compression methods to be mathematically lossless. But lossless image coding has a rather low compression ratio (around 2:1 for natural…

Image and Video Processing · Electrical Eng. & Systems 2020-02-11 Xi Zhang , Xiaolin Wu

In this paper, we propose a new deep unfolding neural network based on the ADMM algorithm for analysis Compressed Sensing. The proposed network jointly learns a redundant analysis operator for sparsification and reconstructs the signal of…

Information Theory · Computer Science 2022-05-03 Vasiliki Kouni , Georgios Paraskevopoulos , Holger Rauhut , George C. Alexandropoulos

Traditional fault diagnosis methods struggle to handle fault data, with complex data characteristics such as high dimensions and large noise. Deep learning is a promising solution, which typically works well only when labeled fault data are…

Machine Learning · Computer Science 2025-03-13 Dandan Zhao , Hongpeng Yin , Jintang Bian , Han Zhou

Deep neural networks are among the most widely applied machine learning tools showing outstanding performance in a broad range of tasks. We present a method for folding a deep neural network of arbitrary size into a single neuron with…

Machine Learning · Computer Science 2021-09-15 Florian Stelzer , André Röhm , Raul Vicente , Ingo Fischer , Serhiy Yanchuk

Recent advancements in deep learning-based image compression are notable. However, prevalent schemes that employ a serial context-adaptive entropy model to enhance rate-distortion (R-D) performance are markedly slow. Furthermore, the…

Applications · Statistics 2024-03-25 Haisheng Fu , Feng Liang , Jie Liang , Zhenman Fang , Guohe Zhang , Jingning Han

Deep neural networks (DNNs) are so over-parametrized that recent research has found them to already contain a subnetwork with high accuracy at their randomly initialized state. Finding these subnetworks is a viable alternative training…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Ángel López García-Arias , Masanori Hashimoto , Masato Motomura , Jaehoon Yu

This paper introduces Laplace techniques for designing a neural network, with the goal of estimating simplex-constraint sparse vectors from compressed measurements. To this end, we recast the problem of MMSE estimation (w.r.t. a pre-defined…

Information Theory · Computer Science 2017-09-28 Steffen Limmer , Slawomir Stanczak

Performance of trained neural network (NN) models, in terms of testing accuracy, has improved remarkably over the past several years, especially with the advent of deep learning. However, even the most accurate NNs can be biased toward a…

Machine Learning · Computer Science 2023-03-14 Mahum Naseer , Bharath Srinivas Prabakaran , Osman Hasan , Muhammad Shafique

Neural networks often require large amounts of data to generalize and can be ill-suited for modeling small and noisy experimental datasets. Standard network architectures trained on scarce and noisy data will return predictions that violate…

Machine Learning · Computer Science 2021-05-20 Gregory Barber , Mulugeta A. Haile , Tzikang Chen

Networks are widely used in many fields for their powerful ability to provide vivid representations of relationships between variables. However, many of them may be corrupted by experimental noise or inappropriate network inference methods…

Molecular Networks · Quantitative Biology 2021-09-21 Jiating Yu , Jiacheng Leng , Ling-Yun Wu

Low-rank and sparse decomposition based methods find their use in many applications involving background modeling such as clutter suppression and object tracking. While Robust Principal Component Analysis (RPCA) has achieved great success…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Shoaib Imran , Muhammad Tahir , Zubair Khalid , Momin Uppal