English
Related papers

Related papers: Deep Sparse Coding Using Optimized Linear Expansio…

200 papers

In many practical applications such as direction-of-arrival (DOA) estimation and line spectral estimation, the sparsifying dictionary is usually characterized by a set of unknown parameters in a continuous domain. To apply the conventional…

Information Theory · Computer Science 2015-06-18 Jun Fang , Jing Li , Yanning Shen , Hongbin Li , Shaoqian Li

Recently, the paradigm of unfolding iterative algorithms into finite-length feed-forward neural networks has achieved a great success in the area of sparse recovery. Benefit from available training data, the learned networks have achieved…

Machine Learning · Computer Science 2019-10-14 Yulun Jiang , Lei Yu , Haijian Zhang , Zhou Liu

While deep neural networks have achieved impressive success in image compressive sensing (CS), most of them lack flexibility when dealing with multi-ratio tasks and multi-scene images in practical applications. To tackle these challenges,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Di You , Jingfen Xie , Jian Zhang

Magnetic resonance imaging has been widely applied in clinical diagnosis, however, is limited by its long data acquisition time. Although imaging can be accelerated by sparse sampling and parallel imaging, achieving promising reconstruction…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 Tieyuan Lu , Xinlin Zhang , Yihui Huang , Yonggui Yang , Gang Guo , Lijun Bao , Feng Huang , Di Guo , Xiaobo Qu

Single-pixel imaging (SPI) is a promising imaging modality with distinctive advantages in strongly perturbed environments. Existing SPI methods lack physical sparsity constraints and overlook the integration of local and global features,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Jijun Lu , Yifan Chen , Libang Chen , Yiqiang Zhou , Ye Zheng , Mingliang Chen , Zhe Sun , Xuelong Li

This paper introduces a method based on a deep neural network (DNN) that is perfectly capable of processing radar data from extremely thinned radar apertures. The proposed DNN processing can provide both aliasing-free radar imaging and…

Signal Processing · Electrical Eng. & Systems 2023-07-12 Christian Schuessler , Marcel Hoffmann , Martin Vossiek

Deep neural networks (DNNs) have been proven to be effective in solving many real-life problems, but its high computation cost prohibits those models from being deployed to edge devices. Pruning, as a method to introduce zeros to model…

Machine Learning · Computer Science 2021-12-22 Fei Sun , Minghai Qin , Tianyun Zhang , Xiaolong Ma , Haoran Li , Junwen Luo , Zihao Zhao , Yen-Kuang Chen , Yuan Xie

Identifying the structural priors that enable Deep Neural Networks (DNNs) to overcome the curse of dimensionality is a fundamental challenge in machine learning theory. Existing literature suggests that effective high-dimensional learning…

Machine Learning · Computer Science 2026-05-15 Hongyu Lin , Antonio Briola , Yuanrong Wang , Tomaso Aste

Dynamic Metasurface Antenna (DMA) is a cutting-edge antenna technology offering scalable and sustainable solutions for large antenna arrays. The effectiveness of DMAs stems from their inherent configurable analog signal processing…

Information Theory · Computer Science 2023-11-15 Xiangyu Zhang , Haiyang Zhang , Luxi Yang , Yonina C. Eldar

That neural networks may be pruned to high sparsities and retain high accuracy is well established. Recent research efforts focus on pruning immediately after initialization so as to allow the computational savings afforded by sparsity to…

Machine Learning · Computer Science 2022-01-28 Ilan Price , Jared Tanner

Insect flight is a strongly nonlinear and actuated dynamical system. As such, strategies for understanding its control have typically relied on either model-based methods or linearizations thereof. Here we develop a framework that combines…

Quantitative Methods · Quantitative Biology 2023-01-11 Olivia Zahn , Jorge Bustamante , Callin Switzer , Thomas Daniel , J. Nathan Kutz

In this paper, we propose a new deep unfolding neural network based on the ADMM algorithm for analysis Compressed Sensing. The proposed network jointly learns a redundant analysis operator for sparsification and reconstructs the signal of…

Information Theory · Computer Science 2022-05-03 Vasiliki Kouni , Georgios Paraskevopoulos , Holger Rauhut , George C. Alexandropoulos

Convolutional neural networks (CNNs) are emerging as powerful tools for visual recognition. Recent architecture proposals for sparse CNNs exploit zeros in the feature maps and filters for performance and energy without losing accuracy.…

Hardware Architecture · Computer Science 2021-05-11 Ashish Gondimalla , Sree Charan Gundabolu , T. N. Vijaykumar , Mithuna Thottethodi

We use a quantum annealing D-Wave 2X computer to obtain solutions to NP-hard sparse coding problems. To reduce the dimensionality of the sparse coding problem to fit on the quantum D-Wave 2X hardware, we passed downsampled MNIST images…

Quantum Physics · Physics 2019-05-31 Nga T. T. Nguyen , Garrett T. Kenyon

Modern deep neural networks are typically highly overparameterized. Pruning techniques are able to remove a significant fraction of network parameters with little loss in accuracy. Recently, techniques based on dynamic reallocation of…

Machine Learning · Computer Science 2019-05-14 Hesham Mostafa , Xin Wang

The non-uniform sampling is a powerful approach to enable fast acquisition but requires sophisticated reconstruction algorithms. Faithful reconstruction from partial sampled exponentials is highly expected in general signal processing and…

Deep Neural Network (DNN) trained by the gradient descent method is known to be vulnerable to maliciously perturbed adversarial input, aka. adversarial attack. As one of the countermeasures against adversarial attack, increasing the model…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Adnan Siraj Rakin , Zhezhi He , Li Yang , Yanzhi Wang , Liqiang Wang , Deliang Fan

The R2D2 Deep Neural Network (DNN) series was recently introduced for image formation in radio interferometry. It can be understood as a learned version of CLEAN, whose minor cycles are substituted with DNNs. We revisit R2D2 on the grounds…

Instrumentation and Methods for Astrophysics · Physics 2025-10-02 Amir Aghabiglou , Chung San Chu , Chao Tang , Arwa Dabbech , Yves Wiaux

This paper proposes a sparse Bayesian treatment of deep neural networks (DNNs) for system identification. Although DNNs show impressive approximation ability in various fields, several challenges still exist for system identification…

Systems and Control · Electrical Eng. & Systems 2022-06-02 Hongpeng Zhou , Chahine Ibrahim , Wei Xing Zheng , Wei Pan

Deep neural networks (DNNs) are so over-parametrized that recent research has found them to already contain a subnetwork with high accuracy at their randomly initialized state. Finding these subnetworks is a viable alternative training…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Ángel López García-Arias , Masanori Hashimoto , Masato Motomura , Jaehoon Yu