English
Related papers

Related papers: Optimal deep neural networks for sparse recovery v…

200 papers

In this work we develop a novel approach using deep neural networks to reconstruct the conductivity distribution in elliptic problems from one measurement of the solution over the whole domain. The approach is based on a mixed reformulation…

Numerical Analysis · Mathematics 2023-12-20 Bangti Jin , Xiyao Li , Qimeng Quan , Zhi Zhou

Deep neural networks (DNNs) have achieved significant success in a variety of real world applications, i.e., image classification. However, tons of parameters in the networks restrict the efficiency of neural networks due to the large model…

Machine Learning · Computer Science 2019-08-21 Yuzhe Ma , Ran Chen , Wei Li , Fanhua Shang , Wenjian Yu , Minsik Cho , Bei Yu

Neuroevolution is a promising area of research that combines evolutionary algorithms with neural networks. A popular subclass of neuroevolutionary methods, called evolution strategies, relies on dense noise perturbations to mutate networks,…

Neural and Evolutionary Computing · Computer Science 2023-02-14 Tim Whitaker , Darrell Whitley

This note considers the unstructured sparse recovery problems in a general form. Examples include rational approximation, spectral function estimation, Fourier inversion, Laplace inversion, and sparse deconvolution. The main challenges are…

Numerical Analysis · Mathematics 2024-03-11 Lexing Ying

In this work, we propose a deep learning approach for parallel magnetic resonance imaging (MRI) reconstruction, termed a variable splitting network (VS-Net), for an efficient, high-quality reconstruction of undersampled multi-coil MR data.…

Image and Video Processing · Electrical Eng. & Systems 2019-07-24 Jinming Duan , Jo Schlemper , Chen Qin , Cheng Ouyang , Wenjia Bai , Carlo Biffi , Ghalib Bello , Ben Statton , Declan P O'Regan , Daniel Rueckert

It has been observed in practical applications and in theoretical analysis that over-parametrization helps to find good minima in neural network training. Similarly, in this article we study widening and deepening neural networks by a…

Numerical Analysis · Mathematics 2020-02-06 G. Welper

We show that training deep neural networks (DNNs) with absolute value activation and arbitrary input dimension can be formulated as equivalent convex Lasso problems with novel features expressed using geometric algebra. This formulation…

Machine Learning · Computer Science 2024-10-15 Emi Zeger , Mert Pilanci

Depth completion aims to recover dense depth maps from sparse depth measurements. It is of increasing importance for autonomous driving and draws increasing attention from the vision community. Most of existing methods directly train a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-16 Yan Xu , Xinge Zhu , Jianping Shi , Guofeng Zhang , Hujun Bao , Hongsheng Li

This paper introduces an incremental training framework for compressing popular Deep Neural Network (DNN) based unfolded multiple-input-multiple-output (MIMO) detection algorithms like DetNet. The idea of incremental training is explored to…

Information Theory · Computer Science 2021-04-19 Nancy Nayak , Thulasi Tholeti , Muralikrishnan Srinivasan , Sheetal Kalyani

In next-generation communications, massive machine-type communications (mMTC) induce severe burden on base stations. To address such an issue, automatic modulation classification (AMC) can help to reduce signaling overhead by blindly…

Signal Processing · Electrical Eng. & Systems 2020-02-10 Chieh-Fang Teng , Ching-Yao Chou , Chun-Hsiang Chen , An-Yeu Wu

A supervised learning approach is proposed for regularization of large inverse problems where the main operator is built from noisy data. This is germane to superresolution imaging via the sampling indicators of the inverse scattering…

Numerical Analysis · Mathematics 2025-08-22 Fatemeh Pourahmadian , Yang Xu

To develop a deep-learning method for achieving fast high-resolution MR elastography from highly undersampled data without the need of high-quality training dataset. We first framed the deep neural network representation as a nonlinear…

Signal Processing · Electrical Eng. & Systems 2026-01-21 Xi Peng

We propose a reconfigurable hardware architecture for deep neural networks (DNNs) capable of online training and inference, which uses algorithmically pre-determined, structured sparsity to significantly lower memory and computational…

Neural and Evolutionary Computing · Computer Science 2017-11-07 Sourya Dey , Yinan Shao , Keith M. Chugg , Peter A. Beerel

We propose a novel deep-learning framework for super-resolution ultrasound images and videos in terms of spatial resolution and line reconstruction. We up-sample the acquired low-resolution image through a vision-based interpolation method;…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Simone Cammarasana , Paolo Nicolardi , Giuseppe Patanè

Recovering latent structure from count data has received considerable attention in network inference, particularly when one seeks both cross-group interactions and within-group similarity patterns in bipartite networks, which is widely used…

Machine Learning · Statistics 2026-04-27 Aoran Zhang , Tianyao Wei , Maria J. Guerrero , César A. Uribe

Given a set of image denoisers, each having a different denoising capability, is there a provably optimal way of combining these denoisers to produce an overall better result? An answer to this question is fundamental to designing an…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Joon Hee Choi , Omar Elgendy , Stanley H. Chan

Gaussian random matrix (GRM) has been widely used to generate linear measurements in compressed sensing (CS) of natural images. However, there actually exist two disadvantages with GRM in practice. One is that GRM has large memory…

Computer Vision and Pattern Recognition · Computer Science 2018-06-20 Wenxue Cui , Feng Jiang , Xinwei Gao , Wen Tao , Debin Zhao

The joint optimization of the reconstruction and classification error is a hard non convex problem, especially when a non linear mapping is utilized. In order to overcome this obstacle, a novel optimization strategy is proposed, in which a…

Machine Learning · Computer Science 2022-11-07 Ioannis A. Nellas , Sotiris K. Tasoulis , Vassilis P. Plagianakos , Spiros V. Georgakopoulos

Deep Neural Networks are successful but highly computationally expensive learning systems. One of the main sources of time and energy drains is the well known backpropagation (backprop) algorithm, which roughly accounts for 2/3 of the…

Machine Learning · Computer Science 2020-04-17 Simon Wiedemann , Temesgen Mehari , Kevin Kepp , Wojciech Samek

The problem of the distributed recovery of jointly sparse signals has attracted much attention recently. Let us assume that the nodes of a network observe different sparse signals with common support; starting from linear, compressed…

Optimization and Control · Mathematics 2016-11-15 Sophie M. Fosson , Javier Matamoros , Carles Anton-Haro , Enrico Magli