English
Related papers

Related papers: Robust Time-Frequency Reconstruction by Learning S…

200 papers

Time-frequency images (TFIs) provide a joint time-frequency representation of a signal and have become an effective tool for analyzing, characterizing, and processing non-stationary signals. Deep learning (DL) techniques have become…

Signal Processing · Electrical Eng. & Systems 2023-02-23 Mehmet Parlak

Time-frequency representation (TFR) allowing for mode reconstruction plays a significant role in interpreting and analyzing the nonstationary signal constituted of various modes. However, it is difficult for most previous methods to handle…

Signal Processing · Electrical Eng. & Systems 2021-09-01 Haijian Zhang , Guang Hua

Recently, the study on learned iterative shrinkage thresholding algorithm (LISTA) has attracted increasing attentions. A large number of experiments as well as some theories have proved the high efficiency of LISTA for solving sparse coding…

Machine Learning · Computer Science 2021-06-24 Lin Kong , Wei Sun , Fanhua Shang , Yuanyuan Liu , Hongying Liu

Deep learning for image super-resolution (SR) has been investigated by numerous researchers in recent years. Most of the works concentrate on effective block designs and improve the network representation but lack interpretation. There are…

Image and Video Processing · Electrical Eng. & Systems 2022-10-17 Yuqing Liu , Wei Zhang , Weifeng Sun , Zhikai Yu , Jianfeng Wei , Shengquan Li

With the aim of developing a fast yet accurate algorithm for compressive sensing (CS) reconstruction of natural images, we combine in this paper the merits of two existing categories of CS methods: the structure insights of traditional…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Jian Zhang , Bernard Ghanem

In this paper, we propose a novel recurrent neural network architecture for speech separation. This architecture is constructed by unfolding the iterations of a sequential iterative soft-thresholding algorithm (ISTA) that solves the…

Sound · Computer Science 2017-09-22 Scott Wisdom , Thomas Powers , James Pitton , Les Atlas

In this paper, we address the problem of distributed sparse recovery of signals acquired via compressed measurements in a sensor network. We propose a new class of distributed algorithms to solve Lasso regression problems, when the…

Information Theory · Computer Science 2013-10-15 Chiara Ravazzi , Sophie M. Fosson , Enrico Magli

The idea of unfolding iterative algorithms as deep neural networks has been widely applied in solving sparse coding problems, providing both solid theoretical analysis in convergence rate and superior empirical performance. However, for…

Machine Learning · Computer Science 2020-10-27 Yuhai Song , Zhong Cao , Kailun Wu , Ziang Yan , Changshui Zhang

Deep unfolding methods---for example, the learned iterative shrinkage thresholding algorithm (LISTA)---design deep neural networks as learned variations of optimization methods. These networks have been shown to achieve faster convergence…

Machine Learning · Computer Science 2020-03-19 Huynh Van Luong , Boris Joukovsky , Nikos Deligiannis

Sparsity in Deep Neural Networks (DNNs) is studied extensively with the focus of maximizing prediction accuracy given an overall parameter budget. Existing methods rely on uniform or heuristic non-uniform sparsity budgets which have…

Machine Learning · Computer Science 2020-06-24 Aditya Kusupati , Vivek Ramanujan , Raghav Somani , Mitchell Wortsman , Prateek Jain , Sham Kakade , Ali Farhadi

High mobility channel estimation is crucial for beyond 5G (B5G) or 6G wireless communication networks. This paper is concerned with channel estimation of high mobility OFDM communication systems. First, a two-dimensional compressed sensing…

Information Theory · Computer Science 2020-12-02 Yinchuan Li , Xiaodong Wang , Robert L. Olesen

Various iterative reconstruction algorithms for inverse problems can be unfolded as neural networks. Empirically, this approach has often led to improved results, but theoretical guarantees are still scarce. While some progress on…

Statistics Theory · Mathematics 2021-08-16 Arash Behboodi , Holger Rauhut , Ekkehard Schnoor

Many consequential real-world systems, like wind fields and ocean currents, are dynamic and hard to model. Learning their governing dynamics remains a central challenge in scientific machine learning. Dynamic Mode Decomposition (DMD)…

Machine Learning · Computer Science 2025-11-26 Yujin Kim , Sarah Dean

Stochastic gradient descent (SGD) is commonly used for optimization in large-scale machine learning problems. Langford et al. (2009) introduce a sparse online learning method to induce sparsity via truncated gradient. With high-dimensional…

Machine Learning · Statistics 2017-05-10 Yuting Ma , Tian Zheng

The short-time Fourier transform (STFT) is widely used for analyzing non-stationary signals. However, its performance is highly sensitive to its parameters, and manual or heuristic tuning often yields suboptimal results. To overcome this…

Sound · Computer Science 2025-06-27 Maxime Leiber , Yosra Marnissi , Axel Barrau , Sylvain Meignen , Laurent Massoulié

The "fast iterative shrinkage-thresholding algorithm", a.k.a. FISTA, is one of the most well-known first-order optimisation scheme in the literature, as it achieves the worst-case $O(1/k^2)$ optimal convergence rate in terms of objective…

Optimization and Control · Mathematics 2021-01-21 Jingwei Liang , Tao Luo , Carola-Bibiane Schönlieb

We propose a novel convolutional neural network (CNN), called $\Psi$DONet, designed for learning pseudodifferential operators ($\Psi$DOs) in the context of linear inverse problems. Our starting point is the Iterative Soft Thresholding…

Optimization and Control · Mathematics 2020-06-03 Tatiana A. Bubba , Mathilde Galinier , Matti Lassas , Marco Prato , Luca Ratti , Samuli Siltanen

Driven by the continuous development of models such as Multi-Layer Perceptron, Convolutional Neural Network (CNN), and Transformer, deep learning has made breakthrough progress in fields such as computer vision and natural language…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Shuang Liu , Lina Zhao , Tian Wang , Huaqing Wang

Recently it has been shown that the intensity time-bandwidth product of optical signals can be engineered to match that of the data acquisition instrument. In particular, it is possible to slow down an ultrafast signal, resulting in…

Optics · Physics 2015-06-22 Jacky Chan , Ata Mahjoubfar , Mohammad H. Asghari , Bahram Jalali

Anomaly detection in time series data is crucial across various domains. The scarcity of labeled data for such tasks has increased the attention towards unsupervised learning methods. These approaches, often relying solely on reconstruction…

Machine Learning · Computer Science 2024-05-14 Ramin Ghorbani , Marcel J. T. Reinders , David M. J. Tax