English
Related papers

Related papers: FISTA-Net: Learning A Fast Iterative Shrinkage Thr…

200 papers

The paradigm of pre-training and fine-tuning has laid the foundation for deploying deep learning models. However, most fine-tuning methods are designed to meet a specific resource budget. Recently, considering diverse deployment scenarios…

Machine Learning · Computer Science 2024-07-10 Haoyu He , Zizheng Pan , Jing Liu , Jianfei Cai , Bohan Zhuang

With the rapid development of deep learning, a growing number of pre-trained models have been publicly available. However, deploying these fixed models in real-world IoT applications is challenging because different devices possess…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Maoyu Wang , Yao Lu , Jiaqi Nie , Zeyu Wang , Yun Lin , Qi Xuan , Guan Gui

Remote sensing images are essential for many applications of the earth's sciences, but their quality can usually be degraded due to limitations in sensor technology and complex imaging environments. To address this, various remote sensing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Yujie Feng , Yin Yang , Xiaohong Fan , Zhengpeng Zhang , Jianping Zhang

We consider a variable metric and inexact version of the FISTA-type algorithm considered in (Chambolle, Pock, 2016, Calatroni, Chambolle, 2019) for the minimization of the sum of two (possibly strongly) convex functions. The proposed…

Optimization and Control · Mathematics 2021-01-12 Simone Rebegoldi , Luca Calatroni

This paper presents a multilevel framework for inertial and inexact proximal algorithms, that encompasses multilevel versions of classical algorithms such as forward-backward and FISTA. The methods are supported by strong theoretical…

Optimization and Control · Mathematics 2024-04-03 Guillaume Lauga , Elisa Riccietti , Nelly Pustelnik , Paulo Gonçalves

Deep neural networks for event-based video reconstruction often suffer from a lack of interpretability and have high memory demands. A lightweight network called CISTA-LSTC has recently been introduced showing that high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Siying Liu , Pier Luigi Dragotti

Various iterative reconstruction algorithms for inverse problems can be unfolded as neural networks. Empirically, this approach has often led to improved results, but theoretical guarantees are still scarce. While some progress on…

Statistics Theory · Mathematics 2021-08-16 Arash Behboodi , Holger Rauhut , Ekkehard Schnoor

In this paper, we conduct a theoretical and numerical study of the Fast Iterative Shrinkage-Thresholding Algorithm (FISTA) under strong convexity assumptions. We propose an autonomous Lyapunov function that reflects the strong convexity of…

Optimization and Control · Mathematics 2025-06-16 Luis M. Briceño-Arias

This paper presents an accelerated proximal gradient method for multiobjective optimization, in which each objective function is the sum of a continuously differentiable, convex function and a closed, proper, convex function. Extending…

Optimization and Control · Mathematics 2023-06-08 Hiroki Tanabe , Ellen H. Fukuda , Nobuo Yamashita

To improve the efficiency and sustainability of learning deep models, we propose CREST, the first scalable framework with rigorous theoretical guarantees to identify the most valuable examples for training non-convex models, particularly…

Machine Learning · Computer Science 2023-06-05 Yu Yang , Hao Kang , Baharan Mirzasoleiman

Time-frequency distributions (TFDs) play a vital role in providing descriptive analysis of non-stationary signals involved in realistic scenarios. It is well known that low time-frequency (TF) resolution and the emergency of cross-terms…

Signal Processing · Electrical Eng. & Systems 2020-05-01 Lei Jiang , Haijian Zhang , Lei Yu

Purpose: To systematically investigate the influence of various data consistency layers, (semi-)supervised learning and ensembling strategies, defined in a $\Sigma$-net, for accelerated parallel MR image reconstruction using deep learning.…

Image and Video Processing · Electrical Eng. & Systems 2019-12-20 Kerstin Hammernik , Jo Schlemper , Chen Qin , Jinming Duan , Ronald M. Summers , Daniel Rueckert

It is well-established that many iterative sparse reconstruction algorithms can be unrolled to yield a learnable neural network for improved empirical performance. A prime example is learned ISTA (LISTA) where weights, step sizes and…

Machine Learning · Computer Science 2020-10-06 Freya Behrens , Jonathan Sauder , Peter Jung

Deformable image registration is a fundamental task in medical image analysis, aiming to establish a dense and non-linear correspondence between a pair of images. Previous deep-learning studies usually employ supervised neural networks to…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Jun Zhang

Large-scale models pre-trained on large-scale datasets have profoundly advanced the development of deep learning. However, the state-of-the-art models for medical image segmentation are still small-scale, with their parameters only in the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Ziyan Huang , Haoyu Wang , Zhongying Deng , Jin Ye , Yanzhou Su , Hui Sun , Junjun He , Yun Gu , Lixu Gu , Shaoting Zhang , Yu Qiao

Drawing on theoretical insights, we advocate an error-based thresholding (EBT) mechanism for learned ISTA (LISTA), which utilizes a function of the layer-wise reconstruction error to suggest a specific threshold for each observation in the…

Machine Learning · Computer Science 2023-12-20 Ziang Li , Kailun Wu , Yiwen Guo , Changshui Zhang

In this paper, we propose a novel sparse signal recovery algorithm called Trainable ISTA (TISTA). The proposed algorithm consists of two estimation units such as a linear estimation unit and a minimum mean squared error (MMSE)…

Information Theory · Computer Science 2019-05-22 Daisuke Ito , Satoshi Takabe , Tadashi Wadayama

Learned inverse problem solvers exhibit remarkable performance in applications like image reconstruction tasks. These data-driven reconstruction methods often follow a two-step scheme. First, one trains the often neural network-based…

Deep neural networks for chest X-ray classification achieve strong average performance, yet often underperform for specific demographic subgroups, raising critical concerns about clinical safety and equity. Existing debiasing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Darakshan Rashid , Raza Imam , Dwarikanath Mahapatra , Brejesh Lall

Deep learning approaches, known for their ability to model complex relationships and fast execution, are increasingly being applied to solve large optimization problems. However, existing methods often face challenges in simultaneously…

Optimization and Control · Mathematics 2025-12-16 Zisheng Zhou , Dengyu Zheng , Zirui Chen , Shixiang Chen