English
Related papers

Related papers: Fast non-coplanar beam orientation optimization ba…

200 papers

The most popular first-order accelerated black-box methods for solving large-scale convex optimization problems are the Fast Gradient Method (FGM) and the Fast Iterative Shrinkage Thresholding Algorithm (FISTA). FGM requires that the…

Optimization and Control · Mathematics 2021-09-29 Mihai I. Florea , Sergiy A. Vorobyov

Purpose: Beam angle selection is critical in proton therapy treatment planning, yet automated approaches remain underexplored. This study presents and evaluates GAMBAS, a novel, fast machine learning model for automatic beam angle…

In sparse estimation, such as fused lasso and convex clustering, we apply either the proximal gradient method or the alternating direction method of multipliers (ADMM) to solve the problem. It takes time to include matrix division in the…

Optimization and Control · Mathematics 2022-03-29 Ryosuke Shimmura , Joe Suzuki

This paper focuses on stochastic proximal gradient methods for optimizing a smooth non-convex loss function with a non-smooth non-convex regularizer and convex constraints. To the best of our knowledge we present the first non-asymptotic…

Optimization and Control · Mathematics 2019-05-27 Michael R. Metel , Akiko Takeda

It has recently been shown that ISTA, an unaccelerated optimization method, presents sparse updates for the $\ell_1$-regularized personalized PageRank problem, leading to cheap iteration complexity and providing the same guarantees as the…

Optimization and Control · Mathematics 2023-03-24 David Martínez-Rubio , Elias Wirth , Sebastian Pokutta

Nonconvex and nonsmooth optimization problems are frequently encountered in much of statistics, business, science and engineering, but they are not yet widely recognized as a technology in the sense of scalability. A reason for this…

Optimization and Control · Mathematics 2018-01-19 Bo Jiang , Tianyi Lin , Shiqian Ma , Shuzhong Zhang

In this work we present a computationally efficient linear optimization approach for estimating the cross--power spectrum of an hidden multivariate stochastic process from that of another observed process. Sparsity in the resulting…

Methodology · Statistics 2024-12-02 Laura Carini , Isabella Furci , Sara Sommariva

In this paper, we describe and establish iteration-complexity of two accelerated composite gradient (ACG) variants to solve a smooth nonconvex composite optimization problem whose objective function is the sum of a nonconvex differentiable…

Optimization and Control · Mathematics 2021-03-09 Jiaming Liang , Renato D. C. Monteiro , Chee-Khian Sim

We develop and analyze stochastic variants of ISTA and a full backtracking FISTA algorithms [Beck and Teboulle, 2009, Scheinberg et al., 2014] for composite optimization without the assumption that stochastic gradient is an unbiased…

Optimization and Control · Mathematics 2025-02-14 Lam M. Nguyen , Katya Scheinberg , Trang H. Tran

We consider the projected gradient algorithm for the nonconvex best subset selection problem that minimizes a given empirical loss function under an $\ell_0$-norm constraint. Through decomposing the feasible set of the given sparsity…

Optimization and Control · Mathematics 2026-02-13 Jan Harold Alcantara , Ching-pei Lee

Inverse problems are essential to imaging applications. In this paper, we propose a model-based deep learning network, named FISTA-Net, by combining the merits of interpretability and generality of the model-based Fast Iterative…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Jinxi Xiang , Yonggui Dong , Yunjie Yang

We consider algorithms and recovery guarantees for the analysis sparse model in which the signal is sparse with respect to a highly coherent frame. We consider the use of a monotone version of the fast iterative shrinkage- thresholding…

Optimization and Control · Mathematics 2015-06-17 Zhao Tan , Yonina C. Eldar , Amir Beck , Arye Nehorai

Introduced by Beck and Teboulle, FISTA (for Fast Iterative Shrinkage-Thresholding Algorithm) is a first-order method widely used in convex optimization. Adapted from Nesterov's accelerated gradient method for convex functions, the generated…

Optimization and Control · Mathematics 2024-07-25 Jean-François Aujol , Charles Dossal , Hippolyte Labarrière , Aude Rondepierre

Convex-composite optimization, which minimizes an objective function represented by the sum of a differentiable function and a convex one, is widely used in machine learning and signal/image processing. Fast Iterative Shrinkage Thresholding…

Optimization and Control · Mathematics 2022-05-12 Hiroki Tanabe , Ellen H. Fukuda , Nobuo Yamashita

Iterative shrinkage/thresholding algorithm (ISTA) is a well-studied method for finding sparse solutions to ill-posed inverse problems. In this letter, we present a data-driven scheme for learning optimal thresholding functions for ISTA. The…

Machine Learning · Computer Science 2016-05-04 Ulugbek S. Kamilov , Hassan Mansour

The group Lasso is an extension of the Lasso for feature selection on (predefined) non-overlapping groups of features. The non-overlapping group structure limits its applicability in practice. There have been several recent attempts to…

Machine Learning · Computer Science 2010-09-03 Jun Liu , Jieping Ye

We consider a numerical framework tailored to identifying optimal parameters in the context of modelling disease propagation. Our focus is on understanding the behaviour of optimisation algorithms for such problems, where the dynamics are…

Optimization and Control · Mathematics 2025-02-13 Andrés Miniguano-Trujillo , John W. Pearson , Benjamin D. Goddard

The accelerated composite optimization method FISTA (Beck, Teboulle 2009) is suboptimal by a constant factor, and we present a new method OptISTA that improves FISTA by a constant factor of 2. The performance estimation problem (PEP) has…

Optimization and Control · Mathematics 2026-02-17 Uijeong Jang , Shuvomoy Das Gupta , Ernest K. Ryu

The ``fast iterative shrinkage-thresholding algorithm'', a.k.a. FISTA, is one of the most widely used algorithms in the literature. However, despite its optimal theoretical $O(1/k^2)$ convergence rate guarantee, oftentimes in practice its…

Optimization and Control · Mathematics 2018-07-12 Jingwei Liang , Carola-Bibiane Schönlieb

In radiation therapy, mathematical methods have been used for optimizing treatment planning for delivery of sufficient dose to the cancerous cells while keeping the dose to critical surrounding structures minimal. This optimization problem…

Medical Physics · Physics 2015-06-16 Hamed Yarmand , David Craft