English
Related papers

Related papers: A Line--Search--Based Stochastic Gradient Method f…

200 papers

Compressed sensing (CS) is an innovative technique allowing to represent signals through a small number of their linear projections. In this paper we address the application of CS to the scenario of progressive acquisition of 2D visual…

Information Theory · Computer Science 2014-03-06 Giulio Coluccia , Enrico Magli

In this work, we propose a new paradigm of iterative model-based reconstruction algorithms for providing real-time solution for zooming-in and refining a region of interest in medical and clinical tomographic images. This algorithmic…

Image and Video Processing · Electrical Eng. & Systems 2025-12-01 Junqi Tang , Guixian Xu , Jinglai Li

Although deep learning (DL) methods are powerful for solving inverse problems, their reliance on high-quality training data is a major hurdle. This is significant in high-dimensional (dynamic/volumetric) magnetic resonance imaging (MRI),…

Image and Video Processing · Electrical Eng. & Systems 2024-05-24 Frederic Wang , Han Qi , Alfredo De Goyeneche , Reinhard Heckel , Michael Lustig , Efrat Shimron

Constrained optimization plays a crucial role in the fields of quantum physics and quantum information science and becomes especially challenging for high-dimensional complex structure problems. One specific issue is that of quantum process…

Quantum Physics · Physics 2024-04-30 Daniel Volya , Andrey Nikitin , Prabhat Mishra

In this paper, we consider a class of Forward--Backward (FB) splitting methods that includes several variants (e.g. inertial schemes, FISTA) for minimizing the sum of two proper convex and lower semi-continuous functions, one of which has a…

Optimization and Control · Mathematics 2018-01-04 Jingwei Liang , Jalal Fadili , Gabriel Peyré

Radar imaging is crucial in remote sensing and has many applications in detection and autonomous driving. However, the received radar signal for imaging is enormous and redundant, which degrades the speed of real-time radar quantitative…

Signal Processing · Electrical Eng. & Systems 2023-07-06 Zhuoyang Liu , Huilin Xu , Feng Xu

We present a stochastic descent algorithm for unconstrained optimization that is particularly efficient when the objective function is slow to evaluate and gradients are not easily obtained, as in some PDE-constrained optimization and…

Optimization and Control · Mathematics 2024-07-08 David Kozak , Stephen Becker , Alireza Doostan , Luis Tenorio

A major challenge in computed tomography is reconstructing objects from incomplete data. An increasingly popular solution for these problems is to incorporate deep learning models into reconstruction algorithms. This study introduces a…

Numerical Analysis · Mathematics 2024-02-20 Knut Salomonsson , Eric Oldgren , Emanuel Ström , Ozan Öktem

In this paper, we propose a distributed first-order algorithm with backtracking linesearch for solving multi-agent minimisation problems, where each agent handles a local objective involving nonsmooth and smooth components. Unlike existing…

Optimization and Control · Mathematics 2025-05-14 Felipe Atenas , Minh N. Dao , Matthew K. Tam

We develop a line-search second-order algorithmic framework for minimizing finite sums. We do not make any convexity assumptions, but require the terms of the sum to be continuously differentiable and have Lipschitz-continuous gradients.…

Optimization and Control · Mathematics 2022-06-28 Daniela di Serafino , Nataša Krejić , Nataša Krklec Jerinkić , Marco Viola

This paper proposes a new two-step procedure for sparse-view tomographic image reconstruction. It is called RISING, since it combines an early-stopped Rapid Iterative Solver with a subsequent Iteration Network-based Gaining step. So far,…

Numerical Analysis · Mathematics 2022-01-25 Davide Evangelista , Elena Morotti , Elena Loli Piccolomini

Adaptive gradient methods have been increasingly adopted by deep learning community due to their fast convergence and reduced sensitivity to hyper-parameters. However, these methods come with limitations, such as increased memory…

Machine Learning · Computer Science 2024-12-17 Corrado Coppola , Lorenzo Papa , Irene Amerini , Laura Palagi

In this paper, a Line based Compressive Sensing (LCS) scheme is discussed and proposed for low power visual applications, in which image acquisition is performed in a line-by-line manner at the encoder side using same measurement operator.…

Image and Video Processing · Electrical Eng. & Systems 2020-01-08 Mansoor Ebrahim , Syed Hasan Adil , Daniyal Nawaz , Kamran Raza

The phase retrieval problem is found in various areas of applications of engineering and applied physics. It is also a very active field of research in mathematics, signal processing and machine learning. In this paper, we present an…

Optimization and Control · Mathematics 2023-04-26 Rossen Nenov , Dang-Khoa Nguyen , Peter Balazs

Multi-task learning is a powerful method for solving several tasks jointly by learning robust representation. Optimization of the multi-task learning model is a more complex task than a single-task due to task conflict. Based on theoretical…

Machine Learning · Computer Science 2021-10-05 Andrey Filatov , Daniil Merkulov

Incorporating computed tomography (CT) reconstruction operators into differentiable pipelines has proven beneficial in many applications. Such approaches usually focus on the projection data and keep the acquisition geometry fixed. However,…

We propose a method to efficiently compute tomographic projections of a 3D volume represented by a linear combination of shifted B-splines. To do so, we propose a ray-tracing algorithm that computes 3D line integrals with arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Youssef Haouchat , Sepand Kashani , Aleix Boquet-Pujadas , Philippe Thévenaz , Michael Unser

We propose a statistical adaptive procedure called SALSA for automatically scheduling the learning rate (step size) in stochastic gradient methods. SALSA first uses a smoothed stochastic line-search procedure to gradually increase the…

Machine Learning · Statistics 2020-02-26 Pengchuan Zhang , Hunter Lang , Qiang Liu , Lin Xiao

We develop new algorithms for Riemannian bilevel optimization. We focus in particular on batch and stochastic gradient-based methods, with the explicit goal of avoiding second-order information such as Riemannian hyper-gradients. We propose…

Optimization and Control · Mathematics 2024-05-28 Sanchayan Dutta , Xiang Cheng , Suvrit Sra

Performing stochastic inversion on a computationally expensive forward simulation model with a high-dimensional uncertain parameter space (e.g. a spatial random field) is computationally prohibitive even with gradient information provided.…

Computation · Statistics 2018-03-19 Charanraj A. Thimmisetty , Wenju Zhao , Xiao Chen , Charles H. Tong , Joshua A. White