English
Related papers

Related papers: Scaled Projected-Directions Methods with Applicati…

200 papers

Advances in spatial transcriptomics (ST) technologies enable systematic molecular characterization of tumor microenvironment, tumor gradients and gene regulatory networks. Cancer progression is known to vary along pathological gradients,…

To be feasible for computationally intensive applications such as parametric studies, optimization and control design, large-scale finite element analysis requires model order reduction. This is particularly true in nonlinear settings that…

Computational Physics · Physics 2015-05-22 Maciej Balajewicz , David Amsallem , Charbel Farhat

Stochastic gradient descent (SGD) is a widely adopted iterative method for optimizing differentiable objective functions. In this paper, we propose and discuss a novel approach to scale up SGD in applications involving non-convex functions…

Machine Learning · Statistics 2022-10-07 Saad Mohamad , Hamad Alamri , Abdelhamid Bouchachia

This paper addresses the optimization problem of minimizing non-convex continuous functions, which is relevant in the context of high-dimensional machine learning applications characterized by over-parametrization. We analyze a randomized…

Machine Learning · Computer Science 2025-02-28 Jim Zhao , Aurelien Lucchi , Nikita Doikov

The concept of Gaussian process tomography along with nonnegative constraints is applied in the context of high-resolution image reconstruction using segmented planar detectors with few readout channels.Expanding on the concept of 2-D…

Instrumentation and Detectors · Physics 2020-08-26 D. Blyth , N. Mullins , E. Galyaev , J. Holmes

Stochastic gradient-based optimization is crucial to optimize neural networks. While popular approaches heuristically adapt the step size and direction by rescaling gradients, a more principled approach to improve optimizers requires…

Machine Learning · Computer Science 2023-11-01 Philipp Dahlinger , Philipp Becker , Maximilian Hüttenrauch , Gerhard Neumann

In recent years, random subspace methods have been actively studied for large-dimensional nonconvex problems. Recent subspace methods have improved theoretical guarantees such as iteration complexity and local convergence rate while…

Optimization and Control · Mathematics 2025-03-25 Rei Higuchi , Pierre-Louis Poirion , Akiko Takeda

We address the problem of reconstructing X-Ray tomographic images from scarce measurements by interpolating missing acquisitions using a self-supervised approach. To do so, we train shallow neural networks to combine two neighbouring…

Image and Video Processing · Electrical Eng. & Systems 2022-05-18 Emilien Valat , Katayoun Farrahi , Thomas Blumensath

We introduce a two-level trust-region method (TLTR) for solving unconstrained nonlinear optimization problems. Our method uses a composite iteration step, which is based on two distinct search directions. The first search direction is…

Numerical Analysis · Mathematics 2024-09-10 Andrea Angino , Alena Kopaničáková , Rolf Krause

This work investigates a two-stage method for constructing projection-based reduced-order models (ROMs) of parameterized partial differential equations (PDEs). Based on established tensorial ROM methodology, the proposed approach reduces…

Numerical Analysis · Mathematics 2026-04-30 Arjun Vijaywargia , Eric C. Cyr , Anthony Gruber

This paper studies stability and symmetry preserving $H^2$ optimal model reduction problems of linear systems which include linear gradient systems as a special case. The problem is formulated as a nonlinear optimization problem on the…

Optimization and Control · Mathematics 2018-03-13 Kazuhiro Sato , Hiroyuki Sato

Search is a key service within constraint programming systems, and it demands the restoration of previously accessed states during the exploration of a search tree. Restoration proceeds either bottom-up within the tree to roll back…

Programming Languages · Computer Science 2016-02-05 Yong Lin , Martin Henz

In this work we investigate the practicality of stochastic gradient descent and recently introduced variants with variance-reduction techniques in imaging inverse problems. Such algorithms have been shown in the machine learning literature…

Optimization and Control · Mathematics 2021-01-26 Junqi Tang , Karen Egiazarian , Mohammad Golbabaee , Mike Davies

Accurate reconstruction of latent environmental fields from sparse and indirect observations is a foundational challenge across scientific domains-from atmospheric science and geophysics to public health and aerospace safety. Traditional…

Machine Learning · Computer Science 2025-06-17 Kazuma Kobayashi , Samrendra Roy , Seid Koric , Diab Abueidda , Syed Bahauddin Alam

In distributed second order optimization, a standard strategy is to average many local estimates, each of which is based on a small sketch or batch of the data. However, the local estimates on each machine are typically biased, relative to…

Machine Learning · Computer Science 2020-07-06 Michał Dereziński , Burak Bartan , Mert Pilanci , Michael W. Mahoney

Reduced Order Modeling is of paramount importance for efficiently inferring high-dimensional spatio-temporal fields in parametric contexts, enabling computationally tractable parametric analyses, uncertainty quantification and control.…

Machine Learning · Computer Science 2025-02-18 Matteo Tomasetto , Jan P. Williams , Francesco Braghin , Andrea Manzoni , J. Nathan Kutz

This paper considers an explicit continuation method and the trust-region updating strategy for the unconstrained optimization problem. Moreover, in order to improve its computational efficiency and robustness, the new method uses the…

Optimization and Control · Mathematics 2021-02-16 Xin-long Luo , Hang Xiao , Jia-hui Lv , Sen Zhang

Compressed Sensing MRI (CS-MRI) has shown promise in reconstructing under-sampled MR images, offering the potential to reduce scan times. Classical techniques minimize a regularized least-squares cost function using an expensive iterative…

Image and Video Processing · Electrical Eng. & Systems 2020-07-30 Alan Q. Wang , Adrian V. Dalca , Mert R. Sabuncu

We propose a higher-order dimensionality reduction framework based on the Trace Ratio (TR) optimization problem. We establish conditions for existence and uniqueness of solutions and clarify the theoretical connection between the Trace…

Numerical Analysis · Mathematics 2025-11-25 Alaeddine Zahir , Franck Dufrenois , Khalide Jbilou , Ahmed Ratnani

English: This paper concerns the image reconstruction from a few projections in Computed Tomography (CT). The main objective of this paper is to show that the problem is so ill posed that no classical method, such as analytical methods…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ali Mohammad-Djafari