English
Related papers

Related papers: Deflation-based certified greedy algorithm and ada…

200 papers

This work introduces an empirical quadrature-based hyperreduction procedure and greedy training algorithm to effectively reduce the computational cost of solving convection-dominated problems with limited training. The proposed approach…

Numerical Analysis · Mathematics 2023-09-14 Marzieh Alireza Mirhoseini , Matthew J. Zahr

Motivated by recent work on stochastic gradient descent methods, we develop two stochastic variants of greedy algorithms for possibly non-convex optimization problems with sparsity constraints. We prove linear convergence in expectation to…

Numerical Analysis · Mathematics 2014-07-02 Nam Nguyen , Deanna Needell , Tina Woolf

We propose a variable decomposition algorithm -greedy block coordinate descent (GBCD)- in order to make dense Gaussian process regression practical for large scale problems. GBCD breaks a large scale optimization into a series of small…

Machine Learning · Computer Science 2012-06-18 Liefeng Bo , Cristian Sminchisescu

The reduced basis method (RBM) empowers repeated and rapid evaluation of parametrized partial differential equations through an offline-online decomposition, a.k.a. a learning-execution process. A key feature of the method is a greedy…

Numerical Analysis · Mathematics 2020-09-16 Jiahua Jiang , Yanlai Chen

A novel and detailed convergence analysis is presented for a greedy algorithm that was previously introduced for operator reconstruction problems in the field of quantum mechanics. This algorithm is based on an offline/online decomposition…

Optimization and Control · Mathematics 2020-11-02 S Buchwald , G Ciaramella , Julien Salomon

Models based on recursive adaptive partitioning such as decision trees and their ensembles are popular for high-dimensional regression as they can potentially avoid the curse of dimensionality. Because empirical risk minimization (ERM) is…

Machine Learning · Statistics 2025-09-11 Yan Shuo Tan , Jason M. Klusowski , Krishnakumar Balasubramanian

In this article, we present a greedy algorithm based on a tensor product decomposition, whose aim is to compute the global minimum of a strongly convex energy functional. We prove the convergence of our method provided that the gradient of…

Functional Analysis · Mathematics 2015-03-13 Eric Cances , Virginie Ehrlacher , Tony Lelievre

In this work we propose and analyze a weighted proper orthogonal decomposition method to solve elliptic partial differential equations depending on random input data, for stochastic problems that can be transformed into parametric systems.…

Numerical Analysis · Mathematics 2023-08-08 Luca Venturi , Francesco Ballarin , Gianluigi Rozza

This work introduces a new method to efficiently solve optimization problems constrained by partial differential equations (PDEs) with uncertain coefficients. The method leverages two sources of inexactness that trade accuracy for speed:…

Optimization and Control · Mathematics 2019-05-20 Matthew J. Zahr , Kevin T. Carlberg , Drew P. Kouri

Recently, neural networks have been widely applied for solving partial differential equations (PDEs). Although such methods have been proven remarkably successful on practical engineering problems, they have not been shown, theoretically or…

Numerical Analysis · Mathematics 2023-03-27 Jonathan W. Siegel , Qingguo Hong , Xianlin Jin , Wenrui Hao , Jinchao Xu

We present convergence estimates of two types of greedy algorithms in terms of the metric entropy of underlying compact sets. In the first part, we measure the error of a standard greedy reduced basis method for parametric PDEs by the…

Numerical Analysis · Mathematics 2024-10-29 Yuwen Li , Jonathan Siegel

We present an accelerated greedy strategy for training of projection-based reduced-order models for parametric steady and unsteady partial differential equations. Our approach exploits hierarchical approximate proper orthogonal…

Numerical Analysis · Mathematics 2024-01-17 Eki Agouzal , Tommaso Taddei

We consider parametrized linear-quadratic optimal control problems and provide their online-efficient solutions by combining greedy reduced basis methods and machine learning algorithms. To this end, we first extend the greedy control…

Optimization and Control · Mathematics 2023-07-31 Hendrik Kleikamp , Martin Lazar , Cesare Molinari

Coordinate descent with random coordinate selection is the current state of the art for many large scale optimization problems. However, greedy selection of the steepest coordinate on smooth problems can yield convergence rates independent…

Optimization and Control · Mathematics 2018-10-17 Sai Praneeth Karimireddy , Anastasia Koloskova , Sebastian U. Stich , Martin Jaggi

This paper focuses on the development of novel greedy techniques for distributed learning under sparsity constraints. Greedy techniques have widely been used in centralized systems due to their low computational requirements and at the same…

Information Theory · Computer Science 2015-06-23 Symeon Chouvardas , Gerasimos Mileounis , Nicholas Kalouptsidis , Sergios Theodoridis

An adaptive scheme to generate reduced-order models for parametric nonlinear dynamical systems is proposed. It aims to automatize the POD-Greedy algorithm combined with empirical interpolation. At each iteration, it is able to adaptively…

Numerical Analysis · Mathematics 2021-10-13 Sridhar Chellappa , Lihong Feng , Peter Benner

This work presents a comprehensive framework for capturing bifurcating phenomena and detecting bifurcation curves in nonlinear multiparametric partial differential equations, where the system exhibits multiple coexisting solutions for given…

Numerical Analysis · Mathematics 2026-02-16 Nitin Kumar , Federico Pichi , Gianluigi Rozza

Sparse optimization is a central problem in machine learning and computer vision. However, this problem is inherently NP-hard and thus difficult to solve in general. Combinatorial search methods find the global optimal solution but are…

Optimization and Control · Mathematics 2020-06-30 Ganzhao Yuan , Li Shen , Wei-Shi Zheng

When developing robust preconditioners for multiphysics problems, fractional functions of the Laplace operator often arise and need to be inverted. Rational approximation in the uniform norm can be used to convert inverting those fractional…

Numerical Analysis · Mathematics 2024-07-23 James H. Adler , Xiaozhe Hu , Xue Wang , Zhongqin Xue

We propose an adaptive refinement algorithm to solve total variation regularized measure optimization problems. The method iteratively constructs dyadic partitions of the unit cube based on i) the resolution of discretized dual problems and…

Optimization and Control · Mathematics 2023-01-19 Axel Flinth , Frédéric de Gournay , Pierre Weiss
‹ Prev 1 2 3 10 Next ›