English
Related papers

Related papers: Orthogonal greedy algorithm for linear operator le…

200 papers

Greedy algorithms have been successfully analyzed and applied in training neural networks for solving variational problems, ensuring guaranteed convergence orders. In this paper, we extend the analysis of the orthogonal greedy algorithm…

Numerical Analysis · Mathematics 2025-04-21 Jinchao Xu , Xiaofeng Xu

The paper presents a priori error analysis of the shallow neural network approximation to the solution to the indefinite elliptic equation and and cutting-edge implementation of the Orthogonal Greedy Algorithm (OGA) tailored to overcome the…

Numerical Analysis · Mathematics 2024-10-28 Qingguo Hong , Jiwei Jia , Young Ju Lee , Ziqian Li

We consider the approximation capability of orthogonal super greedy algorithms (OSGA) and its applications in supervised learning. OSGA is concerned with selecting more than one atoms in each iteration step, which, of course, greatly…

Machine Learning · Computer Science 2014-09-19 Jian Fang , Shaobo Lin , Zongben Xu

Orthogonal greedy learning (OGL) is a stepwise learning scheme that starts with selecting a new atom from a specified dictionary via the steepest gradient descent (SGD) and then builds the estimator through orthogonal projection. In this…

Machine Learning · Computer Science 2016-04-21 Lin Xu , Shaobo Lin , Jinshan Zeng , Xia Liu , Zongben Xu

Orthogonal greedy learning (OGL) is a stepwise learning scheme that adds a new atom from a dictionary via the steepest gradient descent and build the estimator via orthogonal projecting the target function to the space spanned by the…

Machine Learning · Computer Science 2014-11-14 Lin Xu , Shaobo Lin , Jinshan Zeng , Zongben Xu

Recently, neural networks have been widely applied for solving partial differential equations (PDEs). Although such methods have been proven remarkably successful on practical engineering problems, they have not been shown, theoretically or…

Numerical Analysis · Mathematics 2023-03-27 Jonathan W. Siegel , Qingguo Hong , Xianlin Jin , Wenrui Hao , Jinchao Xu

We prove some results on the rate of convergence of greedy algorithms, which provide expansions. We consider both the case of Hilbert spaces and the more general case of Banach spaces. The new ingredient of the paper is that we bound the…

Numerical Analysis · Mathematics 2023-04-14 V. N. Temlyakov

In this paper, we explore the finite difference approximation of the fractional Laplace operator in conjunction with a neural network method for solving it. We discretized the fractional Laplace operator using the Riemann-Liouville formula…

Numerical Analysis · Mathematics 2024-09-26 Ruitong Shan , Young Ju Lee , Jiwei Jia

We investigate the prediction capability of the orthogonal greedy algorithm (OGA) in high-dimensional regression models with dependent observations. The rates of convergence of the prediction error of OGA are obtained under a variety of…

Machine Learning · Statistics 2019-06-19 Ching-Kang Ing

Kernel-based schemes are state-of-the-art techniques for learning by data. In this work we extend some ideas about kernel-based greedy algorithms to exponential-polynomial splines, whose main drawback consists in possible overfitting and…

Numerical Analysis · Mathematics 2022-10-31 Rosanna Campagna , Stefano De Marchi , Emma Perracchione , Gabriele Santin

Thanks to their easy implementation via Radial Basis Functions (RBFs), meshfree kernel methods have been proved to be an effective tool for e.g. scattered data interpolation, PDE collocation, classification and regression tasks. Their…

Numerical Analysis · Mathematics 2023-01-20 Tizian Wenzel , Francesco Marchetti , Emma Perracchione

We consider the problem of approximating a given element $f$ from a Hilbert space $\mathcal{H}$ by means of greedy algorithms and the application of such procedures to the regression problem in statistical learning theory. We improve on the…

Statistics Theory · Mathematics 2009-09-29 Andrew R. Barron , Albert Cohen , Wolfgang Dahmen , Ronald A. DeVore

In this effort we introduce and analyze a novel reduced basis approach, used to construct an approximating subspace for a given set of data. Our technique, which we call the Natural Greedy Algorithm (NGA), is based on a recursive approach…

Functional Analysis · Mathematics 2019-11-05 Anton Dereventsov , Clayton Webster

We address the challenging application of 3D pore scale reactive flow under varying geometry parameters. The task is to predict time-dependent integral quantities, i.e., breakthrough curves, from the given geometries. As the 3D reactive…

Numerical Analysis · Mathematics 2024-05-30 Robin Herkert , Patrick Buchfink , Tizian Wenzel , Bernard Haasdonk , Pavel Toktaliev , Oleg Iliev

We analyze the orthogonal greedy algorithm when applied to dictionaries $\mathbb{D}$ whose convex hull has small entropy. We show that if the metric entropy of the convex hull of $\mathbb{D}$ decays at a rate of $O(n^{-\frac{1}{2}-\alpha})$…

Statistics Theory · Mathematics 2022-01-25 Jonathan W. Siegel , Jinchao Xu

In this paper, we first remodel the line coverage as a 1D discrete problem with co-linear targets. Then, an order-based greedy algorithm, called OGA, is proposed to solve the problem optimally. It will be shown that the existing order in…

Data Structures and Algorithms · Computer Science 2017-04-20 Hamed Sadeghi , MohammadReza Soroushmehr , Shahrokh Valaee , Shahram Shirani , Shadrokh Samavi

Kernel methods are versatile tools for function approximation and surrogate modeling. In particular, greedy techniques offer computational efficiency and reliability through inherent sparsity and provable convergence. Inspired by the…

Numerical Analysis · Mathematics 2026-03-09 Marian Klink , Tobias Ehring , Robin Herkert , Robin Lautenschlager , Dominik Göddeke , Bernard Haasdonk

The fields of signal and image processing have been deeply influenced by the introduction of deep neural networks. These are successfully deployed in a wide range of real-world applications, obtaining state of the art results and surpassing…

Machine Learning · Computer Science 2020-10-21 Rajaei Khatib , Dror Simon , Michael Elad

We study Matching and other related problems in a partial information setting where the agents' utilities for being matched to other agents are hidden and the mechanism only has access to ordinal preference information. Our model is…

Computer Science and Game Theory · Computer Science 2016-08-03 Elliot Anshelevich , Shreyas Sekar

Operational Neural Networks (ONNs) have recently been proposed to address the well-known limitations and drawbacks of conventional Convolutional Neural Networks (CNNs) such as network homogeneity with the sole linear neuron model. ONNs are…

Machine Learning · Computer Science 2020-04-27 Serkan Kiranyaz , Junaid Malik , Habib Ben Abdallah , Turker Ince , Alexandros Iosifidis , Moncef Gabbouj
‹ Prev 1 2 3 10 Next ›