English
Related papers

Related papers: A local greedy algorithm and higher order extensio…

200 papers

Greedy algorithms have long been a workhorse for learning graphical models, and more broadly for learning statistical models with sparse structure. In the context of learning directed acyclic graphs, greedy algorithms are popular despite…

Machine Learning · Computer Science 2021-11-01 Goutham Rajendran , Bohdan Kivva , Ming Gao , Bryon Aragam

Given a graph $G=(V,E)$, suppose we are interested in selecting a sequence of vertices $(x_j)_{j=1}^n$ such that $\left\{x_1, \dots, x_k\right\}$ is `well-distributed' uniformly in $k$. We describe a greedy algorithm motivated by potential…

Combinatorics · Mathematics 2021-03-05 Louis Brown

In this paper we solve two problems of Esperet, Kang and Thomasse as well as Li concerning (i) induced bipartite subgraphs in triangle-free graphs and (ii) van der Waerden numbers. Each time random greedy algorithms allow us to go beyond…

Combinatorics · Mathematics 2022-06-01 He Guo , Lutz Warnke

Sparsity learning with known grouping structure has received considerable attention due to wide modern applications in high-dimensional data analysis. Although advantages of using group information have been well-studied by shrinkage-based…

Machine Learning · Statistics 2018-09-28 Wei Qian , Wending Li , Yasuhiro Sogawa , Ryohei Fujimaki , Xitong Yang , Ji Liu

We generalize the matroid-theoretic approach to greedy algorithms to the setting of poset matroids, in the sense of Barnabei, Nicoletti and Pezzoli (1998) [BNP]. We illustrate our result by providing a generalization of Kruskal algorithm…

Combinatorics · Mathematics 2013-06-18 Luca Ferrari

We study sublinear time algorithms for estimating the size of maximum matching in graphs. Our main result is a $(\frac{1}{2}+\Omega(1))$-approximation algorithm which can be implemented in $O(n^{1+\epsilon})$ time, where $n$ is the number…

Data Structures and Algorithms · Computer Science 2022-06-28 Soheil Behnezhad , Mohammad Roghani , Aviad Rubinstein , Amin Saberi

In this article, we present two new greedy algorithms for the computation of the lowest eigenvalue (and an associated eigenvector) of a high-dimensional eigenvalue problem, and prove some convergence results for these algorithms and their…

Numerical Analysis · Mathematics 2013-04-10 Eric Cancès , Virginie Ehrlacher , Tony Lelièvre

Greedy algorithms have been successfully analyzed and applied in training neural networks for solving variational problems, ensuring guaranteed convergence orders. In this paper, we extend the analysis of the orthogonal greedy algorithm…

Numerical Analysis · Mathematics 2025-04-21 Jinchao Xu , Xiaofeng Xu

We present a greedy algorithm for computing selected eigenpairs of a large sparse matrix $H$ that can exploit localization features of the eigenvector. When the eigenvector to be computed is localized, meaning only a small number of its…

Computational Physics · Physics 2021-02-09 Taylor M. Hernandez , Roel Van Beeumen , Mark A. Caprio , Chao Yang

The method of alternating projections involves projecting an element of a Hilbert space cyclically onto a collection of closed subspaces. It is known that the resulting sequence always converges in norm and that one can obtain estimates for…

Numerical Analysis · Mathematics 2019-02-14 Oscar Darwin , Aashraya Jha , Souktik Roy , David Seifert , Rhys Steele , Liam Stigant

Motivated by, e.g., sensitivity analysis and end-to-end learning, the demand for differentiable optimization algorithms has been significantly increasing. In this paper, we establish a theoretically guaranteed versatile framework that makes…

Data Structures and Algorithms · Computer Science 2020-06-15 Shinsaku Sakaue

This paper is devoted to the development and convergence analysis of greedy reconstruction algorithms based on the strategy presented in [Y. Maday and J. Salomon, Joint Proceedings of the 48th IEEE Conference on Decision and Control and the…

Optimization and Control · Mathematics 2023-08-30 S. Buchwald , G. Ciaramella , J. Salomon

Greedy algorithms, particularly the orthogonal greedy algorithm (OGA), have proven effective in training shallow neural networks for fitting functions and solving partial differential equations (PDEs). In this paper, we extend the…

Numerical Analysis · Mathematics 2025-01-07 Ye Lin , Jiwei Jia , Young Ju Lee , Ran Zhang

Motivated by online decision-making in time-varying combinatorial environments, we study the problem of transforming offline algorithms to their online counterparts. We focus on offline combinatorial problems that are amenable to a constant…

Machine Learning · Computer Science 2023-02-07 Rad Niazadeh , Negin Golrezaei , Joshua Wang , Fransisca Susan , Ashwinkumar Badanidiyuru

The coupling of some types of oscillators requires the mediation of a physical link between them, rendering the distance between oscillators a critical factor to achieve synchronization. In this paper we propose and explore a greedy…

Adaptation and Self-Organizing Systems · Physics 2022-09-21 Damien Beecroft , Juan G. Restrepo , David Angulo-Garcia

We propose a novel second-order ODE as the continuous-time limit of a Riemannian accelerated gradient-based method on a manifold with curvature bounded from below. This ODE can be seen as a generalization of the ODE derived for Euclidean…

Optimization and Control · Mathematics 2020-03-10 Foivos Alimisis , Antonio Orvieto , Gary Bécigneul , Aurelien Lucchi

The frame algorithm uses a simple recursive formula to approximate an unknown vector from its frame coefficients. This note introduces an adaptive version of the frame algorithm that maximizes the error reduction between steps in terms of…

Functional Analysis · Mathematics 2025-06-24 Brody Dylan Johnson

In a previous work we introduced, in the context of gravitational wave science, an initial study on an automated domain-decomposition approach for reduced basis through hp-greedy refinement. The approach constructs local reduced bases of…

General Relativity and Quantum Cosmology · Physics 2023-10-24 Franco Cerino , Andrés Diaz-Pace , Emmanuel Tassone , Manuel Tiglio , Atuel Villegas

We derive new results for the performance of a simple greedy algorithm for finding large independent sets and matchings in constant degree regular graphs. We show that for $r$-regular graphs with $n$ nodes and girth at least $g$, the…

Discrete Mathematics · Computer Science 2008-07-09 David Gamarnik , David Goldberg

Several modern applications involve huge graphs and require fast answers to reachability queries. In more than two decades since first proposals, several approaches have been presented adopting on-line searches, hop labelling or transitive…

Data Structures and Algorithms · Computer Science 2016-11-09 Nicolas Boria , Gianpiero Cabodi , Paolo Camurati , Marco Palena , Paolo Pasini , Stefano Quer