English
Related papers

Related papers: Greedy algorithms for high-dimensional eigenvalue …

200 papers

We study the worst-case adaptive optimization problem with budget constraint that is useful for modeling various practical applications in artificial intelligence and machine learning. We investigate the near-optimality of greedy algorithms…

Artificial Intelligence · Computer Science 2017-05-24 Nguyen Viet Cuong , Huan Xu

Greedy algorithms are widely used for problems in machine learning such as feature selection and set function optimization. Unfortunately, for large datasets, the running time of even greedy algorithms can be quite high. This is because for…

Machine Learning · Statistics 2017-03-09 Rajiv Khanna , Ethan Elenberg , Alexandros G. Dimakis , Sahand Negahban , Joydeep Ghosh

In many high-frequency simulation workflows, eigenvalue tracking along a parameter variation is necessary. This can become computationally prohibitive when repeated time-consuming eigenvalue problems must be solved. Therefore, we employ a…

Computational Engineering, Finance, and Science · Computer Science 2023-08-07 Max Kappesser , Anna Ziegler , Sebastian Schöps

Finding efficient tensor contraction paths is essential for a wide range of problems, including model counting, quantum circuits, graph problems, and language models. There exist several approaches to find efficient paths, such as the…

Quantum Physics · Physics 2024-05-17 Sheela Orgler , Mark Blacher

Submodular maximization has been widely studied over the past decades, mostly because of its numerous applications in real-world problems. It is well known that the standard greedy algorithm guarantees a worst-case approximation factor of…

Data Structures and Algorithms · Computer Science 2020-02-12 Alfredo Torrico , Mohit Singh , Sebastian Pokutta

Sparsity learning with known grouping structure has received considerable attention due to wide modern applications in high-dimensional data analysis. Although advantages of using group information have been well-studied by shrinkage-based…

Machine Learning · Statistics 2018-09-28 Wei Qian , Wending Li , Yasuhiro Sogawa , Ryohei Fujimaki , Xitong Yang , Ji Liu

Greedy algorithms have been successfully analyzed and applied in training neural networks for solving variational problems, ensuring guaranteed convergence orders. In this paper, we extend the analysis of the orthogonal greedy algorithm…

Numerical Analysis · Mathematics 2025-04-21 Jinchao Xu , Xiaofeng Xu

The main goal of this paper is twofold. First, we extend some results known in the case of weak greedy algorithms with a scalar parameter to the case of weak greedy algorithms with a weakness sequence. Second, we formulate a new setting of…

Numerical Analysis · Mathematics 2026-04-30 A. S. Spivak , V. N. Temlyakov

For compressed sensing over arbitrarily connected networks, we consider the problem of estimating underlying sparse signals in a distributed manner. We introduce a new signal model that helps to describe inter-signal correlation among…

Information Theory · Computer Science 2013-10-29 Dennis Sundman , Saikat Chatterjee , Mikael Skoglund

We consider parametrized linear-quadratic optimal control problems and provide their online-efficient solutions by combining greedy reduced basis methods and machine learning algorithms. To this end, we first extend the greedy control…

Optimization and Control · Mathematics 2023-07-31 Hendrik Kleikamp , Martin Lazar , Cesare Molinari

MapReduce has become the de facto standard model for designing distributed algorithms to process big data on a cluster. There has been considerable research on designing efficient MapReduce algorithms for clustering, graph optimization, and…

Data Structures and Algorithms · Computer Science 2018-06-19 Nicholas J. A. Harvey , Christopher Liaw , Paul Liu

A major problem in data augmentation is to ensure that the generated new samples cover the search space. This is a challenging problem and requires exploration for data augmentation policies to ensure their effectiveness in covering the…

Machine Learning · Computer Science 2020-10-08 Alireza Naghizadeh , Mohammadsajad Abavisani , Dimitris N. Metaxas

In this article, we derive a novel convergence estimate for the weak POD-Greedy method with multiple POD modes and variable greedy thresholds in terms of the entropy numbers of the parametric solution manifold. Combining the POD with the…

Numerical Analysis · Mathematics 2025-01-15 Yuwen Li , Yupeng Wang

Submodular optimization is a special class of combinatorial optimization arising in several machine learning problems, but also in cooperative control of complex systems. In this paper, we consider agents in an asynchronous, unreliable and…

Systems and Control · Computer Science 2018-12-17 Andrea Testa , Ivano Notarnicola , Giuseppe Notarstefano

We present a novel stagewise strategy for improving greedy algorithms for sparse recovery. We demonstrate its efficiency both for synthesis and analysis sparse priors, where in both cases we demonstrate its computational efficiency and…

Numerical Analysis · Mathematics 2020-12-02 Guy Leibovitz , Raja Giryes

A flaw in the greedy approximation algorithm proposed by Zhang et al. for minimum connected set cover problem is corrected, and a stronger result on the approximation ratio of the modified greedy algorithm is established. The results are…

Data Structures and Algorithms · Computer Science 2015-03-19 Wei Ren , Qing Zhao

We briefly discuss the greedy method and a couple of its more efficient variants for approximately maximizing monotone submodular functions.

Optimization and Control · Mathematics 2025-10-21 Alen Alexanderian

An important problem in computational topology is to calculate the homology of a space from samples. In this work, we develop a statistical approach to this problem by calculating the expected rank of an induced map on homology from a…

Computation · Statistics 2023-08-04 Tianyi Sun , Bradley Nelson

We consider optimization problems for complex systems in which the cost function has a multivalleyed landscape. We introduce a new class of dynamical algorithms which, using a suitable annealing procedure coupled with a balanced…

Mathematical Physics · Physics 2007-05-23 Pierluigi Contucci , Cristian Giardina' , Claudio Giberti , Cecilia Vernia

To provide a novel tool for the investigation of the energy landscape of the Edwards-Anderson spin-glass model we introduce an algorithm that allows an efficient execution of a greedy optimization based on data from a previously performed…

Disordered Systems and Neural Networks · Physics 2023-12-01 Stefan Schnabel , Wolfhard Janke