English
Related papers

Related papers: Dynamic Greedy Algorithms for the Edwards-Anderson…

200 papers

Optimal selection of a subset of items from a given set is a hard problem that requires combinatorial optimization. In this paper, we propose a subset selection algorithm that is trainable with gradient-based methods yet achieves…

Machine Learning · Computer Science 2018-10-31 Thomas Powers , Rasool Fakoor , Siamak Shakeri , Abhinav Sethy , Amanjit Kainth , Abdel-rahman Mohamed , Ruhi Sarikaya

Actuator placement is an active field of research which has received significant attention for its applications in complex dynamical networks. In this paper, we study the problem of finding a set of actuator placements minimizing the metric…

Optimization and Control · Mathematics 2021-07-14 Baiwei Guo , Orcun Karaca , Tyler Summers , Maryam Kamgarpour

We consider interactive learning and covering problems, in a setting where actions may incur different costs, depending on the response to the action. We propose a natural greedy algorithm for response-dependent costs. We bound the…

Machine Learning · Computer Science 2018-11-21 Sivan Sabato

A deterministic approximation algorithm is presented for the maximization of non-monotone submodular functions over a ground set of size $n$ subject to cardinality constraint $k$; the algorithm is based upon the idea of interlacing two…

Data Structures and Algorithms · Computer Science 2019-10-28 Alan Kuhnle

Rule ensembles are designed to provide a useful trade-off between predictive accuracy and model interpretability. However, the myopic and random search components of current rule ensemble methods can compromise this goal: they often need…

Machine Learning · Computer Science 2021-01-22 Mario Boley , Simon Teshuva , Pierre Le Bodic , Geoffrey I Webb

Models based on recursive adaptive partitioning such as decision trees and their ensembles are popular for high-dimensional regression as they can potentially avoid the curse of dimensionality. Because empirical risk minimization (ERM) is…

Machine Learning · Statistics 2025-09-11 Yan Shuo Tan , Jason M. Klusowski , Krishnakumar Balasubramanian

We present a greedy-based approach to construct an efficient single hidden layer neural network with the ReLU activation that approximates a target function. In our approach we obtain a shallow network by utilizing a greedy algorithm with…

Machine Learning · Computer Science 2021-10-01 Anton Dereventsov , Armenak Petrosyan , Clayton Webster

During network planning phase, optimal network planning implemented through efficient resource allocation and static traffic demand provisioning in IP-over-elastic optical network (IP-over-EON) is significantly challenging compared with the…

Networking and Internet Architecture · Computer Science 2021-11-23 Pramit Biswas , Md Shahbaz Akhtar , Aneek Adhya , Sriparna Saha , Sudhan Majhi

Test-time data augmentation$-$averaging the predictions of a machine learning model across multiple augmented samples of data$-$is a widely used technique that improves the predictive performance. While many advanced learnable data…

Machine Learning · Statistics 2020-06-23 Dmitry Molchanov , Alexander Lyzhov , Yuliya Molchanova , Arsenii Ashukha , Dmitry Vetrov

We show for several computational problems how classical greedy algorithms for special cases can be derived in a simple way from dynamic programs for the general case: interval scheduling (restricted to unit weights), knapsack (restricted…

Data Structures and Algorithms · Computer Science 2026-02-26 Dieter van Melkebeek

The `lid' algorithm performs an exhaustive exploration of neighborhoods of local energy minima of energy landscapes. This paper describes an implementation of the algorithm, including issues of parallel performance and scalability. To…

Computational Physics · Physics 2009-10-31 Paolo Sibani , Ruud van der Pas , J. Christian Schoen

We investigate at decision trees that incorporate both traditional queries based on one attribute and queries based on hypotheses about the values of all attributes. Such decision trees are similar to ones studied in exact learning, where…

Computational Complexity · Computer Science 2022-03-18 Mohammad Azad , Igor Chikalov , Shahid Hussain , Mikhail Moshkov , Beata Zielosko

In this article, we present a greedy algorithm based on a tensor product decomposition, whose aim is to compute the global minimum of a strongly convex energy functional. We prove the convergence of our method provided that the gradient of…

Functional Analysis · Mathematics 2015-03-13 Eric Cances , Virginie Ehrlacher , Tony Lelievre

In the search and retrieval of multimedia objects, it is impractical to either manually or automatically extract the contents for indexing since most of the multimedia contents are not machine extractable, while manual extraction tends to…

Information Retrieval · Computer Science 2019-11-25 Nikki Lijing Kuang , Clement H. C. Leung

Motivated by recent work on stochastic gradient descent methods, we develop two stochastic variants of greedy algorithms for possibly non-convex optimization problems with sparsity constraints. We prove linear convergence in expectation to…

Numerical Analysis · Mathematics 2014-07-02 Nam Nguyen , Deanna Needell , Tina Woolf

Wireless network virtualization enables multiple virtual wireless networks to coexist on shared physical infrastructure. However, one of the main challenges is the problem of assigning the physical resources to virtual networks in an…

Networking and Internet Architecture · Computer Science 2015-05-18 Jonathan van de Belt , Hamed Ahmadi , Linda E. Doyle

The contextual bandit literature has traditionally focused on algorithms that address the exploration-exploitation tradeoff. In particular, greedy algorithms that exploit current estimates without any exploration may be sub-optimal in…

Machine Learning · Statistics 2020-04-21 Hamsa Bastani , Mohsen Bayati , Khashayar Khosravi

This paper introduces a methodology designed to augment the inverse design optimization process in scenarios constrained by limited compute, through the strategic synergy of multi-fidelity evaluations, machine learning models, and…

Computational Engineering, Finance, and Science · Computer Science 2024-06-04 Luka Grbcic , Juliane Müller , Wibe Albert de Jong

Anderson acceleration (AA) as an efficient technique for speeding up the convergence of fixed-point iterations may be designed for accelerating an optimization method. We propose a novel optimization algorithm by adapting Anderson…

Optimization and Control · Mathematics 2022-11-17 Hailiang Liu , Jia-Hao He , Xuping Tian

Chebyshev Greedy Algorithm is a generalization of the well known Orthogonal Matching Pursuit defined in a Hilbert space to the case of Banach spaces. We apply this algorithm for constructing sparse approximate solutions (with respect to a…

Machine Learning · Statistics 2013-12-05 Vladimir Temlyakov