English
Related papers

Related papers: The Greedy Miser: Learning under Test-time Budgets

200 papers

In this work we introduce an implementation for which machine learning techniques helped improve the overall performance of an evolutionary algorithm for an optimization problem, namely a variation of robust minimum-cost path in graphs. In…

Neural and Evolutionary Computing · Computer Science 2021-02-04 Ricardo Di Pasquale , Javier Marenco

We propose a new scalable method to optimize the architecture of an artificial neural network. The proposed algorithm, called Greedy Search for Neural Network Architecture, aims to determine a neural network with minimal number of layers…

Machine Learning · Computer Science 2021-04-30 Massimiliano Lupo Pasini , Junqi Yin , Ying Wai Li , Markus Eisenbach

We propose a randomized greedy search algorithm to find a point estimate for a random partition based on a loss function and posterior Monte Carlo samples. Given the large size and awkward discrete nature of the search space, the…

Methodology · Statistics 2021-05-11 David B. Dahl , Devin J. Johnson , Peter Mueller

In this paper we present the greedy step averaging(GSA) method, a parameter-free stochastic optimization algorithm for a variety of machine learning problems. As a gradient-based optimization method, GSA makes use of the information from…

Machine Learning · Computer Science 2016-11-14 Xiatian Zhang , Fan Yao , Yongjun Tian

In this paper, we consider a subset selection problem in a spatial field where we seek to find a set of k locations whose observations provide the best estimate of the field value at a finite set of prediction locations. The measurements…

Optimization and Control · Mathematics 2022-04-12 Shamak Dutta , Nils Wilde , Stephen L. Smith

Despite the great success of deep learning, recent works show that large deep neural networks are often highly redundant and can be significantly reduced in size. However, the theoretical question of how much we can prune a neural network…

Machine Learning · Computer Science 2020-11-02 Mao Ye , Lemeng Wu , Qiang Liu

The Greedy algorithm is the simplest heuristic in sequential decision problem that carelessly takes the locally optimal choice at each round, disregarding any advantages of exploring and/or information gathering. Theoretically, it is known…

Machine Learning · Computer Science 2021-01-05 Matthieu Jedor , Jonathan Louëdec , Vianney Perchet

Subset selection is a popular topic in recent years and a number of subset selection methods have been proposed. Among those methods, hypervolume subset selection is widely used. Greedy hypervolume subset selection algorithms can achieve…

Neural and Evolutionary Computing · Computer Science 2020-07-07 Weiyu Chen , Hisao Ishibuhci , Ke Shang

The "classical" (weak) greedy algorithm is widely used within model order reduction in order to compute a reduced basis in the offline training phase: An a posteriori error estimator is maximized and the snapshot corresponding to the…

Numerical Analysis · Mathematics 2026-05-27 Niklas Reich , Karsten Urban , Jürgen Vorloeper

We investigate at decision trees that incorporate both traditional queries based on one attribute and queries based on hypotheses about the values of all attributes. Such decision trees are similar to ones studied in exact learning, where…

Computational Complexity · Computer Science 2022-03-18 Mohammad Azad , Igor Chikalov , Shahid Hussain , Mikhail Moshkov , Beata Zielosko

Clustering problems such as $k$-means and $k$-median are staples of unsupervised learning, and many algorithmic techniques have been developed to tackle their numerous aspects. In this paper, we focus on the class of greedy approximation…

Data Structures and Algorithms · Computer Science 2025-10-30 Max Dupré la Tour , David Saulpic

Feature selection is an important preprocessing step in machine learning and data mining. In real-world applications, costs, including money, time and other resources, are required to acquire the features. In some cases, there is a test…

Artificial Intelligence · Computer Science 2013-05-22 Fan Min , Qinghua Hu , William Zhu

Model order reduction usually consists of two stages: the offline stage and the online stage. The offline stage is the expensive part that sometimes takes hours till the final reduced-order model is derived, especially when the original…

Numerical Analysis · Mathematics 2023-01-20 Lihong Feng , Luigi Lombardi , Giulio Antonini , Peter Benner

Decision trees and decision rule systems play important roles as classifiers, knowledge representation tools, and algorithms. They are easily interpretable models for data analysis, making them widely used and studied in computer science.…

Artificial Intelligence · Computer Science 2024-01-17 Kerven Durdymyradov , Mikhail Moshkov

We study the problem of causal structure learning when the experimenter is limited to perform at most $k$ non-adaptive experiments of size $1$. We formulate the problem of finding the best intervention target set as an optimization problem,…

Machine Learning · Computer Science 2018-08-03 AmirEmad Ghassami , Saber Salehkaleybar , Negar Kiyavash , Elias Bareinboim

We analyze the expected cost of a greedy active learning algorithm. Our analysis extends previous work to a more general setting in which different queries have different costs. Moreover, queries may have more than two possible responses…

Machine Learning · Computer Science 2009-05-20 Andrew Guillory , Jeff Bilmes

Inverse classification is the process of manipulating an instance such that it is more likely to conform to a specific class. Past methods that address such a problem have shortcomings. Greedy methods make changes that are overly radical,…

Machine Learning · Computer Science 2017-06-12 Michael T. Lash , Qihang Lin , W. Nick Street , Jennifer G. Robinson

Finding efficient tensor contraction paths is essential for a wide range of problems, including model counting, quantum circuits, graph problems, and language models. There exist several approaches to find efficient paths, such as the…

Quantum Physics · Physics 2024-05-17 Sheela Orgler , Mark Blacher

We develop greedy algorithms to approximate the optimal solution to the multi-fidelity sensor selection problem, which is a cost constrained optimization problem prescribing the placement and number of cheap (low signal-to-noise) and…

Signal Processing · Electrical Eng. & Systems 2020-05-08 Emily Clark , Steven L. Brunton , J. Nathan Kutz

The greedy strategy is an approximation algorithm to solve optimization problems arising in decision making with multiple actions. How good is the greedy strategy compared to the optimal solution? In this survey, we mainly consider two…

Optimization and Control · Mathematics 2019-05-10 Yajing Liu , Edwin K. P. Chong , Ali Pezeshki , Zhenliang Zhang