English
Related papers

Related papers: Near-Optimal Data Source Selection for Bayesian Le…

200 papers

Detection of a signal under noise is a classical signal processing problem. When monitoring spatial phenomena under a fixed budget, i.e., either physical, economical or computational constraints, the selection of a subset of available…

Signal Processing · Electrical Eng. & Systems 2018-08-01 Mario Coutino , Sundeep Prabhakar Chepuri , Geert Leus

Meta-Learning has gained increasing attention in the machine learning and artificial intelligence communities. In this paper, we introduce and study an adaptive submodular meta-learning problem. The input of our problem is a set of items,…

Machine Learning · Computer Science 2021-03-26 Shaojie Tang , Jing Yuan

Machine learning algorithms frequently require careful tuning of model hyperparameters, regularization terms, and optimization parameters. Unfortunately, this tuning is often a "black art" that requires expert experience, unwritten rules of…

Machine Learning · Statistics 2012-08-30 Jasper Snoek , Hugo Larochelle , Ryan P. Adams

We consider a general task called partial Wasserstein covering with the goal of providing information on what patterns are not being taken into account in a dataset (e.g., dataset used during development) compared with another dataset(e.g.,…

Machine Learning · Computer Science 2021-12-09 Keisuke Kawano , Satoshi Koide , Keisuke Otaki

Active learning methods for neural networks are usually based on greedy criteria which ultimately give a single new design point for the evaluation. Such an approach requires either some heuristics to sample a batch of design points at one…

Machine Learning · Computer Science 2020-01-28 Evgenii Tsymbalov , Sergei Makarychev , Alexander Shapeev , Maxim Panov

Submodular function maximization finds application in a variety of real-world decision-making problems. However, most existing methods, based on greedy maximization, assume it is computationally feasible to evaluate F, the function being…

Artificial Intelligence · Computer Science 2020-08-11 Yash Satsangi , Shimon Whiteson , Frans A. Oliehoek

Given a collection of bags where each bag is a set of images, our goal is to select one image from each bag such that the selected images are from the same object class. We model the selection as an energy minimization problem with unary…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Amirreza Shaban , Amir Rahimi , Shray Bansal , Stephen Gould , Byron Boots , Richard Hartley

The performance of acquisition functions for Bayesian optimisation to locate the global optimum of continuous functions is investigated in terms of the Pareto front between exploration and exploitation. We show that Expected Improvement…

Machine Learning · Computer Science 2021-04-29 George De Ath , Richard M. Everson , Alma A. M. Rahat , Jonathan E. Fieldsend

One of the basic tasks for Bayesian networks (BNs) is that of learning a network structure from data. The BN-learning problem is NP-hard, so the standard solution is heuristic search. Many approaches have been proposed for this task, but…

Machine Learning · Computer Science 2012-07-09 Marc Teyssier , Daphne Koller

The design of good heuristics or approximation algorithms for NP-hard combinatorial optimization problems often requires significant specialized knowledge and trial-and-error. Can we automate this challenging, tedious process, and learn the…

Machine Learning · Computer Science 2018-02-23 Hanjun Dai , Elias B. Khalil , Yuyu Zhang , Bistra Dilkina , Le Song

In this paper, we consider a subset selection problem in a spatial field where we seek to find a set of k locations whose observations provide the best estimate of the field value at a finite set of prediction locations. The measurements…

Optimization and Control · Mathematics 2022-04-12 Shamak Dutta , Nils Wilde , Stephen L. Smith

The reliable fraction of information is an attractive score for quantifying (functional) dependencies in high-dimensional data. In this paper, we systematically explore the algorithmic implications of using this measure for optimization. We…

Artificial Intelligence · Computer Science 2018-09-17 Panagiotis Mandros , Mario Boley , Jilles Vreeken

Solving stochastic optimization problems under partial observability, where one needs to adaptively make decisions with uncertain outcomes, is a fundamental but notoriously difficult challenge. In this paper, we introduce the concept of…

Machine Learning · Computer Science 2017-12-07 Daniel Golovin , Andreas Krause

In many prediction problems, it is not uncommon that the number of variables used to construct a forecast is of the same order of magnitude as the sample size, if not larger. We then face the problem of constructing a prediction in the…

Statistics Theory · Mathematics 2016-02-08 Alessio Sancetta

We consider parametrized linear-quadratic optimal control problems and provide their online-efficient solutions by combining greedy reduced basis methods and machine learning algorithms. To this end, we first extend the greedy control…

Optimization and Control · Mathematics 2023-07-31 Hendrik Kleikamp , Martin Lazar , Cesare Molinari

For many optimization problems in machine learning, finding an optimal solution is computationally intractable and we seek algorithms that perform well in practice. Since computational intractability often results from pathological…

Machine Learning · Computer Science 2021-02-25 Eric Balkanski , Sharon Qian , Yaron Singer

We study the problem of learning Bayesian networks where an $\epsilon$-fraction of the samples are adversarially corrupted. We focus on the fully-observable case where the underlying graph structure is known. In this work, we present the…

Machine Learning · Computer Science 2021-05-13 Yu Cheng , Honghao Lin

An effective technique for solving optimization problems over massive data sets is to partition the data into smaller pieces, solve the problem on each piece and compute a representative solution from it, and finally obtain a solution…

Data Structures and Algorithms · Computer Science 2015-06-23 Vahab Mirrokni , Morteza Zadimoghaddam

A wide range of machine learning algorithms iteratively add data to the training sample. Examples include semi-supervised learning, active learning, multi-armed bandits, and Bayesian optimization. We embed this kind of data addition into…

Machine Learning · Statistics 2024-06-25 Julian Rodemann

Recently, neural networks have been widely applied for solving partial differential equations (PDEs). Although such methods have been proven remarkably successful on practical engineering problems, they have not been shown, theoretically or…

Numerical Analysis · Mathematics 2023-03-27 Jonathan W. Siegel , Qingguo Hong , Xianlin Jin , Wenrui Hao , Jinchao Xu