English
Related papers

Related papers: Adaptivity Gaps for Stochastic Probing: Submodular…

200 papers

The Few-Shot Segmentation (FSS) aims to accomplish the novel class segmentation task with a few annotated images. Current FSS research based on meta-learning focus on designing a complex interaction mechanism between the query and support…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Jing Wang , Jinagyun Li , Chen Chen , Yisi Zhang , Haoran Shen , Tianxiang Zhang

Many important problems in discrete optimization require maximization of a monotonic submodular function subject to matroid constraints. For these problems, a simple greedy algorithm is guaranteed to obtain near-optimal solutions. In this…

Data Structures and Algorithms · Computer Science 2015-03-17 Daniel Golovin , Andreas Krause

The supervised learning problem to determine a neural network approximation $\mathbb{R}^d\ni x\mapsto\sum_{k=1}^K\hat\beta_k e^{{\mathrm{i}}\omega_k\cdot x}$ with one hidden layer is studied as a random Fourier features algorithm. The…

Numerical Analysis · Mathematics 2020-11-30 Aku Kammonen , Jonas Kiessling , Petr Plecháč , Mattias Sandberg , Anders Szepessy

We study the problem of detecting zeros of continuous functions that are known only up to an error bound, extending the earlier theoretical work with explicit algorithms and experiments with an implementation. More formally, the robustness…

Computational Geometry · Computer Science 2017-09-28 Peter Franek , Marek Krčál , Hubert Wagner

The problem of searching for an unknown object occurs in important applications ranging from security, medicine and defense. Sensors with the capability to process information rapidly require adaptive algorithms to control their search in…

Information Theory · Computer Science 2015-08-18 Huanyu Ding , David A. Castañón

We study the fundamental problem of selecting optimal features for model construction. This problem is computationally challenging on large datasets, even with the use of greedy algorithm variants. To address this challenge, we extend the…

In this work we propose the use of adaptive stochastic search as a building block for general, non-convex optimization operations within deep neural network architectures. Specifically, for an objective function located at some layer in the…

Machine Learning · Computer Science 2021-04-05 Ioannis Exarchos , Marcus A. Pereira , Ziyi Wang , Evangelos A. Theodorou

We study the problem of estimating the value of a known smooth function $f$ at an unknown point $\boldsymbol{\mu} \in \mathbb{R}^n$, where each component $\mu_i$ can be sampled via a noisy oracle. Sampling more frequently components of…

Machine Learning · Computer Science 2022-03-22 Tavor Z. Baharav , Gary Cheng , Mert Pilanci , David Tse

In this paper, we focus on applications in machine learning, optimization, and control that call for the resilient selection of a few elements, e.g. features, sensors, or leaders, against a number of adversarial denial-of-service attacks or…

Optimization and Control · Mathematics 2017-11-01 Vasileios Tzoumas , Konstantinos Gatsis , Ali Jadbabaie , George J. Pappas

We consider the problem of maximizing a non-negative submodular set function $f:2^N \rightarrow \mathbb{R}_+$ over a ground set $N$ subject to a variety of packing type constraints including (multiple) matroid constraints, knapsack…

Discrete Mathematics · Computer Science 2014-08-14 Chandra Chekuri , Jan Vondrák , Rico Zenklusen

We consider minimization of composite functions of the form $f(g(x))+h(x)$, where $f$ and $h$ are convex functions (which can be nonsmooth) and $g$ is a smooth vector mapping. In addition, we assume that $g$ is the average of finite number…

Optimization and Control · Mathematics 2021-05-17 Junyu Zhang , Lin Xiao

We study a general stochastic probing problem defined on a universe V, where each element e in V is "active" independently with probability p_e. Elements have weights {w_e} and the goal is to maximize the weight of a chosen subset S of…

Data Structures and Algorithms · Computer Science 2013-02-26 Anupam Gupta , Viswanath Nagarajan

Active search is a learning paradigm for actively identifying as many members of a given class as possible. A critical target scenario is high-throughput screening for scientific discovery, such as drug or materials discovery. In this…

Machine Learning · Computer Science 2018-11-27 Shali Jiang , Gustavo Malkomes , Benjamin Moseley , Roman Garnett

To cope with the high level of ambiguity faced in domains such as Computer Vision or Natural Language processing, robust prediction methods often search for a diverse set of high-quality candidate solutions or proposals. In structured…

Machine Learning · Computer Science 2014-11-10 Adarsh Prasad , Stefanie Jegelka , Dhruv Batra

We study the problem of estimating a continuous ability parameter from sequential binary responses by actively asking questions with varying difficulties, a setting that arises naturally in adaptive testing and online preference learning.…

Machine Learning · Statistics 2025-10-10 Sanghwa Kim , Dohyun Ahn , Seungki Min

In the adaptive ProbeMax problem, given a collection of mutually-independent random variables $X_1, \ldots, X_n$, our goal is to design an adaptive probing policy for sequentially sampling at most $k$ of these variables, with the objective…

Data Structures and Algorithms · Computer Science 2022-10-17 Guillermo Gallego , Danny Segev

In this paper, we study stochastic submodular maximization problems with general matroid constraints, that naturally arise in online learning, team formation, facility location, influence maximization, active learning and sensing objective…

Machine Learning · Computer Science 2023-03-20 Gözde Özcan , Stratis Ioannidis

Maximizing monotone submodular functions under cardinality constraints is a classic optimization task with several applications in data mining and machine learning. In this paper we study this problem in a dynamic environment with…

Data Structures and Algorithms · Computer Science 2024-05-31 Paul Dütting , Federico Fusco , Silvio Lattanzi , Ashkan Norouzi-Fard , Morteza Zadimoghaddam

Subset selection tasks, arise in recommendation systems and search engines and ask to select a subset of items that maximize the value for the user. The values of subsets often display diminishing returns, and hence, submodular functions…

Machine Learning · Computer Science 2023-05-05 Anay Mehrotra , Nisheeth K. Vishnoi

In this paper, we propose a new framework for designing fast parallel algorithms for fundamental statistical subset selection tasks that include feature selection and experimental design. Such tasks are known to be weakly submodular and are…

Machine Learning · Computer Science 2021-04-02 Sharon Qian , Yaron Singer