English
Related papers

Related papers: Submodular Functions Are Noise Stable

200 papers

It is shown that a class of optical physical unclonable functions (PUFs) can be learned to arbitrary precision with arbitrarily high probability, even in the presence of noise, given access to polynomially many challenge-response pairs and…

Machine Learning · Computer Science 2023-09-08 Apollo Albright , Boris Gelfand , Michael Dixon

Benjamini, Kalai and Schramm showed that a monotone function $f : \{-1,1\}^n \to \{-1,1\}$ is noise stable if and only if it is correlated with a half-space (a set of the form $\{x: \langle x, a\rangle \le b\}$). We study noise stability in…

Probability · Mathematics 2016-03-08 Elchanan Mossel , Joe Neeman

Node-perturbation learning is a type of statistical gradient descent algorithm that can be applied to problems where the objective function is not explicitly formulated, including reinforcement learning. It estimates the gradient of an…

Machine Learning · Statistics 2017-06-22 Kazuyuki Hara , Kentaro Katahira , Masato Okada

We prove that any submodular function f: {0,1}^n -> {0,1,...,k} can be represented as a pseudo-Boolean 2k-DNF formula. Pseudo-Boolean DNFs are a natural generalization of DNF representation for functions with integer range. Each term in…

Machine Learning · Computer Science 2012-08-14 Sofya Raskhodnikova , Grigory Yaroslavtsev

Set-functions appear in many areas of computer science and applied mathematics, such as machine learning, computer vision, operations research or electrical networks. Among these set-functions, submodular functions play an important role,…

Machine Learning · Computer Science 2010-11-17 Francis Bach

We consider log-supermodular models on binary variables, which are probabilistic models with negative log-densities which are submodular. These models provide probabilistic interpretations of common combinatorial optimization tasks such as…

Machine Learning · Statistics 2016-08-19 Tatiana Shpakova , Francis Bach

A first step is taken towards understanding often observed non-robustness phenomena of deep neural net (DNN) classifiers. This is done from the perspective of Boolean functions by asking if certain sequences of Boolean functions represented…

Machine Learning · Statistics 2023-08-21 Johan Jonasson , Jeffrey E. Steif , Olof Zetterqvist

Uncertainty estimation for unlabeled data is crucial to active learning. With a deep neural network employed as the backbone model, the data selection process is highly challenging due to the potential over-confidence of the model…

Machine Learning · Computer Science 2024-02-14 Xingjian Li , Pengkun Yang , Yangcheng Gu , Xueying Zhan , Tianyang Wang , Min Xu , Chengzhong Xu

We provide sufficient conditions for instability of the subgradient method with constant step size around a local minimum of a locally Lipschitz semi-algebraic function. They are satisfied by several spurious local minima arising in robust…

Optimization and Control · Mathematics 2023-06-30 Cédric Josz , Lexiao Lai

Temporal data such as time series can be viewed as discretized measurements of the underlying function. To build a generative model for such data we have to model the stochastic process that governs it. We propose a solution by defining the…

Machine Learning · Computer Science 2023-05-22 Marin Biloš , Kashif Rasul , Anderson Schneider , Yuriy Nevmyvaka , Stephan Günnemann

We consider the maximization of a submodular objective function $f:2^U\to\mathbb{R}_{\geq 0}$, where the objective $f$ is not accessed as a value oracle but instead subject to noisy queries. We introduce a versatile adaptive sampling…

Data Structures and Algorithms · Computer Science 2024-04-11 Wenjing Chen , Shuo Xing , Victoria G. Crawford

We present a "learning to learn" approach for automatically constructing white-box classification loss functions that are robust to label noise in the training data. We parameterize a flexible family of loss functions using Taylor…

Machine Learning · Computer Science 2021-03-02 Boyan Gao , Henry Gouk , Timothy M. Hospedales

Submodular functions are a fundamental object of study in combinatorial optimization, economics, machine learning, etc. and exhibit a rich combinatorial structure. Many subclasses of submodular functions have also been well studied and…

Data Structures and Algorithms · Computer Science 2013-04-19 Nikhil R. Devanur , Shaddin Dughmi , Roy Schwartz , Ankit Sharma , Mohit Singh

In this paper, we study stochastic submodular maximization problems with general matroid constraints, that naturally arise in online learning, team formation, facility location, influence maximization, active learning and sensing objective…

Machine Learning · Computer Science 2023-03-20 Gözde Özcan , Stratis Ioannidis

We extend the work of Narasimhan and Bilmes [30] for minimizing set functions representable as a difference between submodular functions. Similar to [30], our new algorithms are guaranteed to monotonically reduce the objective function at…

Data Structures and Algorithms · Computer Science 2013-08-27 Rishabh Iyer , Jeff Bilmes

It is generally believed that submodular functions -- and the more general class of $\gamma$-weakly submodular functions -- may only be optimized under the non-negativity assumption $f(S) \geq 0$. In this paper, we show that once the…

Data Structures and Algorithms · Computer Science 2019-04-23 Christopher Harshaw , Moran Feldman , Justin Ward , Amin Karbasi

In a stochastic probing problem we are given a universe $E$, where each element $e \in E$ is active independently with probability $p_e$, and only a probe of e can tell us whether it is active or not. On this universe we execute a process…

Data Structures and Algorithms · Computer Science 2014-02-19 Marek Adamczyk , Maxim Sviridenko , Justin Ward

Submodular function optimization has numerous applications in machine learning and data analysis, including data summarization which aims to identify a concise and diverse set of data points from a large dataset. It is important to…

Data Structures and Algorithms · Computer Science 2023-04-11 Shaojie Tang , Jing Yuan , Twumasi Mensah-Boateng

We study projective functions. We prove that projective functions generalise lower and upper-semianalytic ones while being stable by composition and difference. We show that the class of projective functions is closed under sums,…

Logic · Mathematics 2025-10-14 Laurence Carassus , Massinissa Ferhoune

We give the first fully polynomial-time algorithm for learning halfspaces with respect to the uniform distribution on the hypercube in the presence of contamination, where an adversary may corrupt some fraction of examples and labels…

Data Structures and Algorithms · Computer Science 2025-11-11 Gautam Chandrasekaran , Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan