English
Related papers

Related papers: Submodular Functions Are Noise Stable

200 papers

Which ads should we display in sponsored search in order to maximize our revenue? How should we dynamically rank information sources to maximize value of information? These applications exhibit strong diminishing returns: Selection of…

Machine Learning · Computer Science 2009-08-07 Daniel Golovin , Andreas Krause , Matthew Streeter

We consider reaction-diffusion equations that are stochastically forced by a small multiplicative noise term. We show that spectrally stable travelling wave solutions to the deterministic system retain their orbital stability if the…

Analysis of PDEs · Mathematics 2020-03-09 C. H. S. Hamster , H. J. Hupkes

An algorithm based on the interior-point methodology for solving continuous nonlinearly constrained optimization problems is proposed, analyzed, and tested. The distinguishing feature of the algorithm is that it presumes that only noisy…

Optimization and Control · Mathematics 2025-02-18 Frank E. Curtis , Shima Dezfulian , Andreas Waechter

We consider the problem of estimating a low-rank matrix from a noisy observed matrix. Previous work has shown that the optimal method depends crucially on the choice of loss function. In this paper, we use a family of weighted loss…

Statistics Theory · Mathematics 2021-04-08 William Leeb

Submodular maximization is a general optimization problem with a wide range of applications in machine learning (e.g., active learning, clustering, and feature selection). In large-scale optimization, the parallel running time of an…

Data Structures and Algorithms · Computer Science 2023-04-11 Matthew Fahrbach , Vahab Mirrokni , Morteza Zadimoghaddam

Gauss-Newton methods and their stochastic version have been widely used in machine learning and signal processing. Their nonsmooth counterparts, modified Gauss-Newton or prox-linear algorithms, can lead to contrasting outcomes when compared…

Optimization and Control · Mathematics 2023-05-19 Krishna Pillutla , Vincent Roulet , Sham Kakade , Zaid Harchaoui

Feature selection, as a vital dimension reduction technique, reduces data dimension by identifying an essential subset of input features, which can facilitate interpretable insights into learning and inference processes. Algorithmic…

Machine Learning · Computer Science 2022-01-06 Xinxing Wu , Qiang Cheng

Spectral density functions quantify how environmental modes couple to quantum systems and govern their open dynamics. Inferring such frequency-dependent functions from time-domain measurements is an ill-conditioned inverse problem. Here, we…

Submodular optimization generalizes many classic problems in combinatorial optimization and has recently found a wide range of applications in machine learning (e.g., feature engineering and active learning). For many large-scale…

Data Structures and Algorithms · Computer Science 2023-04-11 Matthew Fahrbach , Vahab Mirrokni , Morteza Zadimoghaddam

Recently, it has become evident that submodularity naturally captures widely occurring concepts in machine learning, signal processing and computer vision. Consequently, there is need for efficient optimization procedures for submodular…

Machine Learning · Computer Science 2013-11-19 Stefanie Jegelka , Francis Bach , Suvrit Sra

We study the problem of global maximization of a function f given a finite number of evaluations perturbed by noise. We consider a very weak assumption on the function, namely that it is locally smooth (in some precise sense) with respect…

Machine Learning · Computer Science 2026-04-28 Michal Valko , Alexandra Carpentier , Rémi Munos

Natural target functions and tasks typically exhibit hierarchical modularity -- they can be broken down into simpler sub-functions that are organized in a hierarchy. Such sub-functions have two important features: they have a distinct set…

Machine Learning · Computer Science 2023-10-31 Shreyas Malakarjun Patil , Loizos Michael , Constantine Dovrolis

We show that any submodular minimization (SM) problem defined on a linear constraint set with constraints having up to two variables per inequality, are 2-approximable in polynomial time. If the constraints are monotone (the two variables…

Discrete Mathematics · Computer Science 2017-05-01 Dorit S. Hochbaum

Inspired by prior work of Bruinier and Ono and Mertens and Rolen, we study class polynomials for non-holomorphic modular functions arising from modular forms of negative weight. In particular, we give general conditions for the…

Number Theory · Mathematics 2015-08-26 Joschka J. Braun , Johannes J. Buck , Johannes Girsch

Submodular and fractionally subadditive (or equivalently XOS) functions play a fundamental role in combinatorial optimization, algorithmic game theory and machine learning. Motivated by learnability of these classes of functions from random…

Data Structures and Algorithms · Computer Science 2015-08-04 Vitaly Feldman , Jan Vondrak

Neuromorphic photonics relies on efficiently emulating analog neural networks at high speeds. Prior work showed that transducing signals from the optical to the electrical domain and back with transimpedance gain was an efficient approach…

Control of underactuated dynamical systems has been studied for decades in robotics, and is now emerging in other fields such as neuroscience. Most of the advances have been in model based control theory, which has limitations when the…

Optimization and Control · Mathematics 2020-06-30 Bharat Monga , Jeff Moehlis

We address the problem of maximizing an unknown submodular function that can only be accessed via noisy evaluations. Our work is motivated by the task of summarizing content, e.g., image collections, by leveraging users' feedback in form of…

Artificial Intelligence · Computer Science 2015-12-02 Adish Singla , Sebastian Tschiatschek , Andreas Krause

We introduce a new approach for designing computationally efficient learning algorithms that are tolerant to noise, and demonstrate its effectiveness by designing algorithms with improved noise tolerance guarantees for learning linear…

Machine Learning · Computer Science 2018-06-05 Pranjal Awasthi , Maria Florina Balcan , Philip M. Long

Agnostic learning of Boolean halfspaces is a fundamental problem in computational learning theory, but it is known to be computationally hard even for weak learning. Recent work [CKKMK24] proposed smoothed analysis as a way to bypass such…

Machine Learning · Computer Science 2025-11-25 Yiwen Kou , Raghu Meka