English
Related papers

Related papers: The sample complexity of level set approximation

200 papers

In this paper, we study a class of bilevel programming problem where the inner objective function is strongly convex. More specifically, under some mile assumptions on the partial derivatives of both inner and outer objective functions, we…

Optimization and Control · Mathematics 2018-02-08 Saeed Ghadimi , Mengdi Wang

In this paper, a sample-based procedure for obtaining simple and computable approximations of chance-constrained sets is proposed. The procedure allows to control the complexity of the approximating set, by defining families of…

Systems and Control · Electrical Eng. & Systems 2021-01-19 Martina Mammarella , Victor Mirasierra , Matthias Lorenzen , Teodoro Alamo , Fabrizio Dabbene

We propose a new numerical scheme for approximating level-sets of Lipschitz multivariate functions which is robust to stochastic noise. The algorithm's main feature is an adaptive grid-based stochastic approximation strategy which…

Numerical Analysis · Mathematics 2025-09-19 Matteo Croci , Abdul-Lateef Haji-Ali , Ian C. J. Powell

This paper considers non-smooth optimization problems where we seek to minimize the pointwise maximum of a continuously parameterized family of functions. Since the objective function is given as the solution to a maximization problem,…

Optimization and Control · Mathematics 2026-01-12 Dimitris Boskos , Jorge Cortés , Sonia Martínez

We consider approximation or recovery of functions based on a finite number of function evaluations. This is a well-studied problem in optimal recovery, machine learning, and numerical analysis in general, but many fundamental insights were…

Numerical Analysis · Mathematics 2026-04-07 David Krieg , Mario Ullrich

This paper studies simple bilevel problems, where a convex upper-level function is minimized over the optimal solutions of a convex lower-level problem. We first show the fundamental difficulty of simple bilevel problems, that the…

Optimization and Control · Mathematics 2025-01-28 Huaqing Zhang , Lesi Chen , Jing Xu , Jingzhao Zhang

In this chapter, we discuss recent work on learning sparse approximations to high-dimensional functions on data, where the target functions may be scalar-, vector- or even Hilbert space-valued. Our main objective is to study how the…

Numerical Analysis · Mathematics 2022-02-08 Ben Adcock , Juan M. Cardenas , Nick Dexter , Sebastian Moraga

Deciding what to sense is a crucial task, made harder by dependencies and by a nonadditive utility function. We develop approximation algorithms for selecting an optimal set of measurements, under a dependency structure modeled by a…

Artificial Intelligence · Computer Science 2012-06-18 Yan Radovilsky , Solomon Eyal Shimony

We investigate smooth approximations of functions, with prescribed gradient behavior on a distinguished stratified subset of the domain. As an application, we outline how our results yield important consequences for a recently introduced…

Classical Analysis and ODEs · Mathematics 2015-07-21 D. Drusvyatskiy , M. Larsson

The paper presents complexity results and performance guaranties for a family of approximation algorithms for an optimisation problem arising in software testing and manufacturing. The problem is formulated as a partitioning of a set where…

Data Structures and Algorithms · Computer Science 2022-12-13 Yakov Zinder , Bertrand M. T. Lin , Joanna Berlińska

The level set estimation problem seeks to find all points in a domain ${\cal X}$ where the value of an unknown function $f:{\cal X}\rightarrow \mathbb{R}$ exceeds a threshold $\alpha$. The estimation is based on noisy function evaluations…

Machine Learning · Statistics 2021-11-03 Blake Mason , Romain Camilleri , Subhojyoti Mukherjee , Kevin Jamieson , Robert Nowak , Lalit Jain

Bilevel optimization has been developed for many machine learning tasks with large-scale and high-dimensional data. This paper considers a constrained bilevel optimization problem, where the lower-level optimization problem is convex with…

Machine Learning · Computer Science 2023-08-22 Siyuan Xu , Minghui Zhu

Level Set Estimation (LSE) is an important problem with applications in various fields such as material design, biotechnology, machine operational testing, etc. Existing techniques suffer from the scalability issue, that is, these methods…

Machine Learning · Statistics 2020-12-21 Huong Ha , Sunil Gupta , Santu Rana , Svetha Venkatesh

Bilevel optimization problems are receiving increasing attention in machine learning as they provide a natural framework for hyperparameter optimization and meta-learning. A key step to tackle these problems is the efficient computation of…

Machine Learning · Statistics 2025-05-20 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo

We design and analyze a novel accelerated gradient-based algorithm for a class of bilevel optimization problems. These problems have various applications arising from machine learning and image processing, where optimal solutions of the two…

Optimization and Control · Mathematics 2023-11-20 Sepideh Samadi , Daniel Burbano , Farzad Yousefian

The reconstruction of the unknown acoustic source is studied using the noisy multiple frequency data on a remote closed surface. Assume that the unknown source is coded in a spatial dependent piecewise constant function, whose support set…

Numerical Analysis · Mathematics 2019-07-23 Zhiliang Deng , Xiaomei Yang , Jiangfeng Huang

We adapt the gradient sampling algorithm to the local scoring algorithm to solve complex estimation problems based on an optimization of an objective function. This overcomes non-differentiability and non-smoothness of the objective…

Methodology · Statistics 2017-05-30 Marc-Olivier Boldi , Valérie Chavez-Demoulin

In multistage perfect matching problems we are given a sequence of graphs on the same vertex set and asked to find a sequence of perfect matchings, corresponding to the sequence of graphs, such that consecutive matchings are as similar as…

Data Structures and Algorithms · Computer Science 2021-05-11 Markus Chimani , Niklas Troost , Tilo Wiedera

Given a finite number of samples of a continuous set-valued function F, mapping an interval to non-empty compact subsets of $\mathbb{R}^d$, $F: [a,b] \to K(\mathbb{R}^d)$, we discuss the problem of computing good approximations of F. We…

Numerical Analysis · Mathematics 2025-01-27 Nira Dyn , David Levin

Parameterization and approximation are two popular ways of coping with NP-hard problems. More recently, the two have also been combined to derive many interesting results. We survey developments in the area both from the algorithmic and…

Data Structures and Algorithms · Computer Science 2020-06-09 Andreas Emil Feldmann , Karthik C. S. , Euiwoong Lee , Pasin Manurangsi
‹ Prev 1 2 3 10 Next ›