English
Related papers

Related papers: Low-regret shape optimization in the presence of m…

200 papers

In this work, we investigate black-box optimization from the perspective of frequentist kernel methods. We propose a novel batch optimization algorithm, which jointly maximizes the acquisition function and select points from a whole batch…

Machine Learning · Computer Science 2020-03-30 Yueming Lyu , Yuan Yuan , Ivor W. Tsang

Finite element approximations of Dirichlet boundary control problems governed by parabolic PDEs on convex polygonal domains are studied in this paper. The existence of a unique solution to optimal control problems is guaranteed based on…

Optimization and Control · Mathematics 2014-10-02 Wei Gong , Michael Hinze , Zhaojie Zhou

We consider nonsmooth optimal control problems subject to a linear elliptic partial differential equation with homogeneous Dirichlet boundary conditions. It is well-known that local solutions satisfy the celebrated Pontryagin maximum…

Optimization and Control · Mathematics 2024-06-28 Daniel Wachsmuth

This paper mainly addresses the distributed online optimization problem where the local objective functions are assumed to be convex or non-convex. First, the distributed algorithms are proposed for the convex and non-convex situations,…

Optimization and Control · Mathematics 2025-03-24 Yaowen Wang , Lipo Mo , Min Zuo , Yuanshi Zheng

This paper is devoted to analyse the Dirichlet problem for a nonlinear elliptic equation involving the $1$--Laplacian and a total variation term, that is, the inhomogeneous case of the equation arising in the level set formulation of the…

Analysis of PDEs · Mathematics 2016-07-25 M. Latorre , S. Segura de León

We revisit the challenge of designing online algorithms for the bandit convex optimization problem (BCO) which are also scalable to high dimensional problems. Hence, we consider algorithms that are \textit{projection-free}, i.e., based on…

Machine Learning · Computer Science 2019-10-09 Dan Garber , Ben Kretzu

Guided-diffusion black-box optimization (BO) has shown strong empirical performance on structured design problems such as molecules and crystals, but its regret behavior remains poorly understood. Existing BO regret analyses typically rely…

Machine Learning · Statistics 2026-05-12 Masaki Adachi , Anita Yang , Yakun Wang , Song Liu

To deal with complicated constraints via locally light computations in distributed online learning, a recent study has presented a projection-free algorithm called distributed online conditional gradient (D-OCG), and achieved an…

Machine Learning · Computer Science 2022-06-15 Yuanyu Wan , Guanghui Wang , Wei-Wei Tu , Lijun Zhang

Construction of optimal deformations is one of the long standing problems of computational mathematics. We consider the problem of computing quasi-isometric deformations with minimal possible quasi-isometry constant (global estimate for…

Computational Geometry · Computer Science 2022-01-31 Vladimir Garanzha , Igor Kaporin , Liudmila Kudryavtseva , François Protais , David Desobry , Dmitry Sokolov

We consider Markov Decision Processes (MDPs) with deterministic transitions and study the problem of regret minimization, which is central to the analysis and design of optimal learning algorithms. We present logarithmic problem-specific…

Machine Learning · Computer Science 2021-06-29 Damianos Tranos , Alexandre Proutiere

In clinical trials and other applications, we often see regions of the feature space that appear to exhibit interesting behaviour, but it is unclear whether these observed phenomena are reflected at the population level. Focusing on a…

Statistics Theory · Mathematics 2023-09-21 Henry W. J. Reeve , Timothy I. Cannings , Richard J. Samworth

In this paper, we consider the problem of distributed online convex optimization, where a group of agents collaborate to track the global minimizers of a sum of time-varying objective functions in an online manner. Specifically, we propose…

Optimization and Control · Mathematics 2020-10-14 Yan Zhang , Robert J. Ravier , Vahid Tarokh , Michael M. Zavlanos

The framework of online learning with memory naturally captures learning problems with temporal constraints, and was previously studied for the experts setting. In this work we extend the notion of learning with memory to the general Online…

Machine Learning · Computer Science 2014-06-11 Oren Anava , Elad Hazan , Shie Mannor

A constrained version of the online convex optimization (OCO) problem is considered. With slotted time, for each slot, first an action is chosen. Subsequently the loss function and the constraint violation penalty evaluated at the chosen…

Machine Learning · Computer Science 2023-01-25 Rahul Vaze

We develop a new optimisation technique that combines multiresolution subdivision surfaces for boundary description with immersed finite elements for the discretisation of the primal and adjoint problems of optimisation. Similar to wavelets…

Numerical Analysis · Mathematics 2016-01-20 Kosala Bandara , Thomas Rüberg , Fehmi Cirak

We consider the online convex optimization problem. In the setting of arbitrary sequences and finite set of parameters, we establish a new fast-rate quantile regret bound. Then we investigate the optimization into the L1-ball by…

Statistics Theory · Mathematics 2018-05-24 Pierre Gaillard , Olivier Wintenberger

We study numerical optimisation algorithms that use zeroth-order information to minimise time-varying geodesically-convex cost functions on Riemannian manifolds. In the Euclidean setting, zeroth-order algorithms have received a lot of…

Optimization and Control · Mathematics 2022-02-15 Alejandro I. Maass , Chris Manzie , Dragan Nesic , Jonathan H. Manton , Iman Shames

The regret bound of an optimization algorithms is one of the basic criteria for evaluating the performance of the given algorithm. By inspecting the differences between the regret bounds of traditional algorithms and adaptive one, we…

Machine Learning · Statistics 2017-07-07 HyoungSeok Kim , JiHoon Kang , WooMyoung Park , SukHyun Ko , YoonHo Cho , DaeSung Yu , YoungSook Song , JungWon Choi

We consider a family of learning strategies for online optimization problems that evolve in continuous time and we show that they lead to no regret. From a more traditional, discrete-time viewpoint, this continuous-time approach allows us…

Optimization and Control · Mathematics 2014-02-28 Joon Kwon , Panayotis Mertikopoulos

In this paper we analyze the relaxed form of a shape optimization problem with state equation $\{{array}{ll} -div \big(a(x)Du\big)=f\qquad\hbox{in}D \hbox{boundary conditions on}\partial D. {array}.$ The new fact is that the term $f$ is…

Optimization and Control · Mathematics 2010-02-16 Giuseppe Buttazzo , Faustino Maestre