English
Related papers

Related papers: A cavity approach to optimization and inverse dyna…

200 papers

Given a set of observations generated by an optimization process, the goal of inverse optimization is to determine likely parameters of that process. We cast inverse optimization as a form of deep learning. Our method, called deep inverse…

Machine Learning · Computer Science 2018-12-04 Yingcong Tan , Andrew Delong , Daria Terekhov

We introduce a general framework for Markov decision problems under model uncertainty in a discrete-time infinite horizon setting. By providing a dynamic programming principle we obtain a local-to-global paradigm, namely solving a local,…

Optimization and Control · Mathematics 2023-01-06 Ariel Neufeld , Julian Sester , Mario Šikić

Quadratic programming (QP) is a common and important constrained optimization problem. Here, we derive a surprising duality between constrained optimization with inequality constraints -- of which QP is a special case -- and consumer…

Statistical Mechanics · Physics 2019-05-22 Pankaj Mehta , Wenping Cui , Ching-Hao Wang , Robert Marsland

Many real-world optimisation problems involve dynamic and stochastic components. While problems with multiple interacting components are omnipresent in inherently dynamic domains like supply-chain optimisation and logistics, most research…

Neural and Evolutionary Computing · Computer Science 2020-09-16 Ragav Sachdeva , Frank Neumann , Markus Wagner

In this paper we apply a reduced basis framework for the computation of flow bifurcation (and stability) problems in fluid dynamics. The proposed method aims at reducing the complexity and the computational time required for the…

Numerical Analysis · Mathematics 2018-01-04 Giuseppe Pitton , Gianluigi Rozza

We propose practical extensions to Bayesian optimization for solving dynamic problems. We model dynamic objective functions using spatiotemporal Gaussian process priors which capture all the instances of the functions over time. Our…

Machine Learning · Statistics 2018-03-12 Favour M. Nyikosa , Michael A. Osborne , Stephen J. Roberts

Cascade processes are responsible for many important phenomena in natural and social sciences. Simple models of irreversible dynamics on graphs, in which nodes activate depending on the state of their neighbors, have been successfully…

Disordered Systems and Neural Networks · Physics 2013-09-16 Fabrizio Altarelli , Alfredo Braunstein , Luca Dall'Asta , Riccardo Zecchina

We study quasi-convex optimization problems, where only a subset of the constraints can be sampled, and yet one would like a probabilistic guarantee on the obtained solution with respect to the initial (unknown) optimization problem. Even…

Optimization and Control · Mathematics 2021-01-06 Guillaume O. Berger , Raphaël M. Jungers , Zheming Wang

In this paper, we address the challenging problem of optimal experimental design (OED) of constrained inverse problems. We consider two OED formulations that allow reducing the experimental costs by minimizing the number of measurements.…

Numerical Analysis · Mathematics 2017-08-17 Lars Ruthotto , Julianne Chung , Matthias Chung

We consider solving large scale nonconvex optimisation problems with nonnegativity constraints. Such problems arise frequently in machine learning, such as nonnegative least-squares, nonnegative matrix factorisation, as well as problems…

Optimization and Control · Mathematics 2024-05-22 Oscar Smee , Fred Roosta

In robust optimization, the general aim is to find a solution that performs well over a set of possible parameter outcomes, the so-called uncertainty set. In this paper, we assume that the uncertainty size is not fixed, and instead aim at…

Optimization and Control · Mathematics 2016-06-24 André Chassein , Marc Goerigk

Given a non-convex optimization problem, we study conditions under which every Karush-Kuhn-Tucker (KKT) point is a global optimizer. This property is known as KT-invexity and allows to identify the subset of problems where an interior point…

Optimization and Control · Mathematics 2017-07-07 Ksenia Bestuzheva , Hassan Hijazi

Structured optimization problems are ubiquitous in fields like data science and engineering. The goal in structured optimization is using a prescribed set of points, called atoms, to build up a solution that minimizes or maximizes a given…

Optimization and Control · Mathematics 2021-01-14 Andrea Cristofari , Francesco Rinaldi

We provide a new perspective on the study of parameterized optimization problems. Our approach combines methods for post-optimal sensitivity analysis and ordinary differential equations to quantify the uncertainty in the minimizer due to…

Optimization and Control · Mathematics 2022-09-26 Alen Alexanderian , Joseph Hart , Mason Stevens

In many contemporary optimization problems such as those arising in machine learning, it can be computationally challenging or even infeasible to evaluate an entire function or its derivatives. This motivates the use of stochastic…

Optimization and Control · Mathematics 2021-07-01 El-houcine Bergou , Youssef Diouane , Vladimir Kunc , Vyacheslav Kungurtsev , Clément W. Royer

In this paper we propose a general algorithmic framework for first-order methods in optimization in a broad sense, including minimization problems, saddle-point problems and variational inequalities. This framework allows to obtain many…

Beginning with the projectively invariant method for linear programming, interior point methods have led to powerful algorithms for many difficult computing problems, in combinatorial optimization, logic, number theory and non-convex…

Numerical Analysis · Computer Science 2014-12-11 Narendra Karmarkar

The classical approach to inverse problems is based on the optimization of a misfit function. Despite its computational appeal, such an approach suffers from many shortcomings, e.g., non-uniqueness of solutions, modeling prior knowledge,…

Machine Learning · Statistics 2014-10-22 Panagiotis Tsilifis , Ilias Bilionis , Ioannis Katsounaros , Nicholas Zabaras

This paper discusses a special kind of convex constrained optimization problem, whose constraints consist of box inequalities and linear equalities. For this problem, in addition to general optimization algorithms such as exact penalty…

Optimization and Control · Mathematics 2020-04-21 Yue Sun

This paper presents a general description of a parameter estimation inverse problem for systems governed by nonlinear differential equations. The inverse problem is presented using optimal control tools with state constraints, where the…

Numerical Analysis · Mathematics 2018-06-28 Mohamed Kamel Riahi , Issam Al Qattan