English
Related papers

Related papers: A new perspective on parameter study of optimizati…

200 papers

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

Machine learning pipelines often rely on optimization procedures to make discrete decisions (e.g., sorting, picking closest neighbors, or shortest paths). Although these discrete decisions are easily computed, they break the…

Machine Learning · Computer Science 2020-06-11 Quentin Berthet , Mathieu Blondel , Olivier Teboul , Marco Cuturi , Jean-Philippe Vert , Francis Bach

The estimation of distributed parameters in partial differential equations (PDE) from measures of the solution of the PDE may lead to under-determination problems. The choice of a parameterization is a usual way of adding a-priori…

Numerical Analysis · Mathematics 2008-01-16 Hend Ben Ameur , François Clément , Pierre Weis , Guy Chavent

When considering fractional diffusion equation as model equation in analyzing anomalous diffusion processes, some important parameters in the model related to orders of the fractional derivatives, are often unknown and difficult to be…

Analysis of PDEs · Mathematics 2019-04-15 Zhiyuan Li , Yikan Liu , Masahiro Yamamoto

In this paper, we provide a mathematical framework for improving generalization in a class of learning problems which is related to point estimations for modeling of high-dimensional nonlinear functions. In particular, we consider a…

Optimization and Control · Mathematics 2024-12-13 Getachew K. Befekadu

Many real-world optimization problems involve uncertain parameters with probability distributions that can be estimated using contextual feature information. In contrast to the standard approach of first estimating the distribution of…

Machine Learning · Statistics 2023-08-03 Meng Qi , Paul Grigas , Zuo-Jun Max Shen

Variational regularization of ill-posed inverse problems is based on minimizing the sum of a data fidelity term and a regularization term. The balance between them is tuned using a positive regularization parameter, whose automatic choice…

Numerical Analysis · Mathematics 2025-11-12 Markus Juvonen , Bjørn Jensen , Ilmari Pohjola , Yiqiu Dong , Samuli Siltanen

Uncertainty in optimization is often represented as stochastic parameters in the optimization model. In Predict-Then-Optimize approaches, predictions of a machine learning model are used as values for such parameters, effectively…

Machine Learning · Computer Science 2025-12-03 Pieter Smet

The inverse radiative transfer problem finds broad applications in medical imaging, atmospheric science, astronomy, and many other areas. This problem intends to recover the optical properties, denoted as absorption and scattering…

Numerical Analysis · Mathematics 2017-08-08 Qin Li , Ruiwen Shu , Li Wang

Ordinary differential equations (ODEs) are widely used to describe dynamical systems in science, but identifying parameters that explain experimental measurements is challenging. In particular, although ODEs are differentiable and would…

Machine Learning · Computer Science 2024-07-22 Jonas Beck , Nathanael Bosch , Michael Deistler , Kyra L. Kadhim , Jakob H. Macke , Philipp Hennig , Philipp Berens

The article considers parameter estimation constructing such as quasi-maximum likelyhood estimation and one step estimation in statistical models generated by solution of stochastic differential equation. It has been developed a software…

Statistics Theory · Mathematics 2021-03-12 Dmytro Ivanenko , Rostyslav Pogorielov

Predict+Optimize is a recently proposed framework which combines machine learning and constrained optimization, tackling optimization problems that contain parameters that are unknown at solving time. The goal is to predict the unknown…

Artificial Intelligence · Computer Science 2022-09-09 Xinyi Hu , Jasper C. H. Lee , Jimmy H. M. Lee

We consider optimal design of infinite-dimensional Bayesian linear inverse problems governed by partial differential equations that contain secondary reducible model uncertainties, in addition to the uncertainty in the inversion parameters.…

Optimization and Control · Mathematics 2020-06-23 Alen Alexanderian , Noemi Petra , Georg Stadler , Isaac Sunseri

Many real-world decision processes are modeled by optimization problems whose defining parameters are unknown and must be inferred from observable data. The Predict-Then-Optimize framework uses machine learning models to predict unknown…

Machine Learning · Computer Science 2023-11-23 James Kotary , Vincenzo Di Vito , Jacob Christopher , Pascal Van Hentenryck , Ferdinando Fioretto

We consider the problem of parameter estimation in dynamic systems described by ordinary differential equations. A review of the existing literature emphasizes the need for deterministic global optimization methods due to the nonconvex…

Optimization and Control · Mathematics 2025-06-16 M. Fernández de Dios , Ángel M. González-Rueda , Julio R. Banga , Julio González-Díaz , David R. Penas

Variational analysis provides the theoretical foundations and practical tools for constructing optimization algorithms without being restricted to smooth or convex problems. We survey the central concepts in the context of a concrete but…

Optimization and Control · Mathematics 2025-04-08 Johannes O. Royset

In this work, we investigate the use of Besov priors in the context of Bayesian inverse problems. The solution to Bayesian inverse problems is the posterior distribution which naturally enables us to interpret the uncertainties. Besov…

Numerical Analysis · Mathematics 2025-06-23 Andreas Horst , Babak Maboudi Afkham , Yiqiu Dong , Jakob Lemvig

This paper is concerned with objective value performance of the scenario approach for robust convex optimization. A novel method is proposed to derive probabilistic bounds for the objective value from scenario programs with a finite number…

Optimization and Control · Mathematics 2022-04-20 Zheming Wang , Raphaël M. Jungers

In many applied optimization settings, parameters that define the constraints may not guarantee the best possible solution, and superior solutions might exist that are infeasible for the given parameter values. Removing such constraints,…

Optimization and Control · Mathematics 2024-07-22 Farzin Ahmadi , Todd R. McNutt , Kimia Ghobadi

Many inverse problems include nuisance parameters which, while not of direct interest, are required to recover primary parameters. Structure present in these problems allows efficient optimization strategies - a well known example is…

Numerical Analysis · Mathematics 2015-06-05 Aleksandr Y. Aravkin , Tristan van Leeuwen