English
Related papers

Related papers: Parameter estimation in ODEs: assessing the potent…

200 papers

Parameter control and dynamic algorithm configuration study how to dynamically choose suitable configurations of a parametrized algorithm during the optimization process. Despite being an intensively researched topic in evolutionary…

Neural and Evolutionary Computing · Computer Science 2025-07-14 Gianluca Covini , Denis Antipov , Carola Doerr

Many statistical estimation procedures lead to nonconvex optimization problems. Algorithms to solve these are often guaranteed to output a stationary point of the optimization problem. Oracle inequalities are an important theoretical…

Statistics Theory · Mathematics 2018-02-28 Andreas Elsener , Sara van de Geer

Recently, a new class of non-convex optimization problems motivated by the statistical problem of learning an acyclic directed graphical model from data has attracted significant interest. While existing work uses standard first-order…

Machine Learning · Computer Science 2023-07-03 Chang Deng , Kevin Bello , Bryon Aragam , Pradeep Ravikumar

In this work, we propose a method for determining a non-uniform sampling scheme for multi-dimensional signals by solving a convex optimization problem reminiscent of the sensor selection problem. The resulting sampling scheme minimizes the…

Methodology · Statistics 2017-07-12 Johan Swärd , Filip Elvander , Andreas Jakobsson

Standard stochastic optimization methods are brittle, sensitive to stepsize choices and other algorithmic parameters, and they exhibit instability outside of well-behaved families of objectives. To address these challenges, we investigate…

Optimization and Control · Mathematics 2022-06-08 Hilal Asi , John C. Duchi

Optimization problems with both control variables and environmental variables arise in many fields. This paper introduces a framework of personalized optimization to han- dle such problems. Unlike traditional robust optimization,…

Computation · Statistics 2016-07-07 Shifeng Xiong

Ordinary differential equations (ODEs) are used to model dynamic systems appearing in engineering, physics, biomedical sciences and many other fields. These equations contain unknown parameters, say $\theta$ of physical significance which…

Statistics Theory · Mathematics 2014-03-05 Prithwish Bhaumik , Subhashis Ghosal

Conservation principles like conservation of charge or energy provide a natural way to couple and constrain different physical variables. In this letter, we propose a dynamical system model that exploits these constraints for solving…

Optimization and Control · Mathematics 2017-07-24 Oindrila Chatterjee , Shantanu Chakrabartty

Many real-world processes and phenomena are modeled using systems of ordinary differential equations with parameters. Given such a system, we say that a parameter is globally identifiable if it can be uniquely recovered from input and…

Classical Analysis and ODEs · Mathematics 2023-05-24 Hoon Hong , Alexey Ovchinnikov , Gleb Pogudin , Chee Yap

Optimization problems involving sequential decisions in a stochastic environment were studied in Stochastic Programming (SP), Stochastic Optimal Control (SOC) and Markov Decision Processes (MDP). In this paper we mainly concentrate on SP…

Optimization and Control · Mathematics 2023-03-29 Guanghui Lan , Alexander Shapiro

We propose a new gradient descent algorithm with added stochastic terms for finding the global optimizers of nonconvex optimization problems. A key component in the algorithm is the adaptive tuning of the randomness based on the value of…

Optimization and Control · Mathematics 2025-06-16 Björn Engquist , Kui Ren , Yunan Yang

We propose a novel gradient-based online optimization framework for solving stochastic programming problems that frequently arise in the context of cyber-physical and robotic systems. Our problem formulation accommodates constraints that…

Machine Learning · Computer Science 2026-01-06 Hao Ma , Melanie Zeilinger , Michael Muehlebach

We present an algorithm to approximate the solutions to variational problems where set of admissible functions consists of convex functions. The main motivator behind this numerical method is estimating solutions to Adverse Selection…

Optimization and Control · Mathematics 2008-03-07 Ivar Ekeland , Santiago Moreno

The recently developed Distributed Block Proximal Method, for solving stochastic big-data convex optimization problems, is studied in this paper under the assumption of constant stepsizes and strongly convex (possibly non-smooth) local…

Optimization and Control · Mathematics 2020-03-06 Francesco Farina , Giuseppe Notarstefano

Ordinary differential equations are widely-used in the field of systems biology and chemical engineering to model chemical reaction networks. Numerous techniques have been developed to estimate parameters like rate constants, initial…

Molecular Networks · Quantitative Biology 2012-07-06 Daniel Kaschek , Jens Timmer

We derive globally reliable a posteriori error estimators for a PDE-constrained optimization problem involving linear models in fluid dynamics as state equation; control constraints are also considered. The corresponding local error…

Numerical Analysis · Mathematics 2017-08-03 Alejandro Allendes , Enrique Otarola , Richard Rankin

In this paper, we address the issue of modeling and estimating changes in the state of the spatio-temporal dynamical systems based on a sequence of observations like video frames. Traditional numerical simulation systems depend largely on…

Machine Learning · Computer Science 2024-02-12 Kun Wang , Hao Wu , Guibin Zhang , Junfeng Fang , Yuxuan Liang , Yuankai Wu , Roger Zimmermann , Yang Wang

Differentiable simulation is a promising toolkit for fast gradient-based policy optimization and system identification. However, existing approaches to differentiable simulation have largely tackled scenarios where obtaining smooth…

Machine Learning · Statistics 2022-07-04 Rika Antonova , Jingyun Yang , Krishna Murthy Jatavallabhula , Jeannette Bohg

The purpose of this research was to compare the robustness and performance of a local and global optimization algorithm when given the task of fitting the parameters of a common non-linear dose-response model utilized in the field of…

Neural and Evolutionary Computing · Computer Science 2020-12-18 Mark Connor , Michael O'Neill

Ordinary differential equation models are nowadays widely used for the mechanistic description of biological processes and their temporal evolution. These models typically have many unknown and non-measurable parameters, which have to be…

Quantitative Methods · Quantitative Biology 2021-05-27 Alejandro F. Villaverde , Dilan Pathirana , Fabian Fröhlich , Jan Hasenauer , Julio R. Banga