English
Related papers

Related papers: On the smoothness of nonlinear system identificati…

200 papers

Ordinary differential equations (ODE) are widely used for modeling in Systems Biology. As most commonly only some of the kinetic parameters are measurable or precisely known, parameter estimation techniques are applied to parametrize the…

Quantitative Methods · Quantitative Biology 2016-01-19 Christoph Zimmer , Frank T. Bergmann , Sven Sahle

Multiple-shooting is a parameter estimation approach for ordinary differential equations. In this approach, the trajectory is broken into small intervals, each of which can be integrated independently. Equality constraints are then applied…

Machine Learning · Computer Science 2025-06-03 Siddharth Prabhu , Srinivas Rangarajan , Mayuresh Kothare

We present a novel method for mixed-integer optimization problems with multivariate and Lipschitz continuous nonlinearities. In particular, we do not assume that the nonlinear constraints are explicitly given but that we can only evaluate…

Optimization and Control · Mathematics 2023-03-22 Julia Grübel , Richard Krug , Martin Schmidt , Winnifried Wollner

Probabilistic learning is increasingly being tackled as an optimization problem, with gradient-based approaches as predominant methods. When modelling multivariate likelihoods, a usual but undesirable outcome is that the learned model fits…

Machine Learning · Computer Science 2020-10-23 Adrián Javaloy , Isabel Valera

We develop an approach for estimating models described via conditional moment restrictions, with a prototypical application being non-parametric instrumental variable regression. We introduce a min-max criterion function, under which the…

Econometrics · Economics 2020-06-15 Nishanth Dikkala , Greg Lewis , Lester Mackey , Vasilis Syrgkanis

In decentralized optimization, several nodes connected by a network collaboratively minimize some objective function. For minimization of Lipschitz functions lower bounds are known along with optimal algorithms. We study a specific class of…

Optimization and Control · Mathematics 2023-03-15 Savelii Chezhegov , Alexander Rogozin , Alexander Gasnikov

We develop a method for offline parameter estimation of discrete multibody dynamics with regularized and frictional kinematic constraints. This setting leads to unobserved degrees of freedom, which we handle using joint state and parameter…

Optimization and Control · Mathematics 2025-02-11 Hannes Marklund , Martin Servin , Mats G Larson

This work introduces a new cubic regularization method for nonconvex unconstrained multiobjective optimization problems. At each iteration of the method, a model associated with the cubic regularization of each component of the objective…

Optimization and Control · Mathematics 2025-06-11 Douglas S. Gonçalves , Max L. N. Gonçalves , Jefferson G. Melo

Motivated by learning problems including max-norm regularized matrix completion and clustering, robust PCA and sparse inverse covariance selection, we propose a novel optimization algorithm for minimizing a convex objective which decomposes…

Optimization and Control · Mathematics 2012-11-20 Francesco Orabona , Andreas Argyriou , Nathan Srebro

This paper proposes a new algorithm for solving constrained global optimization problems where both the objective function and constraints are one-dimensional non-differentiable multiextremal Lipschitz functions. Multiextremal constraints…

Optimization and Control · Mathematics 2011-07-27 Yaroslav D. Sergeyev

Nonlinear model predictive control (NMPC) is a popular strategy for solving motion planning problems, including obstacle avoidance constraints, in autonomous driving applications. Non-smooth obstacle shapes, such as rectangles, introduce…

Systems and Control · Electrical Eng. & Systems 2024-03-05 Rudolf Reiter , Katrin Baumgärtner , Rien Quirynen , Moritz Diehl

Extracting dynamic models from data is of enormous importance in understanding the properties of unknown systems. In this work, we employ Lipschitz neural networks, a class of neural networks with a prescribed upper bound on their Lipschitz…

Systems and Control · Electrical Eng. & Systems 2025-08-21 Shiqing Wei , Prashanth Krishnamurthy , Farshad Khorrami

This is a technical report that extends and clarifies the results presented in [1]. The model identification problem for asymptotically stable linear time invariant systems is considered. The system output is affected by an additive noise…

Optimization and Control · Mathematics 2018-09-05 Marco Lauricella , Lorenzo Fagiano

We propose a stochastic optimization method for the minimization of the sum of three convex functions, one of which has Lipschitz continuous gradient as well as restricted strong convexity. Our approach is most suitable in the setting where…

Optimization and Control · Mathematics 2017-02-01 Alp Yurtsever , Bang Cong Vu , Volkan Cevher

This paper presents a stochastic block-coordinate proximal Newton method for minimizing the sum of a blockwise Lipschitz-continuously differentiable function and a separable nonsmooth convex function. At each iteration, the method randomly…

Optimization and Control · Mathematics 2026-03-25 Hong Zhu , Xun Qian

This paper proposes a novel technique called "successive stochastic smoothing" that optimizes nonsmooth and discontinuous functions while considering various constraints. Our methodology enables local and global optimization, making it a…

Optimization and Control · Mathematics 2023-08-17 Vladimir Norkin , Alois Pichler , Anton Kozyriev

In this paper, we propose a general class of algorithms for optimizing an extensive variety of nonsmoothly penalized objective functions that satisfy certain regularity conditions. The proposed framework utilizes the…

Computation · Statistics 2011-01-24 Elizabeth D. Schifano , Robert L. Strawderman , Martin T. Wells

Sequential quadratic optimization algorithms are proposed for solving smooth nonlinear optimization problems with equality constraints. The main focus is an algorithm proposed for the case when the constraint functions are deterministic,…

Optimization and Control · Mathematics 2020-07-22 Albert Berahas , Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

Nonlinear dynamic models are widely used for characterizing functional forms of processes that govern complex biological pathway systems. Over the past decade, validation and further development of these models became possible due to data…

Methodology · Statistics 2019-08-13 Itai Dattner , Shota Gugushvili , Harold Ship , Eberhard O. Voit

We present a novel parameter identification algorithm for the estimation of parameters in models of cell motility using imaging data of migrating cells. Two alternative formulations of the objective functional that measures the difference…