English
Related papers

Related papers: An optimization-based approach to parameter learni…

200 papers

This paper considers the problem of determining an optimal control action based on observed data. We formulate the problem assuming that the system can be modelled by a nonlinear state-space model, but where the model parameters, state and…

Optimization and Control · Mathematics 2021-07-02 Johannes N. Hendriks , James R. Z. Holdsworth , Adrian G. Wills , Thomas B. Schon , Brett Ninness

This article provides a brief review of recent developments on two nonlocal operators: fractional Laplacian and fractional time derivative. We start by accounting for several applications of these operators in imaging science, geophysics,…

Optimization and Control · Mathematics 2021-06-28 Harbir Antil , Thomas S. Brown , Ratna Khatri , Akwum Onwunta , Deepanshu Verma , Mahamadi Warma

Learning models that are robust to distribution shifts is a key concern in the context of their real-life applicability. Invariant Risk Minimization (IRM) is a popular framework that aims to learn robust models from multiple environments.…

Machine Learning · Computer Science 2023-04-04 Moulik Choraria , Ibtihal Ferwana , Ankur Mani , Lav R. Varshney

Optimization problems with an auxiliary latent variable structure in addition to the main model parameters occur frequently in computer vision and machine learning. The additional latent variables make the underlying optimization task…

Machine Learning · Computer Science 2020-03-13 Christopher Zach , Huu Le

We consider the inference problem for parameters in stochastic differential equation models from discrete time observations (e.g. experimental or simulation data). Specifically, we study the case where one does not have access to…

Numerical Analysis · Mathematics 2018-04-10 Sebastian Krumscheid

A novel probabilistic approach for the design of mechanical structures with friction interfaces is proposed. The objective function is defined as the probability that a specified performance measure of the forced vibration response is…

Computational Engineering, Finance, and Science · Computer Science 2021-01-01 Malte Krack , Sebastian Tatzko , Lars Panning-von Scheidt , Jörg Wallaschek

Correctly setting the parameters of a production machine is essential to improve product quality, increase efficiency, and reduce production costs while also supporting sustainability goals. Identifying optimal parameters involves an…

Machine Learning · Computer Science 2025-03-24 Philipp Wagner , Tobias Nagel , Philipp Leube , Marco F. Huber

Many applications, especially in physics and other sciences, call for easily interpretable and robust machine learning techniques. We propose a fully gradient-based technique for training radial basis function networks with an efficient and…

Machine Learning · Computer Science 2022-09-30 Jussi Määttä , Viacheslav Bazaliy , Jyri Kimari , Flyura Djurabekova , Kai Nordlund , Teemu Roos

This paper proposes a statistically optimal approach for learning a function value using a confidence interval in a wide range of models, including general non-parametric estimation of an expected loss described as a stochastic programming…

Machine Learning · Statistics 2025-08-07 Arnab Ganguly , Tobias Sutter

We consider nonlinear inverse problems arising in the context of parameter identification for parabolic partial differential equations (PDEs). For stable reconstructions, regularization methods such as the iteratively regularized…

Numerical Analysis · Mathematics 2025-07-16 Michael Kartmann , Benedikt Klein , Mario Ohlberger , Thomas Schuster , Stefan Volkwein

The classical approach to system identification is based on stochastic assumptions about the measurement error, and provides estimates that have random nature. Worst-case identification, on the other hand, only assumes the knowledge of…

Systems and Control · Computer Science 2013-06-07 Fabrizio Dabbene , Mario Sznaier , Roberto Tempo

We present a parameter estimation method for nonlinear mixed effect models based on ordinary differential equations (NLME-ODEs). The method presented here aims at regularizing the estimation problem in presence of model misspecifications,…

Methodology · Statistics 2021-02-24 Quentin Clairon , Chloé Pasin , Irene Balelli , Rodolphe Thiébaut , Mélanie Prague

A general, variational approach to derive low-order reduced systems is presented. The approach is based on the concept of optimal parameterizing manifold (OPM) that substitutes the more classical notions of invariant or slow manifold when…

Dynamical Systems · Mathematics 2023-09-18 Mickaël D. Chekroun , Honghu Liu , James C. McWilliams

The short-time Fourier transform (STFT) is widely used for analyzing non-stationary signals. However, its performance is highly sensitive to its parameters, and manual or heuristic tuning often yields suboptimal results. To overcome this…

Sound · Computer Science 2025-06-27 Maxime Leiber , Yosra Marnissi , Axel Barrau , Sylvain Meignen , Laurent Massoulié

Stochastic process discovery is concerned with deriving a model capable of reproducing the stochastic character of observed executions of a given process, stored in a log. This leads to an optimisation problem in which the model's parameter…

Formal Languages and Automata Theory · Computer Science 2025-05-01 Pierre Cry , Paolo Ballarini , András Horváth , Pascale Le Gall

We extend Robust Optimization to fractional programming, where both the objective and the constraints contain uncertain parameters. Earlier work did not consider uncertainty in both the objective and the constraints, or did not use Robust…

Optimization and Control · Mathematics 2015-08-21 Bram L. Gorissen

We consider a popular family of constrained optimization problems arising in machine learning that involve optimizing a non-decomposable evaluation metric with a certain thresholded form, while constraining another metric of interest.…

Machine Learning · Computer Science 2021-07-30 Abhishek Kumar , Harikrishna Narasimhan , Andrew Cotter

Fractional differential equations provide a tractable mathematical framework to describe anomalous behavior in complex physical systems, yet they introduce new sensitive model parameters, i.e. derivative orders, in addition to model…

Numerical Analysis · Mathematics 2018-06-05 Ehsan Kharazmi , Mohsen Zayernouri

In high-dimensional statistics, variable selection recovers the latent sparse patterns from all possible covariate combinations. This paper proposes a novel optimization method to solve the exact L0-regularized regression problem, which is…

Methodology · Statistics 2022-06-02 Mingzhang Yin , Nhat Ho , Bowei Yan , Xiaoning Qian , Mingyuan Zhou

Online system identification is the estimation of parameters of a dynamical system, such as mass or friction coefficients, for each measurement of the input and output signals. Here, the nonlinear stochastic differential equation of a…

Machine Learning · Computer Science 2021-06-18 Wouter M Kouw